[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:01:35.620131  8209 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.4.126:39783
I20260709 13:01:35.621762  8209 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:01:35.622848  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:35.640964  8216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:35.641130  8215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:35.641891  8218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:35.643903  8209 server_base.cc:1061] running on GCE node
I20260709 13:01:36.867400  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:36.867820  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:36.868069  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602096868044 us; error 0 us; skew 500 ppm
I20260709 13:01:36.869416  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:36.876940  8209 webserver.cc:533] Webserver started at http://127.8.4.126:33399/ using document root <none> and password file <none>
I20260709 13:01:36.877998  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:36.878257  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:36.878748  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:36.884766  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602095438975-8209-0/minicluster-data/master-0-root/instance:
uuid: "112e7312dac44bdb83fb1b3831cb4d26"
format_stamp: "Formatted at 2026-07-09 13:01:36 on dist-test-slave-008w"
I20260709 13:01:36.895972  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:01:36.901958  8224 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:36.903388  8209 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:01:36.903914  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602095438975-8209-0/minicluster-data/master-0-root
uuid: "112e7312dac44bdb83fb1b3831cb4d26"
format_stamp: "Formatted at 2026-07-09 13:01:36 on dist-test-slave-008w"
I20260709 13:01:36.904304  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602095438975-8209-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602095438975-8209-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602095438975-8209-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:36.967432  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:36.969317  8209 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:01:36.969897  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:37.050732  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.126:39783
I20260709 13:01:37.050838  8275 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.126:39783 every 8 connection(s)
I20260709 13:01:37.059906  8276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:37.084699  8276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26: Bootstrap starting.
I20260709 13:01:37.091670  8276 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:37.094141  8276 log.cc:826] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26: Log is configured to *not* fsync() on all Append() calls
I20260709 13:01:37.099172  8276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26: No bootstrap required, opened a new log
I20260709 13:01:37.120925  8276 raft_consensus.cc:359] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112e7312dac44bdb83fb1b3831cb4d26" member_type: VOTER }
I20260709 13:01:37.121539  8276 raft_consensus.cc:385] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:37.121866  8276 raft_consensus.cc:740] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 112e7312dac44bdb83fb1b3831cb4d26, State: Initialized, Role: FOLLOWER
I20260709 13:01:37.122996  8276 consensus_queue.cc:260] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112e7312dac44bdb83fb1b3831cb4d26" member_type: VOTER }
I20260709 13:01:37.123947  8276 raft_consensus.cc:399] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:01:37.124365  8276 raft_consensus.cc:493] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:01:37.124827  8276 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:37.131829  8276 raft_consensus.cc:515] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112e7312dac44bdb83fb1b3831cb4d26" member_type: VOTER }
I20260709 13:01:37.133157  8276 leader_election.cc:304] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 112e7312dac44bdb83fb1b3831cb4d26; no voters: 
I20260709 13:01:37.135938  8276 leader_election.cc:290] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:01:37.136366  8279 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:37.139782  8279 raft_consensus.cc:697] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26 [term 1 LEADER]: Becoming Leader. State: Replica: 112e7312dac44bdb83fb1b3831cb4d26, State: Running, Role: LEADER
I20260709 13:01:37.141664  8279 consensus_queue.cc:237] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112e7312dac44bdb83fb1b3831cb4d26" member_type: VOTER }
I20260709 13:01:37.143501  8276 sys_catalog.cc:565] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:01:37.159762  8281 sys_catalog.cc:455] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 112e7312dac44bdb83fb1b3831cb4d26. Latest consensus state: current_term: 1 leader_uuid: "112e7312dac44bdb83fb1b3831cb4d26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112e7312dac44bdb83fb1b3831cb4d26" member_type: VOTER } }
I20260709 13:01:37.160578  8281 sys_catalog.cc:458] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26 [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:37.163272  8280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "112e7312dac44bdb83fb1b3831cb4d26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112e7312dac44bdb83fb1b3831cb4d26" member_type: VOTER } }
I20260709 13:01:37.163992  8280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26 [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:37.164192  8289 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:01:37.176957  8289 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:01:37.179742  8209 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:01:37.197057  8289 catalog_manager.cc:1383] Generated new cluster ID: 84c3dd8326fa4a12a7da5b60f33dfb8d
I20260709 13:01:37.197392  8289 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:01:37.227875  8289 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:01:37.230203  8289 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:01:37.248198  8289 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26: Generated new TSK 0
I20260709 13:01:37.249601  8289 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:01:37.311401  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:37.320582  8298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:37.322744  8299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:37.325074  8301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:37.326014  8209 server_base.cc:1061] running on GCE node
I20260709 13:01:37.326849  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:37.327044  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:37.327263  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602097327226 us; error 0 us; skew 500 ppm
I20260709 13:01:37.327889  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:37.332523  8209 webserver.cc:533] Webserver started at http://127.8.4.65:33473/ using document root <none> and password file <none>
I20260709 13:01:37.333190  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:37.333422  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:37.333737  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:37.334884  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602095438975-8209-0/minicluster-data/ts-0-root/instance:
uuid: "05d5eaee01844183a4bbf46ad7d510b2"
format_stamp: "Formatted at 2026-07-09 13:01:37 on dist-test-slave-008w"
I20260709 13:01:37.340947  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:01:37.345806  8306 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:37.346725  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:01:37.347029  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602095438975-8209-0/minicluster-data/ts-0-root
uuid: "05d5eaee01844183a4bbf46ad7d510b2"
format_stamp: "Formatted at 2026-07-09 13:01:37 on dist-test-slave-008w"
I20260709 13:01:37.347334  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602095438975-8209-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602095438975-8209-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602095438975-8209-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:37.374547  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:37.376026  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:37.378993  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:37.383841  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:37.384075  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:37.384420  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:37.384583  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:37.496536  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.65:33295
I20260709 13:01:37.496589  8368 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.65:33295 every 8 connection(s)
I20260709 13:01:37.504060  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:37.518915  8374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:37.520109  8373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:37.526417  8376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:37.527510  8209 server_base.cc:1061] running on GCE node
I20260709 13:01:37.528549  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:37.528861  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:37.529104  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602097529082 us; error 0 us; skew 500 ppm
I20260709 13:01:37.529954  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:37.535223  8209 webserver.cc:533] Webserver started at http://127.8.4.66:46557/ using document root <none> and password file <none>
I20260709 13:01:37.535763  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:37.535944  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:37.536171  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:37.537470  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602095438975-8209-0/minicluster-data/ts-1-root/instance:
uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
format_stamp: "Formatted at 2026-07-09 13:01:37 on dist-test-slave-008w"
I20260709 13:01:37.542541  8369 heartbeater.cc:344] Connected to a master server at 127.8.4.126:39783
I20260709 13:01:37.543215  8369 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:37.544916  8369 heartbeater.cc:507] Master 127.8.4.126:39783 requested a full tablet report, sending...
I20260709 13:01:37.549633  8241 ts_manager.cc:194] Registered new tserver with Master: 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295)
I20260709 13:01:37.549913  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.012s	user 0.009s	sys 0.002s
I20260709 13:01:37.552922  8241 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42714
I20260709 13:01:37.555436  8381 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:37.556456  8209 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:01:37.556875  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602095438975-8209-0/minicluster-data/ts-1-root
uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
format_stamp: "Formatted at 2026-07-09 13:01:37 on dist-test-slave-008w"
I20260709 13:01:37.557308  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602095438975-8209-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602095438975-8209-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602095438975-8209-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:37.576793  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:37.578328  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:37.581643  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:37.585517  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:37.585772  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:37.586035  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:37.586206  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:37.697108  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.66:40051
I20260709 13:01:37.697278  8443 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.66:40051 every 8 connection(s)
I20260709 13:01:37.706400  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:37.717631  8447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:37.723779  8444 heartbeater.cc:344] Connected to a master server at 127.8.4.126:39783
I20260709 13:01:37.724335  8444 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:37.725772  8209 server_base.cc:1061] running on GCE node
W20260709 13:01:37.726356  8448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:37.725762  8444 heartbeater.cc:507] Master 127.8.4.126:39783 requested a full tablet report, sending...
W20260709 13:01:37.728025  8450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:37.729835  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:37.730135  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:37.730127  8241 ts_manager.cc:194] Registered new tserver with Master: fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051)
I20260709 13:01:37.730547  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602097730524 us; error 0 us; skew 500 ppm
I20260709 13:01:37.731443  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:37.732316  8241 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42716
I20260709 13:01:37.734988  8209 webserver.cc:533] Webserver started at http://127.8.4.67:42253/ using document root <none> and password file <none>
I20260709 13:01:37.735648  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:37.735909  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:37.736227  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:37.737515  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602095438975-8209-0/minicluster-data/ts-2-root/instance:
uuid: "58234c3ebef346d8a52d902fc45e2849"
format_stamp: "Formatted at 2026-07-09 13:01:37 on dist-test-slave-008w"
I20260709 13:01:37.743222  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:01:37.747520  8455 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:37.749050  8209 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:01:37.749476  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602095438975-8209-0/minicluster-data/ts-2-root
uuid: "58234c3ebef346d8a52d902fc45e2849"
format_stamp: "Formatted at 2026-07-09 13:01:37 on dist-test-slave-008w"
I20260709 13:01:37.749886  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602095438975-8209-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602095438975-8209-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602095438975-8209-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:37.770479  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:37.771867  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:37.773681  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:37.776440  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:37.776628  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:37.776938  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:37.777177  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:01:37.885576  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.67:40717
I20260709 13:01:37.885857  8517 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.67:40717 every 8 connection(s)
I20260709 13:01:37.902320  8518 heartbeater.cc:344] Connected to a master server at 127.8.4.126:39783
I20260709 13:01:37.902901  8518 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:37.903896  8518 heartbeater.cc:507] Master 127.8.4.126:39783 requested a full tablet report, sending...
I20260709 13:01:37.906418  8241 ts_manager.cc:194] Registered new tserver with Master: 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:37.907112  8209 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016625729s
I20260709 13:01:37.908321  8241 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42726
I20260709 13:01:37.964205  8241 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42728:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:01:37.968012  8241 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:01:38.090667  8408 tablet_service.cc:1511] Processing CreateTablet for tablet c251a30c42f24625b0df1be970faa534 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:01:38.091672  8407 tablet_service.cc:1511] Processing CreateTablet for tablet 66045046df98460387504edc93461751 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:01:38.093744  8406 tablet_service.cc:1511] Processing CreateTablet for tablet c00c12c99811434db59727d5ad24f6be (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:01:38.096447  8405 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae145501f22403da5cc68d69af63915 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:01:38.097730  8408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c251a30c42f24625b0df1be970faa534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.101850  8406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c00c12c99811434db59727d5ad24f6be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.105648  8405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae145501f22403da5cc68d69af63915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.106513  8409 tablet_service.cc:1511] Processing CreateTablet for tablet e032c170e06b4392bcd8d1e761820d89 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:01:38.110782  8404 tablet_service.cc:1511] Processing CreateTablet for tablet 47d7875abc644a7e99ebac699897b724 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:01:38.111654  8403 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff25b46a0ac45b0b845a38ef322d862 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:01:38.117806  8407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66045046df98460387504edc93461751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.119771  8403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff25b46a0ac45b0b845a38ef322d862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.121768  8404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d7875abc644a7e99ebac699897b724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.136142  8409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e032c170e06b4392bcd8d1e761820d89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.155512  8331 tablet_service.cc:1511] Processing CreateTablet for tablet c00c12c99811434db59727d5ad24f6be (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:01:38.145751  8402 tablet_service.cc:1511] Processing CreateTablet for tablet e8936128622840c0bd58170c0d7658e6 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:01:38.159886  8482 tablet_service.cc:1511] Processing CreateTablet for tablet c251a30c42f24625b0df1be970faa534 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:01:38.161990  8333 tablet_service.cc:1511] Processing CreateTablet for tablet c251a30c42f24625b0df1be970faa534 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:01:38.168397  8334 tablet_service.cc:1511] Processing CreateTablet for tablet e032c170e06b4392bcd8d1e761820d89 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:01:38.168480  8327 tablet_service.cc:1511] Processing CreateTablet for tablet e8936128622840c0bd58170c0d7658e6 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:01:38.170589  8331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c00c12c99811434db59727d5ad24f6be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.158315  8328 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff25b46a0ac45b0b845a38ef322d862 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:01:38.159936  8330 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae145501f22403da5cc68d69af63915 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:01:38.163595  8483 tablet_service.cc:1511] Processing CreateTablet for tablet e032c170e06b4392bcd8d1e761820d89 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:01:38.185245  8402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8936128622840c0bd58170c0d7658e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.174384  8332 tablet_service.cc:1511] Processing CreateTablet for tablet 66045046df98460387504edc93461751 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:01:38.177672  8329 tablet_service.cc:1511] Processing CreateTablet for tablet 47d7875abc644a7e99ebac699897b724 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:01:38.180553  8481 tablet_service.cc:1511] Processing CreateTablet for tablet 66045046df98460387504edc93461751 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:01:38.207103  8478 tablet_service.cc:1511] Processing CreateTablet for tablet 47d7875abc644a7e99ebac699897b724 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:01:38.205317  8482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c251a30c42f24625b0df1be970faa534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.206037  8333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c251a30c42f24625b0df1be970faa534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.212901  8401 tablet_service.cc:1511] Processing CreateTablet for tablet f681125f9aff45dbb0d7baf4db8e7d65 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:01:38.211127  8479 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae145501f22403da5cc68d69af63915 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:01:38.210014  8480 tablet_service.cc:1511] Processing CreateTablet for tablet c00c12c99811434db59727d5ad24f6be (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:01:38.216640  8326 tablet_service.cc:1511] Processing CreateTablet for tablet f681125f9aff45dbb0d7baf4db8e7d65 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
W20260709 13:01:38.217855  8288 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:38.226951  8480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c00c12c99811434db59727d5ad24f6be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.228896  8483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e032c170e06b4392bcd8d1e761820d89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.247416  8481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66045046df98460387504edc93461751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.228513  8401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f681125f9aff45dbb0d7baf4db8e7d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.253973  8479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae145501f22403da5cc68d69af63915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.265785  8478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d7875abc644a7e99ebac699897b724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.269152  8477 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff25b46a0ac45b0b845a38ef322d862 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:01:38.272447  8327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8936128622840c0bd58170c0d7658e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.278877  8330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae145501f22403da5cc68d69af63915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.282389  8477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff25b46a0ac45b0b845a38ef322d862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.284893  8328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff25b46a0ac45b0b845a38ef322d862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.284909  8476 tablet_service.cc:1511] Processing CreateTablet for tablet e8936128622840c0bd58170c0d7658e6 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:01:38.290522  8476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8936128622840c0bd58170c0d7658e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.303623  8475 tablet_service.cc:1511] Processing CreateTablet for tablet f681125f9aff45dbb0d7baf4db8e7d65 (DEFAULT_TABLE table=test-workload [id=d25681648de541bc932a90b5fa80729b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:01:38.306568  8332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66045046df98460387504edc93461751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.314203  8326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f681125f9aff45dbb0d7baf4db8e7d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.322852  8329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d7875abc644a7e99ebac699897b724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.332329  8475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f681125f9aff45dbb0d7baf4db8e7d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.334438  8334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e032c170e06b4392bcd8d1e761820d89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.391199  8536 tablet_bootstrap.cc:492] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8: Bootstrap starting.
I20260709 13:01:38.465577  8536 tablet_bootstrap.cc:654] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.506821  8537 tablet_bootstrap.cc:492] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849: Bootstrap starting.
I20260709 13:01:38.515621  8538 tablet_bootstrap.cc:492] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2: Bootstrap starting.
I20260709 13:01:38.517741  8536 tablet_bootstrap.cc:492] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8: No bootstrap required, opened a new log
I20260709 13:01:38.518265  8536 ts_tablet_manager.cc:1403] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8: Time spent bootstrapping tablet: real 0.134s	user 0.016s	sys 0.017s
I20260709 13:01:38.525911  8537 tablet_bootstrap.cc:654] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.523756  8536 raft_consensus.cc:359] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.526605  8536 raft_consensus.cc:385] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.527040  8536 raft_consensus.cc:740] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.529647  8536 consensus_queue.cc:260] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.530900  8538 tablet_bootstrap.cc:654] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.538044  8444 heartbeater.cc:499] Master 127.8.4.126:39783 was elected leader, sending a full tablet report...
I20260709 13:01:38.539065  8536 ts_tablet_manager.cc:1434] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.010s
I20260709 13:01:38.540148  8536 tablet_bootstrap.cc:492] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8: Bootstrap starting.
I20260709 13:01:38.547600  8537 tablet_bootstrap.cc:492] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849: No bootstrap required, opened a new log
I20260709 13:01:38.548410  8537 ts_tablet_manager.cc:1403] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.009s
I20260709 13:01:38.553141  8537 raft_consensus.cc:359] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.554342  8537 raft_consensus.cc:385] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.554989  8537 raft_consensus.cc:740] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.556285  8537 consensus_queue.cc:260] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.557451  8369 heartbeater.cc:499] Master 127.8.4.126:39783 was elected leader, sending a full tablet report...
I20260709 13:01:38.559828  8536 tablet_bootstrap.cc:654] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.561915  8538 tablet_bootstrap.cc:492] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2: No bootstrap required, opened a new log
I20260709 13:01:38.562736  8538 ts_tablet_manager.cc:1403] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2: Time spent bootstrapping tablet: real 0.054s	user 0.028s	sys 0.008s
I20260709 13:01:38.563885  8518 heartbeater.cc:499] Master 127.8.4.126:39783 was elected leader, sending a full tablet report...
I20260709 13:01:38.564872  8537 ts_tablet_manager.cc:1434] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.006s
I20260709 13:01:38.565981  8537 tablet_bootstrap.cc:492] T 9ae145501f22403da5cc68d69af63915 P 58234c3ebef346d8a52d902fc45e2849: Bootstrap starting.
I20260709 13:01:38.567653  8538 raft_consensus.cc:359] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.568414  8538 raft_consensus.cc:385] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.568720  8538 raft_consensus.cc:740] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.569507  8538 consensus_queue.cc:260] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.574738  8537 tablet_bootstrap.cc:654] T 9ae145501f22403da5cc68d69af63915 P 58234c3ebef346d8a52d902fc45e2849: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.583169  8536 tablet_bootstrap.cc:492] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8: No bootstrap required, opened a new log
I20260709 13:01:38.583841  8536 ts_tablet_manager.cc:1403] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.008s
I20260709 13:01:38.588027  8536 raft_consensus.cc:359] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.589083  8536 raft_consensus.cc:385] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.589511  8536 raft_consensus.cc:740] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.593380  8538 ts_tablet_manager.cc:1434] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.018s
I20260709 13:01:38.593145  8536 consensus_queue.cc:260] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.594870  8538 tablet_bootstrap.cc:492] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2: Bootstrap starting.
I20260709 13:01:38.600658  8537 tablet_bootstrap.cc:492] T 9ae145501f22403da5cc68d69af63915 P 58234c3ebef346d8a52d902fc45e2849: No bootstrap required, opened a new log
I20260709 13:01:38.601179  8537 ts_tablet_manager.cc:1403] T 9ae145501f22403da5cc68d69af63915 P 58234c3ebef346d8a52d902fc45e2849: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.003s
I20260709 13:01:38.601765  8538 tablet_bootstrap.cc:654] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.604333  8537 raft_consensus.cc:359] T 9ae145501f22403da5cc68d69af63915 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.605268  8537 raft_consensus.cc:385] T 9ae145501f22403da5cc68d69af63915 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.605655  8537 raft_consensus.cc:740] T 9ae145501f22403da5cc68d69af63915 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.608584  8536 ts_tablet_manager.cc:1434] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 13:01:38.609869  8536 tablet_bootstrap.cc:492] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8: Bootstrap starting.
I20260709 13:01:38.613737  8537 consensus_queue.cc:260] T 9ae145501f22403da5cc68d69af63915 P 58234c3ebef346d8a52d902fc45e2849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.614804  8538 tablet_bootstrap.cc:492] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2: No bootstrap required, opened a new log
I20260709 13:01:38.615264  8538 ts_tablet_manager.cc:1403] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 13:01:38.619542  8537 ts_tablet_manager.cc:1434] T 9ae145501f22403da5cc68d69af63915 P 58234c3ebef346d8a52d902fc45e2849: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:01:38.619980  8538 raft_consensus.cc:359] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.620486  8537 tablet_bootstrap.cc:492] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849: Bootstrap starting.
I20260709 13:01:38.620702  8538 raft_consensus.cc:385] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.621033  8538 raft_consensus.cc:740] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.622663  8538 consensus_queue.cc:260] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.624863  8538 ts_tablet_manager.cc:1434] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:01:38.625900  8538 tablet_bootstrap.cc:492] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2: Bootstrap starting.
I20260709 13:01:38.630285  8536 tablet_bootstrap.cc:654] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.632949  8538 tablet_bootstrap.cc:654] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.634261  8537 tablet_bootstrap.cc:654] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.644805  8537 tablet_bootstrap.cc:492] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849: No bootstrap required, opened a new log
I20260709 13:01:38.645289  8536 tablet_bootstrap.cc:492] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8: No bootstrap required, opened a new log
W20260709 13:01:38.644850  8519 tablet.cc:2406] T 9ae145501f22403da5cc68d69af63915 P 58234c3ebef346d8a52d902fc45e2849: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:01:38.645905  8536 ts_tablet_manager.cc:1403] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.000s
I20260709 13:01:38.645377  8537 ts_tablet_manager.cc:1403] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.006s
I20260709 13:01:38.654757  8536 raft_consensus.cc:359] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.655972  8536 raft_consensus.cc:385] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.656044  8537 raft_consensus.cc:359] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.657133  8536 raft_consensus.cc:740] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.657717  8537 raft_consensus.cc:385] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.658139  8537 raft_consensus.cc:740] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.658434  8536 consensus_queue.cc:260] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.660231  8537 consensus_queue.cc:260] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.661221  8538 tablet_bootstrap.cc:492] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2: No bootstrap required, opened a new log
I20260709 13:01:38.661720  8538 ts_tablet_manager.cc:1403] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2: Time spent bootstrapping tablet: real 0.036s	user 0.022s	sys 0.007s
I20260709 13:01:38.663213  8537 ts_tablet_manager.cc:1434] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:01:38.664354  8537 tablet_bootstrap.cc:492] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849: Bootstrap starting.
I20260709 13:01:38.665448  8538 raft_consensus.cc:359] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.666218  8538 raft_consensus.cc:385] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.666531  8538 raft_consensus.cc:740] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.667347  8538 consensus_queue.cc:260] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.670065  8538 ts_tablet_manager.cc:1434] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:01:38.671588  8538 tablet_bootstrap.cc:492] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2: Bootstrap starting.
I20260709 13:01:38.672319  8537 tablet_bootstrap.cc:654] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.675835  8545 raft_consensus.cc:493] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.676343  8545 raft_consensus.cc:515] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.679972  8545 leader_election.cc:290] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:38.683938  8545 raft_consensus.cc:493] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.684602  8545 raft_consensus.cc:515] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.687120  8537 tablet_bootstrap.cc:492] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849: No bootstrap required, opened a new log
I20260709 13:01:38.687305  8545 leader_election.cc:290] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:38.687745  8537 ts_tablet_manager.cc:1403] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.005s
I20260709 13:01:38.689504  8536 ts_tablet_manager.cc:1434] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8: Time spent starting tablet: real 0.043s	user 0.011s	sys 0.000s
I20260709 13:01:38.690600  8536 tablet_bootstrap.cc:492] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8: Bootstrap starting.
I20260709 13:01:38.691473  8537 raft_consensus.cc:359] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } }
I20260709 13:01:38.692353  8537 raft_consensus.cc:385] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.692770  8537 raft_consensus.cc:740] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.694015  8537 consensus_queue.cc:260] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } }
I20260709 13:01:38.695484  8538 tablet_bootstrap.cc:654] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.696638  8537 ts_tablet_manager.cc:1434] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:01:38.704731  8537 tablet_bootstrap.cc:492] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849: Bootstrap starting.
I20260709 13:01:38.729300  8537 tablet_bootstrap.cc:654] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.729959  8536 tablet_bootstrap.cc:654] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.733139  8538 tablet_bootstrap.cc:492] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2: No bootstrap required, opened a new log
I20260709 13:01:38.733683  8538 ts_tablet_manager.cc:1403] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2: Time spent bootstrapping tablet: real 0.062s	user 0.009s	sys 0.019s
I20260709 13:01:38.735973  8541 raft_consensus.cc:493] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.736564  8541 raft_consensus.cc:515] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.736784  8538 raft_consensus.cc:359] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.737546  8538 raft_consensus.cc:385] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.737944  8538 raft_consensus.cc:740] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.737951  8418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae145501f22403da5cc68d69af63915" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" is_pre_election: true
I20260709 13:01:38.738845  8418 raft_consensus.cc:2468] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05d5eaee01844183a4bbf46ad7d510b2 in term 0.
I20260709 13:01:38.738793  8538 consensus_queue.cc:260] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.739774  8541 leader_election.cc:290] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:38.741338  8538 ts_tablet_manager.cc:1434] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:38.741312  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66045046df98460387504edc93461751" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" is_pre_election: true
I20260709 13:01:38.742872  8538 tablet_bootstrap.cc:492] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2: Bootstrap starting.
I20260709 13:01:38.747818  8308 leader_election.cc:304] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 
I20260709 13:01:38.748943  8545 raft_consensus.cc:2804] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:38.749346  8545 raft_consensus.cc:493] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.749682  8545 raft_consensus.cc:3060] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.750136  8538 tablet_bootstrap.cc:654] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.760380  8543 raft_consensus.cc:493] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.761063  8543 raft_consensus.cc:515] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.766276  8543 leader_election.cc:290] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051)
W20260709 13:01:38.785256  8308 leader_election.cc:343] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.787065  8545 raft_consensus.cc:515] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.800086  8541 raft_consensus.cc:493] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.801416  8541 raft_consensus.cc:515] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.815330  8541 leader_election.cc:290] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:38.817058  8545 leader_election.cc:290] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 1 election: Requested vote from peers fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:38.817993  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae145501f22403da5cc68d69af63915" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
I20260709 13:01:38.819214  8419 raft_consensus.cc:3060] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.828090  8538 tablet_bootstrap.cc:492] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2: No bootstrap required, opened a new log
I20260709 13:01:38.829258  8538 ts_tablet_manager.cc:1403] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2: Time spent bootstrapping tablet: real 0.087s	user 0.030s	sys 0.034s
I20260709 13:01:38.830245  8493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66045046df98460387504edc93461751" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58234c3ebef346d8a52d902fc45e2849" is_pre_election: true
I20260709 13:01:38.836727  8492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae145501f22403da5cc68d69af63915" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58234c3ebef346d8a52d902fc45e2849" is_pre_election: true
I20260709 13:01:38.839694  8493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae145501f22403da5cc68d69af63915" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
I20260709 13:01:38.839556  8492 raft_consensus.cc:2468] T 9ae145501f22403da5cc68d69af63915 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05d5eaee01844183a4bbf46ad7d510b2 in term 0.
W20260709 13:01:38.839593  8309 leader_election.cc:343] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.840865  8493 raft_consensus.cc:3060] T 9ae145501f22403da5cc68d69af63915 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.841146  8536 tablet_bootstrap.cc:492] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8: No bootstrap required, opened a new log
I20260709 13:01:38.838755  8537 tablet_bootstrap.cc:492] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849: No bootstrap required, opened a new log
I20260709 13:01:38.841146  8309 leader_election.cc:304] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2; no voters: 58234c3ebef346d8a52d902fc45e2849, fb98dfdb6a744e83a251ee52b2799ff8
I20260709 13:01:38.842964  8536 ts_tablet_manager.cc:1403] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8: Time spent bootstrapping tablet: real 0.153s	user 0.023s	sys 0.015s
I20260709 13:01:38.843364  8537 ts_tablet_manager.cc:1403] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849: Time spent bootstrapping tablet: real 0.139s	user 0.017s	sys 0.017s
I20260709 13:01:38.845288  8545 raft_consensus.cc:2749] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:38.847745  8538 raft_consensus.cc:359] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.848584  8538 raft_consensus.cc:385] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.848948  8538 raft_consensus.cc:740] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.848376  8419 raft_consensus.cc:2468] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d5eaee01844183a4bbf46ad7d510b2 in term 1.
I20260709 13:01:38.851504  8308 leader_election.cc:304] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 
I20260709 13:01:38.853715  8493 raft_consensus.cc:2468] T 9ae145501f22403da5cc68d69af63915 P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d5eaee01844183a4bbf46ad7d510b2 in term 1.
I20260709 13:01:38.854080  8536 raft_consensus.cc:359] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.854780  8536 raft_consensus.cc:385] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.855055  8536 raft_consensus.cc:740] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.850049  8538 consensus_queue.cc:260] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.852468  8492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d7875abc644a7e99ebac699897b724" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58234c3ebef346d8a52d902fc45e2849" is_pre_election: true
I20260709 13:01:38.855474  8545 raft_consensus.cc:2804] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:38.856452  8536 consensus_queue.cc:260] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
W20260709 13:01:38.860769  8384 leader_election.cc:343] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.861346  8541 raft_consensus.cc:493] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.865569  8492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c251a30c42f24625b0df1be970faa534" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58234c3ebef346d8a52d902fc45e2849" is_pre_election: true
I20260709 13:01:38.865756  8344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d7875abc644a7e99ebac699897b724" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2" is_pre_election: true
I20260709 13:01:38.863817  8541 raft_consensus.cc:515] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.863890  8545 raft_consensus.cc:697] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 LEADER]: Becoming Leader. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Running, Role: LEADER
I20260709 13:01:38.865623  8537 raft_consensus.cc:359] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.866536  8492 raft_consensus.cc:2468] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 0.
I20260709 13:01:38.867867  8537 raft_consensus.cc:385] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.868698  8343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c251a30c42f24625b0df1be970faa534" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2" is_pre_election: true
I20260709 13:01:38.870288  8537 raft_consensus.cc:740] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.869925  8384 leader_election.cc:304] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58234c3ebef346d8a52d902fc45e2849, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 
I20260709 13:01:38.873359  8343 raft_consensus.cc:2468] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 0.
I20260709 13:01:38.873354  8537 consensus_queue.cc:260] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.872716  8545 consensus_queue.cc:237] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.883394  8537 ts_tablet_manager.cc:1434] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849: Time spent starting tablet: real 0.038s	user 0.010s	sys 0.000s
I20260709 13:01:38.903663  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c00c12c99811434db59727d5ad24f6be" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" is_pre_election: true
I20260709 13:01:38.906747  8569 raft_consensus.cc:2804] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:01:38.907346  8457 leader_election.cc:343] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.908253  8569 raft_consensus.cc:493] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.909133  8569 raft_consensus.cc:3060] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.914578  8538 ts_tablet_manager.cc:1434] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2: Time spent starting tablet: real 0.084s	user 0.017s	sys 0.012s
I20260709 13:01:38.915731  8538 tablet_bootstrap.cc:492] T 47d7875abc644a7e99ebac699897b724 P 05d5eaee01844183a4bbf46ad7d510b2: Bootstrap starting.
I20260709 13:01:38.916320  8541 leader_election.cc:290] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:38.919384  8537 tablet_bootstrap.cc:492] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849: Bootstrap starting.
W20260709 13:01:38.922982  8384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:40717, user_credentials={real_user=slave}} blocked reactor thread for 53623us
I20260709 13:01:38.925451  8343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c00c12c99811434db59727d5ad24f6be" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2" is_pre_election: true
I20260709 13:01:38.928619  8343 raft_consensus.cc:2468] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 0.
I20260709 13:01:38.929688  8344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff25b46a0ac45b0b845a38ef322d862" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2" is_pre_election: true
I20260709 13:01:38.930943  8458 leader_election.cc:304] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2, 58234c3ebef346d8a52d902fc45e2849; no voters: fb98dfdb6a744e83a251ee52b2799ff8
I20260709 13:01:38.932299  8536 ts_tablet_manager.cc:1434] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8: Time spent starting tablet: real 0.087s	user 0.006s	sys 0.015s
I20260709 13:01:38.932233  8543 raft_consensus.cc:2804] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:38.933244  8543 raft_consensus.cc:493] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.933861  8543 raft_consensus.cc:3060] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:38.933872  8384 leader_election.cc:343] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.936089  8536 tablet_bootstrap.cc:492] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8: Bootstrap starting.
I20260709 13:01:38.939199  8492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff25b46a0ac45b0b845a38ef322d862" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58234c3ebef346d8a52d902fc45e2849" is_pre_election: true
I20260709 13:01:38.937883  8384 leader_election.cc:304] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb98dfdb6a744e83a251ee52b2799ff8; no voters: 05d5eaee01844183a4bbf46ad7d510b2, 58234c3ebef346d8a52d902fc45e2849
W20260709 13:01:38.948647  8384 leader_election.cc:343] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.950145  8570 raft_consensus.cc:2749] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:38.951170  8384 leader_election.cc:343] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.953681  8538 tablet_bootstrap.cc:654] T 47d7875abc644a7e99ebac699897b724 P 05d5eaee01844183a4bbf46ad7d510b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.953104  8384 leader_election.cc:304] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb98dfdb6a744e83a251ee52b2799ff8; no voters: 05d5eaee01844183a4bbf46ad7d510b2, 58234c3ebef346d8a52d902fc45e2849
I20260709 13:01:38.955839  8570 raft_consensus.cc:2749] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:38.962344  8537 tablet_bootstrap.cc:654] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.964596  8536 tablet_bootstrap.cc:654] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.962085  8543 raft_consensus.cc:515] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.966884  8569 raft_consensus.cc:515] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.968096  8344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c00c12c99811434db59727d5ad24f6be" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
I20260709 13:01:38.968842  8344 raft_consensus.cc:3060] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.973690  8536 tablet_bootstrap.cc:492] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8: No bootstrap required, opened a new log
I20260709 13:01:38.974210  8536 ts_tablet_manager.cc:1403] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.002s
I20260709 13:01:38.976454  8344 raft_consensus.cc:2468] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 1.
I20260709 13:01:38.977201  8536 raft_consensus.cc:359] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.977950  8536 raft_consensus.cc:385] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.978302  8536 raft_consensus.cc:740] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.978799  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c00c12c99811434db59727d5ad24f6be" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
I20260709 13:01:38.979174  8536 consensus_queue.cc:260] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:38.981752  8536 ts_tablet_manager.cc:1434] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:01:38.982738  8536 tablet_bootstrap.cc:492] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8: Bootstrap starting.
I20260709 13:01:38.983556  8419 raft_consensus.cc:3060] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.989172  8536 tablet_bootstrap.cc:654] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.990867  8419 raft_consensus.cc:2468] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 1.
I20260709 13:01:38.990576  8239 catalog_manager.cc:5697] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "05d5eaee01844183a4bbf46ad7d510b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:38.993269  8543 leader_election.cc:290] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 election: Requested vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051)
I20260709 13:01:38.994458  8458 leader_election.cc:304] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2, 58234c3ebef346d8a52d902fc45e2849; no voters: 
I20260709 13:01:38.994776  8569 leader_election.cc:290] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 election: Requested vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:38.996543  8543 raft_consensus.cc:2804] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:38.996623  8344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c251a30c42f24625b0df1be970faa534" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
I20260709 13:01:38.997596  8344 raft_consensus.cc:3060] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.996750  8492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c251a30c42f24625b0df1be970faa534" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
I20260709 13:01:39.001165  8492 raft_consensus.cc:3060] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.029256  8543 raft_consensus.cc:697] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 1 LEADER]: Becoming Leader. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Running, Role: LEADER
I20260709 13:01:39.040417  8492 raft_consensus.cc:2468] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 1.
I20260709 13:01:39.041714  8384 leader_election.cc:304] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58234c3ebef346d8a52d902fc45e2849, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 
I20260709 13:01:39.038771  8543 consensus_queue.cc:237] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.044611  8569 raft_consensus.cc:2804] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:39.046662  8538 tablet_bootstrap.cc:492] T 47d7875abc644a7e99ebac699897b724 P 05d5eaee01844183a4bbf46ad7d510b2: No bootstrap required, opened a new log
I20260709 13:01:39.047781  8569 raft_consensus.cc:697] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 LEADER]: Becoming Leader. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Running, Role: LEADER
I20260709 13:01:39.048012  8538 ts_tablet_manager.cc:1403] T 47d7875abc644a7e99ebac699897b724 P 05d5eaee01844183a4bbf46ad7d510b2: Time spent bootstrapping tablet: real 0.132s	user 0.030s	sys 0.024s
I20260709 13:01:39.048861  8569 consensus_queue.cc:237] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.050151  8576 raft_consensus.cc:493] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.050680  8576 raft_consensus.cc:515] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } }
I20260709 13:01:39.054891  8536 tablet_bootstrap.cc:492] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8: No bootstrap required, opened a new log
I20260709 13:01:39.056128  8536 ts_tablet_manager.cc:1403] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.014s
I20260709 13:01:39.048913  8344 raft_consensus.cc:2468] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 1.
I20260709 13:01:39.063287  8538 raft_consensus.cc:359] T 47d7875abc644a7e99ebac699897b724 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.065158  8538 raft_consensus.cc:385] T 47d7875abc644a7e99ebac699897b724 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.065524  8538 raft_consensus.cc:740] T 47d7875abc644a7e99ebac699897b724 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.066396  8537 tablet_bootstrap.cc:492] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849: No bootstrap required, opened a new log
I20260709 13:01:39.073531  8344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e032c170e06b4392bcd8d1e761820d89" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2" is_pre_election: true
I20260709 13:01:39.073977  8537 ts_tablet_manager.cc:1403] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849: Time spent bootstrapping tablet: real 0.163s	user 0.015s	sys 0.021s
I20260709 13:01:39.066412  8538 consensus_queue.cc:260] T 47d7875abc644a7e99ebac699897b724 P 05d5eaee01844183a4bbf46ad7d510b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
W20260709 13:01:39.074978  8458 leader_election.cc:343] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:39.072045  8576 leader_election.cc:290] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051), 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295)
I20260709 13:01:39.077412  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e032c170e06b4392bcd8d1e761820d89" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" is_pre_election: true
I20260709 13:01:39.068230  8241 catalog_manager.cc:5697] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67). New cstate: current_term: 1 leader_uuid: "58234c3ebef346d8a52d902fc45e2849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.076072  8238 catalog_manager.cc:5697] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 reported cstate change: term changed from 0 to 1, leader changed from <none> to fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.079138  8536 raft_consensus.cc:359] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } }
I20260709 13:01:39.080056  8536 raft_consensus.cc:385] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:01:39.080263  8457 leader_election.cc:343] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:39.081127  8536 raft_consensus.cc:740] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.081634  8457 leader_election.cc:304] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58234c3ebef346d8a52d902fc45e2849; no voters: 05d5eaee01844183a4bbf46ad7d510b2, fb98dfdb6a744e83a251ee52b2799ff8
I20260709 13:01:39.083168  8538 ts_tablet_manager.cc:1434] T 47d7875abc644a7e99ebac699897b724 P 05d5eaee01844183a4bbf46ad7d510b2: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.007s
I20260709 13:01:39.083647  8576 raft_consensus.cc:2749] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:39.084169  8538 tablet_bootstrap.cc:492] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2: Bootstrap starting.
I20260709 13:01:39.081949  8536 consensus_queue.cc:260] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } }
I20260709 13:01:39.085778  8537 raft_consensus.cc:359] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.087471  8537 raft_consensus.cc:385] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.087973  8537 raft_consensus.cc:740] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.088201  8536 ts_tablet_manager.cc:1434] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.003s
I20260709 13:01:39.088915  8537 consensus_queue.cc:260] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.089824  8536 tablet_bootstrap.cc:492] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8: Bootstrap starting.
I20260709 13:01:39.091933  8537 ts_tablet_manager.cc:1434] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:01:39.093123  8537 tablet_bootstrap.cc:492] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849: Bootstrap starting.
I20260709 13:01:39.095526  8538 tablet_bootstrap.cc:654] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.100855  8537 tablet_bootstrap.cc:654] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.101780  8536 tablet_bootstrap.cc:654] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.103725  8545 raft_consensus.cc:493] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.104288  8545 raft_consensus.cc:515] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.107698  8545 leader_election.cc:290] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:39.108678  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8936128622840c0bd58170c0d7658e6" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" is_pre_election: true
I20260709 13:01:39.109982  8492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8936128622840c0bd58170c0d7658e6" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58234c3ebef346d8a52d902fc45e2849" is_pre_election: true
W20260709 13:01:39.110566  8308 leader_election.cc:343] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:39.111517  8309 leader_election.cc:343] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:39.111974  8309 leader_election.cc:304] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2; no voters: 58234c3ebef346d8a52d902fc45e2849, fb98dfdb6a744e83a251ee52b2799ff8
I20260709 13:01:39.115064  8545 raft_consensus.cc:2749] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:39.137912  8576 raft_consensus.cc:493] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.138525  8576 raft_consensus.cc:515] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.140748  8576 leader_election.cc:290] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051)
I20260709 13:01:39.142084  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f681125f9aff45dbb0d7baf4db8e7d65" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" is_pre_election: true
I20260709 13:01:39.142079  8344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f681125f9aff45dbb0d7baf4db8e7d65" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2" is_pre_election: true
W20260709 13:01:39.145474  8458 leader_election.cc:343] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:39.146409  8457 leader_election.cc:343] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:39.149101  8457 leader_election.cc:304] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58234c3ebef346d8a52d902fc45e2849; no voters: 05d5eaee01844183a4bbf46ad7d510b2, fb98dfdb6a744e83a251ee52b2799ff8
I20260709 13:01:39.149986  8576 raft_consensus.cc:2749] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:39.150930  8536 tablet_bootstrap.cc:492] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8: No bootstrap required, opened a new log
I20260709 13:01:39.151572  8536 ts_tablet_manager.cc:1403] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8: Time spent bootstrapping tablet: real 0.062s	user 0.025s	sys 0.017s
I20260709 13:01:39.152642  8538 tablet_bootstrap.cc:492] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2: No bootstrap required, opened a new log
I20260709 13:01:39.153263  8538 ts_tablet_manager.cc:1403] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.004s
I20260709 13:01:39.153676  8537 tablet_bootstrap.cc:492] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849: No bootstrap required, opened a new log
I20260709 13:01:39.154307  8537 ts_tablet_manager.cc:1403] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849: Time spent bootstrapping tablet: real 0.061s	user 0.018s	sys 0.030s
I20260709 13:01:39.154768  8536 raft_consensus.cc:359] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.155478  8536 raft_consensus.cc:385] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.155777  8536 raft_consensus.cc:740] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.156633  8536 consensus_queue.cc:260] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.159240  8536 ts_tablet_manager.cc:1434] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:01:39.157624  8537 raft_consensus.cc:359] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.157557  8538 raft_consensus.cc:359] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.169850  8537 raft_consensus.cc:385] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.169943  8569 raft_consensus.cc:493] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.170004  8538 raft_consensus.cc:385] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.170336  8537 raft_consensus.cc:740] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.170642  8538 raft_consensus.cc:740] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.170614  8569 raft_consensus.cc:515] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } }
I20260709 13:01:39.171166  8537 consensus_queue.cc:260] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.172861  8569 leader_election.cc:290] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717), 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295)
I20260709 13:01:39.174906  8492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e032c170e06b4392bcd8d1e761820d89" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58234c3ebef346d8a52d902fc45e2849" is_pre_election: true
I20260709 13:01:39.175350  8536 tablet_bootstrap.cc:492] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8: Bootstrap starting.
I20260709 13:01:39.175588  8492 raft_consensus.cc:2468] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 0.
I20260709 13:01:39.176168  8537 ts_tablet_manager.cc:1434] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.012s
I20260709 13:01:39.175649  8576 raft_consensus.cc:493] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.175148  8344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e032c170e06b4392bcd8d1e761820d89" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2" is_pre_election: true
I20260709 13:01:39.176936  8576 raft_consensus.cc:515] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.178094  8537 tablet_bootstrap.cc:492] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849: Bootstrap starting.
I20260709 13:01:39.179266  8576 leader_election.cc:290] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051)
I20260709 13:01:39.180922  8344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d7875abc644a7e99ebac699897b724" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2" is_pre_election: true
W20260709 13:01:39.181298  8384 leader_election.cc:343] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:39.181634  8344 raft_consensus.cc:2468] T 47d7875abc644a7e99ebac699897b724 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 0.
I20260709 13:01:39.182050  8384 leader_election.cc:304] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58234c3ebef346d8a52d902fc45e2849, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 05d5eaee01844183a4bbf46ad7d510b2
I20260709 13:01:39.182343  8536 tablet_bootstrap.cc:654] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.182862  8569 raft_consensus.cc:2804] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:39.182873  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d7875abc644a7e99ebac699897b724" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" is_pre_election: true
I20260709 13:01:39.183291  8569 raft_consensus.cc:493] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.183658  8569 raft_consensus.cc:3060] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.183718  8419 raft_consensus.cc:2468] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 0.
I20260709 13:01:39.182886  8458 leader_election.cc:304] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2, 58234c3ebef346d8a52d902fc45e2849; no voters: 
I20260709 13:01:39.187099  8576 raft_consensus.cc:2804] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:39.187494  8576 raft_consensus.cc:493] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.187668  8537 tablet_bootstrap.cc:654] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.187858  8576 raft_consensus.cc:3060] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.190496  8569 raft_consensus.cc:515] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } }
I20260709 13:01:39.193533  8492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e032c170e06b4392bcd8d1e761820d89" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
I20260709 13:01:39.194205  8492 raft_consensus.cc:3060] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.171815  8538 consensus_queue.cc:260] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.197443  8344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e032c170e06b4392bcd8d1e761820d89" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
I20260709 13:01:39.201661  8492 raft_consensus.cc:2468] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 1.
W20260709 13:01:39.202136  8384 leader_election.cc:343] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:39.202445  8537 tablet_bootstrap.cc:492] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849: No bootstrap required, opened a new log
I20260709 13:01:39.202471  8536 tablet_bootstrap.cc:492] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8: No bootstrap required, opened a new log
I20260709 13:01:39.202956  8537 ts_tablet_manager.cc:1403] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.002s
I20260709 13:01:39.203122  8536 ts_tablet_manager.cc:1403] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.001s
I20260709 13:01:39.202945  8384 leader_election.cc:304] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58234c3ebef346d8a52d902fc45e2849, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 05d5eaee01844183a4bbf46ad7d510b2
I20260709 13:01:39.204322  8570 raft_consensus.cc:2804] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:39.204809  8570 raft_consensus.cc:697] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 LEADER]: Becoming Leader. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Running, Role: LEADER
I20260709 13:01:39.205701  8570 consensus_queue.cc:237] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } }
I20260709 13:01:39.206060  8537 raft_consensus.cc:359] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.198909  8576 raft_consensus.cc:515] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.197921  8569 leader_election.cc:290] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 election: Requested vote from peers 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717), 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295)
I20260709 13:01:39.206418  8536 raft_consensus.cc:359] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.206792  8538 ts_tablet_manager.cc:1434] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.004s
I20260709 13:01:39.207144  8536 raft_consensus.cc:385] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.207512  8536 raft_consensus.cc:740] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.208163  8536 consensus_queue.cc:260] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.209093  8576 leader_election.cc:290] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 election: Requested vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051)
I20260709 13:01:39.206801  8537 raft_consensus.cc:385] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.209870  8537 raft_consensus.cc:740] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.210497  8536 ts_tablet_manager.cc:1434] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:39.210469  8537 consensus_queue.cc:260] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.211052  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d7875abc644a7e99ebac699897b724" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
I20260709 13:01:39.211597  8419 raft_consensus.cc:3060] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.212455  8344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d7875abc644a7e99ebac699897b724" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
I20260709 13:01:39.212815  8537 ts_tablet_manager.cc:1434] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:01:39.213021  8344 raft_consensus.cc:3060] T 47d7875abc644a7e99ebac699897b724 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.213855  8537 tablet_bootstrap.cc:492] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849: Bootstrap starting.
I20260709 13:01:39.215304  8536 tablet_bootstrap.cc:492] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8: Bootstrap starting.
W20260709 13:01:39.220448  8288 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:39.221278  8537 tablet_bootstrap.cc:654] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.221470  8536 tablet_bootstrap.cc:654] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.224584  8419 raft_consensus.cc:2468] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 1.
I20260709 13:01:39.225912  8457 leader_election.cc:304] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58234c3ebef346d8a52d902fc45e2849, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 
I20260709 13:01:39.227386  8576 raft_consensus.cc:2804] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:39.227938  8576 raft_consensus.cc:697] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [term 1 LEADER]: Becoming Leader. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Running, Role: LEADER
I20260709 13:01:39.228891  8576 consensus_queue.cc:237] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.243479  8538 tablet_bootstrap.cc:492] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2: Bootstrap starting.
I20260709 13:01:39.232980  8344 raft_consensus.cc:2468] T 47d7875abc644a7e99ebac699897b724 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 1.
I20260709 13:01:39.251806  8536 tablet_bootstrap.cc:492] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8: No bootstrap required, opened a new log
I20260709 13:01:39.252269  8536 ts_tablet_manager.cc:1403] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.015s
I20260709 13:01:39.255409  8537 tablet_bootstrap.cc:492] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849: No bootstrap required, opened a new log
I20260709 13:01:39.255903  8537 ts_tablet_manager.cc:1403] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.010s
I20260709 13:01:39.255810  8536 raft_consensus.cc:359] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.256629  8536 raft_consensus.cc:385] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.256937  8536 raft_consensus.cc:740] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.257603  8536 consensus_queue.cc:260] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.258988  8537 raft_consensus.cc:359] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.259732  8537 raft_consensus.cc:385] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.260002  8536 ts_tablet_manager.cc:1434] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:39.260035  8537 raft_consensus.cc:740] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.261072  8537 consensus_queue.cc:260] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.262854  8537 ts_tablet_manager.cc:1434] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:39.262157  8240 catalog_manager.cc:5697] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67). New cstate: current_term: 1 leader_uuid: "58234c3ebef346d8a52d902fc45e2849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.267551  8570 raft_consensus.cc:493] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.268044  8570 raft_consensus.cc:515] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.269968  8570 leader_election.cc:290] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:39.270339  8545 raft_consensus.cc:493] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.270004  8238 catalog_manager.cc:5697] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 reported cstate change: term changed from 0 to 1, leader changed from <none> to fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.270819  8545 raft_consensus.cc:515] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.273222  8545 leader_election.cc:290] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:39.274482  8492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff25b46a0ac45b0b845a38ef322d862" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58234c3ebef346d8a52d902fc45e2849" is_pre_election: true
I20260709 13:01:39.274863  8493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f681125f9aff45dbb0d7baf4db8e7d65" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58234c3ebef346d8a52d902fc45e2849" is_pre_election: true
I20260709 13:01:39.275135  8492 raft_consensus.cc:2468] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05d5eaee01844183a4bbf46ad7d510b2 in term 0.
I20260709 13:01:39.275499  8493 raft_consensus.cc:2468] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 0.
I20260709 13:01:39.276742  8309 leader_election.cc:304] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2, 58234c3ebef346d8a52d902fc45e2849; no voters: 
I20260709 13:01:39.277554  8545 raft_consensus.cc:2804] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:39.277979  8545 raft_consensus.cc:493] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.278370  8545 raft_consensus.cc:3060] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.276757  8384 leader_election.cc:304] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58234c3ebef346d8a52d902fc45e2849, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 
I20260709 13:01:39.280416  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff25b46a0ac45b0b845a38ef322d862" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" is_pre_election: true
I20260709 13:01:39.281082  8419 raft_consensus.cc:2468] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05d5eaee01844183a4bbf46ad7d510b2 in term 0.
I20260709 13:01:39.282358  8570 raft_consensus.cc:2804] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:39.282737  8570 raft_consensus.cc:493] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.283071  8570 raft_consensus.cc:3060] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.285868  8545 raft_consensus.cc:515] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.286931  8344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f681125f9aff45dbb0d7baf4db8e7d65" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2" is_pre_election: true
I20260709 13:01:39.288022  8545 leader_election.cc:290] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 1 election: Requested vote from peers fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:39.289100  8493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff25b46a0ac45b0b845a38ef322d862" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
W20260709 13:01:39.289288  8384 leader_election.cc:343] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:39.289728  8493 raft_consensus.cc:3060] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.294236  8570 raft_consensus.cc:515] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.295079  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff25b46a0ac45b0b845a38ef322d862" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
I20260709 13:01:39.297420  8419 raft_consensus.cc:3060] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.298424  8538 tablet_bootstrap.cc:654] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.299451  8344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f681125f9aff45dbb0d7baf4db8e7d65" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
I20260709 13:01:39.300387  8570 leader_election.cc:290] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 election: Requested vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:39.300642  8492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f681125f9aff45dbb0d7baf4db8e7d65" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
W20260709 13:01:39.301085  8384 leader_election.cc:343] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:39.301362  8492 raft_consensus.cc:3060] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.306926  8538 tablet_bootstrap.cc:492] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2: No bootstrap required, opened a new log
I20260709 13:01:39.307551  8538 ts_tablet_manager.cc:1403] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.003s
I20260709 13:01:39.310283  8538 raft_consensus.cc:359] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } }
I20260709 13:01:39.311028  8538 raft_consensus.cc:385] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.311347  8538 raft_consensus.cc:740] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.311614  8419 raft_consensus.cc:2468] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d5eaee01844183a4bbf46ad7d510b2 in term 1.
I20260709 13:01:39.312167  8538 consensus_queue.cc:260] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } }
I20260709 13:01:39.312960  8308 leader_election.cc:304] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 
I20260709 13:01:39.313798  8545 raft_consensus.cc:2804] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:39.314266  8545 raft_consensus.cc:697] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 LEADER]: Becoming Leader. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Running, Role: LEADER
I20260709 13:01:39.315053  8545 consensus_queue.cc:237] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.319041  8492 raft_consensus.cc:2468] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 1.
I20260709 13:01:39.320941  8493 raft_consensus.cc:2468] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d5eaee01844183a4bbf46ad7d510b2 in term 1.
I20260709 13:01:39.322036  8384 leader_election.cc:304] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58234c3ebef346d8a52d902fc45e2849, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 05d5eaee01844183a4bbf46ad7d510b2
I20260709 13:01:39.323019  8570 raft_consensus.cc:2804] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:39.320925  8538 ts_tablet_manager.cc:1434] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2: Time spent starting tablet: real 0.013s	user 0.000s	sys 0.005s
I20260709 13:01:39.323561  8570 raft_consensus.cc:697] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 LEADER]: Becoming Leader. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Running, Role: LEADER
I20260709 13:01:39.324556  8538 tablet_bootstrap.cc:492] T f681125f9aff45dbb0d7baf4db8e7d65 P 05d5eaee01844183a4bbf46ad7d510b2: Bootstrap starting.
I20260709 13:01:39.324486  8570 consensus_queue.cc:237] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.332545  8538 tablet_bootstrap.cc:654] T f681125f9aff45dbb0d7baf4db8e7d65 P 05d5eaee01844183a4bbf46ad7d510b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.337754  8241 catalog_manager.cc:5697] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 reported cstate change: term changed from 0 to 1, leader changed from <none> to fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.339607  8238 catalog_manager.cc:5697] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "05d5eaee01844183a4bbf46ad7d510b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.351294  8538 tablet_bootstrap.cc:492] T f681125f9aff45dbb0d7baf4db8e7d65 P 05d5eaee01844183a4bbf46ad7d510b2: No bootstrap required, opened a new log
I20260709 13:01:39.351814  8538 ts_tablet_manager.cc:1403] T f681125f9aff45dbb0d7baf4db8e7d65 P 05d5eaee01844183a4bbf46ad7d510b2: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.007s
I20260709 13:01:39.354617  8538 raft_consensus.cc:359] T f681125f9aff45dbb0d7baf4db8e7d65 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.355372  8538 raft_consensus.cc:385] T f681125f9aff45dbb0d7baf4db8e7d65 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.355661  8538 raft_consensus.cc:740] T f681125f9aff45dbb0d7baf4db8e7d65 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.356546  8576 raft_consensus.cc:493] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.357223  8576 raft_consensus.cc:515] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.356609  8538 consensus_queue.cc:260] T f681125f9aff45dbb0d7baf4db8e7d65 P 05d5eaee01844183a4bbf46ad7d510b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.360092  8538 ts_tablet_manager.cc:1434] T f681125f9aff45dbb0d7baf4db8e7d65 P 05d5eaee01844183a4bbf46ad7d510b2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:01:39.361181  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8936128622840c0bd58170c0d7658e6" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" is_pre_election: true
I20260709 13:01:39.361810  8344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8936128622840c0bd58170c0d7658e6" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2" is_pre_election: true
I20260709 13:01:39.361878  8419 raft_consensus.cc:2468] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 0.
I20260709 13:01:39.362537  8344 raft_consensus.cc:2468] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 0.
I20260709 13:01:39.362951  8576 leader_election.cc:290] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051)
I20260709 13:01:39.364086  8457 leader_election.cc:304] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58234c3ebef346d8a52d902fc45e2849, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 
I20260709 13:01:39.365059  8576 raft_consensus.cc:2804] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:39.365496  8576 raft_consensus.cc:493] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.365867  8576 raft_consensus.cc:3060] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.373579  8576 raft_consensus.cc:515] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.375908  8576 leader_election.cc:290] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 election: Requested vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051)
I20260709 13:01:39.376791  8344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8936128622840c0bd58170c0d7658e6" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
I20260709 13:01:39.377439  8344 raft_consensus.cc:3060] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.377312  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8936128622840c0bd58170c0d7658e6" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
I20260709 13:01:39.378008  8419 raft_consensus.cc:3060] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.382756  8344 raft_consensus.cc:2468] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 1.
I20260709 13:01:39.384209  8458 leader_election.cc:304] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2, 58234c3ebef346d8a52d902fc45e2849; no voters: 
I20260709 13:01:39.384971  8576 raft_consensus.cc:2804] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:39.385509  8576 raft_consensus.cc:697] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 1 LEADER]: Becoming Leader. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Running, Role: LEADER
I20260709 13:01:39.386365  8419 raft_consensus.cc:2468] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 1.
I20260709 13:01:39.386446  8576 consensus_queue.cc:237] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.396687  8238 catalog_manager.cc:5697] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67). New cstate: current_term: 1 leader_uuid: "58234c3ebef346d8a52d902fc45e2849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.425251  8576 raft_consensus.cc:493] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.425745  8576 raft_consensus.cc:515] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.427569  8576 leader_election.cc:290] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051)
I20260709 13:01:39.428445  8344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66045046df98460387504edc93461751" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2" is_pre_election: true
I20260709 13:01:39.428704  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66045046df98460387504edc93461751" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" is_pre_election: true
I20260709 13:01:39.429067  8344 raft_consensus.cc:2468] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 0.
I20260709 13:01:39.429402  8419 raft_consensus.cc:2468] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 0.
I20260709 13:01:39.430157  8458 leader_election.cc:304] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2, 58234c3ebef346d8a52d902fc45e2849; no voters: 
I20260709 13:01:39.430989  8576 raft_consensus.cc:2804] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:39.431387  8576 raft_consensus.cc:493] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.431689  8576 raft_consensus.cc:3060] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.436318  8576 raft_consensus.cc:515] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.438503  8576 leader_election.cc:290] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 election: Requested vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051)
I20260709 13:01:39.439071  8344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66045046df98460387504edc93461751" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
I20260709 13:01:39.439199  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66045046df98460387504edc93461751" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
I20260709 13:01:39.439694  8344 raft_consensus.cc:3060] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.439777  8419 raft_consensus.cc:3060] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.444911  8419 raft_consensus.cc:2468] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 1.
I20260709 13:01:39.446275  8457 leader_election.cc:304] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58234c3ebef346d8a52d902fc45e2849, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 
I20260709 13:01:39.447036  8576 raft_consensus.cc:2804] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:39.447705  8344 raft_consensus.cc:2468] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 1.
I20260709 13:01:39.447515  8576 raft_consensus.cc:697] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 1 LEADER]: Becoming Leader. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Running, Role: LEADER
I20260709 13:01:39.448870  8576 consensus_queue.cc:237] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.463670  8238 catalog_manager.cc:5697] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67). New cstate: current_term: 1 leader_uuid: "58234c3ebef346d8a52d902fc45e2849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.483547  8545 consensus_queue.cc:1048] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.501305  8545 consensus_queue.cc:1048] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.551681  8419 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e032c170e06b4392bcd8d1e761820d89"
dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
mode: GRACEFUL
new_leader_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
 from {username='slave'} at 127.0.0.1:56262
I20260709 13:01:39.552245  8419 raft_consensus.cc:606] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 LEADER]: Received request to transfer leadership to TS 05d5eaee01844183a4bbf46ad7d510b2
I20260709 13:01:39.557739  8419 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c251a30c42f24625b0df1be970faa534"
dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
mode: GRACEFUL
new_leader_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
 from {username='slave'} at 127.0.0.1:56262
I20260709 13:01:39.558209  8419 raft_consensus.cc:606] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 LEADER]: Received request to transfer leadership to TS 05d5eaee01844183a4bbf46ad7d510b2
I20260709 13:01:39.572991  8492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66045046df98460387504edc93461751"
dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
mode: GRACEFUL
new_leader_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
 from {username='slave'} at 127.0.0.1:39734
I20260709 13:01:39.573547  8492 raft_consensus.cc:606] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 1 LEADER]: Received request to transfer leadership to TS 05d5eaee01844183a4bbf46ad7d510b2
I20260709 13:01:39.578568  8492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c00c12c99811434db59727d5ad24f6be"
dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
mode: GRACEFUL
new_leader_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
 from {username='slave'} at 127.0.0.1:39734
I20260709 13:01:39.579218  8492 raft_consensus.cc:606] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 1 LEADER]: Received request to transfer leadership to TS 05d5eaee01844183a4bbf46ad7d510b2
I20260709 13:01:39.592859  8344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ae145501f22403da5cc68d69af63915"
dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
mode: GRACEFUL
new_leader_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
 from {username='slave'} at 127.0.0.1:48004
I20260709 13:01:39.593488  8344 raft_consensus.cc:606] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 LEADER]: Received request to transfer leadership to TS fb98dfdb6a744e83a251ee52b2799ff8
I20260709 13:01:39.597518  8576 consensus_queue.cc:1048] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.598671  8492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47d7875abc644a7e99ebac699897b724"
dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
mode: GRACEFUL
new_leader_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
 from {username='slave'} at 127.0.0.1:39734
I20260709 13:01:39.599284  8492 raft_consensus.cc:606] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [term 1 LEADER]: Received request to transfer leadership to TS fb98dfdb6a744e83a251ee52b2799ff8
I20260709 13:01:39.605927  8576 raft_consensus.cc:993] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849: : Instructing follower 05d5eaee01844183a4bbf46ad7d510b2 to start an election
I20260709 13:01:39.606395  8576 raft_consensus.cc:1081] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 1 LEADER]: Signalling peer 05d5eaee01844183a4bbf46ad7d510b2 to start an election
I20260709 13:01:39.606573  8344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ff25b46a0ac45b0b845a38ef322d862"
dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
mode: GRACEFUL
new_leader_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
 from {username='slave'} at 127.0.0.1:48004
I20260709 13:01:39.607187  8344 raft_consensus.cc:606] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 LEADER]: Received request to transfer leadership to TS fb98dfdb6a744e83a251ee52b2799ff8
I20260709 13:01:39.611898  8342 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c00c12c99811434db59727d5ad24f6be"
dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
 from {username='slave'} at 127.0.0.1:47996
I20260709 13:01:39.612702  8342 raft_consensus.cc:493] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:39.613687  8342 raft_consensus.cc:3060] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.617974  8570 consensus_queue.cc:1048] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.623870  8578 consensus_queue.cc:1048] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:39.628159  8342 raft_consensus.cc:515] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.631578  8418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c00c12c99811434db59727d5ad24f6be" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
I20260709 13:01:39.635504  8493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c00c12c99811434db59727d5ad24f6be" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
I20260709 13:01:39.636106  8493 raft_consensus.cc:3055] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:39.636463  8493 raft_consensus.cc:740] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Running, Role: LEADER
I20260709 13:01:39.637313  8491 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8936128622840c0bd58170c0d7658e6"
dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
mode: GRACEFUL
new_leader_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
 from {username='slave'} at 127.0.0.1:39734
I20260709 13:01:39.637921  8491 raft_consensus.cc:606] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 1 LEADER]: Received request to transfer leadership to TS fb98dfdb6a744e83a251ee52b2799ff8
I20260709 13:01:39.638226  8342 leader_election.cc:290] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 2 election: Requested vote from peers fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:39.637332  8493 consensus_queue.cc:260] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.640180  8493 raft_consensus.cc:3060] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.644316  8541 consensus_queue.cc:1048] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.654271  8578 consensus_queue.cc:1048] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.663446  8541 consensus_queue.cc:1048] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.668253  8418 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f681125f9aff45dbb0d7baf4db8e7d65"
dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
mode: GRACEFUL
new_leader_uuid: "58234c3ebef346d8a52d902fc45e2849"
 from {username='slave'} at 127.0.0.1:56262
I20260709 13:01:39.668877  8418 raft_consensus.cc:606] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 LEADER]: Received request to transfer leadership to TS 58234c3ebef346d8a52d902fc45e2849
I20260709 13:01:39.672377  8603 raft_consensus.cc:493] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.672914  8603 raft_consensus.cc:515] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } }
I20260709 13:01:39.675918  8603 leader_election.cc:290] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717), fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051)
I20260709 13:01:39.676286  8492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e032c170e06b4392bcd8d1e761820d89" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58234c3ebef346d8a52d902fc45e2849" is_pre_election: true
I20260709 13:01:39.677227  8418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e032c170e06b4392bcd8d1e761820d89" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" is_pre_election: true
I20260709 13:01:39.679028  8308 leader_election.cc:304] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2; no voters: 58234c3ebef346d8a52d902fc45e2849, fb98dfdb6a744e83a251ee52b2799ff8
I20260709 13:01:39.680388  8603 raft_consensus.cc:2749] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:39.682399  8493 raft_consensus.cc:2468] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d5eaee01844183a4bbf46ad7d510b2 in term 2.
I20260709 13:01:39.683822  8309 leader_election.cc:304] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2, 58234c3ebef346d8a52d902fc45e2849; no voters: fb98dfdb6a744e83a251ee52b2799ff8
I20260709 13:01:39.684974  8603 raft_consensus.cc:2804] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:39.685688  8603 raft_consensus.cc:697] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 LEADER]: Becoming Leader. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Running, Role: LEADER
I20260709 13:01:39.686548  8603 consensus_queue.cc:237] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.695894  8570 raft_consensus.cc:993] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8: : Instructing follower 05d5eaee01844183a4bbf46ad7d510b2 to start an election
I20260709 13:01:39.696386  8570 raft_consensus.cc:1081] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 LEADER]: Signalling peer 05d5eaee01844183a4bbf46ad7d510b2 to start an election
I20260709 13:01:39.700768  8611 consensus_queue.cc:1048] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:39.708673  8342 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c251a30c42f24625b0df1be970faa534"
dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
 from {username='slave'} at 127.0.0.1:47984
I20260709 13:01:39.711898  8342 raft_consensus.cc:493] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:39.712450  8342 raft_consensus.cc:3060] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.708710  8568 consensus_queue.cc:1048] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:39.711810  8241 catalog_manager.cc:5697] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 reported cstate change: term changed from 1 to 2, leader changed from 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67) to 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65). New cstate: current_term: 2 leader_uuid: "05d5eaee01844183a4bbf46ad7d510b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.715837  8568 raft_consensus.cc:493] T f681125f9aff45dbb0d7baf4db8e7d65 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.716866  8568 raft_consensus.cc:515] T f681125f9aff45dbb0d7baf4db8e7d65 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.721928  8344 raft_consensus.cc:3060] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.722535  8568 leader_election.cc:290] T f681125f9aff45dbb0d7baf4db8e7d65 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:39.727676  8342 raft_consensus.cc:515] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.731770  8417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f681125f9aff45dbb0d7baf4db8e7d65" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" is_pre_election: true
I20260709 13:01:39.732169  8342 leader_election.cc:290] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 2 election: Requested vote from peers fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:39.733441  8416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c251a30c42f24625b0df1be970faa534" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
I20260709 13:01:39.734107  8416 raft_consensus.cc:3055] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:39.733450  8493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c251a30c42f24625b0df1be970faa534" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
I20260709 13:01:39.734510  8416 raft_consensus.cc:740] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Running, Role: LEADER
I20260709 13:01:39.734774  8493 raft_consensus.cc:3060] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.735340  8416 consensus_queue.cc:260] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.736310  8416 raft_consensus.cc:3060] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.737633  8568 raft_consensus.cc:993] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2: : Instructing follower fb98dfdb6a744e83a251ee52b2799ff8 to start an election
I20260709 13:01:39.738080  8568 raft_consensus.cc:1081] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 LEADER]: Signalling peer fb98dfdb6a744e83a251ee52b2799ff8 to start an election
I20260709 13:01:39.742120  8417 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ff25b46a0ac45b0b845a38ef322d862"
dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
 from {username='slave'} at 127.0.0.1:56252
I20260709 13:01:39.742952  8417 raft_consensus.cc:493] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:39.743448  8417 raft_consensus.cc:3060] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.746694  8545 consensus_queue.cc:1048] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.752251  8491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f681125f9aff45dbb0d7baf4db8e7d65" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58234c3ebef346d8a52d902fc45e2849" is_pre_election: true
I20260709 13:01:39.753105  8491 raft_consensus.cc:2393] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05d5eaee01844183a4bbf46ad7d510b2 in current term 1: Already voted for candidate fb98dfdb6a744e83a251ee52b2799ff8 in this term.
I20260709 13:01:39.754208  8309 leader_election.cc:304] T f681125f9aff45dbb0d7baf4db8e7d65 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2; no voters: 58234c3ebef346d8a52d902fc45e2849, fb98dfdb6a744e83a251ee52b2799ff8
I20260709 13:01:39.754089  8541 consensus_queue.cc:1048] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:39.755403  8603 raft_consensus.cc:3060] T f681125f9aff45dbb0d7baf4db8e7d65 P 05d5eaee01844183a4bbf46ad7d510b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.768452  8603 raft_consensus.cc:2749] T f681125f9aff45dbb0d7baf4db8e7d65 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:39.774957  8416 raft_consensus.cc:2468] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d5eaee01844183a4bbf46ad7d510b2 in term 2.
I20260709 13:01:39.777701  8308 leader_election.cc:304] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 
I20260709 13:01:39.775828  8541 consensus_queue.cc:1048] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:01:39.779582  8603 raft_consensus.cc:2804] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:39.780311  8603 raft_consensus.cc:697] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 LEADER]: Becoming Leader. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Running, Role: LEADER
I20260709 13:01:39.781163  8603 consensus_queue.cc:237] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.790019  8578 raft_consensus.cc:993] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849: : Instructing follower fb98dfdb6a744e83a251ee52b2799ff8 to start an election
I20260709 13:01:39.790549  8611 raft_consensus.cc:1081] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [term 1 LEADER]: Signalling peer fb98dfdb6a744e83a251ee52b2799ff8 to start an election
I20260709 13:01:39.792758  8419 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47d7875abc644a7e99ebac699897b724"
dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
 from {username='slave'} at 127.0.0.1:56254
I20260709 13:01:39.793536  8419 raft_consensus.cc:493] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:39.794257  8419 raft_consensus.cc:3060] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.799113  8569 raft_consensus.cc:993] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8: : Instructing follower 58234c3ebef346d8a52d902fc45e2849 to start an election
I20260709 13:01:39.799621  8569 raft_consensus.cc:1081] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 LEADER]: Signalling peer 58234c3ebef346d8a52d902fc45e2849 to start an election
I20260709 13:01:39.802578  8493 raft_consensus.cc:2468] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d5eaee01844183a4bbf46ad7d510b2 in term 2.
I20260709 13:01:39.803525  8492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f681125f9aff45dbb0d7baf4db8e7d65"
dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
 from {username='slave'} at 127.0.0.1:39724
I20260709 13:01:39.804280  8492 raft_consensus.cc:493] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:39.804634  8492 raft_consensus.cc:3060] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.806485  8570 consensus_queue.cc:1048] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.808288  8417 raft_consensus.cc:515] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.809487  8418 raft_consensus.cc:1240] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Rejecting Update request from peer 05d5eaee01844183a4bbf46ad7d510b2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:39.815344  8545 consensus_queue.cc:1059] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.816350  8545 raft_consensus.cc:3055] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:39.816601  8419 raft_consensus.cc:515] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.818042  8570 raft_consensus.cc:993] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8: : Instructing follower 05d5eaee01844183a4bbf46ad7d510b2 to start an election
I20260709 13:01:39.818490  8570 raft_consensus.cc:1081] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 LEADER]: Signalling peer 05d5eaee01844183a4bbf46ad7d510b2 to start an election
I20260709 13:01:39.819017  8417 leader_election.cc:290] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 2 election: Requested vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:39.820597  8344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff25b46a0ac45b0b845a38ef322d862" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
I20260709 13:01:39.820807  8343 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e032c170e06b4392bcd8d1e761820d89"
dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
 from {username='slave'} at 127.0.0.1:47984
I20260709 13:01:39.821558  8545 raft_consensus.cc:740] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Running, Role: LEADER
I20260709 13:01:39.822305  8343 raft_consensus.cc:493] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:39.822741  8343 raft_consensus.cc:3060] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.822817  8545 consensus_queue.cc:260] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.824187  8545 raft_consensus.cc:3060] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.827293  8419 leader_election.cc:290] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 2 election: Requested vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:39.829548  8578 consensus_queue.cc:1048] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.829835  8341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d7875abc644a7e99ebac699897b724" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
I20260709 13:01:39.830454  8341 raft_consensus.cc:3060] T 47d7875abc644a7e99ebac699897b724 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.834548  8490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d7875abc644a7e99ebac699897b724" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
I20260709 13:01:39.833843  8238 catalog_manager.cc:5697] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 reported cstate change: term changed from 1 to 2, leader changed from fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66) to 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65). New cstate: current_term: 2 leader_uuid: "05d5eaee01844183a4bbf46ad7d510b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.835232  8490 raft_consensus.cc:3055] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:39.834869  8492 raft_consensus.cc:515] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.835649  8490 raft_consensus.cc:740] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Running, Role: LEADER
I20260709 13:01:39.838897  8339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f681125f9aff45dbb0d7baf4db8e7d65" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
I20260709 13:01:39.836844  8490 consensus_queue.cc:260] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.844259  8492 leader_election.cc:290] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 2 election: Requested vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051)
I20260709 13:01:39.850554  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f681125f9aff45dbb0d7baf4db8e7d65" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
I20260709 13:01:39.851637  8419 raft_consensus.cc:3055] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:39.851994  8419 raft_consensus.cc:740] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Running, Role: LEADER
I20260709 13:01:39.852864  8419 consensus_queue.cc:260] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.854274  8419 raft_consensus.cc:3060] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.855396  8578 raft_consensus.cc:993] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849: : Instructing follower 05d5eaee01844183a4bbf46ad7d510b2 to start an election
I20260709 13:01:39.855800  8578 raft_consensus.cc:1081] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 1 LEADER]: Signalling peer 05d5eaee01844183a4bbf46ad7d510b2 to start an election
I20260709 13:01:39.821484  8493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff25b46a0ac45b0b845a38ef322d862" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
I20260709 13:01:39.857281  8493 raft_consensus.cc:3060] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.845853  8490 raft_consensus.cc:3060] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.862588  8342 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66045046df98460387504edc93461751"
dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
 from {username='slave'} at 127.0.0.1:47996
I20260709 13:01:39.863919  8342 raft_consensus.cc:493] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:39.864449  8342 raft_consensus.cc:3060] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.870939  8341 raft_consensus.cc:2468] T 47d7875abc644a7e99ebac699897b724 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 2.
I20260709 13:01:39.874959  8343 raft_consensus.cc:515] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } }
I20260709 13:01:39.877372  8490 raft_consensus.cc:2468] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 2.
I20260709 13:01:39.872064  8342 raft_consensus.cc:515] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.880280  8492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e032c170e06b4392bcd8d1e761820d89" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
I20260709 13:01:39.881191  8491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66045046df98460387504edc93461751" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
I20260709 13:01:39.880910  8492 raft_consensus.cc:3060] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.876322  8578 consensus_queue.cc:1048] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.877068  8384 leader_election.cc:304] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 
I20260709 13:01:39.883555  8569 raft_consensus.cc:2804] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:39.884023  8569 raft_consensus.cc:697] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 LEADER]: Becoming Leader. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Running, Role: LEADER
I20260709 13:01:39.884811  8569 consensus_queue.cc:237] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.889287  8491 raft_consensus.cc:3055] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:39.889658  8491 raft_consensus.cc:740] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Running, Role: LEADER
I20260709 13:01:39.890353  8344 raft_consensus.cc:2468] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 2.
I20260709 13:01:39.890727  8491 consensus_queue.cc:260] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.891765  8384 leader_election.cc:304] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 
I20260709 13:01:39.891842  8491 raft_consensus.cc:3060] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.892493  8541 raft_consensus.cc:2804] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:39.892948  8541 raft_consensus.cc:697] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 LEADER]: Becoming Leader. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Running, Role: LEADER
I20260709 13:01:39.893716  8541 consensus_queue.cc:237] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.896462  8343 leader_election.cc:290] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 2 election: Requested vote from peers 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717), fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051)
I20260709 13:01:39.897591  8418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e032c170e06b4392bcd8d1e761820d89" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
I20260709 13:01:39.898108  8418 raft_consensus.cc:3055] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:39.898379  8418 raft_consensus.cc:740] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Running, Role: LEADER
I20260709 13:01:39.890807  8492 raft_consensus.cc:2468] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d5eaee01844183a4bbf46ad7d510b2 in term 2.
I20260709 13:01:39.899076  8418 consensus_queue.cc:260] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } }
I20260709 13:01:39.900444  8418 raft_consensus.cc:3060] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.901356  8309 leader_election.cc:304] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2, 58234c3ebef346d8a52d902fc45e2849; no voters: 
I20260709 13:01:39.902204  8603 raft_consensus.cc:2804] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:39.902678  8603 raft_consensus.cc:697] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 LEADER]: Becoming Leader. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Running, Role: LEADER
I20260709 13:01:39.904421  8493 raft_consensus.cc:2468] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 2.
I20260709 13:01:39.904597  8603 consensus_queue.cc:237] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } }
I20260709 13:01:39.908851  8417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66045046df98460387504edc93461751" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
I20260709 13:01:39.909660  8417 raft_consensus.cc:3060] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.912462  8418 raft_consensus.cc:2468] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d5eaee01844183a4bbf46ad7d510b2 in term 2.
I20260709 13:01:39.915091  8342 leader_election.cc:290] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 2 election: Requested vote from peers fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:39.920295  8417 raft_consensus.cc:2468] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d5eaee01844183a4bbf46ad7d510b2 in term 2.
I20260709 13:01:39.921451  8308 leader_election.cc:304] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 
I20260709 13:01:39.922278  8603 raft_consensus.cc:2804] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:39.922776  8603 raft_consensus.cc:697] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 LEADER]: Becoming Leader. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Running, Role: LEADER
I20260709 13:01:39.923142  8419 raft_consensus.cc:2468] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 2.
I20260709 13:01:39.923610  8603 consensus_queue.cc:237] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.924876  8457 leader_election.cc:304] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58234c3ebef346d8a52d902fc45e2849, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 05d5eaee01844183a4bbf46ad7d510b2
I20260709 13:01:39.926118  8578 raft_consensus.cc:2804] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:39.926576  8578 raft_consensus.cc:697] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [term 2 LEADER]: Becoming Leader. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Running, Role: LEADER
I20260709 13:01:39.927343  8578 consensus_queue.cc:237] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.927770  8238 catalog_manager.cc:5697] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 reported cstate change: term changed from 1 to 2, leader changed from fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66) to 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65). New cstate: current_term: 2 leader_uuid: "05d5eaee01844183a4bbf46ad7d510b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.921871  8491 raft_consensus.cc:2468] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d5eaee01844183a4bbf46ad7d510b2 in term 2.
I20260709 13:01:39.935581  8578 consensus_queue.cc:1048] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.939230  8240 catalog_manager.cc:5697] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 reported cstate change: term changed from 1 to 2, leader changed from 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65) to fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66). New cstate: current_term: 2 leader_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.941124  8240 catalog_manager.cc:5697] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 reported cstate change: term changed from 1 to 2, leader changed from 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67) to fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66). New cstate: current_term: 2 leader_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.948561  8241 catalog_manager.cc:5697] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 reported cstate change: term changed from 1 to 2, leader changed from fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66) to 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67). New cstate: current_term: 2 leader_uuid: "58234c3ebef346d8a52d902fc45e2849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.951027  8576 consensus_queue.cc:1048] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.956077  8545 raft_consensus.cc:993] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2: : Instructing follower fb98dfdb6a744e83a251ee52b2799ff8 to start an election
I20260709 13:01:39.956516  8545 raft_consensus.cc:1081] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 LEADER]: Signalling peer fb98dfdb6a744e83a251ee52b2799ff8 to start an election
I20260709 13:01:39.959937  8418 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ae145501f22403da5cc68d69af63915"
dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
 from {username='slave'} at 127.0.0.1:56252
I20260709 13:01:39.960755  8418 raft_consensus.cc:493] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:39.961371  8418 raft_consensus.cc:3060] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.966681  8578 raft_consensus.cc:993] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849: : Instructing follower fb98dfdb6a744e83a251ee52b2799ff8 to start an election
I20260709 13:01:39.971652  8238 catalog_manager.cc:5697] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 reported cstate change: term changed from 1 to 2, leader changed from 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67) to 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65). New cstate: current_term: 2 leader_uuid: "05d5eaee01844183a4bbf46ad7d510b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.971486  8578 raft_consensus.cc:1081] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 1 LEADER]: Signalling peer fb98dfdb6a744e83a251ee52b2799ff8 to start an election
I20260709 13:01:39.982051  8419 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8936128622840c0bd58170c0d7658e6"
dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
 from {username='slave'} at 127.0.0.1:56254
I20260709 13:01:39.982844  8419 raft_consensus.cc:493] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:39.983367  8419 raft_consensus.cc:3060] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.996447  8419 raft_consensus.cc:515] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.969799  8418 raft_consensus.cc:515] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:39.999089  8419 leader_election.cc:290] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 2 election: Requested vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:39.999773  8418 leader_election.cc:290] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 2 election: Requested vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:40.001945  8343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8936128622840c0bd58170c0d7658e6" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
I20260709 13:01:40.002103  8491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8936128622840c0bd58170c0d7658e6" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
I20260709 13:01:40.002740  8491 raft_consensus.cc:3055] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:40.003127  8491 raft_consensus.cc:740] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Running, Role: LEADER
I20260709 13:01:40.003937  8342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae145501f22403da5cc68d69af63915" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
I20260709 13:01:40.004050  8491 consensus_queue.cc:260] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:40.004629  8342 raft_consensus.cc:3055] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:40.004971  8342 raft_consensus.cc:740] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Running, Role: LEADER
I20260709 13:01:40.005455  8491 raft_consensus.cc:3060] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.005834  8342 consensus_queue.cc:260] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:40.007038  8342 raft_consensus.cc:3060] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.009297  8343 raft_consensus.cc:3060] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.011945  8493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae145501f22403da5cc68d69af63915" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
I20260709 13:01:40.012562  8493 raft_consensus.cc:3060] T 9ae145501f22403da5cc68d69af63915 P 58234c3ebef346d8a52d902fc45e2849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.016523  8342 raft_consensus.cc:2468] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 2.
I20260709 13:01:40.016640  8343 raft_consensus.cc:2468] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 2.
I20260709 13:01:40.018220  8384 leader_election.cc:304] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 
I20260709 13:01:40.019003  8541 raft_consensus.cc:2804] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:40.019455  8493 raft_consensus.cc:2468] T 9ae145501f22403da5cc68d69af63915 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 2.
I20260709 13:01:40.019526  8541 raft_consensus.cc:697] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 LEADER]: Becoming Leader. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Running, Role: LEADER
I20260709 13:01:40.019959  8491 raft_consensus.cc:2468] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 2.
I20260709 13:01:40.020674  8384 leader_election.cc:304] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 
I20260709 13:01:40.020529  8541 consensus_queue.cc:237] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:40.021670  8569 raft_consensus.cc:2804] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:40.022148  8569 raft_consensus.cc:697] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 LEADER]: Becoming Leader. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Running, Role: LEADER
I20260709 13:01:40.022972  8569 consensus_queue.cc:237] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:40.030634  8240 catalog_manager.cc:5697] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 reported cstate change: term changed from 1 to 2, leader changed from 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65) to fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66). New cstate: current_term: 2 leader_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.044812  8240 catalog_manager.cc:5697] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 reported cstate change: term changed from 1 to 2, leader changed from 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67) to fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66). New cstate: current_term: 2 leader_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.168298  8419 raft_consensus.cc:3060] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.173314  8419 raft_consensus.cc:1275] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Refusing update from remote peer 05d5eaee01844183a4bbf46ad7d510b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.174693  8545 consensus_queue.cc:1048] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.182727  8493 raft_consensus.cc:1275] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Refusing update from remote peer 05d5eaee01844183a4bbf46ad7d510b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.184811  8568 consensus_queue.cc:1048] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.251113  8419 raft_consensus.cc:1275] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Refusing update from remote peer 05d5eaee01844183a4bbf46ad7d510b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.252743  8603 consensus_queue.cc:1048] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.260887  8493 raft_consensus.cc:1275] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Refusing update from remote peer 05d5eaee01844183a4bbf46ad7d510b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.262866  8545 consensus_queue.cc:1048] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.291020  8342 raft_consensus.cc:1275] T 47d7875abc644a7e99ebac699897b724 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Refusing update from remote peer fb98dfdb6a744e83a251ee52b2799ff8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.292474  8541 consensus_queue.cc:1048] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.302772  8493 raft_consensus.cc:1275] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Refusing update from remote peer fb98dfdb6a744e83a251ee52b2799ff8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.305814  8419 raft_consensus.cc:1275] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Refusing update from remote peer 05d5eaee01844183a4bbf46ad7d510b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.306676  8569 consensus_queue.cc:1048] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.308363  8603 consensus_queue.cc:1048] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.308843  8493 raft_consensus.cc:1275] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Refusing update from remote peer 05d5eaee01844183a4bbf46ad7d510b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.310201  8603 consensus_queue.cc:1048] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.336031  8419 raft_consensus.cc:1275] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Refusing update from remote peer 05d5eaee01844183a4bbf46ad7d510b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.337698  8603 consensus_queue.cc:1048] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:40.348169  8491 raft_consensus.cc:1275] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Refusing update from remote peer 05d5eaee01844183a4bbf46ad7d510b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.349821  8545 consensus_queue.cc:1048] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.421806  8342 raft_consensus.cc:1275] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Refusing update from remote peer fb98dfdb6a744e83a251ee52b2799ff8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.423193  8569 consensus_queue.cc:1048] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.436569  8491 raft_consensus.cc:1275] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Refusing update from remote peer fb98dfdb6a744e83a251ee52b2799ff8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.439325  8569 consensus_queue.cc:1048] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.454875  8342 raft_consensus.cc:1275] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Refusing update from remote peer fb98dfdb6a744e83a251ee52b2799ff8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.456146  8569 consensus_queue.cc:1048] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.464435  8491 raft_consensus.cc:1275] T 9ae145501f22403da5cc68d69af63915 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Refusing update from remote peer fb98dfdb6a744e83a251ee52b2799ff8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.465721  8570 consensus_queue.cc:1048] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.491657  8342 raft_consensus.cc:1275] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Refusing update from remote peer fb98dfdb6a744e83a251ee52b2799ff8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.493144  8541 consensus_queue.cc:1048] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.498659  8419 raft_consensus.cc:1275] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Refusing update from remote peer 58234c3ebef346d8a52d902fc45e2849: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.500514  8611 consensus_queue.cc:1048] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.501108  8491 raft_consensus.cc:1275] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Refusing update from remote peer fb98dfdb6a744e83a251ee52b2799ff8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.502722  8569 consensus_queue.cc:1048] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.505149  8343 raft_consensus.cc:3060] T f681125f9aff45dbb0d7baf4db8e7d65 P 05d5eaee01844183a4bbf46ad7d510b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.514129  8343 raft_consensus.cc:1275] T f681125f9aff45dbb0d7baf4db8e7d65 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Refusing update from remote peer 58234c3ebef346d8a52d902fc45e2849: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.516399  8611 consensus_queue.cc:1048] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:42.700863  8209 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:01:42.701833  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:42.723814  8418 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ff25b46a0ac45b0b845a38ef322d862"
dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
mode: GRACEFUL
new_leader_uuid: "58234c3ebef346d8a52d902fc45e2849"
 from {username='slave'} at 127.0.0.1:56268
I20260709 13:01:42.724319  8418 raft_consensus.cc:606] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 LEADER]: Received request to transfer leadership to TS 58234c3ebef346d8a52d902fc45e2849
I20260709 13:01:42.735244  8343 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c251a30c42f24625b0df1be970faa534"
dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
mode: GRACEFUL
new_leader_uuid: "58234c3ebef346d8a52d902fc45e2849"
 from {username='slave'} at 127.0.0.1:48008
I20260709 13:01:42.735791  8343 raft_consensus.cc:606] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 LEADER]: Received request to transfer leadership to TS 58234c3ebef346d8a52d902fc45e2849
I20260709 13:01:42.736975  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:01:42.737458  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:42.965114  8569 raft_consensus.cc:993] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8: : Instructing follower 58234c3ebef346d8a52d902fc45e2849 to start an election
I20260709 13:01:42.965602  8569 raft_consensus.cc:1081] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 LEADER]: Signalling peer 58234c3ebef346d8a52d902fc45e2849 to start an election
I20260709 13:01:42.967301  8493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ff25b46a0ac45b0b845a38ef322d862"
dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
 from {username='slave'} at 127.0.0.1:39724
I20260709 13:01:42.967796  8493 raft_consensus.cc:493] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:42.968116  8493 raft_consensus.cc:3060] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.972680  8493 raft_consensus.cc:515] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:42.974526  8493 leader_election.cc:290] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 3 election: Requested vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051)
I20260709 13:01:42.975543  8418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff25b46a0ac45b0b845a38ef322d862" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
I20260709 13:01:42.975543  8343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff25b46a0ac45b0b845a38ef322d862" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
I20260709 13:01:42.976416  8343 raft_consensus.cc:3060] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.976405  8418 raft_consensus.cc:3055] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:42.976977  8418 raft_consensus.cc:740] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Running, Role: LEADER
I20260709 13:01:42.977880  8418 consensus_queue.cc:260] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:42.979074  8418 raft_consensus.cc:3060] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.983588  8343 raft_consensus.cc:2468] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 3.
I20260709 13:01:42.985183  8458 leader_election.cc:304] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2, 58234c3ebef346d8a52d902fc45e2849; no voters: 
I20260709 13:01:42.985517  8418 raft_consensus.cc:2468] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 3.
I20260709 13:01:42.985929  8633 raft_consensus.cc:2804] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:42.987390  8633 raft_consensus.cc:697] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [term 3 LEADER]: Becoming Leader. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Running, Role: LEADER
I20260709 13:01:42.988147  8633 consensus_queue.cc:237] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:42.997205  8240 catalog_manager.cc:5697] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 reported cstate change: term changed from 2 to 3, leader changed from fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66) to 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67). New cstate: current_term: 3 leader_uuid: "58234c3ebef346d8a52d902fc45e2849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:43.082785  8632 raft_consensus.cc:993] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2: : Instructing follower 58234c3ebef346d8a52d902fc45e2849 to start an election
I20260709 13:01:43.083182  8638 raft_consensus.cc:1081] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 LEADER]: Signalling peer 58234c3ebef346d8a52d902fc45e2849 to start an election
I20260709 13:01:43.084645  8493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c251a30c42f24625b0df1be970faa534"
dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
 from {username='slave'} at 127.0.0.1:39718
I20260709 13:01:43.085148  8493 raft_consensus.cc:493] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:43.085470  8493 raft_consensus.cc:3060] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.090047  8493 raft_consensus.cc:515] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:43.091864  8493 leader_election.cc:290] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 3 election: Requested vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051)
I20260709 13:01:43.092679  8343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c251a30c42f24625b0df1be970faa534" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
I20260709 13:01:43.092947  8418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c251a30c42f24625b0df1be970faa534" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
I20260709 13:01:43.093355  8343 raft_consensus.cc:3055] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:43.093555  8418 raft_consensus.cc:3060] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.093698  8343 raft_consensus.cc:740] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Running, Role: LEADER
I20260709 13:01:43.094480  8343 consensus_queue.cc:260] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:43.095384  8343 raft_consensus.cc:3060] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.098515  8418 raft_consensus.cc:2468] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 3.
I20260709 13:01:43.099712  8457 leader_election.cc:304] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58234c3ebef346d8a52d902fc45e2849, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 
I20260709 13:01:43.100670  8633 raft_consensus.cc:2804] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:43.100941  8343 raft_consensus.cc:2468] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 3.
I20260709 13:01:43.101167  8633 raft_consensus.cc:697] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 3 LEADER]: Becoming Leader. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Running, Role: LEADER
I20260709 13:01:43.101951  8633 consensus_queue.cc:237] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:43.108275  8240 catalog_manager.cc:5697] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 reported cstate change: term changed from 2 to 3, leader changed from 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65) to 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67). New cstate: current_term: 3 leader_uuid: "58234c3ebef346d8a52d902fc45e2849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:43.461464  8343 raft_consensus.cc:1275] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Refusing update from remote peer 58234c3ebef346d8a52d902fc45e2849: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:43.462823  8633 consensus_queue.cc:1048] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:43.474232  8418 raft_consensus.cc:1275] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Refusing update from remote peer 58234c3ebef346d8a52d902fc45e2849: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:43.476414  8649 consensus_queue.cc:1048] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:43.644097  8343 raft_consensus.cc:1275] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Refusing update from remote peer 58234c3ebef346d8a52d902fc45e2849: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:43.645603  8649 consensus_queue.cc:1048] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:43.654768  8418 raft_consensus.cc:1275] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Refusing update from remote peer 58234c3ebef346d8a52d902fc45e2849: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:43.656414  8649 consensus_queue.cc:1048] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:43.738325  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:43.749379  8343 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e032c170e06b4392bcd8d1e761820d89"
dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
mode: GRACEFUL
new_leader_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
 from {username='slave'} at 127.0.0.1:48004
I20260709 13:01:43.750061  8343 raft_consensus.cc:606] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 LEADER]: Received request to transfer leadership to TS fb98dfdb6a744e83a251ee52b2799ff8
I20260709 13:01:43.755535  8493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c251a30c42f24625b0df1be970faa534"
dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
mode: GRACEFUL
new_leader_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
 from {username='slave'} at 127.0.0.1:39734
I20260709 13:01:43.756139  8493 raft_consensus.cc:606] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 3 LEADER]: Received request to transfer leadership to TS fb98dfdb6a744e83a251ee52b2799ff8
I20260709 13:01:43.761490  8343 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66045046df98460387504edc93461751"
dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
mode: GRACEFUL
new_leader_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
 from {username='slave'} at 127.0.0.1:48004
I20260709 13:01:43.762130  8343 raft_consensus.cc:606] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 LEADER]: Received request to transfer leadership to TS fb98dfdb6a744e83a251ee52b2799ff8
I20260709 13:01:43.767926  8343 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c00c12c99811434db59727d5ad24f6be"
dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
mode: GRACEFUL
new_leader_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
 from {username='slave'} at 127.0.0.1:48004
I20260709 13:01:43.768586  8343 raft_consensus.cc:606] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 LEADER]: Received request to transfer leadership to TS fb98dfdb6a744e83a251ee52b2799ff8
I20260709 13:01:43.780735  8493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ff25b46a0ac45b0b845a38ef322d862"
dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
mode: GRACEFUL
new_leader_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
 from {username='slave'} at 127.0.0.1:39734
I20260709 13:01:43.781314  8493 raft_consensus.cc:606] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [term 3 LEADER]: Received request to transfer leadership to TS fb98dfdb6a744e83a251ee52b2799ff8
I20260709 13:01:43.821208  8638 raft_consensus.cc:993] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2: : Instructing follower fb98dfdb6a744e83a251ee52b2799ff8 to start an election
I20260709 13:01:43.821686  8655 raft_consensus.cc:1081] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 LEADER]: Signalling peer fb98dfdb6a744e83a251ee52b2799ff8 to start an election
I20260709 13:01:43.823546  8418 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66045046df98460387504edc93461751"
dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
 from {username='slave'} at 127.0.0.1:56252
I20260709 13:01:43.824041  8418 raft_consensus.cc:493] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:43.824337  8418 raft_consensus.cc:3060] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.829312  8418 raft_consensus.cc:515] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:43.831270  8418 leader_election.cc:290] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 3 election: Requested vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:43.832376  8493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66045046df98460387504edc93461751" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
I20260709 13:01:43.832405  8343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66045046df98460387504edc93461751" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
I20260709 13:01:43.832908  8493 raft_consensus.cc:3060] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.833189  8343 raft_consensus.cc:3055] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:43.833586  8343 raft_consensus.cc:740] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Running, Role: LEADER
I20260709 13:01:43.834308  8343 consensus_queue.cc:260] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:43.835403  8343 raft_consensus.cc:3060] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.837785  8493 raft_consensus.cc:2468] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 3.
I20260709 13:01:43.838927  8384 leader_election.cc:304] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58234c3ebef346d8a52d902fc45e2849, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 
I20260709 13:01:43.839782  8569 raft_consensus.cc:2804] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:43.840852  8343 raft_consensus.cc:2468] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 3.
I20260709 13:01:43.840981  8569 raft_consensus.cc:697] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 LEADER]: Becoming Leader. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Running, Role: LEADER
I20260709 13:01:43.842092  8569 consensus_queue.cc:237] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:43.849879  8238 catalog_manager.cc:5697] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 reported cstate change: term changed from 2 to 3, leader changed from 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65) to fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66). New cstate: current_term: 3 leader_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:43.932315  8638 raft_consensus.cc:993] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2: : Instructing follower fb98dfdb6a744e83a251ee52b2799ff8 to start an election
I20260709 13:01:43.932962  8655 raft_consensus.cc:1081] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 LEADER]: Signalling peer fb98dfdb6a744e83a251ee52b2799ff8 to start an election
I20260709 13:01:43.934759  8418 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e032c170e06b4392bcd8d1e761820d89"
dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
 from {username='slave'} at 127.0.0.1:56252
I20260709 13:01:43.935194  8633 raft_consensus.cc:993] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849: : Instructing follower fb98dfdb6a744e83a251ee52b2799ff8 to start an election
I20260709 13:01:43.935364  8418 raft_consensus.cc:493] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:43.935824  8653 raft_consensus.cc:1081] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [term 3 LEADER]: Signalling peer fb98dfdb6a744e83a251ee52b2799ff8 to start an election
I20260709 13:01:43.935808  8418 raft_consensus.cc:3060] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.937813  8419 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ff25b46a0ac45b0b845a38ef322d862"
dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
 from {username='slave'} at 127.0.0.1:56254
I20260709 13:01:43.938438  8419 raft_consensus.cc:493] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:43.938796  8419 raft_consensus.cc:3060] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:43.941645  8418 raft_consensus.cc:515] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } }
I20260709 13:01:43.943585  8418 leader_election.cc:290] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 3 election: Requested vote from peers 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717), 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295)
I20260709 13:01:43.944932  8342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e032c170e06b4392bcd8d1e761820d89" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
I20260709 13:01:43.945313  8493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e032c170e06b4392bcd8d1e761820d89" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
I20260709 13:01:43.945679  8342 raft_consensus.cc:3055] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:43.945945  8493 raft_consensus.cc:3060] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.945644  8419 raft_consensus.cc:515] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:43.946226  8342 raft_consensus.cc:740] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Running, Role: LEADER
I20260709 13:01:43.947644  8419 leader_election.cc:290] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 4 election: Requested vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:43.947211  8342 consensus_queue.cc:260] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } }
I20260709 13:01:43.948668  8342 raft_consensus.cc:3060] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.948791  8343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff25b46a0ac45b0b845a38ef322d862" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
I20260709 13:01:43.949450  8343 raft_consensus.cc:3060] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:43.949875  8491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff25b46a0ac45b0b845a38ef322d862" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
I20260709 13:01:43.950778  8491 raft_consensus.cc:3055] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:43.951134  8491 raft_consensus.cc:740] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Running, Role: LEADER
I20260709 13:01:43.951980  8491 consensus_queue.cc:260] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:43.953125  8493 raft_consensus.cc:2468] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 3.
I20260709 13:01:43.953405  8491 raft_consensus.cc:3060] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:43.954690  8384 leader_election.cc:304] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58234c3ebef346d8a52d902fc45e2849, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 
I20260709 13:01:43.955623  8569 raft_consensus.cc:2804] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:43.956321  8569 raft_consensus.cc:697] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 LEADER]: Becoming Leader. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Running, Role: LEADER
I20260709 13:01:43.957226  8569 consensus_queue.cc:237] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } }
I20260709 13:01:43.957758  8343 raft_consensus.cc:2468] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 4.
I20260709 13:01:43.959390  8384 leader_election.cc:304] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 
I20260709 13:01:43.960399  8656 raft_consensus.cc:2804] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:43.960457  8342 raft_consensus.cc:2468] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 3.
I20260709 13:01:43.962607  8656 raft_consensus.cc:697] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 4 LEADER]: Becoming Leader. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Running, Role: LEADER
I20260709 13:01:43.962688  8491 raft_consensus.cc:2468] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 4.
I20260709 13:01:43.963709  8656 consensus_queue.cc:237] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:43.968117  8238 catalog_manager.cc:5697] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 reported cstate change: term changed from 2 to 3, leader changed from 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65) to fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66). New cstate: current_term: 3 leader_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:43.980255  8238 catalog_manager.cc:5697] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 reported cstate change: term changed from 3 to 4, leader changed from 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67) to fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66). New cstate: current_term: 4 leader_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:43.984612  8638 raft_consensus.cc:993] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2: : Instructing follower fb98dfdb6a744e83a251ee52b2799ff8 to start an election
I20260709 13:01:43.985174  8655 raft_consensus.cc:1081] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 LEADER]: Signalling peer fb98dfdb6a744e83a251ee52b2799ff8 to start an election
I20260709 13:01:43.986829  8419 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c00c12c99811434db59727d5ad24f6be"
dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
 from {username='slave'} at 127.0.0.1:56252
I20260709 13:01:43.987286  8419 raft_consensus.cc:493] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:43.987617  8419 raft_consensus.cc:3060] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.992551  8419 raft_consensus.cc:515] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:43.994303  8419 leader_election.cc:290] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 3 election: Requested vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:43.995237  8343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c00c12c99811434db59727d5ad24f6be" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
I20260709 13:01:43.995877  8491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c00c12c99811434db59727d5ad24f6be" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
I20260709 13:01:43.996213  8343 raft_consensus.cc:3055] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:43.996465  8491 raft_consensus.cc:3060] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.996606  8343 raft_consensus.cc:740] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Running, Role: LEADER
I20260709 13:01:43.997417  8343 consensus_queue.cc:260] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:43.998422  8343 raft_consensus.cc:3060] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:44.001768  8491 raft_consensus.cc:2468] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 3.
I20260709 13:01:44.002815  8384 leader_election.cc:304] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58234c3ebef346d8a52d902fc45e2849, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 
I20260709 13:01:44.002878  8343 raft_consensus.cc:2468] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 3.
I20260709 13:01:44.003537  8656 raft_consensus.cc:2804] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:44.004048  8656 raft_consensus.cc:697] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 LEADER]: Becoming Leader. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Running, Role: LEADER
I20260709 13:01:44.004865  8656 consensus_queue.cc:237] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:44.011281  8238 catalog_manager.cc:5697] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 reported cstate change: term changed from 2 to 3, leader changed from 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65) to fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66). New cstate: current_term: 3 leader_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:44.253185  8343 raft_consensus.cc:1275] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Refusing update from remote peer fb98dfdb6a744e83a251ee52b2799ff8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:44.253371  8649 raft_consensus.cc:993] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849: : Instructing follower fb98dfdb6a744e83a251ee52b2799ff8 to start an election
I20260709 13:01:44.253926  8653 raft_consensus.cc:1081] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 3 LEADER]: Signalling peer fb98dfdb6a744e83a251ee52b2799ff8 to start an election
I20260709 13:01:44.254606  8656 consensus_queue.cc:1048] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:44.255789  8419 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c251a30c42f24625b0df1be970faa534"
dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
 from {username='slave'} at 127.0.0.1:56254
I20260709 13:01:44.256435  8419 raft_consensus.cc:493] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:44.256747  8419 raft_consensus.cc:3060] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:44.268368  8419 raft_consensus.cc:515] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:44.270962  8419 leader_election.cc:290] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 4 election: Requested vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:44.273470  8491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c251a30c42f24625b0df1be970faa534" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
I20260709 13:01:44.274135  8491 raft_consensus.cc:3055] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:44.274477  8491 raft_consensus.cc:740] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Running, Role: LEADER
I20260709 13:01:44.274514  8343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c251a30c42f24625b0df1be970faa534" candidate_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
I20260709 13:01:44.275110  8343 raft_consensus.cc:3060] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:44.275379  8491 consensus_queue.cc:260] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:44.275971  8493 raft_consensus.cc:1275] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 3 FOLLOWER]: Refusing update from remote peer fb98dfdb6a744e83a251ee52b2799ff8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:44.276692  8491 raft_consensus.cc:3060] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:44.278112  8656 consensus_queue.cc:1048] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:44.284785  8491 raft_consensus.cc:2468] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 4.
I20260709 13:01:44.286233  8384 leader_election.cc:304] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58234c3ebef346d8a52d902fc45e2849, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 
I20260709 13:01:44.287391  8569 raft_consensus.cc:2804] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:44.288247  8569 raft_consensus.cc:697] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 4 LEADER]: Becoming Leader. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Running, Role: LEADER
I20260709 13:01:44.289178  8569 consensus_queue.cc:237] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:44.290126  8343 raft_consensus.cc:2468] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb98dfdb6a744e83a251ee52b2799ff8 in term 4.
I20260709 13:01:44.300134  8238 catalog_manager.cc:5697] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 reported cstate change: term changed from 3 to 4, leader changed from 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67) to fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66). New cstate: current_term: 4 leader_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:44.357924  8493 raft_consensus.cc:1275] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [term 4 FOLLOWER]: Refusing update from remote peer fb98dfdb6a744e83a251ee52b2799ff8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:44.359386  8656 consensus_queue.cc:1048] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:44.366947  8343 raft_consensus.cc:1275] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 4 FOLLOWER]: Refusing update from remote peer fb98dfdb6a744e83a251ee52b2799ff8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:44.368440  8656 consensus_queue.cc:1048] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:44.384430  8493 raft_consensus.cc:1275] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849 [term 3 FOLLOWER]: Refusing update from remote peer fb98dfdb6a744e83a251ee52b2799ff8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:44.385687  8569 consensus_queue.cc:1048] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:44.395044  8343 raft_consensus.cc:1275] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Refusing update from remote peer fb98dfdb6a744e83a251ee52b2799ff8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:44.396347  8656 consensus_queue.cc:1048] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:44.511827  8343 raft_consensus.cc:1275] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Refusing update from remote peer fb98dfdb6a744e83a251ee52b2799ff8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:44.513541  8569 consensus_queue.cc:1048] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:44.516049  8493 raft_consensus.cc:1275] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 3 FOLLOWER]: Refusing update from remote peer fb98dfdb6a744e83a251ee52b2799ff8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:44.517531  8656 consensus_queue.cc:1048] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:44.744678  8343 raft_consensus.cc:1275] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 4 FOLLOWER]: Refusing update from remote peer fb98dfdb6a744e83a251ee52b2799ff8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:44.746126  8569 consensus_queue.cc:1048] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:44.756822  8493 raft_consensus.cc:1275] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 4 FOLLOWER]: Refusing update from remote peer fb98dfdb6a744e83a251ee52b2799ff8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:44.759115  8656 consensus_queue.cc:1048] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:46.826232  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:46.833400  8419 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66045046df98460387504edc93461751"
dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
mode: GRACEFUL
new_leader_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
 from {username='slave'} at 127.0.0.1:56268
I20260709 13:01:46.834201  8419 raft_consensus.cc:606] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 LEADER]: Received request to transfer leadership to TS 05d5eaee01844183a4bbf46ad7d510b2
I20260709 13:01:46.837195  8419 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ae145501f22403da5cc68d69af63915"
dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
mode: GRACEFUL
new_leader_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
 from {username='slave'} at 127.0.0.1:56268
I20260709 13:01:46.837730  8419 raft_consensus.cc:606] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 LEADER]: Received request to transfer leadership to TS 05d5eaee01844183a4bbf46ad7d510b2
I20260709 13:01:46.840457  8419 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c00c12c99811434db59727d5ad24f6be"
dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
mode: GRACEFUL
new_leader_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
 from {username='slave'} at 127.0.0.1:56268
I20260709 13:01:46.840945  8419 raft_consensus.cc:606] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 LEADER]: Received request to transfer leadership to TS 05d5eaee01844183a4bbf46ad7d510b2
I20260709 13:01:46.843385  8419 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c251a30c42f24625b0df1be970faa534"
dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
mode: GRACEFUL
new_leader_uuid: "58234c3ebef346d8a52d902fc45e2849"
 from {username='slave'} at 127.0.0.1:56268
I20260709 13:01:46.843883  8419 raft_consensus.cc:606] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 4 LEADER]: Received request to transfer leadership to TS 58234c3ebef346d8a52d902fc45e2849
I20260709 13:01:46.846441  8419 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8936128622840c0bd58170c0d7658e6"
dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
mode: GRACEFUL
new_leader_uuid: "58234c3ebef346d8a52d902fc45e2849"
 from {username='slave'} at 127.0.0.1:56268
I20260709 13:01:46.846876  8419 raft_consensus.cc:606] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 LEADER]: Received request to transfer leadership to TS 58234c3ebef346d8a52d902fc45e2849
I20260709 13:01:46.847944  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:46.848449  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:46.947939  8684 raft_consensus.cc:993] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8: : Instructing follower 58234c3ebef346d8a52d902fc45e2849 to start an election
I20260709 13:01:46.948554  8680 raft_consensus.cc:1081] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 4 LEADER]: Signalling peer 58234c3ebef346d8a52d902fc45e2849 to start an election
I20260709 13:01:46.950269  8488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c251a30c42f24625b0df1be970faa534"
dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
 from {username='slave'} at 127.0.0.1:39724
I20260709 13:01:46.950901  8488 raft_consensus.cc:493] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:46.951237  8488 raft_consensus.cc:3060] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:46.956882  8488 raft_consensus.cc:515] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:46.959372  8488 leader_election.cc:290] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 5 election: Requested vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051)
I20260709 13:01:46.960348  8342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c251a30c42f24625b0df1be970faa534" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
I20260709 13:01:46.960793  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c251a30c42f24625b0df1be970faa534" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
I20260709 13:01:46.961184  8342 raft_consensus.cc:3060] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:46.961329  8419 raft_consensus.cc:3055] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:46.961668  8419 raft_consensus.cc:740] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Running, Role: LEADER
I20260709 13:01:46.962491  8419 consensus_queue.cc:260] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:46.963738  8419 raft_consensus.cc:3060] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:46.968384  8342 raft_consensus.cc:2468] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 5.
I20260709 13:01:46.969764  8458 leader_election.cc:304] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2, 58234c3ebef346d8a52d902fc45e2849; no voters: 
I20260709 13:01:46.970127  8419 raft_consensus.cc:2468] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 5.
I20260709 13:01:46.970652  8677 raft_consensus.cc:2804] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:46.971844  8677 raft_consensus.cc:697] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 5 LEADER]: Becoming Leader. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Running, Role: LEADER
I20260709 13:01:46.972764  8677 consensus_queue.cc:237] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:46.982851  8240 catalog_manager.cc:5697] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 reported cstate change: term changed from 4 to 5, leader changed from fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66) to 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67). New cstate: current_term: 5 leader_uuid: "58234c3ebef346d8a52d902fc45e2849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:47.084900  8272 debug-util.cc:398] Leaking SignalData structure 0x7b0800062060 after lost signal to thread 8212
W20260709 13:01:47.085800  8272 debug-util.cc:398] Leaking SignalData structure 0x7b0800062740 after lost signal to thread 8275
W20260709 13:01:47.086561  8272 debug-util.cc:398] Leaking SignalData structure 0x7b080003fd80 after lost signal to thread 8368
W20260709 13:01:47.087258  8272 debug-util.cc:398] Leaking SignalData structure 0x7b08001c9ee0 after lost signal to thread 8443
W20260709 13:01:47.087924  8272 debug-util.cc:398] Leaking SignalData structure 0x7b08001ef380 after lost signal to thread 8517
I20260709 13:01:47.262449  8684 raft_consensus.cc:993] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8: : Instructing follower 05d5eaee01844183a4bbf46ad7d510b2 to start an election
I20260709 13:01:47.262979  8680 raft_consensus.cc:1081] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 LEADER]: Signalling peer 05d5eaee01844183a4bbf46ad7d510b2 to start an election
I20260709 13:01:47.264909  8342 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c00c12c99811434db59727d5ad24f6be"
dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
 from {username='slave'} at 127.0.0.1:47984
I20260709 13:01:47.265475  8342 raft_consensus.cc:493] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:47.265930  8342 raft_consensus.cc:3060] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:47.269609  8684 raft_consensus.cc:993] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8: : Instructing follower 05d5eaee01844183a4bbf46ad7d510b2 to start an election
I20260709 13:01:47.270120  8684 raft_consensus.cc:1081] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 LEADER]: Signalling peer 05d5eaee01844183a4bbf46ad7d510b2 to start an election
I20260709 13:01:47.272287  8344 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ae145501f22403da5cc68d69af63915"
dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
 from {username='slave'} at 127.0.0.1:47984
I20260709 13:01:47.272557  8342 raft_consensus.cc:515] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:47.273046  8344 raft_consensus.cc:493] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:47.273595  8344 raft_consensus.cc:3060] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:47.274984  8342 leader_election.cc:290] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 4 election: Requested vote from peers fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:47.275818  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c00c12c99811434db59727d5ad24f6be" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
I20260709 13:01:47.276460  8419 raft_consensus.cc:3055] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:47.276749  8419 raft_consensus.cc:740] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Running, Role: LEADER
I20260709 13:01:47.277354  8488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c00c12c99811434db59727d5ad24f6be" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
I20260709 13:01:47.277580  8419 consensus_queue.cc:260] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:47.277962  8488 raft_consensus.cc:3060] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:47.278728  8419 raft_consensus.cc:3060] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:47.283483  8344 raft_consensus.cc:515] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:47.285833  8488 raft_consensus.cc:2468] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d5eaee01844183a4bbf46ad7d510b2 in term 4.
I20260709 13:01:47.287254  8419 raft_consensus.cc:2468] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d5eaee01844183a4bbf46ad7d510b2 in term 4.
I20260709 13:01:47.287978  8418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae145501f22403da5cc68d69af63915" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
I20260709 13:01:47.288072  8309 leader_election.cc:304] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2, 58234c3ebef346d8a52d902fc45e2849; no voters: 
I20260709 13:01:47.288610  8418 raft_consensus.cc:3055] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:47.288976  8418 raft_consensus.cc:740] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Running, Role: LEADER
I20260709 13:01:47.289532  8488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae145501f22403da5cc68d69af63915" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
I20260709 13:01:47.290103  8488 raft_consensus.cc:3060] T 9ae145501f22403da5cc68d69af63915 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:47.289894  8418 consensus_queue.cc:260] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:47.291046  8418 raft_consensus.cc:3060] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:47.293141  8344 leader_election.cc:290] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 3 election: Requested vote from peers fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:47.299013  8488 raft_consensus.cc:2468] T 9ae145501f22403da5cc68d69af63915 P 58234c3ebef346d8a52d902fc45e2849 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d5eaee01844183a4bbf46ad7d510b2 in term 3.
I20260709 13:01:47.299046  8418 raft_consensus.cc:2468] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d5eaee01844183a4bbf46ad7d510b2 in term 3.
I20260709 13:01:47.301977  8308 leader_election.cc:304] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 
I20260709 13:01:47.302817  8691 raft_consensus.cc:2804] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:47.306448  8692 raft_consensus.cc:2804] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:47.314399  8692 raft_consensus.cc:697] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 LEADER]: Becoming Leader. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Running, Role: LEADER
I20260709 13:01:47.316570  8692 consensus_queue.cc:237] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:47.332106  8680 raft_consensus.cc:993] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8: : Instructing follower 05d5eaee01844183a4bbf46ad7d510b2 to start an election
I20260709 13:01:47.334254  8696 raft_consensus.cc:1081] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 LEADER]: Signalling peer 05d5eaee01844183a4bbf46ad7d510b2 to start an election
I20260709 13:01:47.337946  8344 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66045046df98460387504edc93461751"
dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
 from {username='slave'} at 127.0.0.1:47984
I20260709 13:01:47.338311  8691 raft_consensus.cc:697] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 4 LEADER]: Becoming Leader. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Running, Role: LEADER
I20260709 13:01:47.338749  8344 raft_consensus.cc:493] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:47.339237  8344 raft_consensus.cc:3060] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:47.339296  8691 consensus_queue.cc:237] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:47.341477  8684 raft_consensus.cc:993] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8: : Instructing follower 58234c3ebef346d8a52d902fc45e2849 to start an election
I20260709 13:01:47.342031  8684 raft_consensus.cc:1081] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 LEADER]: Signalling peer 58234c3ebef346d8a52d902fc45e2849 to start an election
I20260709 13:01:47.343735  8488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8936128622840c0bd58170c0d7658e6"
dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
 from {username='slave'} at 127.0.0.1:39724
I20260709 13:01:47.344350  8488 raft_consensus.cc:493] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:47.344789  8488 raft_consensus.cc:3060] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:47.348009  8344 raft_consensus.cc:515] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:47.350909  8418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66045046df98460387504edc93461751" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
I20260709 13:01:47.351534  8418 raft_consensus.cc:3055] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:47.351863  8418 raft_consensus.cc:740] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Running, Role: LEADER
I20260709 13:01:47.352702  8418 consensus_queue.cc:260] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:47.353101  8488 raft_consensus.cc:515] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:47.357915  8418 raft_consensus.cc:3060] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:47.358541  8344 leader_election.cc:290] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 4 election: Requested vote from peers fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051), 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67:40717)
I20260709 13:01:47.359747  8493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66045046df98460387504edc93461751" candidate_uuid: "05d5eaee01844183a4bbf46ad7d510b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "58234c3ebef346d8a52d902fc45e2849"
I20260709 13:01:47.360332  8493 raft_consensus.cc:3060] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:47.360931  8240 catalog_manager.cc:5697] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 reported cstate change: term changed from 3 to 4, leader changed from fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66) to 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65). New cstate: current_term: 4 leader_uuid: "05d5eaee01844183a4bbf46ad7d510b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.365126  8344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8936128622840c0bd58170c0d7658e6" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "05d5eaee01844183a4bbf46ad7d510b2"
I20260709 13:01:47.365882  8344 raft_consensus.cc:3060] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:47.369442  8493 raft_consensus.cc:2468] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d5eaee01844183a4bbf46ad7d510b2 in term 4.
I20260709 13:01:47.370959  8309 leader_election.cc:304] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d5eaee01844183a4bbf46ad7d510b2, 58234c3ebef346d8a52d902fc45e2849; no voters: 
I20260709 13:01:47.371831  8419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8936128622840c0bd58170c0d7658e6" candidate_uuid: "58234c3ebef346d8a52d902fc45e2849" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fb98dfdb6a744e83a251ee52b2799ff8"
I20260709 13:01:47.372427  8419 raft_consensus.cc:3055] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:47.372723  8419 raft_consensus.cc:740] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fb98dfdb6a744e83a251ee52b2799ff8, State: Running, Role: LEADER
I20260709 13:01:47.373095  8488 leader_election.cc:290] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 3 election: Requested vote from peers 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295), fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66:40051)
I20260709 13:01:47.373579  8419 consensus_queue.cc:260] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:47.372627  8418 raft_consensus.cc:2468] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d5eaee01844183a4bbf46ad7d510b2 in term 4.
I20260709 13:01:47.374711  8419 raft_consensus.cc:3060] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:47.371937  8691 raft_consensus.cc:2804] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:47.376267  8691 raft_consensus.cc:697] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 4 LEADER]: Becoming Leader. State: Replica: 05d5eaee01844183a4bbf46ad7d510b2, State: Running, Role: LEADER
I20260709 13:01:47.377208  8691 consensus_queue.cc:237] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:47.380318  8240 catalog_manager.cc:5697] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 reported cstate change: term changed from 2 to 3, leader changed from fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66) to 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65). New cstate: current_term: 3 leader_uuid: "05d5eaee01844183a4bbf46ad7d510b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.383121  8419 raft_consensus.cc:2468] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 3.
I20260709 13:01:47.384909  8457 leader_election.cc:304] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58234c3ebef346d8a52d902fc45e2849, fb98dfdb6a744e83a251ee52b2799ff8; no voters: 
I20260709 13:01:47.385178  8344 raft_consensus.cc:2468] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58234c3ebef346d8a52d902fc45e2849 in term 3.
I20260709 13:01:47.386178  8677 raft_consensus.cc:2804] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:47.386870  8677 raft_consensus.cc:697] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 3 LEADER]: Becoming Leader. State: Replica: 58234c3ebef346d8a52d902fc45e2849, State: Running, Role: LEADER
I20260709 13:01:47.388022  8677 consensus_queue.cc:237] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } }
I20260709 13:01:47.405231  8240 catalog_manager.cc:5697] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 reported cstate change: term changed from 3 to 4, leader changed from fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66) to 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65). New cstate: current_term: 4 leader_uuid: "05d5eaee01844183a4bbf46ad7d510b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.408164  8238 catalog_manager.cc:5697] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 reported cstate change: term changed from 2 to 3, leader changed from fb98dfdb6a744e83a251ee52b2799ff8 (127.8.4.66) to 58234c3ebef346d8a52d902fc45e2849 (127.8.4.67). New cstate: current_term: 3 leader_uuid: "58234c3ebef346d8a52d902fc45e2849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:47.438376  8344 raft_consensus.cc:1275] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 5 FOLLOWER]: Refusing update from remote peer 58234c3ebef346d8a52d902fc45e2849: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:47.439742  8677 consensus_queue.cc:1048] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d5eaee01844183a4bbf46ad7d510b2" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 33295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:47.455293  8419 raft_consensus.cc:1275] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 5 FOLLOWER]: Refusing update from remote peer 58234c3ebef346d8a52d902fc45e2849: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:47.457892  8685 consensus_queue.cc:1048] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:47.721171  8419 raft_consensus.cc:1275] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [term 4 FOLLOWER]: Refusing update from remote peer 05d5eaee01844183a4bbf46ad7d510b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:47.722766  8691 consensus_queue.cc:1048] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:47.733371  8488 raft_consensus.cc:1275] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 4 FOLLOWER]: Refusing update from remote peer 05d5eaee01844183a4bbf46ad7d510b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:47.735101  8693 consensus_queue.cc:1048] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:47.758780  8419 raft_consensus.cc:1275] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Refusing update from remote peer 05d5eaee01844183a4bbf46ad7d510b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:47.760246  8691 consensus_queue.cc:1048] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:47.773625  8488 raft_consensus.cc:1275] T 9ae145501f22403da5cc68d69af63915 P 58234c3ebef346d8a52d902fc45e2849 [term 3 FOLLOWER]: Refusing update from remote peer 05d5eaee01844183a4bbf46ad7d510b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:47.776175  8692 consensus_queue.cc:1048] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:47.778226  8419 raft_consensus.cc:1275] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [term 4 FOLLOWER]: Refusing update from remote peer 05d5eaee01844183a4bbf46ad7d510b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:47.779979  8692 consensus_queue.cc:1048] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:47.794801  8493 raft_consensus.cc:1275] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 4 FOLLOWER]: Refusing update from remote peer 05d5eaee01844183a4bbf46ad7d510b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:47.797034  8693 consensus_queue.cc:1048] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58234c3ebef346d8a52d902fc45e2849" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 40717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:47.849603  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:47.855383  8209 tablet_server.cc:179] TabletServer@127.8.4.65:0 shutting down...
W20260709 13:01:47.876092  8384 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:47.879499  8419 raft_consensus.cc:1275] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Refusing update from remote peer 58234c3ebef346d8a52d902fc45e2849: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:47.881222  8703 consensus_queue.cc:1048] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb98dfdb6a744e83a251ee52b2799ff8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:01:47.882061  8384 consensus_peers.cc:597] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 -> Peer 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295): Couldn't send request to peer 05d5eaee01844183a4bbf46ad7d510b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:47.921893  8458 consensus_peers.cc:597] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 -> Peer 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295): Couldn't send request to peer 05d5eaee01844183a4bbf46ad7d510b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:47.925329  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:47.926362  8209 tablet_replica.cc:333] T f681125f9aff45dbb0d7baf4db8e7d65 P 05d5eaee01844183a4bbf46ad7d510b2: stopping tablet replica
W20260709 13:01:47.927016  8458 consensus_peers.cc:597] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 -> Peer 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295): Couldn't send request to peer 05d5eaee01844183a4bbf46ad7d510b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:47.927314  8209 raft_consensus.cc:2243] T f681125f9aff45dbb0d7baf4db8e7d65 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.927968  8209 raft_consensus.cc:2272] T f681125f9aff45dbb0d7baf4db8e7d65 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.930583  8209 tablet_replica.cc:333] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2: stopping tablet replica
I20260709 13:01:47.931368  8209 raft_consensus.cc:2243] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.931895  8209 raft_consensus.cc:2272] T 6ff25b46a0ac45b0b845a38ef322d862 P 05d5eaee01844183a4bbf46ad7d510b2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.933806  8209 tablet_replica.cc:333] T 47d7875abc644a7e99ebac699897b724 P 05d5eaee01844183a4bbf46ad7d510b2: stopping tablet replica
I20260709 13:01:47.934296  8209 raft_consensus.cc:2243] T 47d7875abc644a7e99ebac699897b724 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.934685  8209 raft_consensus.cc:2272] T 47d7875abc644a7e99ebac699897b724 P 05d5eaee01844183a4bbf46ad7d510b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.936417  8209 tablet_replica.cc:333] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2: stopping tablet replica
I20260709 13:01:47.937139  8209 raft_consensus.cc:2243] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.937594  8209 raft_consensus.cc:2272] T e032c170e06b4392bcd8d1e761820d89 P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.939383  8209 tablet_replica.cc:333] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2: stopping tablet replica
I20260709 13:01:47.939909  8209 raft_consensus.cc:2243] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:01:47.940672  8209 raft_consensus.cc:2272] T 66045046df98460387504edc93461751 P 05d5eaee01844183a4bbf46ad7d510b2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.942989  8209 tablet_replica.cc:333] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2: stopping tablet replica
I20260709 13:01:47.943498  8209 raft_consensus.cc:2243] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:01:47.944239  8209 raft_consensus.cc:2272] T c00c12c99811434db59727d5ad24f6be P 05d5eaee01844183a4bbf46ad7d510b2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.946271  8209 tablet_replica.cc:333] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2: stopping tablet replica
I20260709 13:01:47.947010  8209 raft_consensus.cc:2243] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:47.947781  8209 raft_consensus.cc:2272] T 9ae145501f22403da5cc68d69af63915 P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.949849  8209 tablet_replica.cc:333] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2: stopping tablet replica
I20260709 13:01:47.950341  8209 raft_consensus.cc:2243] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.950784  8209 raft_consensus.cc:2272] T e8936128622840c0bd58170c0d7658e6 P 05d5eaee01844183a4bbf46ad7d510b2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:47.952620  8209 tablet_replica.cc:333] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2: stopping tablet replica
I20260709 13:01:47.953183  8209 raft_consensus.cc:2243] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:47.953632  8209 raft_consensus.cc:2272] T c251a30c42f24625b0df1be970faa534 P 05d5eaee01844183a4bbf46ad7d510b2 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:48.108198  8458 consensus_peers.cc:597] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 -> Peer 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295): Couldn't send request to peer 05d5eaee01844183a4bbf46ad7d510b2. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:33295: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.108479  8209 tablet_server.cc:196] TabletServer@127.8.4.65:0 shutdown complete.
W20260709 13:01:48.120447  8384 consensus_peers.cc:597] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 -> Peer 05d5eaee01844183a4bbf46ad7d510b2 (127.8.4.65:33295): Couldn't send request to peer 05d5eaee01844183a4bbf46ad7d510b2. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:33295: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.136613  8209 tablet_server.cc:179] TabletServer@127.8.4.66:0 shutting down...
I20260709 13:01:48.170225  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:48.170965  8209 tablet_replica.cc:333] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8: stopping tablet replica
I20260709 13:01:48.171651  8209 raft_consensus.cc:2243] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.172163  8209 raft_consensus.cc:2272] T f681125f9aff45dbb0d7baf4db8e7d65 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.174363  8209 tablet_replica.cc:333] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8: stopping tablet replica
I20260709 13:01:48.174885  8209 raft_consensus.cc:2243] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.175294  8209 raft_consensus.cc:2272] T 66045046df98460387504edc93461751 P fb98dfdb6a744e83a251ee52b2799ff8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.177493  8209 tablet_replica.cc:333] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8: stopping tablet replica
I20260709 13:01:48.178052  8209 raft_consensus.cc:2243] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.178833  8209 raft_consensus.cc:2272] T e032c170e06b4392bcd8d1e761820d89 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.180529  8209 tablet_replica.cc:333] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8: stopping tablet replica
I20260709 13:01:48.181103  8209 raft_consensus.cc:2243] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.181888  8209 raft_consensus.cc:2272] T 6ff25b46a0ac45b0b845a38ef322d862 P fb98dfdb6a744e83a251ee52b2799ff8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.183772  8209 tablet_replica.cc:333] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8: stopping tablet replica
I20260709 13:01:48.184248  8209 raft_consensus.cc:2243] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.184649  8209 raft_consensus.cc:2272] T e8936128622840c0bd58170c0d7658e6 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.187386  8209 tablet_replica.cc:333] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8: stopping tablet replica
I20260709 13:01:48.187925  8209 raft_consensus.cc:2243] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.188351  8209 raft_consensus.cc:2272] T 9ae145501f22403da5cc68d69af63915 P fb98dfdb6a744e83a251ee52b2799ff8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.190984  8209 tablet_replica.cc:333] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8: stopping tablet replica
I20260709 13:01:48.191517  8209 raft_consensus.cc:2243] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.191946  8209 raft_consensus.cc:2272] T c251a30c42f24625b0df1be970faa534 P fb98dfdb6a744e83a251ee52b2799ff8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.194284  8209 tablet_replica.cc:333] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8: stopping tablet replica
I20260709 13:01:48.194780  8209 raft_consensus.cc:2243] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.195369  8209 raft_consensus.cc:2272] T c00c12c99811434db59727d5ad24f6be P fb98dfdb6a744e83a251ee52b2799ff8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.197642  8209 tablet_replica.cc:333] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8: stopping tablet replica
I20260709 13:01:48.198201  8209 raft_consensus.cc:2243] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.198968  8209 raft_consensus.cc:2272] T 47d7875abc644a7e99ebac699897b724 P fb98dfdb6a744e83a251ee52b2799ff8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.220196  8209 tablet_server.cc:196] TabletServer@127.8.4.66:0 shutdown complete.
I20260709 13:01:48.248095  8209 tablet_server.cc:179] TabletServer@127.8.4.67:0 shutting down...
I20260709 13:01:48.280635  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:48.281574  8209 tablet_replica.cc:333] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849: stopping tablet replica
I20260709 13:01:48.282629  8209 raft_consensus.cc:2243] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.283203  8209 raft_consensus.cc:2272] T 6ff25b46a0ac45b0b845a38ef322d862 P 58234c3ebef346d8a52d902fc45e2849 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.284991  8209 tablet_replica.cc:333] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849: stopping tablet replica
I20260709 13:01:48.285645  8209 raft_consensus.cc:2243] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.286162  8209 raft_consensus.cc:2272] T 47d7875abc644a7e99ebac699897b724 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.288451  8209 tablet_replica.cc:333] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849: stopping tablet replica
I20260709 13:01:48.289214  8209 raft_consensus.cc:2243] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.290171  8209 raft_consensus.cc:2272] T f681125f9aff45dbb0d7baf4db8e7d65 P 58234c3ebef346d8a52d902fc45e2849 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.292271  8209 tablet_replica.cc:333] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849: stopping tablet replica
I20260709 13:01:48.292953  8209 raft_consensus.cc:2243] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.293497  8209 raft_consensus.cc:2272] T 66045046df98460387504edc93461751 P 58234c3ebef346d8a52d902fc45e2849 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.295794  8209 tablet_replica.cc:333] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849: stopping tablet replica
I20260709 13:01:48.296315  8209 raft_consensus.cc:2243] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.296779  8209 raft_consensus.cc:2272] T e032c170e06b4392bcd8d1e761820d89 P 58234c3ebef346d8a52d902fc45e2849 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.298692  8209 tablet_replica.cc:333] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849: stopping tablet replica
I20260709 13:01:48.299196  8209 raft_consensus.cc:2243] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.299642  8209 raft_consensus.cc:2272] T c00c12c99811434db59727d5ad24f6be P 58234c3ebef346d8a52d902fc45e2849 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.302074  8209 tablet_replica.cc:333] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849: stopping tablet replica
I20260709 13:01:48.302611  8209 raft_consensus.cc:2243] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.303335  8209 raft_consensus.cc:2272] T c251a30c42f24625b0df1be970faa534 P 58234c3ebef346d8a52d902fc45e2849 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.305466  8209 tablet_replica.cc:333] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849: stopping tablet replica
I20260709 13:01:48.305944  8209 raft_consensus.cc:2243] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.306658  8209 raft_consensus.cc:2272] T e8936128622840c0bd58170c0d7658e6 P 58234c3ebef346d8a52d902fc45e2849 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.308565  8209 tablet_replica.cc:333] T 9ae145501f22403da5cc68d69af63915 P 58234c3ebef346d8a52d902fc45e2849: stopping tablet replica
I20260709 13:01:48.309159  8209 raft_consensus.cc:2243] T 9ae145501f22403da5cc68d69af63915 P 58234c3ebef346d8a52d902fc45e2849 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.309554  8209 raft_consensus.cc:2272] T 9ae145501f22403da5cc68d69af63915 P 58234c3ebef346d8a52d902fc45e2849 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.341406  8209 tablet_server.cc:196] TabletServer@127.8.4.67:0 shutdown complete.
I20260709 13:01:48.369082  8209 master.cc:562] Master@127.8.4.126:39783 shutting down...
I20260709 13:01:48.600245  8209 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.601053  8209 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.601501  8209 tablet_replica.cc:333] T 00000000000000000000000000000000 P 112e7312dac44bdb83fb1b3831cb4d26: stopping tablet replica
I20260709 13:01:49.588853  8209 master.cc:584] Master@127.8.4.126:39783 shutdown complete.
05d5eaee01844183a4bbf46ad7d510b2  4
58234c3ebef346d8a52d902fc45e2849  1
fb98dfdb6a744e83a251ee52b2799ff8  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (14015 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:01:49.632444  8209 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.4.126:44691
I20260709 13:01:49.633740  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:49.639348  8718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:49.639900  8719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:49.640970  8721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:49.641889  8209 server_base.cc:1061] running on GCE node
I20260709 13:01:49.642946  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:49.643143  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:49.643365  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602109643332 us; error 0 us; skew 500 ppm
I20260709 13:01:49.644086  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:49.647011  8209 webserver.cc:533] Webserver started at http://127.8.4.126:42673/ using document root <none> and password file <none>
I20260709 13:01:49.647747  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:49.647953  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:49.648280  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:49.649921  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602095438975-8209-0/minicluster-data/master-0-root/instance:
uuid: "d7b988e735cd46bd8252c7b552bc5bb5"
format_stamp: "Formatted at 2026-07-09 13:01:49 on dist-test-slave-008w"
I20260709 13:01:49.654726  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:01:49.658696  8726 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:49.659705  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:01:49.660003  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602095438975-8209-0/minicluster-data/master-0-root
uuid: "d7b988e735cd46bd8252c7b552bc5bb5"
format_stamp: "Formatted at 2026-07-09 13:01:49 on dist-test-slave-008w"
I20260709 13:01:49.660274  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602095438975-8209-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602095438975-8209-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602095438975-8209-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:49.684839  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:49.686103  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:49.726598  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.126:44691
I20260709 13:01:49.726713  8777 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.126:44691 every 8 connection(s)
I20260709 13:01:49.730696  8778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:49.741039  8778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5: Bootstrap starting.
I20260709 13:01:49.745970  8778 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:49.750738  8778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5: No bootstrap required, opened a new log
I20260709 13:01:49.752976  8778 raft_consensus.cc:359] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7b988e735cd46bd8252c7b552bc5bb5" member_type: VOTER }
I20260709 13:01:49.753500  8778 raft_consensus.cc:385] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:49.753708  8778 raft_consensus.cc:740] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7b988e735cd46bd8252c7b552bc5bb5, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.754323  8778 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7b988e735cd46bd8252c7b552bc5bb5" member_type: VOTER }
I20260709 13:01:49.754779  8778 raft_consensus.cc:399] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:01:49.754997  8778 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:01:49.755226  8778 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:49.759722  8778 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7b988e735cd46bd8252c7b552bc5bb5" member_type: VOTER }
I20260709 13:01:49.760291  8778 leader_election.cc:304] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7b988e735cd46bd8252c7b552bc5bb5; no voters: 
I20260709 13:01:49.761642  8778 leader_election.cc:290] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:01:49.762239  8781 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:49.763712  8781 raft_consensus.cc:697] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5 [term 1 LEADER]: Becoming Leader. State: Replica: d7b988e735cd46bd8252c7b552bc5bb5, State: Running, Role: LEADER
I20260709 13:01:49.764484  8781 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7b988e735cd46bd8252c7b552bc5bb5" member_type: VOTER }
I20260709 13:01:49.765182  8778 sys_catalog.cc:565] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:01:49.769433  8783 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7b988e735cd46bd8252c7b552bc5bb5. Latest consensus state: current_term: 1 leader_uuid: "d7b988e735cd46bd8252c7b552bc5bb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7b988e735cd46bd8252c7b552bc5bb5" member_type: VOTER } }
I20260709 13:01:49.770298  8783 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:49.772023  8782 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d7b988e735cd46bd8252c7b552bc5bb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7b988e735cd46bd8252c7b552bc5bb5" member_type: VOTER } }
I20260709 13:01:49.772969  8782 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:49.773769  8787 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:01:49.783740  8787 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:01:49.787024  8209 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:01:49.794426  8787 catalog_manager.cc:1383] Generated new cluster ID: 6f2ba060632f4a1f8968249e6f3aa52c
I20260709 13:01:49.794772  8787 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:01:49.821929  8787 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:01:49.823181  8787 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:01:49.836599  8787 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5: Generated new TSK 0
I20260709 13:01:49.837356  8787 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:01:49.853735  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:49.860495  8799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:49.861614  8800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:49.864146  8802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:49.864228  8209 server_base.cc:1061] running on GCE node
I20260709 13:01:49.865552  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:49.865789  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:49.865975  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602109865959 us; error 0 us; skew 500 ppm
I20260709 13:01:49.866602  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:49.869336  8209 webserver.cc:533] Webserver started at http://127.8.4.65:35009/ using document root <none> and password file <none>
I20260709 13:01:49.869832  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:49.870021  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:49.870303  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:49.871361  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602095438975-8209-0/minicluster-data/ts-0-root/instance:
uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
format_stamp: "Formatted at 2026-07-09 13:01:49 on dist-test-slave-008w"
I20260709 13:01:49.876051  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:01:49.879878  8807 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:49.880872  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:01:49.881214  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602095438975-8209-0/minicluster-data/ts-0-root
uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
format_stamp: "Formatted at 2026-07-09 13:01:49 on dist-test-slave-008w"
I20260709 13:01:49.881491  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602095438975-8209-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602095438975-8209-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602095438975-8209-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:49.895282  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:49.896569  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:49.898335  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:49.901070  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:49.901292  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:49.901502  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:49.901674  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:49.946079  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.65:36441
I20260709 13:01:49.946209  8869 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.65:36441 every 8 connection(s)
I20260709 13:01:49.951563  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:49.958918  8874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:49.959431  8875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:49.962911  8877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:49.963447  8209 server_base.cc:1061] running on GCE node
I20260709 13:01:49.964367  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:49.964572  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:49.964866  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602109964845 us; error 0 us; skew 500 ppm
I20260709 13:01:49.965488  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:49.968498  8209 webserver.cc:533] Webserver started at http://127.8.4.66:36751/ using document root <none> and password file <none>
I20260709 13:01:49.969246  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:49.969527  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:49.969833  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:49.970652  8870 heartbeater.cc:344] Connected to a master server at 127.8.4.126:44691
I20260709 13:01:49.971006  8870 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:49.971148  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602095438975-8209-0/minicluster-data/ts-1-root/instance:
uuid: "b573f69535f34eb29ac81316560dcbfb"
format_stamp: "Formatted at 2026-07-09 13:01:49 on dist-test-slave-008w"
I20260709 13:01:49.971748  8870 heartbeater.cc:507] Master 127.8.4.126:44691 requested a full tablet report, sending...
I20260709 13:01:49.973799  8743 ts_manager.cc:194] Registered new tserver with Master: d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441)
I20260709 13:01:49.975567  8743 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46100
I20260709 13:01:49.976563  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.005s
I20260709 13:01:49.980970  8882 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:49.981887  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:01:49.982265  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602095438975-8209-0/minicluster-data/ts-1-root
uuid: "b573f69535f34eb29ac81316560dcbfb"
format_stamp: "Formatted at 2026-07-09 13:01:49 on dist-test-slave-008w"
I20260709 13:01:49.982594  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602095438975-8209-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602095438975-8209-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602095438975-8209-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:50.007405  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:50.008718  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:50.010373  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:50.012974  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:50.013423  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:50.013803  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:50.014014  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:50.060483  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.66:40883
I20260709 13:01:50.060626  8944 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.66:40883 every 8 connection(s)
I20260709 13:01:50.065866  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:50.074239  8948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:50.075328  8949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:50.077441  8951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:50.079077  8209 server_base.cc:1061] running on GCE node
I20260709 13:01:50.079746  8945 heartbeater.cc:344] Connected to a master server at 127.8.4.126:44691
I20260709 13:01:50.080178  8945 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:50.080207  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:50.080595  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:50.080823  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602110080803 us; error 0 us; skew 500 ppm
I20260709 13:01:50.081348  8945 heartbeater.cc:507] Master 127.8.4.126:44691 requested a full tablet report, sending...
I20260709 13:01:50.081694  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:50.084050  8743 ts_manager.cc:194] Registered new tserver with Master: b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883)
I20260709 13:01:50.085093  8209 webserver.cc:533] Webserver started at http://127.8.4.67:34645/ using document root <none> and password file <none>
I20260709 13:01:50.085829  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:50.086086  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:50.086125  8743 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46110
I20260709 13:01:50.086617  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:50.088373  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602095438975-8209-0/minicluster-data/ts-2-root/instance:
uuid: "1ab8939b06d94226859d2091b6837cb0"
format_stamp: "Formatted at 2026-07-09 13:01:50 on dist-test-slave-008w"
I20260709 13:01:50.093364  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:01:50.096692  8956 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:50.097545  8209 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:01:50.097862  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602095438975-8209-0/minicluster-data/ts-2-root
uuid: "1ab8939b06d94226859d2091b6837cb0"
format_stamp: "Formatted at 2026-07-09 13:01:50 on dist-test-slave-008w"
I20260709 13:01:50.098165  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602095438975-8209-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602095438975-8209-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602095438975-8209-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:50.110035  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:50.111395  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:50.112995  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:50.115476  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:50.115736  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:50.116052  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:50.116258  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:50.166600  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.67:35521
I20260709 13:01:50.166666  9018 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.67:35521 every 8 connection(s)
I20260709 13:01:50.181584  9019 heartbeater.cc:344] Connected to a master server at 127.8.4.126:44691
I20260709 13:01:50.181998  9019 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:50.182837  9019 heartbeater.cc:507] Master 127.8.4.126:44691 requested a full tablet report, sending...
I20260709 13:01:50.185060  8743 ts_manager.cc:194] Registered new tserver with Master: 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:50.185179  8209 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015242027s
I20260709 13:01:50.187068  8743 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46112
I20260709 13:01:50.214959  8743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46128:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:01:50.218137  8743 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:01:50.293512  8910 tablet_service.cc:1511] Processing CreateTablet for tablet 08d5152e641944c882dfbb0e853415c6 (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:01:50.295037  8910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d5152e641944c882dfbb0e853415c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.298187  8909 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce625ab6cde4eae85ae856751ba3258 (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:01:50.299649  8909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce625ab6cde4eae85ae856751ba3258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.302178  8908 tablet_service.cc:1511] Processing CreateTablet for tablet 7e89da22e652440a81d85ab6924828ed (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:01:50.303764  8908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e89da22e652440a81d85ab6924828ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.311168  8907 tablet_service.cc:1511] Processing CreateTablet for tablet eab22a9e82e64d8782c5979f0129cb81 (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:01:50.314791  8906 tablet_service.cc:1511] Processing CreateTablet for tablet 45c1d81694c64be39bf3c51c7813c62c (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:01:50.316983  8906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c1d81694c64be39bf3c51c7813c62c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.322839  8907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab22a9e82e64d8782c5979f0129cb81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.328466  8903 tablet_service.cc:1511] Processing CreateTablet for tablet af9eb6066fea4d8888cfcfa200a7e7e3 (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:01:50.318747  8905 tablet_service.cc:1511] Processing CreateTablet for tablet 0821874284d24042bc11cb263f92ae68 (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:01:50.330035  8903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af9eb6066fea4d8888cfcfa200a7e7e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.331028  8905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0821874284d24042bc11cb263f92ae68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.334537  8901 tablet_service.cc:1511] Processing CreateTablet for tablet 41f4cb214fc649deb6d5621660b59def (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:01:50.336488  8901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f4cb214fc649deb6d5621660b59def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.337795  8902 tablet_service.cc:1511] Processing CreateTablet for tablet cb6c1c23963c420aa1c6f9aba2f1e6bb (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:01:50.339670  8902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb6c1c23963c420aa1c6f9aba2f1e6bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.320289  8904 tablet_service.cc:1511] Processing CreateTablet for tablet f27a5fdf363b407280ce8086858a8912 (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:01:50.346954  9034 tablet_bootstrap.cc:492] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb: Bootstrap starting.
I20260709 13:01:50.347980  8904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f27a5fdf363b407280ce8086858a8912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.355687  9034 tablet_bootstrap.cc:654] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.374428  8835 tablet_service.cc:1511] Processing CreateTablet for tablet 08d5152e641944c882dfbb0e853415c6 (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:01:50.375918  8835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d5152e641944c882dfbb0e853415c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.377614  8834 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce625ab6cde4eae85ae856751ba3258 (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:01:50.378301  8979 tablet_service.cc:1511] Processing CreateTablet for tablet 0821874284d24042bc11cb263f92ae68 (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:01:50.379086  8834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce625ab6cde4eae85ae856751ba3258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.379669  8979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0821874284d24042bc11cb263f92ae68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.382299  8975 tablet_service.cc:1511] Processing CreateTablet for tablet 41f4cb214fc649deb6d5621660b59def (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:01:50.382309  8833 tablet_service.cc:1511] Processing CreateTablet for tablet 7e89da22e652440a81d85ab6924828ed (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:01:50.383793  8975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f4cb214fc649deb6d5621660b59def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.383797  8833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e89da22e652440a81d85ab6924828ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.386307  8976 tablet_service.cc:1511] Processing CreateTablet for tablet cb6c1c23963c420aa1c6f9aba2f1e6bb (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:01:50.387764  8976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb6c1c23963c420aa1c6f9aba2f1e6bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.390411  8977 tablet_service.cc:1511] Processing CreateTablet for tablet af9eb6066fea4d8888cfcfa200a7e7e3 (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:01:50.392782  8978 tablet_service.cc:1511] Processing CreateTablet for tablet f27a5fdf363b407280ce8086858a8912 (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:01:50.395143  8980 tablet_service.cc:1511] Processing CreateTablet for tablet 45c1d81694c64be39bf3c51c7813c62c (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:01:50.397377  8982 tablet_service.cc:1511] Processing CreateTablet for tablet 7e89da22e652440a81d85ab6924828ed (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:01:50.399577  8983 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce625ab6cde4eae85ae856751ba3258 (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:01:50.401788  8984 tablet_service.cc:1511] Processing CreateTablet for tablet 08d5152e641944c882dfbb0e853415c6 (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:01:50.403936  8831 tablet_service.cc:1511] Processing CreateTablet for tablet 45c1d81694c64be39bf3c51c7813c62c (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:01:50.405354  8831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c1d81694c64be39bf3c51c7813c62c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.407897  9036 tablet_bootstrap.cc:492] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0: Bootstrap starting.
I20260709 13:01:50.410171  8832 tablet_service.cc:1511] Processing CreateTablet for tablet eab22a9e82e64d8782c5979f0129cb81 (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:01:50.411649  8832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab22a9e82e64d8782c5979f0129cb81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.414291  8981 tablet_service.cc:1511] Processing CreateTablet for tablet eab22a9e82e64d8782c5979f0129cb81 (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:01:50.416644  9036 tablet_bootstrap.cc:654] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.416747  8833 tablet_service.cc:1511] Processing CreateTablet for tablet 0821874284d24042bc11cb263f92ae68 (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:01:50.417407  8830 tablet_service.cc:1511] Processing CreateTablet for tablet f27a5fdf363b407280ce8086858a8912 (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:01:50.418401  8833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0821874284d24042bc11cb263f92ae68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.420593  8829 tablet_service.cc:1511] Processing CreateTablet for tablet af9eb6066fea4d8888cfcfa200a7e7e3 (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:01:50.421116  8984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d5152e641944c882dfbb0e853415c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.421943  8982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e89da22e652440a81d85ab6924828ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.422485  8827 tablet_service.cc:1511] Processing CreateTablet for tablet 41f4cb214fc649deb6d5621660b59def (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:01:50.424019  8977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af9eb6066fea4d8888cfcfa200a7e7e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.424558  8830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f27a5fdf363b407280ce8086858a8912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.425094  9034 tablet_bootstrap.cc:492] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb: No bootstrap required, opened a new log
I20260709 13:01:50.425565  9034 ts_tablet_manager.cc:1403] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb: Time spent bootstrapping tablet: real 0.079s	user 0.020s	sys 0.019s
I20260709 13:01:50.428514  9034 raft_consensus.cc:359] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.429412  8983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce625ab6cde4eae85ae856751ba3258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.429317  9034 raft_consensus.cc:385] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.429284  8828 tablet_service.cc:1511] Processing CreateTablet for tablet cb6c1c23963c420aa1c6f9aba2f1e6bb (DEFAULT_TABLE table=test-workload [id=510ca42f9ccb4cc19142db92bb19012f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:01:50.429930  9034 raft_consensus.cc:740] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.430727  8828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb6c1c23963c420aa1c6f9aba2f1e6bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.433368  8978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f27a5fdf363b407280ce8086858a8912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.433449  8827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f4cb214fc649deb6d5621660b59def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.435717  8829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af9eb6066fea4d8888cfcfa200a7e7e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.437391  8980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c1d81694c64be39bf3c51c7813c62c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.439399  9034 consensus_queue.cc:260] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.442166  8981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab22a9e82e64d8782c5979f0129cb81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:50.469551  9036 tablet_bootstrap.cc:492] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0: No bootstrap required, opened a new log
I20260709 13:01:50.475306  9036 ts_tablet_manager.cc:1403] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0: Time spent bootstrapping tablet: real 0.068s	user 0.018s	sys 0.020s
I20260709 13:01:50.486418  9034 ts_tablet_manager.cc:1434] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.006s
I20260709 13:01:50.487179  8945 heartbeater.cc:499] Master 127.8.4.126:44691 was elected leader, sending a full tablet report...
I20260709 13:01:50.490526  9034 tablet_bootstrap.cc:492] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb: Bootstrap starting.
I20260709 13:01:50.490850  9037 tablet_bootstrap.cc:492] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b: Bootstrap starting.
I20260709 13:01:50.496814  9037 tablet_bootstrap.cc:654] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.505126  9034 tablet_bootstrap.cc:654] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.524009  9036 raft_consensus.cc:359] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.539330  9036 raft_consensus.cc:385] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.539757  9036 raft_consensus.cc:740] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab8939b06d94226859d2091b6837cb0, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.540871  9036 consensus_queue.cc:260] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.568709  9034 tablet_bootstrap.cc:492] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb: No bootstrap required, opened a new log
I20260709 13:01:50.569581  9034 ts_tablet_manager.cc:1403] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb: Time spent bootstrapping tablet: real 0.080s	user 0.017s	sys 0.018s
I20260709 13:01:50.571993  9019 heartbeater.cc:499] Master 127.8.4.126:44691 was elected leader, sending a full tablet report...
I20260709 13:01:50.572572  9036 ts_tablet_manager.cc:1434] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0: Time spent starting tablet: real 0.093s	user 0.015s	sys 0.010s
I20260709 13:01:50.573598  9036 tablet_bootstrap.cc:492] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0: Bootstrap starting.
I20260709 13:01:50.573933  9037 tablet_bootstrap.cc:492] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b: No bootstrap required, opened a new log
I20260709 13:01:50.574393  9037 ts_tablet_manager.cc:1403] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b: Time spent bootstrapping tablet: real 0.114s	user 0.015s	sys 0.005s
I20260709 13:01:50.577643  9037 raft_consensus.cc:359] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.578495  9037 raft_consensus.cc:385] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.578963  9037 raft_consensus.cc:740] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.577534  9034 raft_consensus.cc:359] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.580207  9034 raft_consensus.cc:385] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.579993  9037 consensus_queue.cc:260] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.580562  9034 raft_consensus.cc:740] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.580799  9036 tablet_bootstrap.cc:654] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.581606  9034 consensus_queue.cc:260] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.589488  9039 raft_consensus.cc:493] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.590152  9039 raft_consensus.cc:515] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.607549  9039 leader_election.cc:290] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:50.615355  8870 heartbeater.cc:499] Master 127.8.4.126:44691 was elected leader, sending a full tablet report...
I20260709 13:01:50.618000  9034 ts_tablet_manager.cc:1434] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:01:50.620251  9037 ts_tablet_manager.cc:1434] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b: Time spent starting tablet: real 0.046s	user 0.025s	sys 0.019s
I20260709 13:01:50.615283  9046 raft_consensus.cc:493] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.621553  9037 tablet_bootstrap.cc:492] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b: Bootstrap starting.
I20260709 13:01:50.622960  9034 tablet_bootstrap.cc:492] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb: Bootstrap starting.
I20260709 13:01:50.624845  9036 tablet_bootstrap.cc:492] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0: No bootstrap required, opened a new log
I20260709 13:01:50.628615  9037 tablet_bootstrap.cc:654] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.621311  9046 raft_consensus.cc:515] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.628700  9036 ts_tablet_manager.cc:1403] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0: Time spent bootstrapping tablet: real 0.055s	user 0.020s	sys 0.031s
I20260709 13:01:50.642926  9036 raft_consensus.cc:359] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.643537  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9eb6066fea4d8888cfcfa200a7e7e3" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab8939b06d94226859d2091b6837cb0" is_pre_election: true
I20260709 13:01:50.644165  9036 raft_consensus.cc:385] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.644671  9036 raft_consensus.cc:740] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab8939b06d94226859d2091b6837cb0, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.637683  9034 tablet_bootstrap.cc:654] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.638679  9046 leader_election.cc:290] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
W20260709 13:01:50.645493  8883 leader_election.cc:343] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.646009  9036 consensus_queue.cc:260] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.656199  9036 ts_tablet_manager.cc:1434] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.003s
I20260709 13:01:50.657699  9036 tablet_bootstrap.cc:492] T 08d5152e641944c882dfbb0e853415c6 P 1ab8939b06d94226859d2091b6837cb0: Bootstrap starting.
I20260709 13:01:50.658133  9034 tablet_bootstrap.cc:492] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb: No bootstrap required, opened a new log
I20260709 13:01:50.658648  9034 ts_tablet_manager.cc:1403] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.002s
I20260709 13:01:50.661782  9034 raft_consensus.cc:359] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.662678  9034 raft_consensus.cc:385] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.662985  9034 raft_consensus.cc:740] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.663897  9034 consensus_queue.cc:260] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.667549  9036 tablet_bootstrap.cc:654] T 08d5152e641944c882dfbb0e853415c6 P 1ab8939b06d94226859d2091b6837cb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.671193  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9eb6066fea4d8888cfcfa200a7e7e3" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" is_pre_election: true
I20260709 13:01:50.671646  9034 ts_tablet_manager.cc:1434] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:01:50.672636  9034 tablet_bootstrap.cc:492] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb: Bootstrap starting.
W20260709 13:01:50.673050  8886 leader_election.cc:343] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.683030  8886 leader_election.cc:304] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b573f69535f34eb29ac81316560dcbfb; no voters: 1ab8939b06d94226859d2091b6837cb0, d1afd0dcf1fd4f1f99645e792f53a18b
I20260709 13:01:50.684859  9039 raft_consensus.cc:2749] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:50.682374  9034 tablet_bootstrap.cc:654] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.689337  9037 tablet_bootstrap.cc:492] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b: No bootstrap required, opened a new log
I20260709 13:01:50.690342  9037 ts_tablet_manager.cc:1403] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b: Time spent bootstrapping tablet: real 0.069s	user 0.030s	sys 0.031s
I20260709 13:01:50.691618  9036 tablet_bootstrap.cc:492] T 08d5152e641944c882dfbb0e853415c6 P 1ab8939b06d94226859d2091b6837cb0: No bootstrap required, opened a new log
I20260709 13:01:50.692142  9036 ts_tablet_manager.cc:1403] T 08d5152e641944c882dfbb0e853415c6 P 1ab8939b06d94226859d2091b6837cb0: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.009s
I20260709 13:01:50.694088  9037 raft_consensus.cc:359] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.694849  9037 raft_consensus.cc:385] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.695211  9037 raft_consensus.cc:740] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.694309  9042 raft_consensus.cc:493] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.696157  9037 consensus_queue.cc:260] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.696115  9042 raft_consensus.cc:515] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.698572  9037 ts_tablet_manager.cc:1434] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:01:50.699831  9037 tablet_bootstrap.cc:492] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b: Bootstrap starting.
I20260709 13:01:50.695045  9036 raft_consensus.cc:359] T 08d5152e641944c882dfbb0e853415c6 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.700627  9036 raft_consensus.cc:385] T 08d5152e641944c882dfbb0e853415c6 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.701033  9036 raft_consensus.cc:740] T 08d5152e641944c882dfbb0e853415c6 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab8939b06d94226859d2091b6837cb0, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.702150  9036 consensus_queue.cc:260] T 08d5152e641944c882dfbb0e853415c6 P 1ab8939b06d94226859d2091b6837cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.704420  9042 leader_election.cc:290] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883)
I20260709 13:01:50.707221  9037 tablet_bootstrap.cc:654] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.712442  9036 ts_tablet_manager.cc:1434] T 08d5152e641944c882dfbb0e853415c6 P 1ab8939b06d94226859d2091b6837cb0: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.002s
I20260709 13:01:50.713896  9039 raft_consensus.cc:493] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.714395  9039 raft_consensus.cc:515] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.718544  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e89da22e652440a81d85ab6924828ed" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab8939b06d94226859d2091b6837cb0" is_pre_election: true
I20260709 13:01:50.719462  9037 tablet_bootstrap.cc:492] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b: No bootstrap required, opened a new log
I20260709 13:01:50.719961  9037 ts_tablet_manager.cc:1403] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
W20260709 13:01:50.720556  8883 leader_election.cc:343] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.720932  9036 tablet_bootstrap.cc:492] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0: Bootstrap starting.
I20260709 13:01:50.722892  9037 raft_consensus.cc:359] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.723663  9037 raft_consensus.cc:385] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.716686  9039 leader_election.cc:290] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:50.723970  9037 raft_consensus.cc:740] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.724077  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce625ab6cde4eae85ae856751ba3258" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab8939b06d94226859d2091b6837cb0" is_pre_election: true
I20260709 13:01:50.728964  8994 raft_consensus.cc:2468] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 0.
I20260709 13:01:50.729038  9037 consensus_queue.cc:260] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.731055  8808 leader_election.cc:304] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:50.732291  9046 raft_consensus.cc:2804] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:50.732810  9046 raft_consensus.cc:493] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.733330  9046 raft_consensus.cc:3060] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:50.734520  9037 ts_tablet_manager.cc:1434] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:01:50.735477  9037 tablet_bootstrap.cc:492] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b: Bootstrap starting.
I20260709 13:01:50.737886  9036 tablet_bootstrap.cc:654] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.747047  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e89da22e652440a81d85ab6924828ed" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" is_pre_election: true
I20260709 13:01:50.748137  8845 raft_consensus.cc:2468] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b573f69535f34eb29ac81316560dcbfb in term 0.
I20260709 13:01:50.751130  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce625ab6cde4eae85ae856751ba3258" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b573f69535f34eb29ac81316560dcbfb" is_pre_election: true
I20260709 13:01:50.752744  9037 tablet_bootstrap.cc:654] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.751042  8886 leader_election.cc:304] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b573f69535f34eb29ac81316560dcbfb, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 1ab8939b06d94226859d2091b6837cb0
I20260709 13:01:50.759796  9039 raft_consensus.cc:2804] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:50.760433  9039 raft_consensus.cc:493] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.760922  9039 raft_consensus.cc:3060] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:50.773432  9046 raft_consensus.cc:515] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.776351  9046 leader_election.cc:290] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 election: Requested vote from peers b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
W20260709 13:01:50.776993  8808 leader_election.cc:343] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.780259  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce625ab6cde4eae85ae856751ba3258" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:50.781134  8994 raft_consensus.cc:3060] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:50.781860  8791 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:50.786521  9039 raft_consensus.cc:515] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.799281  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce625ab6cde4eae85ae856751ba3258" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
I20260709 13:01:50.807148  9039 leader_election.cc:290] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 election: Requested vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:50.807760  9039 raft_consensus.cc:493] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.808184  9039 raft_consensus.cc:515] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.808390  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e89da22e652440a81d85ab6924828ed" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:50.808779  9036 tablet_bootstrap.cc:492] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0: No bootstrap required, opened a new log
I20260709 13:01:50.809285  9036 ts_tablet_manager.cc:1403] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.026s
W20260709 13:01:50.809917  8883 leader_election.cc:343] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.810034  9039 leader_election.cc:290] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
W20260709 13:01:50.811097  8808 leader_election.cc:343] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.801129  8994 raft_consensus.cc:2468] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 1.
I20260709 13:01:50.813479  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e89da22e652440a81d85ab6924828ed" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
I20260709 13:01:50.813620  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab22a9e82e64d8782c5979f0129cb81" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab8939b06d94226859d2091b6837cb0" is_pre_election: true
I20260709 13:01:50.814811  8845 raft_consensus.cc:3060] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:50.815891  8883 leader_election.cc:343] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.816084  9036 raft_consensus.cc:359] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.816792  9036 raft_consensus.cc:385] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.817106  9036 raft_consensus.cc:740] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab8939b06d94226859d2091b6837cb0, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.817864  9036 consensus_queue.cc:260] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.818156  9037 tablet_bootstrap.cc:492] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b: No bootstrap required, opened a new log
I20260709 13:01:50.818704  9037 ts_tablet_manager.cc:1403] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b: Time spent bootstrapping tablet: real 0.083s	user 0.028s	sys 0.037s
I20260709 13:01:50.819916  9036 ts_tablet_manager.cc:1434] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:01:50.820930  9036 tablet_bootstrap.cc:492] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0: Bootstrap starting.
I20260709 13:01:50.822170  9037 raft_consensus.cc:359] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.822760  9034 tablet_bootstrap.cc:492] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb: No bootstrap required, opened a new log
I20260709 13:01:50.823005  9037 raft_consensus.cc:385] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.823276  9034 ts_tablet_manager.cc:1403] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb: Time spent bootstrapping tablet: real 0.151s	user 0.057s	sys 0.046s
I20260709 13:01:50.823338  9037 raft_consensus.cc:740] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.824483  9037 consensus_queue.cc:260] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.826681  9034 raft_consensus.cc:359] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.827487  9034 raft_consensus.cc:385] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.827816  9034 raft_consensus.cc:740] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.828133  9036 tablet_bootstrap.cc:654] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.830175  9037 ts_tablet_manager.cc:1434] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 13:01:50.830633  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab22a9e82e64d8782c5979f0129cb81" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" is_pre_election: true
I20260709 13:01:50.831446  9037 tablet_bootstrap.cc:492] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b: Bootstrap starting.
I20260709 13:01:50.831357  8844 raft_consensus.cc:2468] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b573f69535f34eb29ac81316560dcbfb in term 0.
I20260709 13:01:50.833515  8808 leader_election.cc:304] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: b573f69535f34eb29ac81316560dcbfb
I20260709 13:01:50.834713  8886 leader_election.cc:304] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b573f69535f34eb29ac81316560dcbfb, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 1ab8939b06d94226859d2091b6837cb0
I20260709 13:01:50.835265  9046 raft_consensus.cc:2804] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:50.835913  9046 raft_consensus.cc:697] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Becoming Leader. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:50.836199  9060 raft_consensus.cc:2804] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:50.836717  9060 raft_consensus.cc:493] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.837133  9060 raft_consensus.cc:3060] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:50.839314  9037 tablet_bootstrap.cc:654] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.845549  8845 raft_consensus.cc:2468] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b573f69535f34eb29ac81316560dcbfb in term 1.
I20260709 13:01:50.844944  9046 consensus_queue.cc:237] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.850311  9056 raft_consensus.cc:493] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.851004  9056 raft_consensus.cc:515] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.851890  9037 tablet_bootstrap.cc:492] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b: No bootstrap required, opened a new log
I20260709 13:01:50.852387  9037 ts_tablet_manager.cc:1403] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 13:01:50.847575  8886 leader_election.cc:304] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b573f69535f34eb29ac81316560dcbfb, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 1ab8939b06d94226859d2091b6837cb0
I20260709 13:01:50.853065  9039 raft_consensus.cc:2804] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:50.853761  9056 leader_election.cc:290] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883)
I20260709 13:01:50.855316  9037 raft_consensus.cc:359] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.856065  9037 raft_consensus.cc:385] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.856360  9037 raft_consensus.cc:740] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.857323  9037 consensus_queue.cc:260] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.857648  9060 raft_consensus.cc:515] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.859905  9037 ts_tablet_manager.cc:1434] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:01:50.860457  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab22a9e82e64d8782c5979f0129cb81" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
I20260709 13:01:50.860921  9037 tablet_bootstrap.cc:492] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b: Bootstrap starting.
I20260709 13:01:50.861042  8845 raft_consensus.cc:3060] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:50.862625  9039 raft_consensus.cc:697] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 1 LEADER]: Becoming Leader. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Running, Role: LEADER
I20260709 13:01:50.863559  9039 consensus_queue.cc:237] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.868317  9043 raft_consensus.cc:493] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.868880  9043 raft_consensus.cc:515] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.828634  9034 consensus_queue.cc:260] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.870855  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0821874284d24042bc11cb263f92ae68" candidate_uuid: "1ab8939b06d94226859d2091b6837cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b573f69535f34eb29ac81316560dcbfb" is_pre_election: true
I20260709 13:01:50.871217  9043 leader_election.cc:290] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:50.873461  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d5152e641944c882dfbb0e853415c6" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab8939b06d94226859d2091b6837cb0" is_pre_election: true
I20260709 13:01:50.874361  8994 raft_consensus.cc:2468] T 08d5152e641944c882dfbb0e853415c6 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 0.
I20260709 13:01:50.874699  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0821874284d24042bc11cb263f92ae68" candidate_uuid: "1ab8939b06d94226859d2091b6837cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" is_pre_election: true
I20260709 13:01:50.875499  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f4cb214fc649deb6d5621660b59def" candidate_uuid: "1ab8939b06d94226859d2091b6837cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" is_pre_election: true
I20260709 13:01:50.876000  9037 tablet_bootstrap.cc:654] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.876608  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d5152e641944c882dfbb0e853415c6" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b573f69535f34eb29ac81316560dcbfb" is_pre_election: true
I20260709 13:01:50.872838  9034 ts_tablet_manager.cc:1434] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260709 13:01:50.877296  8919 raft_consensus.cc:2468] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 0.
I20260709 13:01:50.877544  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f4cb214fc649deb6d5621660b59def" candidate_uuid: "1ab8939b06d94226859d2091b6837cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b573f69535f34eb29ac81316560dcbfb" is_pre_election: true
I20260709 13:01:50.878258  9034 tablet_bootstrap.cc:492] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb: Bootstrap starting.
I20260709 13:01:50.877310  8808 leader_election.cc:304] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:50.879479  9043 raft_consensus.cc:2804] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:50.879866  9043 raft_consensus.cc:493] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:50.880066  8957 leader_election.cc:343] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.880806  9043 raft_consensus.cc:3060] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:50.884418  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab22a9e82e64d8782c5979f0129cb81" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
W20260709 13:01:50.885967  8883 leader_election.cc:343] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:50.889631  8957 leader_election.cc:343] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.890136  9060 leader_election.cc:290] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 election: Requested vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
W20260709 13:01:50.890578  8960 leader_election.cc:343] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.894345  9043 raft_consensus.cc:515] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.896716  9034 tablet_bootstrap.cc:654] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.898360  9043 leader_election.cc:290] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 election: Requested vote from peers b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:50.899768  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d5152e641944c882dfbb0e853415c6" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
I20260709 13:01:50.900588  8920 raft_consensus.cc:3060] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:50.891350  8845 raft_consensus.cc:2468] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b573f69535f34eb29ac81316560dcbfb in term 1.
I20260709 13:01:50.903851  8886 leader_election.cc:304] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b573f69535f34eb29ac81316560dcbfb, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 1ab8939b06d94226859d2091b6837cb0
I20260709 13:01:50.900357  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d5152e641944c882dfbb0e853415c6" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:50.905354  8994 raft_consensus.cc:3060] T 08d5152e641944c882dfbb0e853415c6 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:50.905115  9039 raft_consensus.cc:2804] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:50.906737  9039 raft_consensus.cc:697] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 1 LEADER]: Becoming Leader. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Running, Role: LEADER
I20260709 13:01:50.907554  9039 consensus_queue.cc:237] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.908218  8960 leader_election.cc:304] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0; no voters: b573f69535f34eb29ac81316560dcbfb, d1afd0dcf1fd4f1f99645e792f53a18b
W20260709 13:01:50.910097  8960 leader_election.cc:343] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.912402  9056 raft_consensus.cc:2749] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:50.910786  8960 leader_election.cc:304] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0; no voters: b573f69535f34eb29ac81316560dcbfb, d1afd0dcf1fd4f1f99645e792f53a18b
I20260709 13:01:50.917587  9056 raft_consensus.cc:2749] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:50.920317  8742 catalog_manager.cc:5697] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to b573f69535f34eb29ac81316560dcbfb (127.8.4.66). New cstate: current_term: 1 leader_uuid: "b573f69535f34eb29ac81316560dcbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:50.923197  8743 catalog_manager.cc:5697] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b reported cstate change: term changed from 0 to 1, leader changed from <none> to d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65). New cstate: current_term: 1 leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:50.926379  8920 raft_consensus.cc:2468] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 1.
I20260709 13:01:50.928856  8808 leader_election.cc:304] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b573f69535f34eb29ac81316560dcbfb, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:50.932683  9046 raft_consensus.cc:2804] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:50.933425  9046 raft_consensus.cc:697] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Becoming Leader. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:50.934301  9046 consensus_queue.cc:237] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.934842  9037 tablet_bootstrap.cc:492] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b: No bootstrap required, opened a new log
I20260709 13:01:50.935066  9034 tablet_bootstrap.cc:492] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb: No bootstrap required, opened a new log
I20260709 13:01:50.935335  9037 ts_tablet_manager.cc:1403] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b: Time spent bootstrapping tablet: real 0.075s	user 0.028s	sys 0.012s
I20260709 13:01:50.935526  9034 ts_tablet_manager.cc:1403] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.008s
I20260709 13:01:50.938534  9036 tablet_bootstrap.cc:492] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0: No bootstrap required, opened a new log
I20260709 13:01:50.938447  9037 raft_consensus.cc:359] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.939165  9036 ts_tablet_manager.cc:1403] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0: Time spent bootstrapping tablet: real 0.118s	user 0.027s	sys 0.035s
I20260709 13:01:50.939289  9037 raft_consensus.cc:385] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.939662  9037 raft_consensus.cc:740] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.940536  9037 consensus_queue.cc:260] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.941700  9034 raft_consensus.cc:359] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.942233  9036 raft_consensus.cc:359] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.943163  9036 raft_consensus.cc:385] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.942469  9034 raft_consensus.cc:385] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.943490  9036 raft_consensus.cc:740] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab8939b06d94226859d2091b6837cb0, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.943717  9034 raft_consensus.cc:740] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.942831  9037 ts_tablet_manager.cc:1434] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:01:50.944453  9036 consensus_queue.cc:260] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.944836  9034 consensus_queue.cc:260] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.945902  9037 tablet_bootstrap.cc:492] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b: Bootstrap starting.
I20260709 13:01:50.946898  9036 ts_tablet_manager.cc:1434] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:01:50.947135  9034 ts_tablet_manager.cc:1434] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:01:50.947885  9036 tablet_bootstrap.cc:492] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0: Bootstrap starting.
I20260709 13:01:50.948100  9034 tablet_bootstrap.cc:492] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb: Bootstrap starting.
I20260709 13:01:50.954087  9037 tablet_bootstrap.cc:654] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.955006  9034 tablet_bootstrap.cc:654] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.956961  9036 tablet_bootstrap.cc:654] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.961699  9046 raft_consensus.cc:493] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.962764  9043 raft_consensus.cc:493] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.963526  9043 raft_consensus.cc:515] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.962433  9046 raft_consensus.cc:515] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.966423  9043 leader_election.cc:290] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:50.972012  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0821874284d24042bc11cb263f92ae68" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b573f69535f34eb29ac81316560dcbfb" is_pre_election: true
I20260709 13:01:50.973058  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9eb6066fea4d8888cfcfa200a7e7e3" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b573f69535f34eb29ac81316560dcbfb" is_pre_election: true
I20260709 13:01:50.974138  9034 tablet_bootstrap.cc:492] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb: No bootstrap required, opened a new log
I20260709 13:01:50.974050  8919 raft_consensus.cc:2468] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 0.
I20260709 13:01:50.975018  9034 ts_tablet_manager.cc:1403] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.005s
I20260709 13:01:50.975662  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0821874284d24042bc11cb263f92ae68" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab8939b06d94226859d2091b6837cb0" is_pre_election: true
I20260709 13:01:50.976651  8993 raft_consensus.cc:2468] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 0.
I20260709 13:01:50.960912  8994 raft_consensus.cc:2468] T 08d5152e641944c882dfbb0e853415c6 P 1ab8939b06d94226859d2091b6837cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 1.
W20260709 13:01:50.979779  8808 leader_election.cc:343] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.980870  8808 leader_election.cc:304] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b573f69535f34eb29ac81316560dcbfb, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:50.982942  9043 raft_consensus.cc:2804] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:50.983605  9043 raft_consensus.cc:493] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.984122  9043 raft_consensus.cc:3060] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:50.985755  8808 leader_election.cc:304] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: b573f69535f34eb29ac81316560dcbfb
I20260709 13:01:50.982399  9034 raft_consensus.cc:359] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.988467  9034 raft_consensus.cc:385] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.990286  9036 tablet_bootstrap.cc:492] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0: No bootstrap required, opened a new log
I20260709 13:01:50.990875  9034 raft_consensus.cc:740] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.991191  9036 ts_tablet_manager.cc:1403] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0: Time spent bootstrapping tablet: real 0.044s	user 0.029s	sys 0.011s
I20260709 13:01:50.991704  9046 leader_election.cc:290] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:50.992308  9046 raft_consensus.cc:2804] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:50.992769  9046 raft_consensus.cc:493] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.991923  9034 consensus_queue.cc:260] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.993324  9046 raft_consensus.cc:3060] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:50.995019  9034 ts_tablet_manager.cc:1434] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.006s
I20260709 13:01:50.995213  9036 raft_consensus.cc:359] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.996191  9034 tablet_bootstrap.cc:492] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb: Bootstrap starting.
I20260709 13:01:50.996265  9036 raft_consensus.cc:385] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.996831  9036 raft_consensus.cc:740] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab8939b06d94226859d2091b6837cb0, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.998834  9036 consensus_queue.cc:260] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:50.999876  9037 tablet_bootstrap.cc:492] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b: No bootstrap required, opened a new log
I20260709 13:01:51.000371  9037 ts_tablet_manager.cc:1403] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.016s
I20260709 13:01:51.002321  9046 raft_consensus.cc:515] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.004190  9037 raft_consensus.cc:359] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.004983  9037 raft_consensus.cc:385] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.005364  9037 raft_consensus.cc:740] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.005494  9043 raft_consensus.cc:515] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.006110  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0821874284d24042bc11cb263f92ae68" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
I20260709 13:01:51.007042  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9eb6066fea4d8888cfcfa200a7e7e3" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab8939b06d94226859d2091b6837cb0" is_pre_election: true
I20260709 13:01:51.007519  9043 leader_election.cc:290] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 election: Requested vote from peers b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:51.007659  8994 raft_consensus.cc:2468] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 0.
I20260709 13:01:51.008679  9037 consensus_queue.cc:260] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.009451  9036 ts_tablet_manager.cc:1434] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:01:51.010048  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9eb6066fea4d8888cfcfa200a7e7e3" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
I20260709 13:01:51.010462  9036 tablet_bootstrap.cc:492] T f27a5fdf363b407280ce8086858a8912 P 1ab8939b06d94226859d2091b6837cb0: Bootstrap starting.
I20260709 13:01:51.010632  8919 raft_consensus.cc:3060] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.010942  9037 ts_tablet_manager.cc:1434] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.006s
I20260709 13:01:51.011866  9037 tablet_bootstrap.cc:492] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b: Bootstrap starting.
I20260709 13:01:51.012066  9034 tablet_bootstrap.cc:654] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.017369  9036 tablet_bootstrap.cc:654] T f27a5fdf363b407280ce8086858a8912 P 1ab8939b06d94226859d2091b6837cb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.017777  9075 raft_consensus.cc:493] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.018234  9075 raft_consensus.cc:515] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.020512  9075 leader_election.cc:290] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:51.021271  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0821874284d24042bc11cb263f92ae68" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:51.021986  8994 raft_consensus.cc:3060] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.032521  9037 tablet_bootstrap.cc:654] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.034754  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9eb6066fea4d8888cfcfa200a7e7e3" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:51.035573  8993 raft_consensus.cc:3060] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.039322  8994 raft_consensus.cc:2468] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 1.
I20260709 13:01:51.042960  9037 tablet_bootstrap.cc:492] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b: No bootstrap required, opened a new log
I20260709 13:01:51.043628  9037 ts_tablet_manager.cc:1403] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.006s
I20260709 13:01:51.046733  8993 raft_consensus.cc:2468] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 1.
I20260709 13:01:51.047063  9037 raft_consensus.cc:359] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.048383  8808 leader_election.cc:304] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:51.052091  9037 raft_consensus.cc:385] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.052544  9037 raft_consensus.cc:740] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.052852  9043 raft_consensus.cc:2804] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:51.053594  9043 raft_consensus.cc:697] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Becoming Leader. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
W20260709 13:01:51.054107  8808 leader_election.cc:343] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.055028  9043 consensus_queue.cc:237] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.056362  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27a5fdf363b407280ce8086858a8912" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b573f69535f34eb29ac81316560dcbfb" is_pre_election: true
I20260709 13:01:51.057235  8920 raft_consensus.cc:2468] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 0.
I20260709 13:01:51.050499  8919 raft_consensus.cc:2468] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 1.
I20260709 13:01:51.004720  9046 leader_election.cc:290] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 election: Requested vote from peers b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:51.053517  9037 consensus_queue.cc:260] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.061540  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27a5fdf363b407280ce8086858a8912" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab8939b06d94226859d2091b6837cb0" is_pre_election: true
W20260709 13:01:51.064451  8808 leader_election.cc:343] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.065110  9037 ts_tablet_manager.cc:1434] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b: Time spent starting tablet: real 0.021s	user 0.011s	sys 0.000s
I20260709 13:01:51.066460  8808 leader_election.cc:304] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:51.067444  9046 raft_consensus.cc:2804] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:51.067915  9046 raft_consensus.cc:697] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Becoming Leader. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:51.068744  9046 consensus_queue.cc:237] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.070525  8808 leader_election.cc:304] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b573f69535f34eb29ac81316560dcbfb, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 1ab8939b06d94226859d2091b6837cb0
I20260709 13:01:51.071323  9075 raft_consensus.cc:2804] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:51.071671  9075 raft_consensus.cc:493] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.072063  9075 raft_consensus.cc:3060] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.072767  8743 catalog_manager.cc:5697] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b reported cstate change: term changed from 0 to 1, leader changed from <none> to d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65). New cstate: current_term: 1 leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.076542  9036 tablet_bootstrap.cc:492] T f27a5fdf363b407280ce8086858a8912 P 1ab8939b06d94226859d2091b6837cb0: No bootstrap required, opened a new log
I20260709 13:01:51.076894  9034 tablet_bootstrap.cc:492] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb: No bootstrap required, opened a new log
I20260709 13:01:51.077118  9036 ts_tablet_manager.cc:1403] T f27a5fdf363b407280ce8086858a8912 P 1ab8939b06d94226859d2091b6837cb0: Time spent bootstrapping tablet: real 0.067s	user 0.029s	sys 0.027s
I20260709 13:01:51.077538  9034 ts_tablet_manager.cc:1403] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb: Time spent bootstrapping tablet: real 0.082s	user 0.010s	sys 0.022s
I20260709 13:01:51.080163  9036 raft_consensus.cc:359] T f27a5fdf363b407280ce8086858a8912 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.080515  9034 raft_consensus.cc:359] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.080889  9036 raft_consensus.cc:385] T f27a5fdf363b407280ce8086858a8912 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.081362  9036 raft_consensus.cc:740] T f27a5fdf363b407280ce8086858a8912 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab8939b06d94226859d2091b6837cb0, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.081337  9034 raft_consensus.cc:385] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.081969  9034 raft_consensus.cc:740] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.082261  9036 consensus_queue.cc:260] T f27a5fdf363b407280ce8086858a8912 P 1ab8939b06d94226859d2091b6837cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.082906  9034 consensus_queue.cc:260] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.085074  9036 ts_tablet_manager.cc:1434] T f27a5fdf363b407280ce8086858a8912 P 1ab8939b06d94226859d2091b6837cb0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:01:51.086061  9036 tablet_bootstrap.cc:492] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0: Bootstrap starting.
I20260709 13:01:51.088120  8742 catalog_manager.cc:5697] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to b573f69535f34eb29ac81316560dcbfb (127.8.4.66). New cstate: current_term: 1 leader_uuid: "b573f69535f34eb29ac81316560dcbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.092370  9036 tablet_bootstrap.cc:654] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.092047  9075 raft_consensus.cc:515] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.095830  9075 leader_election.cc:290] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 election: Requested vote from peers b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:51.096215  9034 ts_tablet_manager.cc:1434] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:01:51.097388  9034 tablet_bootstrap.cc:492] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb: Bootstrap starting.
I20260709 13:01:51.098285  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27a5fdf363b407280ce8086858a8912" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
I20260709 13:01:51.099788  8919 raft_consensus.cc:3060] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.099148  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27a5fdf363b407280ce8086858a8912" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:51.066427  9037 tablet_bootstrap.cc:492] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b: Bootstrap starting.
I20260709 13:01:51.104465  9034 tablet_bootstrap.cc:654] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.100709  8993 raft_consensus.cc:3060] T f27a5fdf363b407280ce8086858a8912 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.111037  9036 tablet_bootstrap.cc:492] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0: No bootstrap required, opened a new log
I20260709 13:01:51.111552  9036 ts_tablet_manager.cc:1403] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.004s
I20260709 13:01:51.114264  9036 raft_consensus.cc:359] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.114753  9034 tablet_bootstrap.cc:492] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb: No bootstrap required, opened a new log
I20260709 13:01:51.117067  9036 raft_consensus.cc:385] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.115608  9037 tablet_bootstrap.cc:654] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.118588  9036 raft_consensus.cc:740] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab8939b06d94226859d2091b6837cb0, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.118654  9034 ts_tablet_manager.cc:1403] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.006s
I20260709 13:01:51.119509  9036 consensus_queue.cc:260] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.122022  9036 ts_tablet_manager.cc:1434] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:01:51.121762  9034 raft_consensus.cc:359] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.122540  9034 raft_consensus.cc:385] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.122846  9034 raft_consensus.cc:740] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.123199  9036 tablet_bootstrap.cc:492] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0: Bootstrap starting.
I20260709 13:01:51.123677  9034 consensus_queue.cc:260] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.126266  9034 ts_tablet_manager.cc:1434] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:01:51.127252  9034 tablet_bootstrap.cc:492] T 41f4cb214fc649deb6d5621660b59def P b573f69535f34eb29ac81316560dcbfb: Bootstrap starting.
I20260709 13:01:51.130498  9037 tablet_bootstrap.cc:492] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b: No bootstrap required, opened a new log
I20260709 13:01:51.130622  9036 tablet_bootstrap.cc:654] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.131132  9037 ts_tablet_manager.cc:1403] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.006s
I20260709 13:01:51.134271  9037 raft_consensus.cc:359] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.135104  8993 raft_consensus.cc:2468] T f27a5fdf363b407280ce8086858a8912 P 1ab8939b06d94226859d2091b6837cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 1.
I20260709 13:01:51.135399  9037 raft_consensus.cc:385] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.136829  8919 raft_consensus.cc:2468] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 1.
I20260709 13:01:51.136677  8808 leader_election.cc:304] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:51.137929  9034 tablet_bootstrap.cc:654] T 41f4cb214fc649deb6d5621660b59def P b573f69535f34eb29ac81316560dcbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.137995  9046 raft_consensus.cc:2804] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:51.138631  9046 raft_consensus.cc:697] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Becoming Leader. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:51.139389  9037 raft_consensus.cc:740] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.139448  9046 consensus_queue.cc:237] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.140275  9037 consensus_queue.cc:260] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.142804  9037 ts_tablet_manager.cc:1434] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:01:51.144014  9037 tablet_bootstrap.cc:492] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b: Bootstrap starting.
I20260709 13:01:51.152484  9036 tablet_bootstrap.cc:492] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0: No bootstrap required, opened a new log
I20260709 13:01:51.153075  9036 ts_tablet_manager.cc:1403] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.007s
I20260709 13:01:51.153662  9056 raft_consensus.cc:493] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.154521  9037 tablet_bootstrap.cc:654] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.154170  9056 raft_consensus.cc:515] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.156538  9056 leader_election.cc:290] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883)
I20260709 13:01:51.158258  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c1d81694c64be39bf3c51c7813c62c" candidate_uuid: "1ab8939b06d94226859d2091b6837cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b573f69535f34eb29ac81316560dcbfb" is_pre_election: true
I20260709 13:01:51.160761  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c1d81694c64be39bf3c51c7813c62c" candidate_uuid: "1ab8939b06d94226859d2091b6837cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" is_pre_election: true
I20260709 13:01:51.161044  9036 raft_consensus.cc:359] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.162695  9036 raft_consensus.cc:385] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.163065  9036 raft_consensus.cc:740] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab8939b06d94226859d2091b6837cb0, State: Initialized, Role: FOLLOWER
W20260709 13:01:51.163224  8960 leader_election.cc:343] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.164134  9036 consensus_queue.cc:260] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
W20260709 13:01:51.164927  8957 leader_election.cc:343] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.165604  8957 leader_election.cc:304] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0; no voters: b573f69535f34eb29ac81316560dcbfb, d1afd0dcf1fd4f1f99645e792f53a18b
I20260709 13:01:51.166880  9037 tablet_bootstrap.cc:492] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b: No bootstrap required, opened a new log
I20260709 13:01:51.167490  9037 ts_tablet_manager.cc:1403] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.005s
I20260709 13:01:51.167244  9056 raft_consensus.cc:2749] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:51.170794  9037 raft_consensus.cc:359] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.172194  9037 raft_consensus.cc:385] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.172572  9037 raft_consensus.cc:740] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.173453  9037 consensus_queue.cc:260] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.174474  9036 ts_tablet_manager.cc:1434] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:01:51.175455  9036 tablet_bootstrap.cc:492] T cb6c1c23963c420aa1c6f9aba2f1e6bb P 1ab8939b06d94226859d2091b6837cb0: Bootstrap starting.
I20260709 13:01:51.176049  9037 ts_tablet_manager.cc:1434] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:51.153663  8742 catalog_manager.cc:5697] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b reported cstate change: term changed from 0 to 1, leader changed from <none> to d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65). New cstate: current_term: 1 leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.179976  8742 catalog_manager.cc:5697] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b reported cstate change: term changed from 0 to 1, leader changed from <none> to d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65). New cstate: current_term: 1 leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.187103  9034 tablet_bootstrap.cc:492] T 41f4cb214fc649deb6d5621660b59def P b573f69535f34eb29ac81316560dcbfb: No bootstrap required, opened a new log
I20260709 13:01:51.187647  9034 ts_tablet_manager.cc:1403] T 41f4cb214fc649deb6d5621660b59def P b573f69535f34eb29ac81316560dcbfb: Time spent bootstrapping tablet: real 0.061s	user 0.026s	sys 0.028s
I20260709 13:01:51.188223  9046 raft_consensus.cc:493] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.188750  9046 raft_consensus.cc:515] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.191129  9046 leader_election.cc:290] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:51.191355  9034 raft_consensus.cc:359] T 41f4cb214fc649deb6d5621660b59def P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.191947  9036 tablet_bootstrap.cc:654] T cb6c1c23963c420aa1c6f9aba2f1e6bb P 1ab8939b06d94226859d2091b6837cb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.192128  9034 raft_consensus.cc:385] T 41f4cb214fc649deb6d5621660b59def P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.192263  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c1c23963c420aa1c6f9aba2f1e6bb" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b573f69535f34eb29ac81316560dcbfb" is_pre_election: true
I20260709 13:01:51.192446  9034 raft_consensus.cc:740] T 41f4cb214fc649deb6d5621660b59def P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.192755  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c1c23963c420aa1c6f9aba2f1e6bb" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab8939b06d94226859d2091b6837cb0" is_pre_election: true
I20260709 13:01:51.193102  8919 raft_consensus.cc:2468] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 0.
W20260709 13:01:51.194278  8808 leader_election.cc:343] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.194422  9034 consensus_queue.cc:260] T 41f4cb214fc649deb6d5621660b59def P b573f69535f34eb29ac81316560dcbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.195075  8808 leader_election.cc:304] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b573f69535f34eb29ac81316560dcbfb, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 1ab8939b06d94226859d2091b6837cb0
I20260709 13:01:51.196218  9046 raft_consensus.cc:2804] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:51.196614  9046 raft_consensus.cc:493] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.197027  9046 raft_consensus.cc:3060] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.203455  9046 raft_consensus.cc:515] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.205448  9034 ts_tablet_manager.cc:1434] T 41f4cb214fc649deb6d5621660b59def P b573f69535f34eb29ac81316560dcbfb: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:01:51.206861  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c1c23963c420aa1c6f9aba2f1e6bb" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
I20260709 13:01:51.207446  8919 raft_consensus.cc:3060] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.210237  9034 tablet_bootstrap.cc:492] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb: Bootstrap starting.
I20260709 13:01:51.215068  8919 raft_consensus.cc:2468] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 1.
I20260709 13:01:51.216976  8808 leader_election.cc:304] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b573f69535f34eb29ac81316560dcbfb, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:51.217800  9034 tablet_bootstrap.cc:654] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.217905  9043 raft_consensus.cc:2804] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:51.218411  9043 raft_consensus.cc:697] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Becoming Leader. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:51.219326  9043 consensus_queue.cc:237] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.220408  9036 tablet_bootstrap.cc:492] T cb6c1c23963c420aa1c6f9aba2f1e6bb P 1ab8939b06d94226859d2091b6837cb0: No bootstrap required, opened a new log
I20260709 13:01:51.220891  9036 ts_tablet_manager.cc:1403] T cb6c1c23963c420aa1c6f9aba2f1e6bb P 1ab8939b06d94226859d2091b6837cb0: Time spent bootstrapping tablet: real 0.046s	user 0.022s	sys 0.010s
I20260709 13:01:51.223758  9036 raft_consensus.cc:359] T cb6c1c23963c420aa1c6f9aba2f1e6bb P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.224494  9036 raft_consensus.cc:385] T cb6c1c23963c420aa1c6f9aba2f1e6bb P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.223371  8742 catalog_manager.cc:5697] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b reported cstate change: term changed from 0 to 1, leader changed from <none> to d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65). New cstate: current_term: 1 leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.224802  9036 raft_consensus.cc:740] T cb6c1c23963c420aa1c6f9aba2f1e6bb P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab8939b06d94226859d2091b6837cb0, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.225694  9036 consensus_queue.cc:260] T cb6c1c23963c420aa1c6f9aba2f1e6bb P 1ab8939b06d94226859d2091b6837cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.227490  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c1c23963c420aa1c6f9aba2f1e6bb" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:51.228250  8993 raft_consensus.cc:3060] T cb6c1c23963c420aa1c6f9aba2f1e6bb P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.231071  9036 ts_tablet_manager.cc:1434] T cb6c1c23963c420aa1c6f9aba2f1e6bb P 1ab8939b06d94226859d2091b6837cb0: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:01:51.235209  9046 leader_election.cc:290] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 election: Requested vote from peers b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:51.236757  8993 raft_consensus.cc:2468] T cb6c1c23963c420aa1c6f9aba2f1e6bb P 1ab8939b06d94226859d2091b6837cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 1.
I20260709 13:01:51.237221  9034 tablet_bootstrap.cc:492] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb: No bootstrap required, opened a new log
I20260709 13:01:51.237704  9034 ts_tablet_manager.cc:1403] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.007s
I20260709 13:01:51.240675  9034 raft_consensus.cc:359] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.241421  9034 raft_consensus.cc:385] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.241721  9034 raft_consensus.cc:740] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.242412  9034 consensus_queue.cc:260] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.244688  9034 ts_tablet_manager.cc:1434] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:01:51.244719  8743 catalog_manager.cc:5697] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b reported cstate change: term changed from 0 to 1, leader changed from <none> to d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65). New cstate: current_term: 1 leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.252703  9046 raft_consensus.cc:493] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.253366  9046 raft_consensus.cc:515] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.255625  9046 leader_election.cc:290] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:51.256312  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f4cb214fc649deb6d5621660b59def" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b573f69535f34eb29ac81316560dcbfb" is_pre_election: true
I20260709 13:01:51.256728  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f4cb214fc649deb6d5621660b59def" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab8939b06d94226859d2091b6837cb0" is_pre_election: true
I20260709 13:01:51.256889  8919 raft_consensus.cc:2468] T 41f4cb214fc649deb6d5621660b59def P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 0.
I20260709 13:01:51.257470  8993 raft_consensus.cc:2468] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 0.
I20260709 13:01:51.258018  8808 leader_election.cc:304] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b573f69535f34eb29ac81316560dcbfb, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:51.258807  9046 raft_consensus.cc:2804] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:51.259112  9046 raft_consensus.cc:493] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.259446  9046 raft_consensus.cc:3060] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.264341  9046 raft_consensus.cc:515] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.266011  9046 leader_election.cc:290] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 election: Requested vote from peers b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:51.266911  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f4cb214fc649deb6d5621660b59def" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
I20260709 13:01:51.267136  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f4cb214fc649deb6d5621660b59def" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:51.267470  8919 raft_consensus.cc:3060] T 41f4cb214fc649deb6d5621660b59def P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.267685  8993 raft_consensus.cc:3060] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.272352  8919 raft_consensus.cc:2468] T 41f4cb214fc649deb6d5621660b59def P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 1.
I20260709 13:01:51.272368  9056 raft_consensus.cc:493] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.272591  8993 raft_consensus.cc:2468] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 1.
I20260709 13:01:51.272986  9056 raft_consensus.cc:515] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.273478  8808 leader_election.cc:304] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b573f69535f34eb29ac81316560dcbfb, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:51.274253  9046 raft_consensus.cc:2804] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:51.274775  9046 raft_consensus.cc:697] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Becoming Leader. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:51.275810  9056 leader_election.cc:290] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883)
I20260709 13:01:51.275684  9046 consensus_queue.cc:237] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.276150  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab22a9e82e64d8782c5979f0129cb81" candidate_uuid: "1ab8939b06d94226859d2091b6837cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" is_pre_election: true
I20260709 13:01:51.276667  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab22a9e82e64d8782c5979f0129cb81" candidate_uuid: "1ab8939b06d94226859d2091b6837cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b573f69535f34eb29ac81316560dcbfb" is_pre_election: true
I20260709 13:01:51.276901  8845 raft_consensus.cc:2393] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ab8939b06d94226859d2091b6837cb0 in current term 1: Already voted for candidate b573f69535f34eb29ac81316560dcbfb in this term.
I20260709 13:01:51.278488  8960 leader_election.cc:304] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0; no voters: b573f69535f34eb29ac81316560dcbfb, d1afd0dcf1fd4f1f99645e792f53a18b
I20260709 13:01:51.279275  9056 raft_consensus.cc:3060] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.285490  9039 raft_consensus.cc:493] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.285545  9056 raft_consensus.cc:2749] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:51.286017  9039 raft_consensus.cc:515] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.285516  8743 catalog_manager.cc:5697] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b reported cstate change: term changed from 0 to 1, leader changed from <none> to d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65). New cstate: current_term: 1 leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.288028  9039 leader_election.cc:290] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:51.288745  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce625ab6cde4eae85ae856751ba3258" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" is_pre_election: true
I20260709 13:01:51.289144  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce625ab6cde4eae85ae856751ba3258" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab8939b06d94226859d2091b6837cb0" is_pre_election: true
I20260709 13:01:51.290086  8993 raft_consensus.cc:2393] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b573f69535f34eb29ac81316560dcbfb in current term 1: Already voted for candidate d1afd0dcf1fd4f1f99645e792f53a18b in this term.
I20260709 13:01:51.291036  8883 leader_election.cc:304] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b573f69535f34eb29ac81316560dcbfb; no voters: 1ab8939b06d94226859d2091b6837cb0, d1afd0dcf1fd4f1f99645e792f53a18b
I20260709 13:01:51.291692  9039 raft_consensus.cc:3060] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.297281  9039 raft_consensus.cc:2749] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:51.336589  9046 consensus_queue.cc:1048] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:51.340432  9043 consensus_queue.cc:1048] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:51.349339  9043 consensus_queue.cc:1048] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:51.355733  9043 consensus_queue.cc:1048] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:51.389752  9039 raft_consensus.cc:493] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.390431  9039 raft_consensus.cc:515] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.392333  9039 leader_election.cc:290] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:51.393567  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0821874284d24042bc11cb263f92ae68" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab8939b06d94226859d2091b6837cb0" is_pre_election: true
I20260709 13:01:51.393682  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0821874284d24042bc11cb263f92ae68" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" is_pre_election: true
I20260709 13:01:51.394517  8993 raft_consensus.cc:2393] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b573f69535f34eb29ac81316560dcbfb in current term 1: Already voted for candidate d1afd0dcf1fd4f1f99645e792f53a18b in this term.
I20260709 13:01:51.395447  8883 leader_election.cc:304] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b573f69535f34eb29ac81316560dcbfb; no voters: 1ab8939b06d94226859d2091b6837cb0, d1afd0dcf1fd4f1f99645e792f53a18b
I20260709 13:01:51.396167  9039 raft_consensus.cc:3060] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.401351  9039 raft_consensus.cc:2749] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:51.405373  9060 consensus_queue.cc:1048] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:51.415823  8993 raft_consensus.cc:3060] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.424088  9102 consensus_queue.cc:1048] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:51.449710  9102 raft_consensus.cc:493] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.450314  9102 raft_consensus.cc:515] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.452200  9102 leader_election.cc:290] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:51.452901  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c1d81694c64be39bf3c51c7813c62c" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" is_pre_election: true
I20260709 13:01:51.453418  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c1d81694c64be39bf3c51c7813c62c" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab8939b06d94226859d2091b6837cb0" is_pre_election: true
I20260709 13:01:51.453562  8845 raft_consensus.cc:2468] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b573f69535f34eb29ac81316560dcbfb in term 0.
I20260709 13:01:51.454017  8994 raft_consensus.cc:2468] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b573f69535f34eb29ac81316560dcbfb in term 0.
I20260709 13:01:51.454555  8886 leader_election.cc:304] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b573f69535f34eb29ac81316560dcbfb, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:51.454712  9043 consensus_queue.cc:1048] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:51.455323  9102 raft_consensus.cc:2804] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:51.455623  9102 raft_consensus.cc:493] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.455878  9102 raft_consensus.cc:3060] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.463964  9102 raft_consensus.cc:515] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.466159  9102 leader_election.cc:290] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 election: Requested vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:51.466526  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c1d81694c64be39bf3c51c7813c62c" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
I20260709 13:01:51.467140  8845 raft_consensus.cc:3060] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.468760  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c1d81694c64be39bf3c51c7813c62c" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:51.469444  8994 raft_consensus.cc:3060] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.473716  9043 consensus_queue.cc:1048] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:51.476136  8845 raft_consensus.cc:2468] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b573f69535f34eb29ac81316560dcbfb in term 1.
I20260709 13:01:51.476840  8994 raft_consensus.cc:2468] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b573f69535f34eb29ac81316560dcbfb in term 1.
I20260709 13:01:51.477142  8886 leader_election.cc:304] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b573f69535f34eb29ac81316560dcbfb, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:51.478104  9102 raft_consensus.cc:2804] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:51.478839  9102 raft_consensus.cc:697] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [term 1 LEADER]: Becoming Leader. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Running, Role: LEADER
I20260709 13:01:51.479764  9102 consensus_queue.cc:237] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.489830  9102 consensus_queue.cc:1048] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:51.493388  8741 catalog_manager.cc:5697] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to b573f69535f34eb29ac81316560dcbfb (127.8.4.66). New cstate: current_term: 1 leader_uuid: "b573f69535f34eb29ac81316560dcbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.500923  9060 consensus_queue.cc:1048] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:51.568315  9043 consensus_queue.cc:1048] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:51.580185  9043 consensus_queue.cc:1048] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:51.681178  9043 consensus_queue.cc:1048] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:51.692541  9110 consensus_queue.cc:1048] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:51.696251  9075 consensus_queue.cc:1048] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:51.696925  9043 consensus_queue.cc:1048] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:51.748612  8920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e89da22e652440a81d85ab6924828ed"
dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
mode: GRACEFUL
new_leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
 from {username='slave'} at 127.0.0.1:50944
I20260709 13:01:51.749218  8920 raft_consensus.cc:606] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 1 LEADER]: Received request to transfer leadership to TS d1afd0dcf1fd4f1f99645e792f53a18b
I20260709 13:01:51.754900  8920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eab22a9e82e64d8782c5979f0129cb81"
dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
mode: GRACEFUL
new_leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
 from {username='slave'} at 127.0.0.1:50944
I20260709 13:01:51.755405  8920 raft_consensus.cc:606] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 1 LEADER]: Received request to transfer leadership to TS d1afd0dcf1fd4f1f99645e792f53a18b
I20260709 13:01:51.759157  9046 consensus_queue.cc:1048] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:51.761050  8920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45c1d81694c64be39bf3c51c7813c62c"
dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
mode: GRACEFUL
new_leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
 from {username='slave'} at 127.0.0.1:50944
I20260709 13:01:51.761677  8920 raft_consensus.cc:606] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [term 1 LEADER]: Received request to transfer leadership to TS d1afd0dcf1fd4f1f99645e792f53a18b
I20260709 13:01:51.773814  9046 consensus_queue.cc:1048] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:51.783510  8845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0821874284d24042bc11cb263f92ae68"
dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
mode: GRACEFUL
new_leader_uuid: "b573f69535f34eb29ac81316560dcbfb"
 from {username='slave'} at 127.0.0.1:45408
I20260709 13:01:51.784229  8845 raft_consensus.cc:606] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Received request to transfer leadership to TS b573f69535f34eb29ac81316560dcbfb
I20260709 13:01:51.790438  8845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f27a5fdf363b407280ce8086858a8912"
dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
mode: GRACEFUL
new_leader_uuid: "b573f69535f34eb29ac81316560dcbfb"
 from {username='slave'} at 127.0.0.1:45408
I20260709 13:01:51.791018  8845 raft_consensus.cc:606] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Received request to transfer leadership to TS b573f69535f34eb29ac81316560dcbfb
I20260709 13:01:51.797662  8845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af9eb6066fea4d8888cfcfa200a7e7e3"
dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
mode: GRACEFUL
new_leader_uuid: "b573f69535f34eb29ac81316560dcbfb"
 from {username='slave'} at 127.0.0.1:45408
I20260709 13:01:51.798136  8845 raft_consensus.cc:606] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Received request to transfer leadership to TS b573f69535f34eb29ac81316560dcbfb
I20260709 13:01:51.803516  8845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb6c1c23963c420aa1c6f9aba2f1e6bb"
dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
mode: GRACEFUL
new_leader_uuid: "b573f69535f34eb29ac81316560dcbfb"
 from {username='slave'} at 127.0.0.1:45408
I20260709 13:01:51.803965  8845 raft_consensus.cc:606] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Received request to transfer leadership to TS b573f69535f34eb29ac81316560dcbfb
I20260709 13:01:51.808563  8845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41f4cb214fc649deb6d5621660b59def"
dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
mode: GRACEFUL
new_leader_uuid: "1ab8939b06d94226859d2091b6837cb0"
 from {username='slave'} at 127.0.0.1:45408
I20260709 13:01:51.809094  8845 raft_consensus.cc:606] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Received request to transfer leadership to TS 1ab8939b06d94226859d2091b6837cb0
I20260709 13:01:51.929745  9102 raft_consensus.cc:993] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb: : Instructing follower d1afd0dcf1fd4f1f99645e792f53a18b to start an election
I20260709 13:01:51.930292  9060 raft_consensus.cc:1081] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 1 LEADER]: Signalling peer d1afd0dcf1fd4f1f99645e792f53a18b to start an election
I20260709 13:01:51.931942  8845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eab22a9e82e64d8782c5979f0129cb81"
dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
 from {username='slave'} at 127.0.0.1:45390
I20260709 13:01:51.932276  9060 consensus_queue.cc:1048] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:51.932536  8845 raft_consensus.cc:493] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:51.932934  8845 raft_consensus.cc:3060] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.938719  8845 raft_consensus.cc:515] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.939196  9102 raft_consensus.cc:993] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb: : Instructing follower d1afd0dcf1fd4f1f99645e792f53a18b to start an election
I20260709 13:01:51.939680  9102 raft_consensus.cc:1081] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [term 1 LEADER]: Signalling peer d1afd0dcf1fd4f1f99645e792f53a18b to start an election
I20260709 13:01:51.942098  8845 leader_election.cc:290] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 2 election: Requested vote from peers b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:51.945327  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab22a9e82e64d8782c5979f0129cb81" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:51.946081  8992 raft_consensus.cc:3060] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.946746  9039 consensus_queue.cc:1048] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:51.949121  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab22a9e82e64d8782c5979f0129cb81" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
I20260709 13:01:51.949771  8920 raft_consensus.cc:3055] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:51.950130  8920 raft_consensus.cc:740] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Running, Role: LEADER
I20260709 13:01:51.951017  8920 consensus_queue.cc:260] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.952464  8920 raft_consensus.cc:3060] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.955037  8992 raft_consensus.cc:2468] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 2.
I20260709 13:01:51.956609  8808 leader_election.cc:304] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:51.956971  8845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45c1d81694c64be39bf3c51c7813c62c"
dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
 from {username='slave'} at 127.0.0.1:45390
I20260709 13:01:51.957607  8845 raft_consensus.cc:493] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:51.957983  8845 raft_consensus.cc:3060] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.959017  9046 raft_consensus.cc:2804] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:51.959553  9046 raft_consensus.cc:697] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 LEADER]: Becoming Leader. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:51.960453  9046 consensus_queue.cc:237] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.965664  8920 raft_consensus.cc:2468] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 2.
I20260709 13:01:51.965451  8845 raft_consensus.cc:515] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.967659  8845 leader_election.cc:290] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 2 election: Requested vote from peers b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:51.970258  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c1d81694c64be39bf3c51c7813c62c" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:51.970861  8992 raft_consensus.cc:3060] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.971683  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c1d81694c64be39bf3c51c7813c62c" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
I20260709 13:01:51.972298  8920 raft_consensus.cc:3055] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:51.972663  8920 raft_consensus.cc:740] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Running, Role: LEADER
I20260709 13:01:51.973707  8920 consensus_queue.cc:260] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.975263  8920 raft_consensus.cc:3060] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.976755  8743 catalog_manager.cc:5697] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b reported cstate change: term changed from 1 to 2, leader changed from b573f69535f34eb29ac81316560dcbfb (127.8.4.66) to d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65). New cstate: current_term: 2 leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.978199  8992 raft_consensus.cc:2468] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 2.
I20260709 13:01:51.979355  8808 leader_election.cc:304] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:51.980026  9046 raft_consensus.cc:2804] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:51.980450  9046 raft_consensus.cc:697] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 LEADER]: Becoming Leader. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:51.981248  9046 consensus_queue.cc:237] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:51.984050  8920 raft_consensus.cc:2468] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 2.
I20260709 13:01:51.991734  8743 catalog_manager.cc:5697] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b reported cstate change: term changed from 1 to 2, leader changed from b573f69535f34eb29ac81316560dcbfb (127.8.4.66) to d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65). New cstate: current_term: 2 leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.997987  9060 raft_consensus.cc:993] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb: : Instructing follower d1afd0dcf1fd4f1f99645e792f53a18b to start an election
I20260709 13:01:51.998507  9060 raft_consensus.cc:1081] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 1 LEADER]: Signalling peer d1afd0dcf1fd4f1f99645e792f53a18b to start an election
I20260709 13:01:52.000362  8845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e89da22e652440a81d85ab6924828ed"
dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
 from {username='slave'} at 127.0.0.1:45390
I20260709 13:01:52.000963  8845 raft_consensus.cc:493] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:52.001400  8845 raft_consensus.cc:3060] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.003723  9110 raft_consensus.cc:993] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b: : Instructing follower b573f69535f34eb29ac81316560dcbfb to start an election
I20260709 13:01:52.004184  9046 raft_consensus.cc:1081] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Signalling peer b573f69535f34eb29ac81316560dcbfb to start an election
I20260709 13:01:52.005901  8920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af9eb6066fea4d8888cfcfa200a7e7e3"
dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
 from {username='slave'} at 127.0.0.1:50920
I20260709 13:01:52.006457  8920 raft_consensus.cc:493] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:52.006821  8920 raft_consensus.cc:3060] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.007582  8845 raft_consensus.cc:515] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:52.009429  8845 leader_election.cc:290] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 2 election: Requested vote from peers b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:52.010355  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e89da22e652440a81d85ab6924828ed" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
I20260709 13:01:52.010512  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e89da22e652440a81d85ab6924828ed" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:52.011000  8919 raft_consensus.cc:3055] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:52.011093  8992 raft_consensus.cc:3060] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.011411  8919 raft_consensus.cc:740] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Running, Role: LEADER
I20260709 13:01:52.012244  8919 consensus_queue.cc:260] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:52.013509  8919 raft_consensus.cc:3060] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.013769  8920 raft_consensus.cc:515] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:52.016700  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9eb6066fea4d8888cfcfa200a7e7e3" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
I20260709 13:01:52.017046  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9eb6066fea4d8888cfcfa200a7e7e3" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:52.017557  8845 raft_consensus.cc:3055] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:52.017658  8993 raft_consensus.cc:3060] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.018050  8920 leader_election.cc:290] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 2 election: Requested vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:52.018359  8992 raft_consensus.cc:2468] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 2.
I20260709 13:01:52.019486  8808 leader_election.cc:304] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:52.019901  8919 raft_consensus.cc:2468] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 2.
I20260709 13:01:52.020115  9046 raft_consensus.cc:2804] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:52.020589  9046 raft_consensus.cc:697] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 LEADER]: Becoming Leader. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:52.021703  9046 consensus_queue.cc:237] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:52.023128  8845 raft_consensus.cc:740] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:52.023916  8993 raft_consensus.cc:2468] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b573f69535f34eb29ac81316560dcbfb in term 2.
I20260709 13:01:52.025064  8883 leader_election.cc:304] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, b573f69535f34eb29ac81316560dcbfb; no voters: 
I20260709 13:01:52.024981  8845 consensus_queue.cc:260] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:52.025988  9060 raft_consensus.cc:2804] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:52.026402  9060 raft_consensus.cc:697] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 2 LEADER]: Becoming Leader. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Running, Role: LEADER
I20260709 13:01:52.026435  8845 raft_consensus.cc:3060] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.027285  9060 consensus_queue.cc:237] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:52.028740  8743 catalog_manager.cc:5697] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b reported cstate change: term changed from 1 to 2, leader changed from b573f69535f34eb29ac81316560dcbfb (127.8.4.66) to d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65). New cstate: current_term: 2 leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:52.033246  8845 raft_consensus.cc:2468] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b573f69535f34eb29ac81316560dcbfb in term 2.
I20260709 13:01:52.035115  8740 catalog_manager.cc:5697] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb reported cstate change: term changed from 1 to 2, leader changed from d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65) to b573f69535f34eb29ac81316560dcbfb (127.8.4.66). New cstate: current_term: 2 leader_uuid: "b573f69535f34eb29ac81316560dcbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:52.087482  9075 raft_consensus.cc:993] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b: : Instructing follower b573f69535f34eb29ac81316560dcbfb to start an election
I20260709 13:01:52.087970  9046 raft_consensus.cc:1081] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Signalling peer b573f69535f34eb29ac81316560dcbfb to start an election
I20260709 13:01:52.089522  8919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0821874284d24042bc11cb263f92ae68"
dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
 from {username='slave'} at 127.0.0.1:50920
I20260709 13:01:52.090099  8919 raft_consensus.cc:493] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:52.090495  8919 raft_consensus.cc:3060] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.095444  8919 raft_consensus.cc:515] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:52.097065  8919 leader_election.cc:290] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 2 election: Requested vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:52.097965  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0821874284d24042bc11cb263f92ae68" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
I20260709 13:01:52.098129  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0821874284d24042bc11cb263f92ae68" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:52.098579  8845 raft_consensus.cc:3055] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:52.098592  8993 raft_consensus.cc:3060] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.099084  8845 raft_consensus.cc:740] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:52.099887  8845 consensus_queue.cc:260] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:52.101063  8845 raft_consensus.cc:3060] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.105896  8993 raft_consensus.cc:2468] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b573f69535f34eb29ac81316560dcbfb in term 2.
I20260709 13:01:52.107277  8883 leader_election.cc:304] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, b573f69535f34eb29ac81316560dcbfb; no voters: 
I20260709 13:01:52.107637  8845 raft_consensus.cc:2468] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b573f69535f34eb29ac81316560dcbfb in term 2.
I20260709 13:01:52.108122  9060 raft_consensus.cc:2804] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:52.108727  9060 raft_consensus.cc:697] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 2 LEADER]: Becoming Leader. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Running, Role: LEADER
I20260709 13:01:52.109557  9060 consensus_queue.cc:237] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:52.116451  8740 catalog_manager.cc:5697] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb reported cstate change: term changed from 1 to 2, leader changed from d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65) to b573f69535f34eb29ac81316560dcbfb (127.8.4.66). New cstate: current_term: 2 leader_uuid: "b573f69535f34eb29ac81316560dcbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:52.119225  9075 raft_consensus.cc:993] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b: : Instructing follower b573f69535f34eb29ac81316560dcbfb to start an election
I20260709 13:01:52.119712  9046 raft_consensus.cc:1081] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Signalling peer b573f69535f34eb29ac81316560dcbfb to start an election
I20260709 13:01:52.121394  8919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f27a5fdf363b407280ce8086858a8912"
dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
 from {username='slave'} at 127.0.0.1:50920
I20260709 13:01:52.121961  8919 raft_consensus.cc:493] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:52.122344  8919 raft_consensus.cc:3060] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.128120  8919 raft_consensus.cc:515] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:52.131014  8919 leader_election.cc:290] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 2 election: Requested vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:52.131178  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27a5fdf363b407280ce8086858a8912" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
I20260709 13:01:52.131278  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27a5fdf363b407280ce8086858a8912" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:52.132030  8845 raft_consensus.cc:3055] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:52.132093  8993 raft_consensus.cc:3060] T f27a5fdf363b407280ce8086858a8912 P 1ab8939b06d94226859d2091b6837cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.132623  8845 raft_consensus.cc:740] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:52.133460  8845 consensus_queue.cc:260] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:52.134339  8845 raft_consensus.cc:3060] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.137144  8993 raft_consensus.cc:2468] T f27a5fdf363b407280ce8086858a8912 P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b573f69535f34eb29ac81316560dcbfb in term 2.
I20260709 13:01:52.138172  8883 leader_election.cc:304] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, b573f69535f34eb29ac81316560dcbfb; no voters: 
I20260709 13:01:52.138840  9060 raft_consensus.cc:2804] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:52.139086  8845 raft_consensus.cc:2468] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b573f69535f34eb29ac81316560dcbfb in term 2.
I20260709 13:01:52.139249  9060 raft_consensus.cc:697] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [term 2 LEADER]: Becoming Leader. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Running, Role: LEADER
I20260709 13:01:52.140102  9060 consensus_queue.cc:237] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:52.146162  8740 catalog_manager.cc:5697] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb reported cstate change: term changed from 1 to 2, leader changed from d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65) to b573f69535f34eb29ac81316560dcbfb (127.8.4.66). New cstate: current_term: 2 leader_uuid: "b573f69535f34eb29ac81316560dcbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:52.170047  9075 raft_consensus.cc:993] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b: : Instructing follower b573f69535f34eb29ac81316560dcbfb to start an election
I20260709 13:01:52.170501  9046 raft_consensus.cc:1081] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Signalling peer b573f69535f34eb29ac81316560dcbfb to start an election
I20260709 13:01:52.172282  8919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb6c1c23963c420aa1c6f9aba2f1e6bb"
dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
 from {username='slave'} at 127.0.0.1:50920
I20260709 13:01:52.172946  8919 raft_consensus.cc:493] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:52.173425  8919 raft_consensus.cc:3060] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.188117  8919 raft_consensus.cc:515] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:52.753229  8919 leader_election.cc:290] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 2 election: Requested vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:52.767489  8844 raft_consensus.cc:1275] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Refusing update from remote peer b573f69535f34eb29ac81316560dcbfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:52.769608  9123 consensus_queue.cc:1048] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:52.776301  8917 raft_consensus.cc:1275] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Refusing update from remote peer d1afd0dcf1fd4f1f99645e792f53a18b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:52.776696  8920 raft_consensus.cc:1275] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Refusing update from remote peer d1afd0dcf1fd4f1f99645e792f53a18b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:52.777736  8918 raft_consensus.cc:1275] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Refusing update from remote peer d1afd0dcf1fd4f1f99645e792f53a18b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:52.783066  8992 raft_consensus.cc:1275] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Refusing update from remote peer b573f69535f34eb29ac81316560dcbfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:52.785363  8842 raft_consensus.cc:1275] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Refusing update from remote peer b573f69535f34eb29ac81316560dcbfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:52.788049  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c1c23963c420aa1c6f9aba2f1e6bb" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:52.788789  8993 raft_consensus.cc:3060] T cb6c1c23963c420aa1c6f9aba2f1e6bb P 1ab8939b06d94226859d2091b6837cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.791126  9129 consensus_queue.cc:1048] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:52.800675  9123 consensus_queue.cc:1048] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:52.800947  8992 raft_consensus.cc:1275] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Refusing update from remote peer b573f69535f34eb29ac81316560dcbfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:52.805814  9127 consensus_queue.cc:1048] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:52.807590  8992 raft_consensus.cc:1275] T f27a5fdf363b407280ce8086858a8912 P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Refusing update from remote peer b573f69535f34eb29ac81316560dcbfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:52.807807  9124 consensus_queue.cc:1048] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:52.809089  9124 consensus_queue.cc:1048] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:52.811187  8993 raft_consensus.cc:2468] T cb6c1c23963c420aa1c6f9aba2f1e6bb P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b573f69535f34eb29ac81316560dcbfb in term 2.
I20260709 13:01:52.814749  9131 consensus_queue.cc:1048] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:52.817804  9131 consensus_queue.cc:1048] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:52.996912  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6c1c23963c420aa1c6f9aba2f1e6bb" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
I20260709 13:01:52.997315  8916 raft_consensus.cc:1240] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Rejecting Update request from peer d1afd0dcf1fd4f1f99645e792f53a18b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:52.997882  8845 raft_consensus.cc:3055] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:52.998370  8845 raft_consensus.cc:740] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:52.999794  8845 consensus_queue.cc:260] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:53.006064  8845 raft_consensus.cc:3060] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:53.018827  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:40883, user_credentials={real_user=slave}} blocked reactor thread for 212670us
I20260709 13:01:53.035442  8993 raft_consensus.cc:1240] T cb6c1c23963c420aa1c6f9aba2f1e6bb P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Rejecting Update request from peer d1afd0dcf1fd4f1f99645e792f53a18b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:53.038066  8845 raft_consensus.cc:2468] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b573f69535f34eb29ac81316560dcbfb in term 2.
I20260709 13:01:53.039608  8886 leader_election.cc:304] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b573f69535f34eb29ac81316560dcbfb, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:53.040673  8992 raft_consensus.cc:1275] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Refusing update from remote peer d1afd0dcf1fd4f1f99645e792f53a18b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:53.041900  9133 raft_consensus.cc:2804] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:53.042433  9133 raft_consensus.cc:697] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb [term 2 LEADER]: Becoming Leader. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Running, Role: LEADER
I20260709 13:01:53.043020  8992 raft_consensus.cc:1275] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Refusing update from remote peer d1afd0dcf1fd4f1f99645e792f53a18b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:53.043092  8993 raft_consensus.cc:1275] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Refusing update from remote peer d1afd0dcf1fd4f1f99645e792f53a18b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:53.043321  9133 consensus_queue.cc:237] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:53.053485  9135 consensus_queue.cc:1048] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:53.056942  9126 consensus_queue.cc:1048] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:53.057873  9135 consensus_queue.cc:1048] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:53.071813  8843 raft_consensus.cc:1275] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Refusing update from remote peer b573f69535f34eb29ac81316560dcbfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:53.074257  9129 consensus_queue.cc:1048] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:01:53.086498  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35521, user_credentials={real_user=slave}} blocked reactor thread for 274799us
W20260709 13:01:53.152657  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:40883, user_credentials={real_user=slave}} blocked reactor thread for 55026.6us
I20260709 13:01:53.154999  8740 catalog_manager.cc:5697] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb reported cstate change: term changed from 1 to 2, leader changed from d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65) to b573f69535f34eb29ac81316560dcbfb (127.8.4.66). New cstate: current_term: 2 leader_uuid: "b573f69535f34eb29ac81316560dcbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:53.524276  8843 raft_consensus.cc:1275] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Refusing update from remote peer b573f69535f34eb29ac81316560dcbfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:53.525828  9133 consensus_queue.cc:1048] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:53.534646  8989 raft_consensus.cc:1275] T cb6c1c23963c420aa1c6f9aba2f1e6bb P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Refusing update from remote peer b573f69535f34eb29ac81316560dcbfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:53.536278  9123 consensus_queue.cc:1048] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:53.770828  8941 debug-util.cc:398] Leaking SignalData structure 0x7b08001181e0 after lost signal to thread 8212
W20260709 13:01:53.771592  8941 debug-util.cc:398] Leaking SignalData structure 0x7b08001f1cc0 after lost signal to thread 8777
W20260709 13:01:53.772372  8941 debug-util.cc:398] Leaking SignalData structure 0x7b08001eb840 after lost signal to thread 8869
W20260709 13:01:53.773211  8941 debug-util.cc:398] Leaking SignalData structure 0x7b080009f680 after lost signal to thread 8944
W20260709 13:01:53.773909  8941 debug-util.cc:398] Leaking SignalData structure 0x7b08000d9500 after lost signal to thread 9018
I20260709 13:01:55.383762  8209 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:01:55.385171  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:55.415781  8843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ce625ab6cde4eae85ae856751ba3258"
dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
mode: GRACEFUL
new_leader_uuid: "1ab8939b06d94226859d2091b6837cb0"
 from {username='slave'} at 127.0.0.1:50160
I20260709 13:01:55.416333  8843 raft_consensus.cc:606] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Received request to transfer leadership to TS 1ab8939b06d94226859d2091b6837cb0
I20260709 13:01:55.419895  8843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e89da22e652440a81d85ab6924828ed"
dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
mode: GRACEFUL
new_leader_uuid: "1ab8939b06d94226859d2091b6837cb0"
 from {username='slave'} at 127.0.0.1:50160
I20260709 13:01:55.420553  8843 raft_consensus.cc:606] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 LEADER]: Received request to transfer leadership to TS 1ab8939b06d94226859d2091b6837cb0
I20260709 13:01:55.423635  8843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eab22a9e82e64d8782c5979f0129cb81"
dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
mode: GRACEFUL
new_leader_uuid: "1ab8939b06d94226859d2091b6837cb0"
 from {username='slave'} at 127.0.0.1:50160
I20260709 13:01:55.424211  8843 raft_consensus.cc:606] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 LEADER]: Received request to transfer leadership to TS 1ab8939b06d94226859d2091b6837cb0
I20260709 13:01:55.425387  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:01:55.425880  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:55.595348  9170 raft_consensus.cc:993] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b: : Instructing follower 1ab8939b06d94226859d2091b6837cb0 to start an election
I20260709 13:01:55.595904  9128 raft_consensus.cc:1081] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 LEADER]: Signalling peer 1ab8939b06d94226859d2091b6837cb0 to start an election
I20260709 13:01:55.597826  8989 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eab22a9e82e64d8782c5979f0129cb81"
dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
 from {username='slave'} at 127.0.0.1:46002
I20260709 13:01:55.598364  8989 raft_consensus.cc:493] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:55.598670  8989 raft_consensus.cc:3060] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:55.604269  8989 raft_consensus.cc:515] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:55.607762  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab22a9e82e64d8782c5979f0129cb81" candidate_uuid: "1ab8939b06d94226859d2091b6837cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
I20260709 13:01:55.607936  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab22a9e82e64d8782c5979f0129cb81" candidate_uuid: "1ab8939b06d94226859d2091b6837cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
I20260709 13:01:55.608317  8843 raft_consensus.cc:3055] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:55.608750  8989 leader_election.cc:290] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 3 election: Requested vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883)
I20260709 13:01:55.608675  8916 raft_consensus.cc:3060] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:55.608647  8843 raft_consensus.cc:740] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:55.610064  8843 consensus_queue.cc:260] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:55.611136  8843 raft_consensus.cc:3060] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:55.616376  8843 raft_consensus.cc:2468] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ab8939b06d94226859d2091b6837cb0 in term 3.
I20260709 13:01:55.617148  8916 raft_consensus.cc:2468] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ab8939b06d94226859d2091b6837cb0 in term 3.
I20260709 13:01:55.617473  8960 leader_election.cc:304] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:55.619074  9171 raft_consensus.cc:2804] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:55.620239  9171 raft_consensus.cc:697] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 3 LEADER]: Becoming Leader. State: Replica: 1ab8939b06d94226859d2091b6837cb0, State: Running, Role: LEADER
I20260709 13:01:55.621079  9171 consensus_queue.cc:237] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:55.628881  8743 catalog_manager.cc:5697] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 reported cstate change: term changed from 2 to 3, leader changed from d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65) to 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67). New cstate: current_term: 3 leader_uuid: "1ab8939b06d94226859d2091b6837cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:55.712909  9170 raft_consensus.cc:993] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b: : Instructing follower 1ab8939b06d94226859d2091b6837cb0 to start an election
I20260709 13:01:55.713440  9128 raft_consensus.cc:1081] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 LEADER]: Signalling peer 1ab8939b06d94226859d2091b6837cb0 to start an election
I20260709 13:01:55.714951  8989 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e89da22e652440a81d85ab6924828ed"
dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
 from {username='slave'} at 127.0.0.1:46002
I20260709 13:01:55.715488  8989 raft_consensus.cc:493] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:55.715792  8989 raft_consensus.cc:3060] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:55.721501  8989 raft_consensus.cc:515] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:55.724624  8989 leader_election.cc:290] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 3 election: Requested vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883)
I20260709 13:01:55.725835  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e89da22e652440a81d85ab6924828ed" candidate_uuid: "1ab8939b06d94226859d2091b6837cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
I20260709 13:01:55.726446  8916 raft_consensus.cc:3060] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:55.754910  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e89da22e652440a81d85ab6924828ed" candidate_uuid: "1ab8939b06d94226859d2091b6837cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
I20260709 13:01:55.756963  8843 raft_consensus.cc:3055] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:55.758665  8843 raft_consensus.cc:740] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:55.760478  8843 consensus_queue.cc:260] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:55.764143  8843 raft_consensus.cc:3060] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:55.768395  8916 raft_consensus.cc:2468] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ab8939b06d94226859d2091b6837cb0 in term 3.
I20260709 13:01:55.773154  8957 leader_election.cc:304] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, b573f69535f34eb29ac81316560dcbfb; no voters: 
I20260709 13:01:55.774899  9171 raft_consensus.cc:2804] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:55.775501  9171 raft_consensus.cc:697] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 3 LEADER]: Becoming Leader. State: Replica: 1ab8939b06d94226859d2091b6837cb0, State: Running, Role: LEADER
I20260709 13:01:55.776834  9171 consensus_queue.cc:237] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:55.783247  8843 raft_consensus.cc:2468] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ab8939b06d94226859d2091b6837cb0 in term 3.
I20260709 13:01:55.793295  8743 catalog_manager.cc:5697] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 reported cstate change: term changed from 2 to 3, leader changed from d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65) to 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67). New cstate: current_term: 3 leader_uuid: "1ab8939b06d94226859d2091b6837cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:55.843158  9170 raft_consensus.cc:993] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b: : Instructing follower 1ab8939b06d94226859d2091b6837cb0 to start an election
I20260709 13:01:55.843894  9128 raft_consensus.cc:1081] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Signalling peer 1ab8939b06d94226859d2091b6837cb0 to start an election
I20260709 13:01:55.845700  8989 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ce625ab6cde4eae85ae856751ba3258"
dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
 from {username='slave'} at 127.0.0.1:46002
I20260709 13:01:55.846539  8989 raft_consensus.cc:493] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:55.846985  8989 raft_consensus.cc:3060] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:55.855751  8989 raft_consensus.cc:515] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:55.859242  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce625ab6cde4eae85ae856751ba3258" candidate_uuid: "1ab8939b06d94226859d2091b6837cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
I20260709 13:01:55.859889  8843 raft_consensus.cc:3055] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:55.860234  8843 raft_consensus.cc:740] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:55.861181  8843 consensus_queue.cc:260] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:55.862072  8989 leader_election.cc:290] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 2 election: Requested vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883)
I20260709 13:01:55.862556  8843 raft_consensus.cc:3060] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:55.864032  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce625ab6cde4eae85ae856751ba3258" candidate_uuid: "1ab8939b06d94226859d2091b6837cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
I20260709 13:01:55.864732  8916 raft_consensus.cc:3060] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:55.870676  8843 raft_consensus.cc:2468] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ab8939b06d94226859d2091b6837cb0 in term 2.
I20260709 13:01:55.871706  8916 raft_consensus.cc:2468] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ab8939b06d94226859d2091b6837cb0 in term 2.
I20260709 13:01:55.872237  8960 leader_election.cc:304] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:55.873421  9171 raft_consensus.cc:2804] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:55.873872  9171 raft_consensus.cc:697] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [term 2 LEADER]: Becoming Leader. State: Replica: 1ab8939b06d94226859d2091b6837cb0, State: Running, Role: LEADER
I20260709 13:01:55.874786  9171 consensus_queue.cc:237] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:55.883733  8743 catalog_manager.cc:5697] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 reported cstate change: term changed from 1 to 2, leader changed from d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65) to 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67). New cstate: current_term: 2 leader_uuid: "1ab8939b06d94226859d2091b6837cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:56.078230  8916 raft_consensus.cc:1275] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 3 FOLLOWER]: Refusing update from remote peer 1ab8939b06d94226859d2091b6837cb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:56.079991  9171 consensus_queue.cc:1048] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:56.089030  8843 raft_consensus.cc:1275] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 FOLLOWER]: Refusing update from remote peer 1ab8939b06d94226859d2091b6837cb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:56.091037  9172 consensus_queue.cc:1048] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:56.274013  8843 raft_consensus.cc:1275] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 FOLLOWER]: Refusing update from remote peer 1ab8939b06d94226859d2091b6837cb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:56.275753  9172 consensus_queue.cc:1048] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:56.283217  8916 raft_consensus.cc:1275] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Refusing update from remote peer 1ab8939b06d94226859d2091b6837cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:56.285187  9171 consensus_queue.cc:1048] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:56.287406  8916 raft_consensus.cc:1275] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 3 FOLLOWER]: Refusing update from remote peer 1ab8939b06d94226859d2091b6837cb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:56.289399  9171 consensus_queue.cc:1048] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:56.317415  8843 raft_consensus.cc:1275] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Refusing update from remote peer 1ab8939b06d94226859d2091b6837cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:56.321121  9190 consensus_queue.cc:1048] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:56.426821  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:56.457576  8989 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ce625ab6cde4eae85ae856751ba3258"
dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
mode: GRACEFUL
new_leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
 from {username='slave'} at 127.0.0.1:46916
I20260709 13:01:56.458189  8989 raft_consensus.cc:606] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [term 2 LEADER]: Received request to transfer leadership to TS d1afd0dcf1fd4f1f99645e792f53a18b
I20260709 13:01:56.463980  8989 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e89da22e652440a81d85ab6924828ed"
dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
mode: GRACEFUL
new_leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
 from {username='slave'} at 127.0.0.1:46916
I20260709 13:01:56.464540  8989 raft_consensus.cc:606] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 3 LEADER]: Received request to transfer leadership to TS d1afd0dcf1fd4f1f99645e792f53a18b
I20260709 13:01:56.469964  8989 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eab22a9e82e64d8782c5979f0129cb81"
dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
mode: GRACEFUL
new_leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
 from {username='slave'} at 127.0.0.1:46916
I20260709 13:01:56.470599  8989 raft_consensus.cc:606] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 3 LEADER]: Received request to transfer leadership to TS d1afd0dcf1fd4f1f99645e792f53a18b
I20260709 13:01:56.479364  8918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0821874284d24042bc11cb263f92ae68"
dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
mode: GRACEFUL
new_leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
 from {username='slave'} at 127.0.0.1:50944
I20260709 13:01:56.480000  8918 raft_consensus.cc:606] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 2 LEADER]: Received request to transfer leadership to TS d1afd0dcf1fd4f1f99645e792f53a18b
I20260709 13:01:56.485499  8918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f27a5fdf363b407280ce8086858a8912"
dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
mode: GRACEFUL
new_leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
 from {username='slave'} at 127.0.0.1:50944
I20260709 13:01:56.486119  8918 raft_consensus.cc:606] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [term 2 LEADER]: Received request to transfer leadership to TS d1afd0dcf1fd4f1f99645e792f53a18b
I20260709 13:01:56.490913  8918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af9eb6066fea4d8888cfcfa200a7e7e3"
dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
mode: GRACEFUL
new_leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
 from {username='slave'} at 127.0.0.1:50944
I20260709 13:01:56.491427  8918 raft_consensus.cc:606] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 2 LEADER]: Received request to transfer leadership to TS d1afd0dcf1fd4f1f99645e792f53a18b
I20260709 13:01:56.500128  8843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41f4cb214fc649deb6d5621660b59def"
dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
mode: GRACEFUL
new_leader_uuid: "1ab8939b06d94226859d2091b6837cb0"
 from {username='slave'} at 127.0.0.1:45408
I20260709 13:01:56.500641  8843 raft_consensus.cc:606] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Received request to transfer leadership to TS 1ab8939b06d94226859d2091b6837cb0
I20260709 13:01:56.510243  9194 raft_consensus.cc:993] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb: : Instructing follower d1afd0dcf1fd4f1f99645e792f53a18b to start an election
I20260709 13:01:56.510789  9167 raft_consensus.cc:1081] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 2 LEADER]: Signalling peer d1afd0dcf1fd4f1f99645e792f53a18b to start an election
I20260709 13:01:56.512374  8843 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0821874284d24042bc11cb263f92ae68"
dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
 from {username='slave'} at 127.0.0.1:45390
I20260709 13:01:56.512928  8843 raft_consensus.cc:493] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:56.513320  8843 raft_consensus.cc:3060] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:56.518311  8843 raft_consensus.cc:515] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:56.520141  8843 leader_election.cc:290] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 3 election: Requested vote from peers b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:56.521602  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0821874284d24042bc11cb263f92ae68" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
I20260709 13:01:56.521808  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0821874284d24042bc11cb263f92ae68" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:56.522253  8918 raft_consensus.cc:3055] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:56.522464  8989 raft_consensus.cc:3060] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:56.522625  8918 raft_consensus.cc:740] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Running, Role: LEADER
I20260709 13:01:56.523516  8918 consensus_queue.cc:260] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:56.525728  8918 raft_consensus.cc:3060] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:56.527479  9194 raft_consensus.cc:993] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb: : Instructing follower d1afd0dcf1fd4f1f99645e792f53a18b to start an election
I20260709 13:01:56.527992  9167 raft_consensus.cc:1081] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [term 2 LEADER]: Signalling peer d1afd0dcf1fd4f1f99645e792f53a18b to start an election
I20260709 13:01:56.529754  8843 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f27a5fdf363b407280ce8086858a8912"
dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
 from {username='slave'} at 127.0.0.1:45390
I20260709 13:01:56.530411  8843 raft_consensus.cc:493] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:56.530561  8989 raft_consensus.cc:2468] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 3.
I20260709 13:01:56.530862  8843 raft_consensus.cc:3060] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:56.532445  8808 leader_election.cc:304] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:56.533545  9128 raft_consensus.cc:2804] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:56.534972  8918 raft_consensus.cc:2468] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 3.
I20260709 13:01:56.536543  9128 raft_consensus.cc:697] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 LEADER]: Becoming Leader. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:56.537704  9128 consensus_queue.cc:237] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:56.538734  8843 raft_consensus.cc:515] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:56.540604  8843 leader_election.cc:290] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 3 election: Requested vote from peers b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:56.542281  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27a5fdf363b407280ce8086858a8912" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:56.542908  8989 raft_consensus.cc:3060] T f27a5fdf363b407280ce8086858a8912 P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:56.542613  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27a5fdf363b407280ce8086858a8912" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
I20260709 13:01:56.543530  8918 raft_consensus.cc:3055] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:56.543897  8918 raft_consensus.cc:740] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Running, Role: LEADER
I20260709 13:01:56.544890  8918 consensus_queue.cc:260] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:56.546434  8918 raft_consensus.cc:3060] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:56.552999  8989 raft_consensus.cc:2468] T f27a5fdf363b407280ce8086858a8912 P 1ab8939b06d94226859d2091b6837cb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 3.
I20260709 13:01:56.554968  8808 leader_election.cc:304] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:56.556039  9195 raft_consensus.cc:2804] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:56.556519  8918 raft_consensus.cc:2468] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 3.
I20260709 13:01:56.558811  9195 raft_consensus.cc:697] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 LEADER]: Becoming Leader. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:56.559965  9195 consensus_queue.cc:237] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:56.560912  8743 catalog_manager.cc:5697] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b reported cstate change: term changed from 2 to 3, leader changed from b573f69535f34eb29ac81316560dcbfb (127.8.4.66) to d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65). New cstate: current_term: 3 leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:56.577298  8743 catalog_manager.cc:5697] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b reported cstate change: term changed from 2 to 3, leader changed from b573f69535f34eb29ac81316560dcbfb (127.8.4.66) to d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65). New cstate: current_term: 3 leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:56.621452  9194 raft_consensus.cc:993] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb: : Instructing follower d1afd0dcf1fd4f1f99645e792f53a18b to start an election
I20260709 13:01:56.622071  9167 raft_consensus.cc:1081] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 2 LEADER]: Signalling peer d1afd0dcf1fd4f1f99645e792f53a18b to start an election
I20260709 13:01:56.623562  8843 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af9eb6066fea4d8888cfcfa200a7e7e3"
dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
 from {username='slave'} at 127.0.0.1:45390
I20260709 13:01:56.624119  8843 raft_consensus.cc:493] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:56.624447  8843 raft_consensus.cc:3060] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:56.629295  8843 raft_consensus.cc:515] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:56.630874  8843 leader_election.cc:290] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 3 election: Requested vote from peers b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:56.631793  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9eb6066fea4d8888cfcfa200a7e7e3" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
I20260709 13:01:56.631942  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9eb6066fea4d8888cfcfa200a7e7e3" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:56.632408  8918 raft_consensus.cc:3055] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:56.632416  8989 raft_consensus.cc:3060] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:56.632992  8918 raft_consensus.cc:740] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Running, Role: LEADER
I20260709 13:01:56.633912  8918 consensus_queue.cc:260] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:56.635251  8918 raft_consensus.cc:3060] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:56.640283  8989 raft_consensus.cc:2468] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 3.
I20260709 13:01:56.641708  8808 leader_election.cc:304] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:56.641939  8918 raft_consensus.cc:2468] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 3.
I20260709 13:01:56.642453  9195 raft_consensus.cc:2804] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:56.642978  9195 raft_consensus.cc:697] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 LEADER]: Becoming Leader. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:56.643837  9195 consensus_queue.cc:237] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:56.648725  9190 raft_consensus.cc:993] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0: : Instructing follower d1afd0dcf1fd4f1f99645e792f53a18b to start an election
I20260709 13:01:56.649385  9187 raft_consensus.cc:1081] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 3 LEADER]: Signalling peer d1afd0dcf1fd4f1f99645e792f53a18b to start an election
I20260709 13:01:56.651096  8843 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eab22a9e82e64d8782c5979f0129cb81"
dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
 from {username='slave'} at 127.0.0.1:45402
I20260709 13:01:56.651569  8843 raft_consensus.cc:493] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:56.651888  8843 raft_consensus.cc:3060] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:56.652590  8740 catalog_manager.cc:5697] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b reported cstate change: term changed from 2 to 3, leader changed from b573f69535f34eb29ac81316560dcbfb (127.8.4.66) to d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65). New cstate: current_term: 3 leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:56.657580  8843 raft_consensus.cc:515] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:56.659467  8843 leader_election.cc:290] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 4 election: Requested vote from peers b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:56.660282  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab22a9e82e64d8782c5979f0129cb81" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
I20260709 13:01:56.660612  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab22a9e82e64d8782c5979f0129cb81" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:56.660881  8918 raft_consensus.cc:3060] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:56.661226  8989 raft_consensus.cc:3055] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:56.661556  8989 raft_consensus.cc:740] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1ab8939b06d94226859d2091b6837cb0, State: Running, Role: LEADER
I20260709 13:01:56.662309  8989 consensus_queue.cc:260] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:56.663280  8989 raft_consensus.cc:3060] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:56.666353  8918 raft_consensus.cc:2468] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 4.
I20260709 13:01:56.667498  8808 leader_election.cc:304] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b573f69535f34eb29ac81316560dcbfb, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:56.668236  9195 raft_consensus.cc:2804] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:56.668418  8989 raft_consensus.cc:2468] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 4.
I20260709 13:01:56.668624  9195 raft_consensus.cc:697] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 4 LEADER]: Becoming Leader. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:56.669503  9195 consensus_queue.cc:237] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:56.675180  8740 catalog_manager.cc:5697] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b reported cstate change: term changed from 3 to 4, leader changed from 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67) to d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65). New cstate: current_term: 4 leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:56.704268  9128 raft_consensus.cc:993] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b: : Instructing follower 1ab8939b06d94226859d2091b6837cb0 to start an election
I20260709 13:01:56.704794  9195 raft_consensus.cc:1081] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Signalling peer 1ab8939b06d94226859d2091b6837cb0 to start an election
I20260709 13:01:56.706542  8989 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41f4cb214fc649deb6d5621660b59def"
dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
 from {username='slave'} at 127.0.0.1:46002
I20260709 13:01:56.707063  8989 raft_consensus.cc:493] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:56.707386  8989 raft_consensus.cc:3060] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:56.712800  8989 raft_consensus.cc:515] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:56.714534  8989 leader_election.cc:290] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 2 election: Requested vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883)
I20260709 13:01:56.715539  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f4cb214fc649deb6d5621660b59def" candidate_uuid: "1ab8939b06d94226859d2091b6837cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
I20260709 13:01:56.715679  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f4cb214fc649deb6d5621660b59def" candidate_uuid: "1ab8939b06d94226859d2091b6837cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
I20260709 13:01:56.716216  8843 raft_consensus.cc:3055] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:56.716322  8918 raft_consensus.cc:3060] T 41f4cb214fc649deb6d5621660b59def P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:56.716560  8843 raft_consensus.cc:740] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:56.717372  8843 consensus_queue.cc:260] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:56.718303  8843 raft_consensus.cc:3060] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:56.721920  8918 raft_consensus.cc:2468] T 41f4cb214fc649deb6d5621660b59def P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ab8939b06d94226859d2091b6837cb0 in term 2.
I20260709 13:01:56.723171  8957 leader_election.cc:304] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, b573f69535f34eb29ac81316560dcbfb; no voters: 
I20260709 13:01:56.723502  8843 raft_consensus.cc:2468] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ab8939b06d94226859d2091b6837cb0 in term 2.
I20260709 13:01:56.723953  9187 raft_consensus.cc:2804] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:56.724362  9187 raft_consensus.cc:697] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [term 2 LEADER]: Becoming Leader. State: Replica: 1ab8939b06d94226859d2091b6837cb0, State: Running, Role: LEADER
I20260709 13:01:56.725193  9187 consensus_queue.cc:237] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:56.732479  8740 catalog_manager.cc:5697] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 reported cstate change: term changed from 1 to 2, leader changed from d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65) to 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67). New cstate: current_term: 2 leader_uuid: "1ab8939b06d94226859d2091b6837cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:56.759801  9190 raft_consensus.cc:993] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0: : Instructing follower d1afd0dcf1fd4f1f99645e792f53a18b to start an election
I20260709 13:01:56.760269  9187 raft_consensus.cc:1081] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 3 LEADER]: Signalling peer d1afd0dcf1fd4f1f99645e792f53a18b to start an election
I20260709 13:01:56.762089  8845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e89da22e652440a81d85ab6924828ed"
dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
 from {username='slave'} at 127.0.0.1:45402
I20260709 13:01:56.762596  8845 raft_consensus.cc:493] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:56.762992  8845 raft_consensus.cc:3060] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:56.768205  8845 raft_consensus.cc:515] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:56.769973  8845 leader_election.cc:290] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 4 election: Requested vote from peers b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:56.770910  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e89da22e652440a81d85ab6924828ed" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
I20260709 13:01:56.771209  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e89da22e652440a81d85ab6924828ed" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:56.771502  8918 raft_consensus.cc:3060] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:56.771669  8989 raft_consensus.cc:3055] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:56.771978  8989 raft_consensus.cc:740] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1ab8939b06d94226859d2091b6837cb0, State: Running, Role: LEADER
I20260709 13:01:56.772673  8989 consensus_queue.cc:260] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:56.773813  8989 raft_consensus.cc:3060] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:56.778165  8918 raft_consensus.cc:2468] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 4.
I20260709 13:01:56.779465  8808 leader_election.cc:304] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b573f69535f34eb29ac81316560dcbfb, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:56.779857  8989 raft_consensus.cc:2468] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 4.
I20260709 13:01:56.780290  9195 raft_consensus.cc:2804] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:56.780820  9195 raft_consensus.cc:697] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 4 LEADER]: Becoming Leader. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:56.781525  9195 consensus_queue.cc:237] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:56.786993  8740 catalog_manager.cc:5697] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b reported cstate change: term changed from 3 to 4, leader changed from 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67) to d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65). New cstate: current_term: 4 leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:56.857999  9190 raft_consensus.cc:993] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0: : Instructing follower d1afd0dcf1fd4f1f99645e792f53a18b to start an election
I20260709 13:01:56.858484  9187 raft_consensus.cc:1081] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [term 2 LEADER]: Signalling peer d1afd0dcf1fd4f1f99645e792f53a18b to start an election
I20260709 13:01:56.859959  8845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ce625ab6cde4eae85ae856751ba3258"
dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
 from {username='slave'} at 127.0.0.1:45402
I20260709 13:01:56.860505  8845 raft_consensus.cc:493] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:56.860802  8845 raft_consensus.cc:3060] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:56.865499  8845 raft_consensus.cc:515] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:56.867049  8845 leader_election.cc:290] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 3 election: Requested vote from peers b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:56.867916  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce625ab6cde4eae85ae856751ba3258" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
I20260709 13:01:56.868353  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce625ab6cde4eae85ae856751ba3258" candidate_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:56.868630  8918 raft_consensus.cc:3060] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:56.868930  8989 raft_consensus.cc:3055] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:56.869323  8989 raft_consensus.cc:740] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ab8939b06d94226859d2091b6837cb0, State: Running, Role: LEADER
I20260709 13:01:56.870085  8989 consensus_queue.cc:260] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:56.871212  8989 raft_consensus.cc:3060] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:56.874672  8918 raft_consensus.cc:2468] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 3.
I20260709 13:01:56.875233  8989 raft_consensus.cc:2468] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1afd0dcf1fd4f1f99645e792f53a18b in term 3.
I20260709 13:01:56.875864  8808 leader_election.cc:304] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b573f69535f34eb29ac81316560dcbfb, d1afd0dcf1fd4f1f99645e792f53a18b; no voters: 
I20260709 13:01:56.876716  9128 raft_consensus.cc:2804] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:56.877195  9128 raft_consensus.cc:697] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 LEADER]: Becoming Leader. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:56.878038  9128 consensus_queue.cc:237] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:56.884322  8740 catalog_manager.cc:5697] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b reported cstate change: term changed from 2 to 3, leader changed from 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67) to d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65). New cstate: current_term: 3 leader_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:56.991390  8989 raft_consensus.cc:1275] T f27a5fdf363b407280ce8086858a8912 P 1ab8939b06d94226859d2091b6837cb0 [term 3 FOLLOWER]: Refusing update from remote peer d1afd0dcf1fd4f1f99645e792f53a18b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:56.992689  9128 consensus_queue.cc:1048] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:57.004925  8918 raft_consensus.cc:1275] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [term 3 FOLLOWER]: Refusing update from remote peer d1afd0dcf1fd4f1f99645e792f53a18b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:57.006691  9195 consensus_queue.cc:1048] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:57.007215  8918 raft_consensus.cc:1275] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 3 FOLLOWER]: Refusing update from remote peer d1afd0dcf1fd4f1f99645e792f53a18b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:57.009289  9195 consensus_queue.cc:1048] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:57.020810  8989 raft_consensus.cc:1275] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [term 3 FOLLOWER]: Refusing update from remote peer d1afd0dcf1fd4f1f99645e792f53a18b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:57.022506  9195 consensus_queue.cc:1048] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:57.209803  8989 raft_consensus.cc:1275] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 4 FOLLOWER]: Refusing update from remote peer d1afd0dcf1fd4f1f99645e792f53a18b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:57.211298  9195 consensus_queue.cc:1048] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:57.219533  8916 raft_consensus.cc:1275] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 4 FOLLOWER]: Refusing update from remote peer d1afd0dcf1fd4f1f99645e792f53a18b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:57.221081  9195 consensus_queue.cc:1048] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:57.225356  8918 raft_consensus.cc:1275] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 4 FOLLOWER]: Refusing update from remote peer d1afd0dcf1fd4f1f99645e792f53a18b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:57.227380  9197 consensus_queue.cc:1048] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:57.239368  8989 raft_consensus.cc:1275] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 4 FOLLOWER]: Refusing update from remote peer d1afd0dcf1fd4f1f99645e792f53a18b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:57.240664  9197 consensus_queue.cc:1048] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:57.245699  8916 raft_consensus.cc:1275] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 3 FOLLOWER]: Refusing update from remote peer d1afd0dcf1fd4f1f99645e792f53a18b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:57.247241  9197 consensus_queue.cc:1048] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:57.253893  8990 raft_consensus.cc:1275] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [term 3 FOLLOWER]: Refusing update from remote peer d1afd0dcf1fd4f1f99645e792f53a18b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:57.255476  9197 consensus_queue.cc:1048] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:57.330734  8916 raft_consensus.cc:1275] T 41f4cb214fc649deb6d5621660b59def P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Refusing update from remote peer 1ab8939b06d94226859d2091b6837cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:57.332196  9187 consensus_queue.cc:1048] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:57.340818  8845 raft_consensus.cc:1275] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Refusing update from remote peer 1ab8939b06d94226859d2091b6837cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:57.342221  9172 consensus_queue.cc:1048] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:57.382449  8990 raft_consensus.cc:1275] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [term 3 FOLLOWER]: Refusing update from remote peer d1afd0dcf1fd4f1f99645e792f53a18b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:57.384133  9195 consensus_queue.cc:1048] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:57.386977  8916 raft_consensus.cc:1275] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb [term 3 FOLLOWER]: Refusing update from remote peer d1afd0dcf1fd4f1f99645e792f53a18b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:57.388463  9195 consensus_queue.cc:1048] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:59.502838  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:59.511883  8845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0821874284d24042bc11cb263f92ae68"
dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
mode: GRACEFUL
new_leader_uuid: "b573f69535f34eb29ac81316560dcbfb"
 from {username='slave'} at 127.0.0.1:50160
I20260709 13:01:59.512372  8845 raft_consensus.cc:606] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 LEADER]: Received request to transfer leadership to TS b573f69535f34eb29ac81316560dcbfb
I20260709 13:01:59.515202  8845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08d5152e641944c882dfbb0e853415c6"
dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
mode: GRACEFUL
new_leader_uuid: "b573f69535f34eb29ac81316560dcbfb"
 from {username='slave'} at 127.0.0.1:50160
I20260709 13:01:59.515811  8845 raft_consensus.cc:606] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Received request to transfer leadership to TS b573f69535f34eb29ac81316560dcbfb
I20260709 13:01:59.518301  8845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e89da22e652440a81d85ab6924828ed"
dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
mode: GRACEFUL
new_leader_uuid: "1ab8939b06d94226859d2091b6837cb0"
 from {username='slave'} at 127.0.0.1:50160
I20260709 13:01:59.518832  8845 raft_consensus.cc:606] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 4 LEADER]: Received request to transfer leadership to TS 1ab8939b06d94226859d2091b6837cb0
I20260709 13:01:59.521546  8845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af9eb6066fea4d8888cfcfa200a7e7e3"
dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
mode: GRACEFUL
new_leader_uuid: "1ab8939b06d94226859d2091b6837cb0"
 from {username='slave'} at 127.0.0.1:50160
I20260709 13:01:59.522037  8845 raft_consensus.cc:606] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 LEADER]: Received request to transfer leadership to TS 1ab8939b06d94226859d2091b6837cb0
I20260709 13:01:59.523177  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:01:59.523732  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:59.626173  9197 raft_consensus.cc:993] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b: : Instructing follower b573f69535f34eb29ac81316560dcbfb to start an election
I20260709 13:01:59.626698  9197 raft_consensus.cc:1081] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 LEADER]: Signalling peer b573f69535f34eb29ac81316560dcbfb to start an election
I20260709 13:01:59.630720  8918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0821874284d24042bc11cb263f92ae68"
dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
 from {username='slave'} at 127.0.0.1:50920
I20260709 13:01:59.631321  8918 raft_consensus.cc:493] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:59.631685  8918 raft_consensus.cc:3060] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:59.636567  8918 raft_consensus.cc:515] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:59.638271  8918 leader_election.cc:290] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 4 election: Requested vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:59.639165  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0821874284d24042bc11cb263f92ae68" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
I20260709 13:01:59.639448  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0821874284d24042bc11cb263f92ae68" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:59.639911  8845 raft_consensus.cc:3055] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:59.640049  8989 raft_consensus.cc:3060] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:59.640175  8845 raft_consensus.cc:740] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:59.640935  8845 consensus_queue.cc:260] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:59.641824  8845 raft_consensus.cc:3060] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:59.644657  8989 raft_consensus.cc:2468] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b573f69535f34eb29ac81316560dcbfb in term 4.
I20260709 13:01:59.645881  8883 leader_election.cc:304] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, b573f69535f34eb29ac81316560dcbfb; no voters: 
I20260709 13:01:59.646052  8845 raft_consensus.cc:2468] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b573f69535f34eb29ac81316560dcbfb in term 4.
I20260709 13:01:59.646770  9194 raft_consensus.cc:2804] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:59.647890  9194 raft_consensus.cc:697] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 4 LEADER]: Becoming Leader. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Running, Role: LEADER
I20260709 13:01:59.648669  9194 consensus_queue.cc:237] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:59.656069  8740 catalog_manager.cc:5697] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb reported cstate change: term changed from 3 to 4, leader changed from d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65) to b573f69535f34eb29ac81316560dcbfb (127.8.4.66). New cstate: current_term: 4 leader_uuid: "b573f69535f34eb29ac81316560dcbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:59.656822  9197 raft_consensus.cc:993] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b: : Instructing follower b573f69535f34eb29ac81316560dcbfb to start an election
I20260709 13:01:59.657274  9195 raft_consensus.cc:1081] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Signalling peer b573f69535f34eb29ac81316560dcbfb to start an election
I20260709 13:01:59.658922  8918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08d5152e641944c882dfbb0e853415c6"
dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
 from {username='slave'} at 127.0.0.1:50920
I20260709 13:01:59.659607  8918 raft_consensus.cc:493] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:59.659993  8918 raft_consensus.cc:3060] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:59.666603  8918 raft_consensus.cc:515] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:59.668946  8918 leader_election.cc:290] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 2 election: Requested vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67:35521)
I20260709 13:01:59.669302  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d5152e641944c882dfbb0e853415c6" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
I20260709 13:01:59.669529  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d5152e641944c882dfbb0e853415c6" candidate_uuid: "b573f69535f34eb29ac81316560dcbfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
I20260709 13:01:59.669824  8845 raft_consensus.cc:3055] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:59.670024  8989 raft_consensus.cc:3060] T 08d5152e641944c882dfbb0e853415c6 P 1ab8939b06d94226859d2091b6837cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:59.670272  8845 raft_consensus.cc:740] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:59.671069  8845 consensus_queue.cc:260] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:59.671973  8845 raft_consensus.cc:3060] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:59.674490  8989 raft_consensus.cc:2468] T 08d5152e641944c882dfbb0e853415c6 P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b573f69535f34eb29ac81316560dcbfb in term 2.
I20260709 13:01:59.675465  8883 leader_election.cc:304] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, b573f69535f34eb29ac81316560dcbfb; no voters: 
I20260709 13:01:59.676223  9194 raft_consensus.cc:2804] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:59.676450  8845 raft_consensus.cc:2468] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b573f69535f34eb29ac81316560dcbfb in term 2.
I20260709 13:01:59.676607  9194 raft_consensus.cc:697] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb [term 2 LEADER]: Becoming Leader. State: Replica: b573f69535f34eb29ac81316560dcbfb, State: Running, Role: LEADER
I20260709 13:01:59.677496  9194 consensus_queue.cc:237] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:59.684360  8740 catalog_manager.cc:5697] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb reported cstate change: term changed from 1 to 2, leader changed from d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65) to b573f69535f34eb29ac81316560dcbfb (127.8.4.66). New cstate: current_term: 2 leader_uuid: "b573f69535f34eb29ac81316560dcbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:59.764969  9197 raft_consensus.cc:993] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b: : Instructing follower 1ab8939b06d94226859d2091b6837cb0 to start an election
I20260709 13:01:59.765556  9195 raft_consensus.cc:1081] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 LEADER]: Signalling peer 1ab8939b06d94226859d2091b6837cb0 to start an election
I20260709 13:01:59.766994  8989 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af9eb6066fea4d8888cfcfa200a7e7e3"
dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
 from {username='slave'} at 127.0.0.1:46002
I20260709 13:01:59.767432  8989 raft_consensus.cc:493] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:59.767674  8989 raft_consensus.cc:3060] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:59.771720  8989 raft_consensus.cc:515] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:59.773424  8989 leader_election.cc:290] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 4 election: Requested vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883)
I20260709 13:01:59.774670  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9eb6066fea4d8888cfcfa200a7e7e3" candidate_uuid: "1ab8939b06d94226859d2091b6837cb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
I20260709 13:01:59.774670  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9eb6066fea4d8888cfcfa200a7e7e3" candidate_uuid: "1ab8939b06d94226859d2091b6837cb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
I20260709 13:01:59.775552  8845 raft_consensus.cc:3055] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:59.775583  8918 raft_consensus.cc:3060] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:59.776039  8845 raft_consensus.cc:740] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:59.776661  8845 consensus_queue.cc:260] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:59.777566  8845 raft_consensus.cc:3060] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:59.780673  8918 raft_consensus.cc:2468] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ab8939b06d94226859d2091b6837cb0 in term 4.
I20260709 13:01:59.781795  8845 raft_consensus.cc:2468] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ab8939b06d94226859d2091b6837cb0 in term 4.
I20260709 13:01:59.781821  8957 leader_election.cc:304] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, b573f69535f34eb29ac81316560dcbfb; no voters: 
I20260709 13:01:59.782796  9172 raft_consensus.cc:2804] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:59.784060  9172 raft_consensus.cc:697] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [term 4 LEADER]: Becoming Leader. State: Replica: 1ab8939b06d94226859d2091b6837cb0, State: Running, Role: LEADER
I20260709 13:01:59.784880  9172 consensus_queue.cc:237] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:59.792109  8740 catalog_manager.cc:5697] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 reported cstate change: term changed from 3 to 4, leader changed from d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65) to 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67). New cstate: current_term: 4 leader_uuid: "1ab8939b06d94226859d2091b6837cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:59.919679  9197 raft_consensus.cc:993] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b: : Instructing follower 1ab8939b06d94226859d2091b6837cb0 to start an election
I20260709 13:01:59.920166  9195 raft_consensus.cc:1081] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 4 LEADER]: Signalling peer 1ab8939b06d94226859d2091b6837cb0 to start an election
I20260709 13:01:59.921640  8989 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e89da22e652440a81d85ab6924828ed"
dest_uuid: "1ab8939b06d94226859d2091b6837cb0"
 from {username='slave'} at 127.0.0.1:46002
I20260709 13:01:59.922178  8989 raft_consensus.cc:493] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:59.922451  8989 raft_consensus.cc:3060] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.926457  8989 raft_consensus.cc:515] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:59.927901  8989 leader_election.cc:290] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 5 election: Requested vote from peers d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441), b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883)
I20260709 13:01:59.928874  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e89da22e652440a81d85ab6924828ed" candidate_uuid: "1ab8939b06d94226859d2091b6837cb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b"
I20260709 13:01:59.929056  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e89da22e652440a81d85ab6924828ed" candidate_uuid: "1ab8939b06d94226859d2091b6837cb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b573f69535f34eb29ac81316560dcbfb"
I20260709 13:01:59.929436  8845 raft_consensus.cc:3055] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:59.929581  8918 raft_consensus.cc:3060] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.929699  8845 raft_consensus.cc:740] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d1afd0dcf1fd4f1f99645e792f53a18b, State: Running, Role: LEADER
I20260709 13:01:59.930423  8845 consensus_queue.cc:260] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:59.931253  8845 raft_consensus.cc:3060] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.934084  8918 raft_consensus.cc:2468] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ab8939b06d94226859d2091b6837cb0 in term 5.
I20260709 13:01:59.935173  8957 leader_election.cc:304] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab8939b06d94226859d2091b6837cb0, b573f69535f34eb29ac81316560dcbfb; no voters: 
I20260709 13:01:59.935648  8845 raft_consensus.cc:2468] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ab8939b06d94226859d2091b6837cb0 in term 5.
I20260709 13:01:59.936024  9172 raft_consensus.cc:2804] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:59.936532  9172 raft_consensus.cc:697] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 5 LEADER]: Becoming Leader. State: Replica: 1ab8939b06d94226859d2091b6837cb0, State: Running, Role: LEADER
I20260709 13:01:59.937297  9172 consensus_queue.cc:237] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } }
I20260709 13:01:59.943285  8740 catalog_manager.cc:5697] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 reported cstate change: term changed from 4 to 5, leader changed from d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65) to 1ab8939b06d94226859d2091b6837cb0 (127.8.4.67). New cstate: current_term: 5 leader_uuid: "1ab8939b06d94226859d2091b6837cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.169618  8845 raft_consensus.cc:1275] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 4 FOLLOWER]: Refusing update from remote peer 1ab8939b06d94226859d2091b6837cb0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:00.170749  9172 consensus_queue.cc:1048] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:00.173218  8989 raft_consensus.cc:1275] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [term 4 FOLLOWER]: Refusing update from remote peer b573f69535f34eb29ac81316560dcbfb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:00.174573  9194 consensus_queue.cc:1048] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:00.182451  8918 raft_consensus.cc:1275] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 4 FOLLOWER]: Refusing update from remote peer 1ab8939b06d94226859d2091b6837cb0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:00.184598  9228 consensus_queue.cc:1048] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:00.212560  8845 raft_consensus.cc:1275] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Refusing update from remote peer b573f69535f34eb29ac81316560dcbfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:00.214318  9237 consensus_queue.cc:1048] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:00.223033  8843 raft_consensus.cc:1275] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 4 FOLLOWER]: Refusing update from remote peer b573f69535f34eb29ac81316560dcbfb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:00.226622  9236 consensus_queue.cc:1048] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:00.233701  8989 raft_consensus.cc:1275] T 08d5152e641944c882dfbb0e853415c6 P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Refusing update from remote peer b573f69535f34eb29ac81316560dcbfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:00.235975  9194 consensus_queue.cc:1048] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab8939b06d94226859d2091b6837cb0" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:00.429356  8845 raft_consensus.cc:1275] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 5 FOLLOWER]: Refusing update from remote peer 1ab8939b06d94226859d2091b6837cb0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:00.430505  9172 consensus_queue.cc:1048] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1afd0dcf1fd4f1f99645e792f53a18b" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:00.438810  8918 raft_consensus.cc:1275] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 5 FOLLOWER]: Refusing update from remote peer 1ab8939b06d94226859d2091b6837cb0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:00.440702  9228 consensus_queue.cc:1048] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b573f69535f34eb29ac81316560dcbfb" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:00.524596  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:00.530611  8209 tablet_server.cc:179] TabletServer@127.8.4.65:0 shutting down...
I20260709 13:02:00.563189  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:00.564152  8209 tablet_replica.cc:333] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b: stopping tablet replica
I20260709 13:02:00.565203  8209 raft_consensus.cc:2243] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.565928  8209 raft_consensus.cc:2272] T cb6c1c23963c420aa1c6f9aba2f1e6bb P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.567870  8209 tablet_replica.cc:333] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b: stopping tablet replica
I20260709 13:02:00.568419  8209 raft_consensus.cc:2243] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:00.569219  8209 raft_consensus.cc:2272] T f27a5fdf363b407280ce8086858a8912 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.570964  8209 tablet_replica.cc:333] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b: stopping tablet replica
I20260709 13:02:00.571542  8209 raft_consensus.cc:2243] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.571916  8209 raft_consensus.cc:2272] T 41f4cb214fc649deb6d5621660b59def P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.573716  8209 tablet_replica.cc:333] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b: stopping tablet replica
I20260709 13:02:00.574301  8209 raft_consensus.cc:2243] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.574713  8209 raft_consensus.cc:2272] T 0821874284d24042bc11cb263f92ae68 P d1afd0dcf1fd4f1f99645e792f53a18b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.577126  8209 tablet_replica.cc:333] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b: stopping tablet replica
I20260709 13:02:00.577672  8209 raft_consensus.cc:2243] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.578130  8209 raft_consensus.cc:2272] T af9eb6066fea4d8888cfcfa200a7e7e3 P d1afd0dcf1fd4f1f99645e792f53a18b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.580310  8209 tablet_replica.cc:333] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b: stopping tablet replica
I20260709 13:02:00.580892  8209 raft_consensus.cc:2243] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:02:00.581707  8209 raft_consensus.cc:2272] T eab22a9e82e64d8782c5979f0129cb81 P d1afd0dcf1fd4f1f99645e792f53a18b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.583658  8209 tablet_replica.cc:333] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b: stopping tablet replica
I20260709 13:02:00.584348  8209 raft_consensus.cc:2243] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.584895  8209 raft_consensus.cc:2272] T 08d5152e641944c882dfbb0e853415c6 P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.587455  8209 tablet_replica.cc:333] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b: stopping tablet replica
I20260709 13:02:00.587983  8209 raft_consensus.cc:2243] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.588397  8209 raft_consensus.cc:2272] T 7e89da22e652440a81d85ab6924828ed P d1afd0dcf1fd4f1f99645e792f53a18b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.590572  8209 tablet_replica.cc:333] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b: stopping tablet replica
I20260709 13:02:00.591084  8209 raft_consensus.cc:2243] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:00.591843  8209 raft_consensus.cc:2272] T 45c1d81694c64be39bf3c51c7813c62c P d1afd0dcf1fd4f1f99645e792f53a18b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.593791  8209 tablet_replica.cc:333] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b: stopping tablet replica
I20260709 13:02:00.594247  8209 raft_consensus.cc:2243] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:00.594950  8209 raft_consensus.cc:2272] T 4ce625ab6cde4eae85ae856751ba3258 P d1afd0dcf1fd4f1f99645e792f53a18b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.617641  8209 tablet_server.cc:196] TabletServer@127.8.4.65:0 shutdown complete.
I20260709 13:02:00.638586  8209 tablet_server.cc:179] TabletServer@127.8.4.66:0 shutting down...
W20260709 13:02:00.660705  8960 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.4.65:36441: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260709 13:02:00.665482  8960 consensus_peers.cc:597] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 -> Peer d1afd0dcf1fd4f1f99645e792f53a18b (127.8.4.65:36441): Couldn't send request to peer d1afd0dcf1fd4f1f99645e792f53a18b. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:36441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:00.671046  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:00.671912  8209 tablet_replica.cc:333] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb: stopping tablet replica
I20260709 13:02:00.672842  8209 raft_consensus.cc:2243] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:00.674010  8209 raft_consensus.cc:2272] T cb6c1c23963c420aa1c6f9aba2f1e6bb P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.676367  8209 tablet_replica.cc:333] T 41f4cb214fc649deb6d5621660b59def P b573f69535f34eb29ac81316560dcbfb: stopping tablet replica
I20260709 13:02:00.676978  8209 raft_consensus.cc:2243] T 41f4cb214fc649deb6d5621660b59def P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.677563  8209 raft_consensus.cc:2272] T 41f4cb214fc649deb6d5621660b59def P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.679293  8209 tablet_replica.cc:333] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb: stopping tablet replica
I20260709 13:02:00.679860  8209 raft_consensus.cc:2243] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:02:00.680706  8209 raft_consensus.cc:2272] T 0821874284d24042bc11cb263f92ae68 P b573f69535f34eb29ac81316560dcbfb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.683395  8209 tablet_replica.cc:333] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb: stopping tablet replica
I20260709 13:02:00.683993  8209 raft_consensus.cc:2243] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.684435  8209 raft_consensus.cc:2272] T f27a5fdf363b407280ce8086858a8912 P b573f69535f34eb29ac81316560dcbfb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.686313  8209 tablet_replica.cc:333] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb: stopping tablet replica
I20260709 13:02:00.686890  8209 raft_consensus.cc:2243] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.687352  8209 raft_consensus.cc:2272] T 45c1d81694c64be39bf3c51c7813c62c P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.689309  8209 tablet_replica.cc:333] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb: stopping tablet replica
I20260709 13:02:00.690006  8209 raft_consensus.cc:2243] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.690471  8209 raft_consensus.cc:2272] T 4ce625ab6cde4eae85ae856751ba3258 P b573f69535f34eb29ac81316560dcbfb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.692198  8209 tablet_replica.cc:333] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb: stopping tablet replica
I20260709 13:02:00.692729  8209 raft_consensus.cc:2243] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:00.693583  8209 raft_consensus.cc:2272] T 08d5152e641944c882dfbb0e853415c6 P b573f69535f34eb29ac81316560dcbfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.695772  8209 tablet_replica.cc:333] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb: stopping tablet replica
I20260709 13:02:00.696300  8209 raft_consensus.cc:2243] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.696851  8209 raft_consensus.cc:2272] T 7e89da22e652440a81d85ab6924828ed P b573f69535f34eb29ac81316560dcbfb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.698873  8209 tablet_replica.cc:333] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb: stopping tablet replica
I20260709 13:02:00.699384  8209 raft_consensus.cc:2243] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.699877  8209 raft_consensus.cc:2272] T af9eb6066fea4d8888cfcfa200a7e7e3 P b573f69535f34eb29ac81316560dcbfb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.702142  8209 tablet_replica.cc:333] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb: stopping tablet replica
I20260709 13:02:00.702623  8209 raft_consensus.cc:2243] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.703126  8209 raft_consensus.cc:2272] T eab22a9e82e64d8782c5979f0129cb81 P b573f69535f34eb29ac81316560dcbfb [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:00.734320  8957 consensus_peers.cc:597] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 -> Peer b573f69535f34eb29ac81316560dcbfb (127.8.4.66:40883): Couldn't send request to peer b573f69535f34eb29ac81316560dcbfb. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:40883: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:00.757460  8209 tablet_server.cc:196] TabletServer@127.8.4.66:0 shutdown complete.
I20260709 13:02:00.775765  8209 tablet_server.cc:179] TabletServer@127.8.4.67:0 shutting down...
I20260709 13:02:00.807286  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:00.807910  8209 tablet_replica.cc:333] T cb6c1c23963c420aa1c6f9aba2f1e6bb P 1ab8939b06d94226859d2091b6837cb0: stopping tablet replica
I20260709 13:02:00.808563  8209 raft_consensus.cc:2243] T cb6c1c23963c420aa1c6f9aba2f1e6bb P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.809149  8209 raft_consensus.cc:2272] T cb6c1c23963c420aa1c6f9aba2f1e6bb P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.811017  8209 tablet_replica.cc:333] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0: stopping tablet replica
I20260709 13:02:00.811527  8209 raft_consensus.cc:2243] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.811950  8209 raft_consensus.cc:2272] T eab22a9e82e64d8782c5979f0129cb81 P 1ab8939b06d94226859d2091b6837cb0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.813807  8209 tablet_replica.cc:333] T f27a5fdf363b407280ce8086858a8912 P 1ab8939b06d94226859d2091b6837cb0: stopping tablet replica
I20260709 13:02:00.814343  8209 raft_consensus.cc:2243] T f27a5fdf363b407280ce8086858a8912 P 1ab8939b06d94226859d2091b6837cb0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.814752  8209 raft_consensus.cc:2272] T f27a5fdf363b407280ce8086858a8912 P 1ab8939b06d94226859d2091b6837cb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.816347  8209 tablet_replica.cc:333] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0: stopping tablet replica
I20260709 13:02:00.816846  8209 raft_consensus.cc:2243] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:02:00.817607  8209 raft_consensus.cc:2272] T 7e89da22e652440a81d85ab6924828ed P 1ab8939b06d94226859d2091b6837cb0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.819866  8209 tablet_replica.cc:333] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0: stopping tablet replica
I20260709 13:02:00.820369  8209 raft_consensus.cc:2243] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:02:00.821125  8209 raft_consensus.cc:2272] T af9eb6066fea4d8888cfcfa200a7e7e3 P 1ab8939b06d94226859d2091b6837cb0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.823302  8209 tablet_replica.cc:333] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0: stopping tablet replica
I20260709 13:02:00.823807  8209 raft_consensus.cc:2243] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.824244  8209 raft_consensus.cc:2272] T 0821874284d24042bc11cb263f92ae68 P 1ab8939b06d94226859d2091b6837cb0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.826239  8209 tablet_replica.cc:333] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0: stopping tablet replica
I20260709 13:02:00.826725  8209 raft_consensus.cc:2243] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:00.827382  8209 raft_consensus.cc:2272] T 41f4cb214fc649deb6d5621660b59def P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.828857  8209 tablet_replica.cc:333] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0: stopping tablet replica
I20260709 13:02:00.829350  8209 raft_consensus.cc:2243] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.829756  8209 raft_consensus.cc:2272] T 45c1d81694c64be39bf3c51c7813c62c P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.831352  8209 tablet_replica.cc:333] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0: stopping tablet replica
I20260709 13:02:00.831790  8209 raft_consensus.cc:2243] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.832178  8209 raft_consensus.cc:2272] T 4ce625ab6cde4eae85ae856751ba3258 P 1ab8939b06d94226859d2091b6837cb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.833724  8209 tablet_replica.cc:333] T 08d5152e641944c882dfbb0e853415c6 P 1ab8939b06d94226859d2091b6837cb0: stopping tablet replica
I20260709 13:02:00.834167  8209 raft_consensus.cc:2243] T 08d5152e641944c882dfbb0e853415c6 P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.834563  8209 raft_consensus.cc:2272] T 08d5152e641944c882dfbb0e853415c6 P 1ab8939b06d94226859d2091b6837cb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.862607  8209 tablet_server.cc:196] TabletServer@127.8.4.67:0 shutdown complete.
I20260709 13:02:00.880890  8209 master.cc:562] Master@127.8.4.126:44691 shutting down...
I20260709 13:02:00.904042  8209 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:00.904731  8209 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.905161  8209 tablet_replica.cc:333] T 00000000000000000000000000000000 P d7b988e735cd46bd8252c7b552bc5bb5: stopping tablet replica
I20260709 13:02:00.926489  8209 master.cc:584] Master@127.8.4.126:44691 shutdown complete.
1ab8939b06d94226859d2091b6837cb0  0
b573f69535f34eb29ac81316560dcbfb  4
d1afd0dcf1fd4f1f99645e792f53a18b  6
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (11345 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:02:00.978080  8209 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.4.126:34725
I20260709 13:02:00.979249  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:00.985818  9251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:00.985880  9250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:00.986197  9253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:00.988232  8209 server_base.cc:1061] running on GCE node
I20260709 13:02:00.989580  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:00.989811  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:00.990000  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602120989985 us; error 0 us; skew 500 ppm
I20260709 13:02:00.990609  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:00.993274  8209 webserver.cc:533] Webserver started at http://127.8.4.126:37919/ using document root <none> and password file <none>
I20260709 13:02:00.993811  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:00.993968  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:00.994303  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:00.995428  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/master-0-root/instance:
uuid: "f3fb61137daa445d9297d2162e98e24e"
format_stamp: "Formatted at 2026-07-09 13:02:00 on dist-test-slave-008w"
I20260709 13:02:01.000249  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:02:01.004009  9258 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:01.005164  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 13:02:01.005496  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/master-0-root
uuid: "f3fb61137daa445d9297d2162e98e24e"
format_stamp: "Formatted at 2026-07-09 13:02:00 on dist-test-slave-008w"
I20260709 13:02:01.005755  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:01.016554  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:01.017985  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:01.060298  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.126:34725
I20260709 13:02:01.060388  9309 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.126:34725 every 8 connection(s)
I20260709 13:02:01.064829  9310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.075291  9310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e: Bootstrap starting.
I20260709 13:02:01.080113  9310 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.084364  9310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e: No bootstrap required, opened a new log
I20260709 13:02:01.086458  9310 raft_consensus.cc:359] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3fb61137daa445d9297d2162e98e24e" member_type: VOTER }
I20260709 13:02:01.086833  9310 raft_consensus.cc:385] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.087008  9310 raft_consensus.cc:740] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3fb61137daa445d9297d2162e98e24e, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.087509  9310 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3fb61137daa445d9297d2162e98e24e" member_type: VOTER }
I20260709 13:02:01.087896  9310 raft_consensus.cc:399] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:01.088085  9310 raft_consensus.cc:493] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:01.088295  9310 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.092533  9310 raft_consensus.cc:515] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3fb61137daa445d9297d2162e98e24e" member_type: VOTER }
I20260709 13:02:01.093077  9310 leader_election.cc:304] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f3fb61137daa445d9297d2162e98e24e; no voters: 
I20260709 13:02:01.094487  9310 leader_election.cc:290] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:01.094838  9313 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.096220  9313 raft_consensus.cc:697] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e [term 1 LEADER]: Becoming Leader. State: Replica: f3fb61137daa445d9297d2162e98e24e, State: Running, Role: LEADER
I20260709 13:02:01.096895  9313 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3fb61137daa445d9297d2162e98e24e" member_type: VOTER }
I20260709 13:02:01.097688  9310 sys_catalog.cc:565] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:01.102677  9315 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3fb61137daa445d9297d2162e98e24e. Latest consensus state: current_term: 1 leader_uuid: "f3fb61137daa445d9297d2162e98e24e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3fb61137daa445d9297d2162e98e24e" member_type: VOTER } }
I20260709 13:02:01.103214  9314 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f3fb61137daa445d9297d2162e98e24e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3fb61137daa445d9297d2162e98e24e" member_type: VOTER } }
I20260709 13:02:01.103372  9315 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:01.103832  9314 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:01.105360  9321 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:01.110385  9321 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:01.113714  8209 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:01.119239  9321 catalog_manager.cc:1383] Generated new cluster ID: ee1a887fc8bd4f1d93119249be95d779
I20260709 13:02:01.119519  9321 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:01.137502  9321 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:01.138818  9321 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:01.157188  9321 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e: Generated new TSK 0
I20260709 13:02:01.157789  9321 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:01.180704  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:01.187206  9331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:01.188638  9332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:01.190325  8209 server_base.cc:1061] running on GCE node
W20260709 13:02:01.190407  9334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:01.191488  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:01.191706  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:01.191840  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602121191828 us; error 0 us; skew 500 ppm
I20260709 13:02:01.192337  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:01.194934  8209 webserver.cc:533] Webserver started at http://127.8.4.65:34357/ using document root <none> and password file <none>
I20260709 13:02:01.195459  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:01.195639  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:01.195889  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:01.197121  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-0-root/instance:
uuid: "925acbe78db14db3b9e4cfc857717947"
format_stamp: "Formatted at 2026-07-09 13:02:01 on dist-test-slave-008w"
I20260709 13:02:01.202693  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:02:01.206266  9339 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:01.207358  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:02:01.207674  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-0-root
uuid: "925acbe78db14db3b9e4cfc857717947"
format_stamp: "Formatted at 2026-07-09 13:02:01 on dist-test-slave-008w"
I20260709 13:02:01.208119  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:01.238659  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:01.240358  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:01.242154  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:01.244719  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:01.244926  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:01.245306  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:01.245478  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:01.298079  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.65:37547
I20260709 13:02:01.298192  9401 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.65:37547 every 8 connection(s)
I20260709 13:02:01.303887  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:01.312268  9406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:01.312860  9407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:01.315975  8209 server_base.cc:1061] running on GCE node
W20260709 13:02:01.315994  9409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:01.317359  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:01.317588  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:01.317839  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602121317817 us; error 0 us; skew 500 ppm
I20260709 13:02:01.318447  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:01.321123  8209 webserver.cc:533] Webserver started at http://127.8.4.66:43367/ using document root <none> and password file <none>
I20260709 13:02:01.321667  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:01.321869  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:01.322170  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:01.323387  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-1-root/instance:
uuid: "d62c9d5a052b42ce8675f8438f846526"
format_stamp: "Formatted at 2026-07-09 13:02:01 on dist-test-slave-008w"
I20260709 13:02:01.328787  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:02:01.331249  9402 heartbeater.cc:344] Connected to a master server at 127.8.4.126:34725
I20260709 13:02:01.331700  9402 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:01.332659  9402 heartbeater.cc:507] Master 127.8.4.126:34725 requested a full tablet report, sending...
I20260709 13:02:01.333786  9414 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:01.334853  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:02:01.335248  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-1-root
uuid: "d62c9d5a052b42ce8675f8438f846526"
format_stamp: "Formatted at 2026-07-09 13:02:01 on dist-test-slave-008w"
I20260709 13:02:01.335600  9275 ts_manager.cc:194] Registered new tserver with Master: 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
I20260709 13:02:01.335685  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:01.337860  9275 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43240
I20260709 13:02:01.383476  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:01.384876  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:01.386582  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:01.389189  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:01.389427  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:01.389689  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:01.389863  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:01.438349  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.66:45279
I20260709 13:02:01.438436  9476 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.66:45279 every 8 connection(s)
I20260709 13:02:01.443881  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:01.452440  9480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:01.454303  9481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:01.456259  9483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:01.457370  8209 server_base.cc:1061] running on GCE node
I20260709 13:02:01.458498  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:01.458685  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:01.458915  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602121458896 us; error 0 us; skew 500 ppm
I20260709 13:02:01.459352  9477 heartbeater.cc:344] Connected to a master server at 127.8.4.126:34725
I20260709 13:02:01.459537  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:01.459863  9477 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:01.460785  9477 heartbeater.cc:507] Master 127.8.4.126:34725 requested a full tablet report, sending...
I20260709 13:02:01.462854  8209 webserver.cc:533] Webserver started at http://127.8.4.67:39979/ using document root <none> and password file <none>
I20260709 13:02:01.463433  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:01.463678  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:01.463661  9275 ts_manager.cc:194] Registered new tserver with Master: d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:01.464210  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:01.465540  9275 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43244
I20260709 13:02:01.465628  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-2-root/instance:
uuid: "6d50f1c263264b21919230bee398022b"
format_stamp: "Formatted at 2026-07-09 13:02:01 on dist-test-slave-008w"
I20260709 13:02:01.471230  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.005s
I20260709 13:02:01.475636  9488 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:01.476778  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:02:01.477240  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-2-root
uuid: "6d50f1c263264b21919230bee398022b"
format_stamp: "Formatted at 2026-07-09 13:02:01 on dist-test-slave-008w"
I20260709 13:02:01.477618  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:01.504104  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:01.505471  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:01.507052  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:01.509577  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:01.509824  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:01.510213  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:01.510432  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:01.554395  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.67:35929
I20260709 13:02:01.554549  9550 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.67:35929 every 8 connection(s)
I20260709 13:02:01.569540  9551 heartbeater.cc:344] Connected to a master server at 127.8.4.126:34725
I20260709 13:02:01.569978  9551 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:01.570803  9551 heartbeater.cc:507] Master 127.8.4.126:34725 requested a full tablet report, sending...
I20260709 13:02:01.572975  9275 ts_manager.cc:194] Registered new tserver with Master: 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:01.573495  8209 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016011633s
I20260709 13:02:01.574558  9275 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43252
I20260709 13:02:01.602293  9275 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43262:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:01.609050  9275 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:01.821347  9367 tablet_service.cc:1511] Processing CreateTablet for tablet 31f9d5965eae4c788eb6a40e856cadc7 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:02:01.823031  9367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31f9d5965eae4c788eb6a40e856cadc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.829300  9442 tablet_service.cc:1511] Processing CreateTablet for tablet 31f9d5965eae4c788eb6a40e856cadc7 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:02:01.831209  9439 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4c96d6eb2446529db451af4486b758 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:02:01.833097  9442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31f9d5965eae4c788eb6a40e856cadc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.834990  9441 tablet_service.cc:1511] Processing CreateTablet for tablet 084579f9b3b648f0bff0a7e9cdc1669b (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:02:01.838276  9366 tablet_service.cc:1511] Processing CreateTablet for tablet 084579f9b3b648f0bff0a7e9cdc1669b (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:02:01.839231  9437 tablet_service.cc:1511] Processing CreateTablet for tablet 3ad4133883414768941dffb952ca7caf (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:02:01.839695  9435 tablet_service.cc:1511] Processing CreateTablet for tablet aad3a86fe3f14e62819801e837794bfb (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:02:01.840864  9438 tablet_service.cc:1511] Processing CreateTablet for tablet b5a227bc15c0427bbed0fbbe37f826f1 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:02:01.841173  9436 tablet_service.cc:1511] Processing CreateTablet for tablet 8cb1b08cec264585b21aa628ca12e206 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:02:01.836426  9440 tablet_service.cc:1511] Processing CreateTablet for tablet 7260766fbe5c43b1aab09346a89d9ac6 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:02:01.839742  9366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 084579f9b3b648f0bff0a7e9cdc1669b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.842918  9365 tablet_service.cc:1511] Processing CreateTablet for tablet 7260766fbe5c43b1aab09346a89d9ac6 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:02:01.844496  9365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7260766fbe5c43b1aab09346a89d9ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.844272  9434 tablet_service.cc:1511] Processing CreateTablet for tablet 001ad880018f49e5bec36246253efa0f (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:02:01.847836  9433 tablet_service.cc:1511] Processing CreateTablet for tablet ffaf31f504f540dc957e0b558c940f79 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:02:01.849277  9439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4c96d6eb2446529db451af4486b758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.853410  9434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 001ad880018f49e5bec36246253efa0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.857424  9433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffaf31f504f540dc957e0b558c940f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.858158  9435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aad3a86fe3f14e62819801e837794bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.858937  9441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 084579f9b3b648f0bff0a7e9cdc1669b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.859648  9436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cb1b08cec264585b21aa628ca12e206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.861431  9437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ad4133883414768941dffb952ca7caf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.865463  9438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5a227bc15c0427bbed0fbbe37f826f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.869483  9440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7260766fbe5c43b1aab09346a89d9ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.907088  9364 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4c96d6eb2446529db451af4486b758 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:02:01.910708  9363 tablet_service.cc:1511] Processing CreateTablet for tablet b5a227bc15c0427bbed0fbbe37f826f1 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:02:01.915287  9364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4c96d6eb2446529db451af4486b758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.921669  9363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5a227bc15c0427bbed0fbbe37f826f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.928645  9366 tablet_service.cc:1511] Processing CreateTablet for tablet 3ad4133883414768941dffb952ca7caf (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:02:01.931080  9437 tablet_service.cc:1511] Processing CreateTablet for tablet 7201bcdf8f724879b727639e6e67e31e (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:02:01.933521  9567 tablet_bootstrap.cc:492] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:01.944895  9437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7201bcdf8f724879b727639e6e67e31e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.944936  9361 tablet_service.cc:1511] Processing CreateTablet for tablet 001ad880018f49e5bec36246253efa0f (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:02:01.945601  9442 tablet_service.cc:1511] Processing CreateTablet for tablet 2d995bd1db654f5db92b8452f148c18a (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:02:01.946692  9361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 001ad880018f49e5bec36246253efa0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.946916  9442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d995bd1db654f5db92b8452f148c18a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.933117  9365 tablet_service.cc:1511] Processing CreateTablet for tablet 8cb1b08cec264585b21aa628ca12e206 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:02:01.940434  9362 tablet_service.cc:1511] Processing CreateTablet for tablet aad3a86fe3f14e62819801e837794bfb (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:02:01.950120  9365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cb1b08cec264585b21aa628ca12e206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.950806  9362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aad3a86fe3f14e62819801e837794bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.941789  9434 tablet_service.cc:1511] Processing CreateTablet for tablet 36e88678fcd042e78609b17fe3521242 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:02:01.962630  9360 tablet_service.cc:1511] Processing CreateTablet for tablet ffaf31f504f540dc957e0b558c940f79 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:02:01.963063  9433 tablet_service.cc:1511] Processing CreateTablet for tablet c70c7dbdc8034cefbfa29154c4082cc7 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:02:01.964159  9360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffaf31f504f540dc957e0b558c940f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.962634  9441 tablet_service.cc:1511] Processing CreateTablet for tablet a8c41deeda674b9b8d27e72d70e96e79 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:02:01.969406  9366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ad4133883414768941dffb952ca7caf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.973871  9566 tablet_bootstrap.cc:492] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:01.983551  9359 tablet_service.cc:1511] Processing CreateTablet for tablet a8c41deeda674b9b8d27e72d70e96e79 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:02:01.986667  9359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c41deeda674b9b8d27e72d70e96e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.986480  9435 tablet_service.cc:1511] Processing CreateTablet for tablet b77c45e065544a6cb4ff451f91a27cd1 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:02:01.987514  9358 tablet_service.cc:1511] Processing CreateTablet for tablet 36e88678fcd042e78609b17fe3521242 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:02:01.988866  9358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36e88678fcd042e78609b17fe3521242. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.997792  9434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36e88678fcd042e78609b17fe3521242. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:01.998463  9433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c70c7dbdc8034cefbfa29154c4082cc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.000254  9364 tablet_service.cc:1511] Processing CreateTablet for tablet 7201bcdf8f724879b727639e6e67e31e (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:02:02.001389  9435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b77c45e065544a6cb4ff451f91a27cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.001806  9364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7201bcdf8f724879b727639e6e67e31e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.003357  9441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c41deeda674b9b8d27e72d70e96e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.008155  9566 tablet_bootstrap.cc:654] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.016631  9438 tablet_service.cc:1511] Processing CreateTablet for tablet d55d9be5c0db4ab3a575698dea3014ba (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:02:02.018097  9438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55d9be5c0db4ab3a575698dea3014ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.018702  9567 tablet_bootstrap.cc:654] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.025902  9361 tablet_service.cc:1511] Processing CreateTablet for tablet 2d995bd1db654f5db92b8452f148c18a (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:02:02.027359  9361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d995bd1db654f5db92b8452f148c18a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.035430  9437 tablet_service.cc:1511] Processing CreateTablet for tablet 6836716b8e044849b07461ac40f5f1a6 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:02:02.036954  9437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6836716b8e044849b07461ac40f5f1a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.012513  9363 tablet_service.cc:1511] Processing CreateTablet for tablet b77c45e065544a6cb4ff451f91a27cd1 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:02:02.016511  9436 tablet_service.cc:1511] Processing CreateTablet for tablet 23a88c5000a045dbb65387d4da0a378c (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:02:02.057977  9363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b77c45e065544a6cb4ff451f91a27cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.047734  9439 tablet_service.cc:1511] Processing CreateTablet for tablet 7f7d9e2ac04d41d69afab7dd1be321e2 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:02:02.049053  9367 tablet_service.cc:1511] Processing CreateTablet for tablet 23a88c5000a045dbb65387d4da0a378c (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:02:02.061088  9367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23a88c5000a045dbb65387d4da0a378c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.062511  9442 tablet_service.cc:1511] Processing CreateTablet for tablet a3b5c7847cbc42538f7f07cceeb9c125 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:02:02.051447  9440 tablet_service.cc:1511] Processing CreateTablet for tablet 9e3280937dd84fa789b7a8c362985847 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:02:02.040899  9566 tablet_bootstrap.cc:492] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:02.057982  9436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23a88c5000a045dbb65387d4da0a378c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.049896  9362 tablet_service.cc:1511] Processing CreateTablet for tablet c70c7dbdc8034cefbfa29154c4082cc7 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:02:02.118592  9362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c70c7dbdc8034cefbfa29154c4082cc7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:02.109122  9323 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:02.124012  9360 tablet_service.cc:1511] Processing CreateTablet for tablet 7f7d9e2ac04d41d69afab7dd1be321e2 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:02:02.125738  9360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f7d9e2ac04d41d69afab7dd1be321e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.134781  9358 tablet_service.cc:1511] Processing CreateTablet for tablet 9e3280937dd84fa789b7a8c362985847 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:02:02.135030  9515 tablet_service.cc:1511] Processing CreateTablet for tablet 084579f9b3b648f0bff0a7e9cdc1669b (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:02:02.135944  9512 tablet_service.cc:1511] Processing CreateTablet for tablet b5a227bc15c0427bbed0fbbe37f826f1 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:02:02.136530  9515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 084579f9b3b648f0bff0a7e9cdc1669b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.137396  9512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5a227bc15c0427bbed0fbbe37f826f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.139977  9511 tablet_service.cc:1511] Processing CreateTablet for tablet 3ad4133883414768941dffb952ca7caf (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:02:02.141528  9511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ad4133883414768941dffb952ca7caf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.145454  9514 tablet_service.cc:1511] Processing CreateTablet for tablet 7260766fbe5c43b1aab09346a89d9ac6 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:02:02.147058  9514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7260766fbe5c43b1aab09346a89d9ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.080435  9567 tablet_bootstrap.cc:492] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:02.149959  9567 ts_tablet_manager.cc:1403] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.217s	user 0.016s	sys 0.000s
I20260709 13:02:02.149462  9516 tablet_service.cc:1511] Processing CreateTablet for tablet 31f9d5965eae4c788eb6a40e856cadc7 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:02:02.151139  9516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31f9d5965eae4c788eb6a40e856cadc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.153230  9442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b5c7847cbc42538f7f07cceeb9c125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.153290  9513 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4c96d6eb2446529db451af4486b758 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:02:02.154922  9513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4c96d6eb2446529db451af4486b758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.155125  9366 tablet_service.cc:1511] Processing CreateTablet for tablet a3b5c7847cbc42538f7f07cceeb9c125 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:02:02.157290  9510 tablet_service.cc:1511] Processing CreateTablet for tablet 8cb1b08cec264585b21aa628ca12e206 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:02:02.105276  9359 tablet_service.cc:1511] Processing CreateTablet for tablet 6836716b8e044849b07461ac40f5f1a6 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:02:02.158778  9510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cb1b08cec264585b21aa628ca12e206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.161072  9434 tablet_service.cc:1511] Processing CreateTablet for tablet 83531d29bc754f95b7c86cb864a9e096 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:02:02.162411  9434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83531d29bc754f95b7c86cb864a9e096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.163193  9509 tablet_service.cc:1511] Processing CreateTablet for tablet aad3a86fe3f14e62819801e837794bfb (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:02:02.164781  9509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aad3a86fe3f14e62819801e837794bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.168164  9441 tablet_service.cc:1511] Processing CreateTablet for tablet dc4ed6b5107b44b2bf1844daec23e8dd (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:02:02.169523  9441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4ed6b5107b44b2bf1844daec23e8dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.072815  9435 tablet_service.cc:1511] Processing CreateTablet for tablet 1b9a868ddd7e47e2bf15bb4c000634d0 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:02:02.172137  9435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b9a868ddd7e47e2bf15bb4c000634d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.173496  9507 tablet_service.cc:1511] Processing CreateTablet for tablet ffaf31f504f540dc957e0b558c940f79 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
W20260709 13:02:02.165778  9262 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 44784.1us
I20260709 13:02:02.152878  9567 raft_consensus.cc:359] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:02.081842  9433 tablet_service.cc:1511] Processing CreateTablet for tablet 6e8f1f59b3d149e09a5d394c216144b9 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:02:02.166524  9508 tablet_service.cc:1511] Processing CreateTablet for tablet 001ad880018f49e5bec36246253efa0f (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:02:02.175432  9567 raft_consensus.cc:385] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.175777  9567 raft_consensus.cc:740] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.175885  9507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffaf31f504f540dc957e0b558c940f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.179163  9366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b5c7847cbc42538f7f07cceeb9c125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.178807  9567 consensus_queue.cc:260] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:02.178764  9508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 001ad880018f49e5bec36246253efa0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.181224  9566 ts_tablet_manager.cc:1403] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.208s	user 0.016s	sys 0.006s
I20260709 13:02:02.185194  9358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e3280937dd84fa789b7a8c362985847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.149459  9364 tablet_service.cc:1511] Processing CreateTablet for tablet 895d29bbb65c4b67a479a2dc2f3cbb83 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:02:02.186595  9364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 895d29bbb65c4b67a479a2dc2f3cbb83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.067855  9365 tablet_service.cc:1511] Processing CreateTablet for tablet d55d9be5c0db4ab3a575698dea3014ba (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:02:02.191648  9365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55d9be5c0db4ab3a575698dea3014ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.175905  9440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e3280937dd84fa789b7a8c362985847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.193573  9433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e8f1f59b3d149e09a5d394c216144b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.195291  9438 tablet_service.cc:1511] Processing CreateTablet for tablet 6d1dd60ff2744b109e2d3f9d61d2702f (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:02:02.196880  9359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6836716b8e044849b07461ac40f5f1a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.197417  9439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f7d9e2ac04d41d69afab7dd1be321e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.184624  9566 raft_consensus.cc:359] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:02.206174  9566 raft_consensus.cc:385] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.206629  9566 raft_consensus.cc:740] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.213725  9363 tablet_service.cc:1511] Processing CreateTablet for tablet 1b9a868ddd7e47e2bf15bb4c000634d0 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:02:02.261852  9363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b9a868ddd7e47e2bf15bb4c000634d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.220532  9361 tablet_service.cc:1511] Processing CreateTablet for tablet 6e8f1f59b3d149e09a5d394c216144b9 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:02:02.221469  9438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d1dd60ff2744b109e2d3f9d61d2702f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.265955  9361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e8f1f59b3d149e09a5d394c216144b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.231767  9362 tablet_service.cc:1511] Processing CreateTablet for tablet 83531d29bc754f95b7c86cb864a9e096 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:02:02.269814  9362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83531d29bc754f95b7c86cb864a9e096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.236361  9437 tablet_service.cc:1511] Processing CreateTablet for tablet 895d29bbb65c4b67a479a2dc2f3cbb83 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:02:02.271065  9437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 895d29bbb65c4b67a479a2dc2f3cbb83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.239313  9367 tablet_service.cc:1511] Processing CreateTablet for tablet dc4ed6b5107b44b2bf1844daec23e8dd (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:02:02.277837  9367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4ed6b5107b44b2bf1844daec23e8dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.241197  9566 consensus_queue.cc:260] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:02.244650  9402 heartbeater.cc:499] Master 127.8.4.126:34725 was elected leader, sending a full tablet report...
I20260709 13:02:02.245404  9570 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.280347  9570 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:02.247391  9567 ts_tablet_manager.cc:1434] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.097s	user 0.013s	sys 0.000s
I20260709 13:02:02.287670  9567 tablet_bootstrap.cc:492] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:02.310029  9512 tablet_service.cc:1511] Processing CreateTablet for tablet a8c41deeda674b9b8d27e72d70e96e79 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:02:02.311563  9512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c41deeda674b9b8d27e72d70e96e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.316129  9508 tablet_service.cc:1511] Processing CreateTablet for tablet 36e88678fcd042e78609b17fe3521242 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:02:02.327386  9567 tablet_bootstrap.cc:654] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.329283  9570 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:02.349802  9436 tablet_service.cc:1511] Processing CreateTablet for tablet 45a4f94c156249adab9c2b1ffb00ac46 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:02:02.350078  9434 tablet_service.cc:1511] Processing CreateTablet for tablet 897f815762f54948b7f3aea4ee0c84f0 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:02:02.351583  9436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a4f94c156249adab9c2b1ffb00ac46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.359553  9366 tablet_service.cc:1511] Processing CreateTablet for tablet 6d1dd60ff2744b109e2d3f9d61d2702f (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:02:02.364300  9365 tablet_service.cc:1511] Processing CreateTablet for tablet 45a4f94c156249adab9c2b1ffb00ac46 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:02:02.367668  9360 tablet_service.cc:1511] Processing CreateTablet for tablet 897f815762f54948b7f3aea4ee0c84f0 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:02:02.399679  9508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36e88678fcd042e78609b17fe3521242. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.409224  9509 tablet_service.cc:1511] Processing CreateTablet for tablet b77c45e065544a6cb4ff451f91a27cd1 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:02:02.411230  9509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b77c45e065544a6cb4ff451f91a27cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.376307  9441 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8897d3859c4aa692a409afb3f57944 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:02:02.410691  9515 tablet_service.cc:1511] Processing CreateTablet for tablet 7201bcdf8f724879b727639e6e67e31e (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:02:02.415724  9515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7201bcdf8f724879b727639e6e67e31e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.388875  9433 tablet_service.cc:1511] Processing CreateTablet for tablet aada562be2484a8fb8aac8e7f9348043 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:02:02.414088  9441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8897d3859c4aa692a409afb3f57944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.422351  9433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aada562be2484a8fb8aac8e7f9348043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.440696  9366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d1dd60ff2744b109e2d3f9d61d2702f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.459635  9434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 897f815762f54948b7f3aea4ee0c84f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.471457  9477 heartbeater.cc:499] Master 127.8.4.126:34725 was elected leader, sending a full tablet report...
I20260709 13:02:02.469174  9360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 897f815762f54948b7f3aea4ee0c84f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.475348  9572 tablet_bootstrap.cc:492] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:02.489393  9365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a4f94c156249adab9c2b1ffb00ac46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.490301  9438 tablet_service.cc:1511] Processing CreateTablet for tablet 82949cde879a425f9973e01e26ea0b69 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:02:02.498044  9566 ts_tablet_manager.cc:1434] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.316s	user 0.023s	sys 0.012s
I20260709 13:02:02.502270  9358 tablet_service.cc:1511] Processing CreateTablet for tablet aada562be2484a8fb8aac8e7f9348043 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:02:02.503733  9358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aada562be2484a8fb8aac8e7f9348043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.503973  9439 tablet_service.cc:1511] Processing CreateTablet for tablet 060ae09cf899421ea6057ee5eca95814 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:02:02.469400  9507 tablet_service.cc:1511] Processing CreateTablet for tablet 83531d29bc754f95b7c86cb864a9e096 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:02:02.506299  9511 tablet_service.cc:1511] Processing CreateTablet for tablet 6836716b8e044849b07461ac40f5f1a6 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:02:02.506888  9440 tablet_service.cc:1511] Processing CreateTablet for tablet 0e30c155cba64357ae275b3366772777 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:02:02.509344  9513 tablet_service.cc:1511] Processing CreateTablet for tablet 7f7d9e2ac04d41d69afab7dd1be321e2 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:02:02.510357  9508 tablet_service.cc:1511] Processing CreateTablet for tablet c70c7dbdc8034cefbfa29154c4082cc7 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:02:02.510741  9516 tablet_service.cc:1511] Processing CreateTablet for tablet 2d995bd1db654f5db92b8452f148c18a (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:02:02.512037  9510 tablet_service.cc:1511] Processing CreateTablet for tablet 23a88c5000a045dbb65387d4da0a378c (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:02:02.457794  9364 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8897d3859c4aa692a409afb3f57944 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:02:02.513687  9364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8897d3859c4aa692a409afb3f57944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.515574  9365 tablet_service.cc:1511] Processing CreateTablet for tablet 0e30c155cba64357ae275b3366772777 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:02:02.517091  9365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e30c155cba64357ae275b3366772777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.506332  9507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83531d29bc754f95b7c86cb864a9e096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.526219  9511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6836716b8e044849b07461ac40f5f1a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.527657  9508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c70c7dbdc8034cefbfa29154c4082cc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.529191  9572 tablet_bootstrap.cc:654] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.531154  9513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f7d9e2ac04d41d69afab7dd1be321e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.551010  9516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d995bd1db654f5db92b8452f148c18a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.551309  9366 tablet_service.cc:1511] Processing CreateTablet for tablet 82949cde879a425f9973e01e26ea0b69 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:02:02.551765  9359 tablet_service.cc:1511] Processing CreateTablet for tablet 060ae09cf899421ea6057ee5eca95814 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:02:02.552212  9509 tablet_service.cc:1511] Processing CreateTablet for tablet d55d9be5c0db4ab3a575698dea3014ba (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:02:02.553583  9509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55d9be5c0db4ab3a575698dea3014ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.555987  9575 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.556664  9575 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:02.563431  9514 tablet_service.cc:1511] Processing CreateTablet for tablet 9e3280937dd84fa789b7a8c362985847 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:02:02.563550  9515 tablet_service.cc:1511] Processing CreateTablet for tablet a3b5c7847cbc42538f7f07cceeb9c125 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:02:02.552564  9366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82949cde879a425f9973e01e26ea0b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.590219  9514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e3280937dd84fa789b7a8c362985847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.590360  9551 heartbeater.cc:499] Master 127.8.4.126:34725 was elected leader, sending a full tablet report...
I20260709 13:02:02.599730  9575 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:02.617424  9359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060ae09cf899421ea6057ee5eca95814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.622287  9514 tablet_service.cc:1511] Processing CreateTablet for tablet 1b9a868ddd7e47e2bf15bb4c000634d0 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:02:02.623824  9514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b9a868ddd7e47e2bf15bb4c000634d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.637835  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:02.639099  9435 tablet_service.cc:1511] Processing CreateTablet for tablet 5b1affc9131446038db1c8ad10108ab0 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
W20260709 13:02:02.639796  9341 leader_election.cc:343] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:02.646986  9433 tablet_service.cc:1511] Processing CreateTablet for tablet f6a0d9dc457d47bc801e795a2a573601 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:02:02.648397  9433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6a0d9dc457d47bc801e795a2a573601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.630267  9515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b5c7847cbc42538f7f07cceeb9c125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.652796  9566 tablet_bootstrap.cc:492] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:02.653580  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:02.655310  9343 leader_election.cc:343] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:02.655771  9343 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:02.656635  9570 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:02.660840  9437 tablet_service.cc:1511] Processing CreateTablet for tablet 1e9721df2c264fa2bc26de02ce5bbe1a (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:02:02.662050  9572 tablet_bootstrap.cc:492] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:02.661626  9361 tablet_service.cc:1511] Processing CreateTablet for tablet 1e9721df2c264fa2bc26de02ce5bbe1a (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:02:02.662580  9572 ts_tablet_manager.cc:1403] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.188s	user 0.012s	sys 0.013s
I20260709 13:02:02.663192  9361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9721df2c264fa2bc26de02ce5bbe1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.665295  9510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23a88c5000a045dbb65387d4da0a378c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.665309  9435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b1affc9131446038db1c8ad10108ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.669629  9438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82949cde879a425f9973e01e26ea0b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.670346  9440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e30c155cba64357ae275b3366772777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.674655  9442 tablet_service.cc:1511] Processing CreateTablet for tablet 31a8af9a9a6948d584c9c4c96ee8c808 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:02:02.676044  9442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31a8af9a9a6948d584c9c4c96ee8c808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.686523  9567 tablet_bootstrap.cc:492] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:02.687074  9567 ts_tablet_manager.cc:1403] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.400s	user 0.034s	sys 0.022s
I20260709 13:02:02.609903  9363 tablet_service.cc:1511] Processing CreateTablet for tablet 5b1affc9131446038db1c8ad10108ab0 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:02:02.694625  9362 tablet_service.cc:1511] Processing CreateTablet for tablet f6a0d9dc457d47bc801e795a2a573601 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:02:02.695101  9361 tablet_service.cc:1511] Processing CreateTablet for tablet 99c4416401f2427a9f7e68b64ec6915e (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:02:02.684442  9367 tablet_service.cc:1511] Processing CreateTablet for tablet 31a8af9a9a6948d584c9c4c96ee8c808 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:02:02.707677  9566 tablet_bootstrap.cc:654] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.710558  9572 raft_consensus.cc:359] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:02.711654  9572 raft_consensus.cc:385] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.712096  9572 raft_consensus.cc:740] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.716296  9514 tablet_service.cc:1511] Processing CreateTablet for tablet 6e8f1f59b3d149e09a5d394c216144b9 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
W20260709 13:02:02.717367  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 62230.6us
I20260709 13:02:02.721401  9361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99c4416401f2427a9f7e68b64ec6915e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.725350  9363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b1affc9131446038db1c8ad10108ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.726902  9367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31a8af9a9a6948d584c9c4c96ee8c808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.728367  9362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6a0d9dc457d47bc801e795a2a573601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.733369  9572 consensus_queue.cc:260] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:02.738343  9567 raft_consensus.cc:359] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:02.739290  9567 raft_consensus.cc:385] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.739645  9567 raft_consensus.cc:740] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.740583  9567 consensus_queue.cc:260] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:02.742093  9514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e8f1f59b3d149e09a5d394c216144b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.743040  9567 ts_tablet_manager.cc:1434] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.056s	user 0.004s	sys 0.004s
I20260709 13:02:02.744194  9567 tablet_bootstrap.cc:492] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:02.692291  9436 tablet_service.cc:1511] Processing CreateTablet for tablet 99c4416401f2427a9f7e68b64ec6915e (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:02:02.745980  9436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99c4416401f2427a9f7e68b64ec6915e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.749432  9439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060ae09cf899421ea6057ee5eca95814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.712543  9441 tablet_service.cc:1511] Processing CreateTablet for tablet d7a866663507456b9442af6c42748c5f (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:02:02.736430  9512 tablet_service.cc:1511] Processing CreateTablet for tablet dc4ed6b5107b44b2bf1844daec23e8dd (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:02:02.760421  9437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9721df2c264fa2bc26de02ce5bbe1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.774470  9512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4ed6b5107b44b2bf1844daec23e8dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.762120  9511 tablet_service.cc:1511] Processing CreateTablet for tablet 6d1dd60ff2744b109e2d3f9d61d2702f (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:02:02.776222  9511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d1dd60ff2744b109e2d3f9d61d2702f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.776681  9441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7a866663507456b9442af6c42748c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.728475  9360 tablet_service.cc:1511] Processing CreateTablet for tablet d7a866663507456b9442af6c42748c5f (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:02:02.758234  9509 tablet_service.cc:1511] Processing CreateTablet for tablet 895d29bbb65c4b67a479a2dc2f3cbb83 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:02:02.783634  9434 tablet_service.cc:1511] Processing CreateTablet for tablet a81c17774a484973a3b82a63d2a33ff0 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:02:02.825321  9572 ts_tablet_manager.cc:1434] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.162s	user 0.019s	sys 0.005s
I20260709 13:02:02.827168  9566 tablet_bootstrap.cc:492] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:02.827365  9434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a81c17774a484973a3b82a63d2a33ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.827733  9566 ts_tablet_manager.cc:1403] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.175s	user 0.024s	sys 0.025s
I20260709 13:02:02.831087  9566 raft_consensus.cc:359] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:02.831941  9566 raft_consensus.cc:385] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.832289  9566 raft_consensus.cc:740] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.833256  9566 consensus_queue.cc:260] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:02.835999  9566 ts_tablet_manager.cc:1434] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:02:02.837195  9566 tablet_bootstrap.cc:492] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:02.838768  9435 tablet_service.cc:1511] Processing CreateTablet for tablet 620e7847d47845ad93329cf9a3a07dba (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:02:02.840086  9435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 620e7847d47845ad93329cf9a3a07dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.844413  9566 tablet_bootstrap.cc:654] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.844914  9360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7a866663507456b9442af6c42748c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.861229  9509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 895d29bbb65c4b67a479a2dc2f3cbb83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.867337  9440 tablet_service.cc:1511] Processing CreateTablet for tablet a326e6d2c4664dbe9374e92fa4c42c93 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:02:02.869026  9440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a326e6d2c4664dbe9374e92fa4c42c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.871681  9361 tablet_service.cc:1511] Processing CreateTablet for tablet a326e6d2c4664dbe9374e92fa4c42c93 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:02:02.913898  9361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a326e6d2c4664dbe9374e92fa4c42c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.872503  9513 tablet_service.cc:1511] Processing CreateTablet for tablet 45a4f94c156249adab9c2b1ffb00ac46 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:02:02.873569  9572 tablet_bootstrap.cc:492] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:02.874610  9366 tablet_service.cc:1511] Processing CreateTablet for tablet a81c17774a484973a3b82a63d2a33ff0 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:02:02.878237  9365 tablet_service.cc:1511] Processing CreateTablet for tablet 620e7847d47845ad93329cf9a3a07dba (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:02:02.918511  9567 tablet_bootstrap.cc:654] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.918556  9366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a81c17774a484973a3b82a63d2a33ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.921764  9513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a4f94c156249adab9c2b1ffb00ac46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.923555  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:02.925792  9365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 620e7847d47845ad93329cf9a3a07dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.928094  9572 tablet_bootstrap.cc:654] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.878034  9516 tablet_service.cc:1511] Processing CreateTablet for tablet 897f815762f54948b7f3aea4ee0c84f0 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:02:02.881383  9364 tablet_service.cc:1511] Processing CreateTablet for tablet f7b2e1b1ef6540b1915f1dda8f95e81b (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:02:02.932399  9364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b2e1b1ef6540b1915f1dda8f95e81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.934301  9510 tablet_service.cc:1511] Processing CreateTablet for tablet 31a8af9a9a6948d584c9c4c96ee8c808 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:02:02.825783  9359 tablet_service.cc:1511] Processing CreateTablet for tablet f70a11c5ae574b43ab50a91cfb6e293c (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:02:02.967749  9359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f70a11c5ae574b43ab50a91cfb6e293c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.896968  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:02.899261  9433 tablet_service.cc:1511] Processing CreateTablet for tablet f70a11c5ae574b43ab50a91cfb6e293c (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:02:02.969816  9433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f70a11c5ae574b43ab50a91cfb6e293c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.970433  9508 tablet_service.cc:1511] Processing CreateTablet for tablet 82949cde879a425f9973e01e26ea0b69 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:02:02.981809  9363 tablet_service.cc:1511] Processing CreateTablet for tablet d4df305315b74f329792b6a1f9a5e4db (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:02:02.983621  9363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4df305315b74f329792b6a1f9a5e4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.987854  9570 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.988554  9570 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:02.994748  9358 tablet_service.cc:1511] Processing CreateTablet for tablet 7f6a0746767b404997bb10c4d3ecd42c (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:02:03.005905  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:03.008352  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:03.009047  9526 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:03.010401  9343 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:03.015003  9570 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:03.015630  9570 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:03.016013  9570 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.016346  9570 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.019260  9437 tablet_service.cc:1511] Processing CreateTablet for tablet 807906edc34d41589d9b860b72f70e16 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:02:03.020648  9437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 807906edc34d41589d9b860b72f70e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.910131  9362 tablet_service.cc:1511] Processing CreateTablet for tablet 7a4d4b66d6394ace8bb74d9778cbd542 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:02:03.023079  9438 tablet_service.cc:1511] Processing CreateTablet for tablet d4df305315b74f329792b6a1f9a5e4db (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:02:03.024478  9438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4df305315b74f329792b6a1f9a5e4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.912329  9442 tablet_service.cc:1511] Processing CreateTablet for tablet f7b2e1b1ef6540b1915f1dda8f95e81b (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:02:03.024667  9513 tablet_service.cc:1511] Processing CreateTablet for tablet 060ae09cf899421ea6057ee5eca95814 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:02:03.025743  9442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b2e1b1ef6540b1915f1dda8f95e81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.930869  9436 tablet_service.cc:1511] Processing CreateTablet for tablet 7a4d4b66d6394ace8bb74d9778cbd542 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
W20260709 13:02:02.938688  9418 leader_election.cc:343] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:03.029349  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 90833.8us
W20260709 13:02:03.030740  9418 leader_election.cc:343] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.031222  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:03.032929  9436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4d4b66d6394ace8bb74d9778cbd542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.033107  9588 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:03.035225  9572 tablet_bootstrap.cc:492] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:03.035717  9572 ts_tablet_manager.cc:1403] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.162s	user 0.012s	sys 0.000s
I20260709 13:02:02.941186  9441 tablet_service.cc:1511] Processing CreateTablet for tablet 7f6a0746767b404997bb10c4d3ecd42c (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:02:02.936765  9507 tablet_service.cc:1511] Processing CreateTablet for tablet aada562be2484a8fb8aac8e7f9348043 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:02:02.948115  9575 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.038026  9575 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.038993  9572 raft_consensus.cc:359] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.039273  9452 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:03.039705  9572 raft_consensus.cc:385] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.040062  9572 raft_consensus.cc:740] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.040557  9575 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:03.042829  9441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f6a0746767b404997bb10c4d3ecd42c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.045540  9509 tablet_service.cc:1511] Processing CreateTablet for tablet 5b1affc9131446038db1c8ad10108ab0 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:02:02.960997  9566 tablet_bootstrap.cc:492] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:02.961187  9512 tablet_service.cc:1511] Processing CreateTablet for tablet 0e30c155cba64357ae275b3366772777 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:02:03.050077  9567 tablet_bootstrap.cc:492] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:03.050673  9567 ts_tablet_manager.cc:1403] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.307s	user 0.017s	sys 0.011s
I20260709 13:02:02.963296  9367 tablet_service.cc:1511] Processing CreateTablet for tablet 807906edc34d41589d9b860b72f70e16 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:02:02.882407  9515 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8897d3859c4aa692a409afb3f57944 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:02:02.932402  9516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 897f815762f54948b7f3aea4ee0c84f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.051913  9566 ts_tablet_manager.cc:1403] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.215s	user 0.040s	sys 0.027s
I20260709 13:02:03.055320  9566 raft_consensus.cc:359] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:03.056212  9566 raft_consensus.cc:385] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.056535  9566 raft_consensus.cc:740] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.057435  9512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e30c155cba64357ae275b3366772777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.058161  9515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8897d3859c4aa692a409afb3f57944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.061424  9507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aada562be2484a8fb8aac8e7f9348043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.065219  9439 tablet_service.cc:1511] Processing CreateTablet for tablet 09bfbc64d6af4fe0893109a7008e9b5d (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:02:03.065698  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:03.066643  9439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09bfbc64d6af4fe0893109a7008e9b5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.069957  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:03.070190  9360 tablet_service.cc:1511] Processing CreateTablet for tablet 09bfbc64d6af4fe0893109a7008e9b5d (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:02:03.070698  9526 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:03.072963  9418 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:03.074747  9575 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:03.075187  9575 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.075569  9575 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.072703  9364 tablet_service.cc:1511] Processing CreateTablet for tablet f322b7281d554c459bb8109ed249047b (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:02:03.076949  9572 consensus_queue.cc:260] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.078193  9582 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.078495  9514 tablet_service.cc:1511] Processing CreateTablet for tablet f6a0d9dc457d47bc801e795a2a573601 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:02:03.078727  9582 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.089553  9582 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:03.094177  9513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060ae09cf899421ea6057ee5eca95814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.110532  9575 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.099946  9358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f6a0746767b404997bb10c4d3ecd42c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.111406  9442 tablet_service.cc:1511] Processing CreateTablet for tablet f322b7281d554c459bb8109ed249047b (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:02:03.112805  9442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f322b7281d554c459bb8109ed249047b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.118007  9572 ts_tablet_manager.cc:1434] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.082s	user 0.011s	sys 0.009s
I20260709 13:02:03.119123  9572 tablet_bootstrap.cc:492] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:03.126870  9366 tablet_service.cc:1511] Processing CreateTablet for tablet 58a6a34a419649a4829c651a0402a5fa (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:02:03.097452  9570 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.129282  9510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31a8af9a9a6948d584c9c4c96ee8c808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.131203  9570 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:03.135526  9377 raft_consensus.cc:2393] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 1: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:03.135941  9567 raft_consensus.cc:359] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.137744  9567 raft_consensus.cc:385] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.114810  9566 consensus_queue.cc:260] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:03.138410  9567 raft_consensus.cc:740] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.140539  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:03.141189  9566 ts_tablet_manager.cc:1434] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.089s	user 0.009s	sys 0.000s
I20260709 13:02:03.133486  9367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 807906edc34d41589d9b860b72f70e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.147495  9566 tablet_bootstrap.cc:492] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:03.141429  9452 raft_consensus.cc:2393] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 1: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
W20260709 13:02:03.147994  9323 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:03.153869  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:03.169632  9526 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.174479  9360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09bfbc64d6af4fe0893109a7008e9b5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.179454  9511 tablet_service.cc:1511] Processing CreateTablet for tablet 99c4416401f2427a9f7e68b64ec6915e (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:02:03.181141  9514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6a0d9dc457d47bc801e795a2a573601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.140733  9567 consensus_queue.cc:260] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.185217  9567 ts_tablet_manager.cc:1434] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.134s	user 0.005s	sys 0.006s
I20260709 13:02:03.139493  9575 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:03.186667  9509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b1affc9131446038db1c8ad10108ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.186764  9366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58a6a34a419649a4829c651a0402a5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.193369  9508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82949cde879a425f9973e01e26ea0b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.184913  9512 tablet_service.cc:1511] Processing CreateTablet for tablet 1e9721df2c264fa2bc26de02ce5bbe1a (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:02:03.199101  9566 tablet_bootstrap.cc:654] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.175370  9363 tablet_service.cc:1511] Processing CreateTablet for tablet 10c8ef1923f34ce1befc8604db656137 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:02:03.162335  9572 tablet_bootstrap.cc:654] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.211058  9511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99c4416401f2427a9f7e68b64ec6915e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.215229  9362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4d4b66d6394ace8bb74d9778cbd542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.221665  9364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f322b7281d554c459bb8109ed249047b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.244936  9511 tablet_service.cc:1511] Processing CreateTablet for tablet d7a866663507456b9442af6c42748c5f (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:02:03.246543  9511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7a866663507456b9442af6c42748c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.249632  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:03.250475  9377 raft_consensus.cc:2393] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 1: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:03.250300  9516 tablet_service.cc:1511] Processing CreateTablet for tablet 620e7847d47845ad93329cf9a3a07dba (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:02:03.251742  9516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 620e7847d47845ad93329cf9a3a07dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.251904  9575 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.251559  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:03.252486  9575 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:03.253340  9567 tablet_bootstrap.cc:492] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:03.254892  9575 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:03.258129  9436 tablet_service.cc:1511] Processing CreateTablet for tablet 58a6a34a419649a4829c651a0402a5fa (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:02:03.259596  9436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58a6a34a419649a4829c651a0402a5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.258039  9439 tablet_service.cc:1511] Processing CreateTablet for tablet 10c8ef1923f34ce1befc8604db656137 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:02:03.261188  9435 tablet_service.cc:1511] Processing CreateTablet for tablet b5154ade768f425fa43369d9709e66a4 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:02:03.262552  9439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10c8ef1923f34ce1befc8604db656137. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.263823  9442 tablet_service.cc:1511] Processing CreateTablet for tablet 605e9c36ec724a60ac9a7846d6491c9f (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:02:03.240332  9365 tablet_service.cc:1511] Processing CreateTablet for tablet 605e9c36ec724a60ac9a7846d6491c9f (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:02:03.258019  9434 tablet_service.cc:1511] Processing CreateTablet for tablet 5e2df6fa742945289dda523a3fb658b0 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:02:03.268527  9440 tablet_service.cc:1511] Processing CreateTablet for tablet 522dd78118a14f5783e99d5dc43c9308 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:02:03.258039  9507 tablet_service.cc:1511] Processing CreateTablet for tablet a81c17774a484973a3b82a63d2a33ff0 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:02:03.265381  9435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5154ade768f425fa43369d9709e66a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.270264  9507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a81c17774a484973a3b82a63d2a33ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.270840  9440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522dd78118a14f5783e99d5dc43c9308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.271530  9442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605e9c36ec724a60ac9a7846d6491c9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.277434  9434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e2df6fa742945289dda523a3fb658b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.278545  9515 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46892 (request call id 30) took 1011 ms. Trace:
I20260709 13:02:03.282416  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:03.289207  9363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10c8ef1923f34ce1befc8604db656137. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.291752  9365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605e9c36ec724a60ac9a7846d6491c9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.293282  9512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9721df2c264fa2bc26de02ce5bbe1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.293037  9358 tablet_service.cc:1511] Processing CreateTablet for tablet b5154ade768f425fa43369d9709e66a4 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:02:03.294637  9358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5154ade768f425fa43369d9709e66a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.234556  9526 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:03.302282  9343 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:03.302438  9361 tablet_service.cc:1511] Processing CreateTablet for tablet 5e2df6fa742945289dda523a3fb658b0 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:02:03.303573  9570 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:03.303898  9361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e2df6fa742945289dda523a3fb658b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.304168  9570 raft_consensus.cc:697] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:03.305092  9570 consensus_queue.cc:237] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.302471  9359 tablet_service.cc:1511] Processing CreateTablet for tablet 522dd78118a14f5783e99d5dc43c9308 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:02:03.307206  9359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522dd78118a14f5783e99d5dc43c9308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.303805  9567 tablet_bootstrap.cc:654] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.319834  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:03.321465  9492 leader_election.cc:343] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.332340  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:03.335182  9418 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:03.338337  9575 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:03.351136  9587 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.351725  9587 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.353578  9508 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46892 (request call id 33) took 1019 ms. Trace:
I20260709 13:02:03.354331  9587 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:03.355587  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:03.356066  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:03.357018  9343 leader_election.cc:343] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:03.357856  9341 leader_election.cc:343] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.358385  9341 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:03.359803  9587 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:03.325507  9360 tablet_service.cc:1511] Processing CreateTablet for tablet 71ffe24ed6cf41c5b150d5ed4fa28c44 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:02:03.361901  9360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ffe24ed6cf41c5b150d5ed4fa28c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.279037  9515 rpcz_store.cc:276] 0709 13:02:02.285122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.881525 (+596403us) service_pool.cc:224] Handling call
0709 13:02:03.051327 (+169802us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:02:03.051436 (+   109us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:02:03.245644 (+194208us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:03.277992 (+ 32348us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:03.278469 (+   477us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:03.354002  9508 rpcz_store.cc:276] 0709 13:02:02.334185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.969228 (+635043us) service_pool.cc:224] Handling call
0709 13:02:02.971398 (+  2170us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:02:02.971507 (+   109us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:02:03.250783 (+279276us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:03.353044 (+102261us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:03.353514 (+   470us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:03.373728  9418 leader_election.cc:343] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:03.375691  9418 leader_election.cc:343] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.376154  9418 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:03.382400  9441 tablet_service.cc:1511] Processing CreateTablet for tablet 71ffe24ed6cf41c5b150d5ed4fa28c44 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:02:03.394181  9572 tablet_bootstrap.cc:492] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:03.394145  9510 tablet_service.cc:1511] Processing CreateTablet for tablet a326e6d2c4664dbe9374e92fa4c42c93 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:02:03.398838  9509 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46892 (request call id 35) took 1064 ms. Trace:
I20260709 13:02:03.402663  9575 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:03.410894  9515 tablet_service.cc:1511] Processing CreateTablet for tablet f70a11c5ae574b43ab50a91cfb6e293c (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:02:03.412393  9441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ffe24ed6cf41c5b150d5ed4fa28c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.412035  9273 catalog_manager.cc:5697] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:03.406989  9508 tablet_service.cc:1511] Processing CreateTablet for tablet f7b2e1b1ef6540b1915f1dda8f95e81b (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:02:03.415387  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:03.413158  9572 ts_tablet_manager.cc:1403] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.294s	user 0.018s	sys 0.011s
W20260709 13:02:03.425632  9490 leader_election.cc:343] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.426030  9510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a326e6d2c4664dbe9374e92fa4c42c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.426117  9490 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:03.427520  9589 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:03.428344  9572 raft_consensus.cc:359] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.432057  9572 raft_consensus.cc:385] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.431581  9513 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46892 (request call id 34) took 1097 ms. Trace:
I20260709 13:02:03.433633  9508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b2e1b1ef6540b1915f1dda8f95e81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.404111  9509 rpcz_store.cc:276] 0709 13:02:02.334778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.044557 (+709779us) service_pool.cc:224] Handling call
0709 13:02:03.046399 (+  1842us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:02:03.046655 (+   256us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:02:03.321378 (+274723us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:03.398291 (+ 76913us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:03.398776 (+   485us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:03.456775  9566 tablet_bootstrap.cc:492] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:03.457274  9567 tablet_bootstrap.cc:492] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:03.457374  9566 ts_tablet_manager.cc:1403] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.310s	user 0.032s	sys 0.044s
I20260709 13:02:03.457751  9567 ts_tablet_manager.cc:1403] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.224s	user 0.013s	sys 0.033s
I20260709 13:02:03.461483  9566 raft_consensus.cc:359] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.462194  9566 raft_consensus.cc:385] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.462473  9566 raft_consensus.cc:740] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.463608  9512 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46892 (request call id 37) took 1128 ms. Trace:
I20260709 13:02:03.463996  9512 rpcz_store.cc:276] 0709 13:02:02.335669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.180736 (+845067us) service_pool.cc:224] Handling call
0709 13:02:03.211494 (+ 30758us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:02:03.233361 (+ 21867us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:02:03.384474 (+151113us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:03.463097 (+ 78623us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:03.463544 (+   447us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:03.464582  9516 tablet_service.cc:1511] Processing CreateTablet for tablet 7a4d4b66d6394ace8bb74d9778cbd542 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:02:03.464761  9566 consensus_queue.cc:260] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.441601  9572 raft_consensus.cc:740] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.471094  9567 raft_consensus.cc:359] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.471702  9514 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46892 (request call id 36) took 1136 ms. Trace:
I20260709 13:02:03.467767  9509 tablet_service.cc:1511] Processing CreateTablet for tablet 7f6a0746767b404997bb10c4d3ecd42c (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:02:03.471833  9567 raft_consensus.cc:385] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.472934  9567 raft_consensus.cc:740] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.473933  9567 consensus_queue.cc:260] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.474773  9572 consensus_queue.cc:260] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.475164  9516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4d4b66d6394ace8bb74d9778cbd542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.476313  9515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f70a11c5ae574b43ab50a91cfb6e293c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.441951  9513 rpcz_store.cc:276] 0709 13:02:02.334495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.016201 (+681706us) service_pool.cc:224] Handling call
0709 13:02:03.026004 (+  9803us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:02:03.026113 (+   109us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:02:03.347857 (+321744us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:03.431032 (+ 83175us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:03.431515 (+   483us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:03.477804  9509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f6a0746767b404997bb10c4d3ecd42c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.478708  9572 ts_tablet_manager.cc:1434] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.053s	user 0.001s	sys 0.005s
I20260709 13:02:03.480501  9513 tablet_service.cc:1511] Processing CreateTablet for tablet d4df305315b74f329792b6a1f9a5e4db (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:02:03.472115  9514 rpcz_store.cc:276] 0709 13:02:02.335265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.077265 (+742000us) service_pool.cc:224] Handling call
0709 13:02:03.079519 (+  2254us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:02:03.079628 (+   109us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:02:03.416001 (+336373us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:03.471225 (+ 55224us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:03.471645 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:03.483525  9511 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46892 (request call id 40) took 1012 ms. Trace:
I20260709 13:02:03.484910  9567 ts_tablet_manager.cc:1434] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.003s
I20260709 13:02:03.489143  9512 tablet_service.cc:1511] Processing CreateTablet for tablet 807906edc34d41589d9b860b72f70e16 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:02:03.489143  9507 tablet_service.cc:1511] Processing CreateTablet for tablet 09bfbc64d6af4fe0893109a7008e9b5d (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:02:03.491086  9567 tablet_bootstrap.cc:492] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:03.484093  9511 rpcz_store.cc:276] 0709 13:02:02.523964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.243766 (+719802us) service_pool.cc:224] Handling call
0709 13:02:03.245995 (+  2229us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:02:03.246113 (+   118us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:02:03.423499 (+177386us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:03.476998 (+ 53499us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:03.483441 (+  6443us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8576}
I20260709 13:02:03.494719  9514 tablet_service.cc:1511] Processing CreateTablet for tablet f322b7281d554c459bb8109ed249047b (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:02:03.499950  9511 tablet_service.cc:1511] Processing CreateTablet for tablet 58a6a34a419649a4829c651a0402a5fa (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:02:03.500449  9566 ts_tablet_manager.cc:1434] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.002s
I20260709 13:02:03.501765  9566 tablet_bootstrap.cc:492] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:03.509316  9514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f322b7281d554c459bb8109ed249047b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.515400  9570 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.516095  9570 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.516942  9572 tablet_bootstrap.cc:492] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:03.516937  9510 tablet_service.cc:1511] Processing CreateTablet for tablet 5e2df6fa742945289dda523a3fb658b0 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:02:03.518960  9516 tablet_service.cc:1511] Processing CreateTablet for tablet 10c8ef1923f34ce1befc8604db656137 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:02:03.521327  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:03.523895  9341 leader_election.cc:343] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.525286  9513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4df305315b74f329792b6a1f9a5e4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.526814  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:03.527472  9526 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:03.528669  9512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 807906edc34d41589d9b860b72f70e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.528951  9343 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:03.529995  9587 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:03.530344  9587 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.530683  9587 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.525451  9570 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:03.539925  9587 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.540874  9510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e2df6fa742945289dda523a3fb658b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.543251  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:02:03.544807  9341 leader_election.cc:343] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.547375  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:03.547983  9526 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.550112  9572 tablet_bootstrap.cc:654] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.555275  9526 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:03.556663  9343 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:03.557526  9570 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:03.562440  9507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09bfbc64d6af4fe0893109a7008e9b5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.535437  9567 tablet_bootstrap.cc:654] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.568650  9587 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:03.570132  9570 raft_consensus.cc:697] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:03.571548  9511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58a6a34a419649a4829c651a0402a5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.572841  9515 tablet_service.cc:1511] Processing CreateTablet for tablet 605e9c36ec724a60ac9a7846d6491c9f (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:02:03.573414  9567 tablet_bootstrap.cc:492] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:03.578830  9567 ts_tablet_manager.cc:1403] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.088s	user 0.010s	sys 0.004s
I20260709 13:02:03.578248  9515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605e9c36ec724a60ac9a7846d6491c9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.581306  9516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10c8ef1923f34ce1befc8604db656137. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.577487  9570 consensus_queue.cc:237] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.584185  9513 tablet_service.cc:1511] Processing CreateTablet for tablet b5154ade768f425fa43369d9709e66a4 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:02:03.585812  9513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5154ade768f425fa43369d9709e66a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.591760  9566 tablet_bootstrap.cc:654] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.597570  9572 tablet_bootstrap.cc:492] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:03.601125  9572 ts_tablet_manager.cc:1403] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.084s	user 0.021s	sys 0.014s
I20260709 13:02:03.601257  9508 tablet_service.cc:1511] Processing CreateTablet for tablet 71ffe24ed6cf41c5b150d5ed4fa28c44 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:02:03.602555  9508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ffe24ed6cf41c5b150d5ed4fa28c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.603966  9572 raft_consensus.cc:359] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.604648  9572 raft_consensus.cc:385] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.604938  9572 raft_consensus.cc:740] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.609200  9511 tablet_service.cc:1511] Processing CreateTablet for tablet 522dd78118a14f5783e99d5dc43c9308 (DEFAULT_TABLE table=test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:02:03.610644  9511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522dd78118a14f5783e99d5dc43c9308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.605746  9572 consensus_queue.cc:260] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.611048  9567 raft_consensus.cc:359] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.615641  9567 raft_consensus.cc:385] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.616034  9567 raft_consensus.cc:740] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.616866  9567 consensus_queue.cc:260] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.619668  9567 ts_tablet_manager.cc:1434] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 13:02:03.620772  9567 tablet_bootstrap.cc:492] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:03.639643  9572 ts_tablet_manager.cc:1434] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:02:03.641382  9572 tablet_bootstrap.cc:492] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:03.650058  9567 tablet_bootstrap.cc:654] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.649703  9275 catalog_manager.cc:5697] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:03.653990  9572 tablet_bootstrap.cc:654] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.661625  9572 tablet_bootstrap.cc:492] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:03.662215  9572 ts_tablet_manager.cc:1403] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.004s
I20260709 13:02:03.662670  9582 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.663165  9582 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.665257  9582 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:03.665211  9572 raft_consensus.cc:359] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.666239  9572 raft_consensus.cc:385] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.666620  9572 raft_consensus.cc:740] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.667061  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:03.667554  9572 consensus_queue.cc:260] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.667986  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:03.668768  9492 leader_election.cc:343] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:03.669456  9490 leader_election.cc:343] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.669883  9490 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:03.670126  9572 ts_tablet_manager.cc:1434] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:03.670658  9582 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:03.671453  9572 tablet_bootstrap.cc:492] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:03.672755  9566 tablet_bootstrap.cc:492] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:03.673285  9566 ts_tablet_manager.cc:1403] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.172s	user 0.016s	sys 0.016s
I20260709 13:02:03.676369  9566 raft_consensus.cc:359] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.677179  9566 raft_consensus.cc:385] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.677485  9566 raft_consensus.cc:740] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.678655  9572 tablet_bootstrap.cc:654] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.678378  9566 consensus_queue.cc:260] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.681027  9567 tablet_bootstrap.cc:492] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:03.681551  9567 ts_tablet_manager.cc:1403] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.061s	user 0.019s	sys 0.001s
I20260709 13:02:03.684386  9567 raft_consensus.cc:359] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.685005  9567 raft_consensus.cc:385] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.685377  9567 raft_consensus.cc:740] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.686132  9567 consensus_queue.cc:260] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.688127  9567 ts_tablet_manager.cc:1434] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:02:03.689143  9567 tablet_bootstrap.cc:492] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:03.693899  9567 tablet_bootstrap.cc:654] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.695294  9566 ts_tablet_manager.cc:1434] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:02:03.696501  9566 tablet_bootstrap.cc:492] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:03.705570  9566 tablet_bootstrap.cc:654] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.710525  9567 tablet_bootstrap.cc:492] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:03.711050  9567 ts_tablet_manager.cc:1403] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260709 13:02:03.712620  9572 tablet_bootstrap.cc:492] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:03.713377  9572 ts_tablet_manager.cc:1403] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.019s
I20260709 13:02:03.714323  9567 raft_consensus.cc:359] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:03.715186  9567 raft_consensus.cc:385] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.715550  9567 raft_consensus.cc:740] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.716391  9567 consensus_queue.cc:260] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:03.717590  9572 raft_consensus.cc:359] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.718163  9572 raft_consensus.cc:385] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.718467  9572 raft_consensus.cc:740] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.719700  9567 ts_tablet_manager.cc:1434] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:03.719424  9572 consensus_queue.cc:260] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.720468  9566 tablet_bootstrap.cc:492] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:03.721592  9566 ts_tablet_manager.cc:1403] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.007s
I20260709 13:02:03.722043  9572 ts_tablet_manager.cc:1434] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:03.723537  9572 tablet_bootstrap.cc:492] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:03.720769  9567 tablet_bootstrap.cc:492] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:03.724889  9566 raft_consensus.cc:359] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.728972  9566 raft_consensus.cc:385] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.729386  9566 raft_consensus.cc:740] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.730751  9572 tablet_bootstrap.cc:654] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.730299  9566 consensus_queue.cc:260] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.732726  9567 tablet_bootstrap.cc:654] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.734055  9570 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:03.736126  9566 ts_tablet_manager.cc:1434] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 13:02:03.737244  9566 tablet_bootstrap.cc:492] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:03.754012  9566 tablet_bootstrap.cc:654] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.761802  9575 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.762583  9575 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.766979  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:03.768002  9575 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:03.769558  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:03.770659  9526 raft_consensus.cc:2393] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 1: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:03.773201  9418 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:03.774799  9575 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.787340  9587 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:03.820312  9575 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:03.822719  9575 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.823390  9575 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.827180  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:03.829190  9418 leader_election.cc:343] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.830237  9575 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:03.831434  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:03.832175  9526 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:03.833549  9418 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:03.835052  9575 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:03.837159  9575 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.838029  9575 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.842170  9567 tablet_bootstrap.cc:492] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:03.842338  9572 tablet_bootstrap.cc:492] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:03.842720  9567 ts_tablet_manager.cc:1403] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.122s	user 0.019s	sys 0.030s
I20260709 13:02:03.842839  9572 ts_tablet_manager.cc:1403] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.120s	user 0.029s	sys 0.068s
I20260709 13:02:03.845242  9567 raft_consensus.cc:359] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.845862  9567 raft_consensus.cc:385] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.846129  9567 raft_consensus.cc:740] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.846221  9572 raft_consensus.cc:359] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.846797  9567 consensus_queue.cc:260] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.848905  9567 ts_tablet_manager.cc:1434] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:02:03.847069  9572 raft_consensus.cc:385] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.849305  9566 tablet_bootstrap.cc:492] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:03.849395  9572 raft_consensus.cc:740] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.849947  9566 ts_tablet_manager.cc:1403] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.113s	user 0.023s	sys 0.053s
I20260709 13:02:03.850641  9572 consensus_queue.cc:260] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.853652  9567 tablet_bootstrap.cc:492] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:03.853215  9566 raft_consensus.cc:359] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.854107  9566 raft_consensus.cc:385] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.854447  9566 raft_consensus.cc:740] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.855257  9566 consensus_queue.cc:260] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.852250  9575 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.857769  9566 ts_tablet_manager.cc:1434] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:03.858820  9566 tablet_bootstrap.cc:492] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:03.859359  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:02:03.861281  9418 leader_election.cc:343] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.861552  9572 ts_tablet_manager.cc:1434] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.003s
I20260709 13:02:03.862793  9572 tablet_bootstrap.cc:492] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:03.863319  9601 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.863847  9601 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.866066  9601 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:03.865847  9566 tablet_bootstrap.cc:654] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.868444  9601 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.868947  9601 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:03.869894  9617 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.870594  9617 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.872905  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:03.873696  9451 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:03.873508  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:03.872941  9601 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:03.875306  9341 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:03.876195  9341 leader_election.cc:343] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.876749  9572 tablet_bootstrap.cc:654] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.876885  9601 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:03.877290  9601 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.877653  9601 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.881570  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:03.882649  9526 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:03.885274  9343 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:03.886858  9567 tablet_bootstrap.cc:654] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.887102  9587 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:03.887737  9587 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.888250  9587 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.890897  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:03.891880  9377 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:03.896267  9601 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:03.901650  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:02:03.903798  9343 leader_election.cc:343] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.905694  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:03.907562  9567 tablet_bootstrap.cc:492] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
W20260709 13:02:03.907868  9343 leader_election.cc:343] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.910734  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:03.911578  9452 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.912642  9617 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:03.908232  9567 ts_tablet_manager.cc:1403] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.000s
I20260709 13:02:03.920706  9567 raft_consensus.cc:359] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.921689  9567 raft_consensus.cc:385] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.922084  9567 raft_consensus.cc:740] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.916301  9418 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:03.924157  9617 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:03.924722  9617 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.924863  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:03.925436  9617 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.925715  9526 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:03.926707  9452 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:03.927986  9341 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:03.929158  9570 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:03.931052  9570 raft_consensus.cc:697] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:03.932256  9570 consensus_queue.cc:237] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:03.937251  9601 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:03.938839  9582 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.938935  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:03.939908  9526 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.939781  9582 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.943879  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:03.944494  9582 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:03.938839  9575 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:03.945492  9492 leader_election.cc:343] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.949512  9273 catalog_manager.cc:5697] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:03.951310  9526 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:03.952934  9418 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:03.955899  9575 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:03.956532  9575 raft_consensus.cc:697] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:03.957541  9575 consensus_queue.cc:237] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.955983  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:03.961520  9587 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.962322  9452 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:03.964030  9490 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:03.965550  9582 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:03.965679  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:03.966110  9582 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.966650  9582 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:03.967819  9341 leader_election.cc:343] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.973176  9587 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:03.973425  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:03.974056  9526 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.975106  9567 consensus_queue.cc:260] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.975873  9617 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.977196  9567 ts_tablet_manager.cc:1434] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.001s
I20260709 13:02:03.978101  9567 tablet_bootstrap.cc:492] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:03.980449  9582 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.981793  9526 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:03.983201  9343 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:03.984166  9587 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:03.985306  9587 raft_consensus.cc:697] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:03.985705  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:03.986449  9587 consensus_queue.cc:237] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:03.987273  9492 leader_election.cc:343] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.987955  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:03.990248  9452 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.990348  9566 tablet_bootstrap.cc:492] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:03.990942  9566 ts_tablet_manager.cc:1403] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.132s	user 0.038s	sys 0.079s
I20260709 13:02:03.993692  9566 raft_consensus.cc:359] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.994349  9566 raft_consensus.cc:385] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.994624  9566 raft_consensus.cc:740] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.995275  9566 consensus_queue.cc:260] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:03.995532  9273 catalog_manager.cc:5697] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 0 to 1, leader changed from <none> to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:03.988766  9582 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:03.997318  9566 ts_tablet_manager.cc:1434] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:02:03.999629  9567 tablet_bootstrap.cc:654] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.999673  9566 tablet_bootstrap.cc:492] T 9c4c96d6eb2446529db451af4486b758 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:03.999861  9572 tablet_bootstrap.cc:492] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:04.000355  9572 ts_tablet_manager.cc:1403] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.138s	user 0.062s	sys 0.018s
I20260709 13:02:04.002336  9452 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:04.002986  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:04.005376  9377 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.007658  9490 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:04.008528  9582 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:04.009194  9582 raft_consensus.cc:697] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:04.010325  9582 consensus_queue.cc:237] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.010967  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:04.011438  9617 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:04.011662  9526 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.004642  9572 raft_consensus.cc:359] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.026116  9572 raft_consensus.cc:385] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.026494  9572 raft_consensus.cc:740] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.027834  9572 consensus_queue.cc:260] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.030906  9572 ts_tablet_manager.cc:1434] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.030s	user 0.002s	sys 0.005s
I20260709 13:02:04.031697  9566 tablet_bootstrap.cc:654] T 9c4c96d6eb2446529db451af4486b758 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.032299  9572 tablet_bootstrap.cc:492] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:04.033344  9617 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.033821  9617 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.035574  9377 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:04.035974  9617 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:04.037854  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:04.038645  9525 raft_consensus.cc:2393] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 1: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:04.040766  9418 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:04.041674  9617 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:04.042377  9617 raft_consensus.cc:697] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:04.030666  9526 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:04.043210  9617 consensus_queue.cc:237] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.043401  9273 catalog_manager.cc:5697] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:04.047159  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:04.048786  9418 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:04.049654  9575 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.050326  9566 tablet_bootstrap.cc:492] T 9c4c96d6eb2446529db451af4486b758 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:04.051034  9566 ts_tablet_manager.cc:1403] T 9c4c96d6eb2446529db451af4486b758 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.004s
I20260709 13:02:04.055140  9566 raft_consensus.cc:359] T 9c4c96d6eb2446529db451af4486b758 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.056296  9566 raft_consensus.cc:385] T 9c4c96d6eb2446529db451af4486b758 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.056754  9566 raft_consensus.cc:740] T 9c4c96d6eb2446529db451af4486b758 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.057499  9575 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:04.058049  9566 consensus_queue.cc:260] T 9c4c96d6eb2446529db451af4486b758 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.060724  9566 ts_tablet_manager.cc:1434] T 9c4c96d6eb2446529db451af4486b758 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:04.062120  9566 tablet_bootstrap.cc:492] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:04.064194  9572 tablet_bootstrap.cc:654] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.068555  9566 tablet_bootstrap.cc:654] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.070302  9275 catalog_manager.cc:5697] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:04.075755  9587 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.075943  9572 tablet_bootstrap.cc:492] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:04.076514  9572 ts_tablet_manager.cc:1403] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.000s
I20260709 13:02:04.076325  9587 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.076860  9566 tablet_bootstrap.cc:492] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:04.077440  9566 ts_tablet_manager.cc:1403] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 13:02:04.078676  9587 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:04.079303  9572 raft_consensus.cc:359] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:04.080391  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:04.081082  9452 raft_consensus.cc:2468] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:04.081375  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:04.079931  9572 raft_consensus.cc:385] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.082000  9572 raft_consensus.cc:740] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.082074  9526 raft_consensus.cc:2468] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:04.082648  9341 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:04.080478  9566 raft_consensus.cc:359] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.082685  9572 consensus_queue.cc:260] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:04.083542  9566 raft_consensus.cc:385] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.084172  9566 raft_consensus.cc:740] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.084865  9572 ts_tablet_manager.cc:1434] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:02:04.084965  9566 consensus_queue.cc:260] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.085618  9273 catalog_manager.cc:5697] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 0 to 1, leader changed from <none> to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:04.086668  9572 tablet_bootstrap.cc:492] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:04.087206  9567 tablet_bootstrap.cc:492] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:04.087339  9566 ts_tablet_manager.cc:1434] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.002s
I20260709 13:02:04.087677  9567 ts_tablet_manager.cc:1403] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.110s	user 0.030s	sys 0.029s
I20260709 13:02:04.088256  9566 tablet_bootstrap.cc:492] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:04.090441  9567 raft_consensus.cc:359] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.091171  9567 raft_consensus.cc:385] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.091495  9567 raft_consensus.cc:740] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.092617  9572 tablet_bootstrap.cc:654] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.092180  9567 consensus_queue.cc:260] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.094710  9566 tablet_bootstrap.cc:654] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.096531  9587 raft_consensus.cc:2804] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:04.097080  9587 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.097553  9587 raft_consensus.cc:3060] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.101166  9570 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.102113  9570 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.106977  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:04.108181  9452 raft_consensus.cc:2393] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 1: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:04.112046  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:04.113718  9343 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:04.114722  9601 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.114960  9570 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:04.115934  9570 consensus_queue.cc:1048] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:04.122782  9601 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:04.126762  9567 ts_tablet_manager.cc:1434] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:02:04.138832  9572 tablet_bootstrap.cc:492] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:04.139050  9567 tablet_bootstrap.cc:492] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:04.139289  9566 tablet_bootstrap.cc:492] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:04.139333  9572 ts_tablet_manager.cc:1403] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.053s	user 0.022s	sys 0.023s
I20260709 13:02:04.142522  9587 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.143235  9572 raft_consensus.cc:359] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.143971  9572 raft_consensus.cc:385] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.144243  9572 raft_consensus.cc:740] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.144929  9572 consensus_queue.cc:260] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.145437  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:04.146024  9566 ts_tablet_manager.cc:1403] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.058s	user 0.017s	sys 0.021s
I20260709 13:02:04.146083  9451 raft_consensus.cc:3060] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.146762  9567 tablet_bootstrap.cc:654] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.150543  9572 ts_tablet_manager.cc:1434] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:02:04.150286  9601 consensus_queue.cc:1048] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:04.148954  9566 raft_consensus.cc:359] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.151503  9566 raft_consensus.cc:385] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.151782  9566 raft_consensus.cc:740] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.152681  9572 tablet_bootstrap.cc:492] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:04.152556  9566 consensus_queue.cc:260] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.153803  9451 raft_consensus.cc:2468] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:04.154852  9566 ts_tablet_manager.cc:1434] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:04.155117  9341 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:04.155746  9566 tablet_bootstrap.cc:492] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:04.155980  9601 raft_consensus.cc:2804] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:04.156746  9601 raft_consensus.cc:697] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:04.157629  9601 consensus_queue.cc:237] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.160794  9572 tablet_bootstrap.cc:654] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.162092  9624 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.164179  9624 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.165867  9567 tablet_bootstrap.cc:492] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:04.166308  9567 ts_tablet_manager.cc:1403] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.002s
I20260709 13:02:04.166548  9624 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:04.168231  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:04.169863  9343 leader_election.cc:343] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.169902  9567 raft_consensus.cc:359] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.170881  9567 raft_consensus.cc:385] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.171250  9567 raft_consensus.cc:740] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.171811  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:04.163112  9566 tablet_bootstrap.cc:654] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:04.173254  9341 leader_election.cc:343] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:04.173607  9323 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:04.173699  9341 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:04.174487  9624 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:04.172713  9567 consensus_queue.cc:260] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.177847  9567 ts_tablet_manager.cc:1434] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:02:04.177347  9572 tablet_bootstrap.cc:492] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:04.179355  9572 ts_tablet_manager.cc:1403] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.011s
I20260709 13:02:04.183045  9572 raft_consensus.cc:359] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.184198  9572 raft_consensus.cc:385] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.185750  9572 raft_consensus.cc:740] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.187086  9572 consensus_queue.cc:260] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.190116  9572 ts_tablet_manager.cc:1434] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:02:04.178791  9567 tablet_bootstrap.cc:492] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:04.193703  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:04.194341  9525 raft_consensus.cc:3060] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.198014  9572 tablet_bootstrap.cc:492] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:04.200487  9567 tablet_bootstrap.cc:654] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.205664  9587 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:04.204630  9525 raft_consensus.cc:2468] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:04.216758  9572 tablet_bootstrap.cc:654] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.217814  9582 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.219266  9582 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.224967  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:04.225951  9377 raft_consensus.cc:2468] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:04.227532  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:04.227767  9492 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:04.228470  9452 raft_consensus.cc:2468] T 9c4c96d6eb2446529db451af4486b758 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:04.229219  9589 raft_consensus.cc:2804] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:04.229775  9589 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.230237  9589 raft_consensus.cc:3060] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.223476  9582 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:04.243350  9589 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.242835  9272 catalog_manager.cc:5697] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:04.248171  9589 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:04.249784  9566 tablet_bootstrap.cc:492] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:04.250389  9566 ts_tablet_manager.cc:1403] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.095s	user 0.026s	sys 0.036s
I20260709 13:02:04.252807  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:04.253441  9377 raft_consensus.cc:3060] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.254632  9566 raft_consensus.cc:359] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.255715  9566 raft_consensus.cc:385] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.256078  9566 raft_consensus.cc:740] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.257054  9566 consensus_queue.cc:260] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.248600  9567 tablet_bootstrap.cc:492] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:04.258860  9567 ts_tablet_manager.cc:1403] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.080s	user 0.027s	sys 0.009s
I20260709 13:02:04.260753  9566 ts_tablet_manager.cc:1434] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:02:04.260869  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:04.261482  9452 raft_consensus.cc:3060] T 9c4c96d6eb2446529db451af4486b758 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.261955  9566 tablet_bootstrap.cc:492] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:04.265290  9567 raft_consensus.cc:359] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.265964  9567 raft_consensus.cc:385] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.266254  9567 raft_consensus.cc:740] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.266876  9567 consensus_queue.cc:260] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.268841  9566 tablet_bootstrap.cc:654] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.270074  9567 ts_tablet_manager.cc:1434] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:02:04.270853  9452 raft_consensus.cc:2468] T 9c4c96d6eb2446529db451af4486b758 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:04.271100  9567 tablet_bootstrap.cc:492] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:04.273264  9572 tablet_bootstrap.cc:492] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:04.273911  9572 ts_tablet_manager.cc:1403] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.076s	user 0.021s	sys 0.002s
I20260709 13:02:04.278095  9490 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:04.277658  9572 raft_consensus.cc:359] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.278781  9572 raft_consensus.cc:385] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.279116  9567 tablet_bootstrap.cc:654] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.279064  9589 raft_consensus.cc:2804] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:04.279342  9572 raft_consensus.cc:740] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.279647  9589 raft_consensus.cc:697] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:04.280365  9572 consensus_queue.cc:260] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.280625  9589 consensus_queue.cc:237] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.282502  9570 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.282749  9566 tablet_bootstrap.cc:492] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:04.283010  9570 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.283437  9566 ts_tablet_manager.cc:1403] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.008s
I20260709 13:02:04.286140  9570 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:04.288403  9566 raft_consensus.cc:359] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.288486  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:04.289633  9452 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:04.289841  9572 ts_tablet_manager.cc:1434] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.015s	user 0.015s	sys 0.000s
I20260709 13:02:04.290481  9566 raft_consensus.cc:385] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.290843  9572 tablet_bootstrap.cc:492] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:04.290764  9566 raft_consensus.cc:740] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.291153  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:04.291474  9566 consensus_queue.cc:260] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.291996  9526 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:04.294133  9566 ts_tablet_manager.cc:1434] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:02:04.294030  9341 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:04.295308  9566 tablet_bootstrap.cc:492] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:04.295287  9570 raft_consensus.cc:2804] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:04.295939  9570 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.296372  9570 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.298934  9572 tablet_bootstrap.cc:654] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.300066  9567 tablet_bootstrap.cc:492] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:04.300534  9567 ts_tablet_manager.cc:1403] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.011s
I20260709 13:02:04.301935  9566 tablet_bootstrap.cc:654] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.303356  9567 raft_consensus.cc:359] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.304025  9567 raft_consensus.cc:385] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.304272  9567 raft_consensus.cc:740] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.305073  9567 consensus_queue.cc:260] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.307400  9567 ts_tablet_manager.cc:1434] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:02:04.308285  9567 tablet_bootstrap.cc:492] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:04.312392  9572 tablet_bootstrap.cc:492] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:04.313161  9572 ts_tablet_manager.cc:1403] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.005s
I20260709 13:02:04.314901  9646 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.315634  9646 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:04.319888  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:04.323387  9601 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.324051  9601 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.326718  9601 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:04.328068  9646 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:04.328245  9377 raft_consensus.cc:2468] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:04.329501  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:04.330404  9452 raft_consensus.cc:2393] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 1: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:04.330065  9570 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.331816  9572 raft_consensus.cc:359] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.332186  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:04.332463  9572 raft_consensus.cc:385] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.332744  9572 raft_consensus.cc:740] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.332872  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:04.333173  9617 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.333491  9451 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.333839  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:04.333863  9572 consensus_queue.cc:260] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.334568  9526 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:04.335908  9490 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:04.336778  9572 ts_tablet_manager.cc:1434] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:02:04.336944  9343 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:04.338104  9601 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:04.338204  9646 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.338529  9601 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.338932  9601 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:04.340231  9341 leader_election.cc:343] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.333684  9617 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.342911  9617 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:04.343020  9451 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:04.344400  9341 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:04.345073  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:04.345297  9587 raft_consensus.cc:2804] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:04.345863  9587 raft_consensus.cc:697] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:02:04.347278  9418 leader_election.cc:343] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.346964  9587 consensus_queue.cc:237] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.348196  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:04.348104  9601 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.349184  9646 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:04.349594  9418 leader_election.cc:343] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.352114  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:04.352726  9526 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.351773  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:04.352571  9418 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:04.354496  9566 tablet_bootstrap.cc:492] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:04.354962  9566 ts_tablet_manager.cc:1403] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.024s
I20260709 13:02:04.355160  9617 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:04.356355  9341 leader_election.cc:343] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.358109  9572 tablet_bootstrap.cc:492] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:04.360440  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:04.361402  9525 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.369546  9526 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:04.360667  9601 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:04.371178  9343 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:04.372000  9566 raft_consensus.cc:359] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.372681  9566 raft_consensus.cc:385] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.372965  9566 raft_consensus.cc:740] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.374013  9525 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:04.374981  9566 consensus_queue.cc:260] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.377235  9566 ts_tablet_manager.cc:1434] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:02:04.377591  9642 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:04.378115  9642 raft_consensus.cc:697] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:04.378978  9642 consensus_queue.cc:237] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.386385  9587 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:04.388150  9570 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:04.388840  9566 tablet_bootstrap.cc:492] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:04.388968  9567 tablet_bootstrap.cc:654] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.398459  9617 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.400712  9566 tablet_bootstrap.cc:654] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.400314  9617 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.399916  9273 catalog_manager.cc:5697] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:04.395241  9572 tablet_bootstrap.cc:654] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.403102  9617 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:04.403791  9642 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:04.404599  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:04.405746  9524 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:04.407135  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:04.407510  9418 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:04.408476  9617 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:04.408875  9617 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.409273  9617 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:04.414916  9418 leader_election.cc:343] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.422724  9589 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.423214  9589 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.426093  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:04.426753  9377 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:04.428022  9575 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.428553  9377 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.428522  9575 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.428047  9492 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:04.431368  9646 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:04.431552  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:04.431811  9646 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.431449  9617 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.432236  9646 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.434006  9275 catalog_manager.cc:5697] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:04.435904  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:04.437413  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:04.437536  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:04.438184  9589 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:04.438391  9524 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.438766  9451 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:04.432238  9376 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
W20260709 13:02:04.448307  9418 leader_election.cc:343] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.449431  9418 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:04.450603  9620 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:04.450982  9620 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.450908  9575 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:04.451617  9620 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.466249  9275 catalog_manager.cc:5697] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:04.489598  9567 tablet_bootstrap.cc:492] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:04.476111  9642 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:02:04.490134  9567 ts_tablet_manager.cc:1403] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.182s	user 0.025s	sys 0.049s
I20260709 13:02:04.463166  9620 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.495151  9620 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:04.495916  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:04.503908  9376 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.469127  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:04.504590  9524 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:04.500440  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:04.467661  9646 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.443116  9617 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:04.513900  9620 consensus_queue.cc:1048] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:04.463551  9582 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.055s
I20260709 13:02:04.517970  9575 consensus_queue.cc:1048] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:04.518765  9589 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:04.522398  9525 raft_consensus.cc:2393] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 1: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:04.523600  9418 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:04.524596  9601 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:04.524957  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:04.530719  9572 tablet_bootstrap.cc:492] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:04.530992  9646 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:04.531198  9572 ts_tablet_manager.cc:1403] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.173s	user 0.017s	sys 0.014s
I20260709 13:02:04.533819  9572 raft_consensus.cc:359] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.529059  9575 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:04.534794  9572 raft_consensus.cc:385] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.535859  9572 raft_consensus.cc:740] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.538681  9572 consensus_queue.cc:260] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.540568  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:04.542827  9450 raft_consensus.cc:2393] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 1: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:04.544296  9490 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:04.545890  9567 raft_consensus.cc:359] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.547169  9567 raft_consensus.cc:385] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.547628  9567 raft_consensus.cc:740] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.545892  9566 tablet_bootstrap.cc:492] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:04.548475  9567 consensus_queue.cc:260] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.550117  9566 ts_tablet_manager.cc:1403] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.161s	user 0.016s	sys 0.011s
I20260709 13:02:04.576010  9572 ts_tablet_manager.cc:1434] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 13:02:04.545624  9575 raft_consensus.cc:697] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:04.699009  9572 tablet_bootstrap.cc:492] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:04.549198  9646 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:04.647416  9617 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.555419  9376 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:04.710888  9620 consensus_queue.cc:1048] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:02:04.714969  9575 consensus_queue.cc:237] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.712093  9617 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.721410  9567 ts_tablet_manager.cc:1434] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.231s	user 0.038s	sys 0.049s
I20260709 13:02:04.722397  9567 tablet_bootstrap.cc:492] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:04.727314  9570 consensus_queue.cc:1048] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:04.729280  9566 raft_consensus.cc:359] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.730016  9566 raft_consensus.cc:385] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.730279  9566 raft_consensus.cc:740] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.722434  9617 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:04.732391  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:04.734189  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:04.734846  9566 consensus_queue.cc:260] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.737834  9566 ts_tablet_manager.cc:1434] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.048s	user 0.011s	sys 0.002s
I20260709 13:02:04.738874  9566 tablet_bootstrap.cc:492] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:04.761755  9418 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:04.770648  9587 consensus_queue.cc:1048] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:04.773963  9572 tablet_bootstrap.cc:654] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.779621  9620 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:04.767853  9567 tablet_bootstrap.cc:654] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.782565  9620 raft_consensus.cc:697] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:02:04.785970  9418 leader_election.cc:343] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.794984  9620 consensus_queue.cc:237] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.798120  9575 consensus_queue.cc:1048] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:02:04.798188  9418 leader_election.cc:343] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.802249  9418 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:04.803107  9617 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:04.812975  9646 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.813661  9646 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.818542  9646 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:04.820868  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:04.827690  9572 tablet_bootstrap.cc:492] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:04.828208  9572 ts_tablet_manager.cc:1403] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.130s	user 0.011s	sys 0.010s
I20260709 13:02:04.828709  9275 catalog_manager.cc:5697] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 0 to 1, leader changed from <none> to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:04.833932  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:04.836359  9490 leader_election.cc:343] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.837987  9646 consensus_queue.cc:1048] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:04.841351  9492 leader_election.cc:343] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.841804  9492 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:04.843030  9646 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:04.845837  9341 consensus_peers.cc:597] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:04.851089  9566 tablet_bootstrap.cc:654] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.860846  9572 raft_consensus.cc:359] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.866030  9572 raft_consensus.cc:385] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.867220  9572 raft_consensus.cc:740] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.868961  9572 consensus_queue.cc:260] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.886958  9572 ts_tablet_manager.cc:1434] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.006s
I20260709 13:02:04.887977  9572 tablet_bootstrap.cc:492] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:04.894420  9646 consensus_queue.cc:1048] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:04.886749  9601 consensus_queue.cc:1048] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:02:04.902539  9567 tablet_bootstrap.cc:492] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:04.903184  9567 ts_tablet_manager.cc:1403] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.181s	user 0.012s	sys 0.004s
I20260709 13:02:04.907553  9567 raft_consensus.cc:359] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.908463  9567 raft_consensus.cc:385] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.908814  9567 raft_consensus.cc:740] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.909781  9567 consensus_queue.cc:260] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.914212  9567 ts_tablet_manager.cc:1434] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:02:04.914680  9572 tablet_bootstrap.cc:654] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.915261  9567 tablet_bootstrap.cc:492] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:04.918560  9566 tablet_bootstrap.cc:492] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:04.919049  9566 ts_tablet_manager.cc:1403] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.180s	user 0.006s	sys 0.008s
I20260709 13:02:04.924904  9601 consensus_queue.cc:1048] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:04.929870  9566 raft_consensus.cc:359] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.930498  9566 raft_consensus.cc:385] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.930745  9566 raft_consensus.cc:740] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.934463  9587 consensus_queue.cc:1048] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:04.938928  9620 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.939502  9620 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.942294  9620 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:04.944576  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:04.945266  9374 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:04.945506  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:04.946484  9418 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:04.947779  9418 leader_election.cc:343] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.948658  9620 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:04.949082  9620 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.949445  9620 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.950008  9572 tablet_bootstrap.cc:492] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:04.950664  9572 ts_tablet_manager.cc:1403] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.007s
I20260709 13:02:04.955850  9642 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.956553  9567 tablet_bootstrap.cc:654] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.956383  9642 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.958688  9642 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:04.960958  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:04.961300  9572 raft_consensus.cc:359] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.964552  9572 raft_consensus.cc:385] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:02:04.963676  9343 leader_election.cc:343] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.964937  9572 raft_consensus.cc:740] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.965895  9572 consensus_queue.cc:260] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.962944  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:04.974045  9450 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:04.964406  9620 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.967736  9273 catalog_manager.cc:5697] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 0 to 1, leader changed from <none> to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:04.976398  9620 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:04.962131  9566 consensus_queue.cc:260] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.978072  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:04.978626  9566 ts_tablet_manager.cc:1434] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.059s	user 0.003s	sys 0.011s
I20260709 13:02:04.979579  9566 tablet_bootstrap.cc:492] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:04.979435  9341 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:04.980144  9601 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:04.980481  9601 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.980777  9572 ts_tablet_manager.cc:1434] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:02:04.980821  9601 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.982856  9572 tablet_bootstrap.cc:492] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:04.978677  9374 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.988336  9566 tablet_bootstrap.cc:654] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.988621  9601 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:04.990175  9572 tablet_bootstrap.cc:654] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.991504  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:04.992172  9452 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.978092  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:02:04.994549  9418 leader_election.cc:343] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.996371  9374 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:04.998188  9418 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:04.998634  9601 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:04.999481  9620 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.000411  9620 raft_consensus.cc:697] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:05.001540  9620 consensus_queue.cc:237] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.013974  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:02:05.015755  9343 leader_election.cc:343] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.019313  9452 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:05.020977  9341 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:05.022040  9601 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.022634  9601 raft_consensus.cc:697] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:05.028450  9601 consensus_queue.cc:237] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.030547  9572 tablet_bootstrap.cc:492] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:05.031018  9572 ts_tablet_manager.cc:1403] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.002s
I20260709 13:02:05.032286  9570 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.032840  9570 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.033937  9572 raft_consensus.cc:359] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.034590  9572 raft_consensus.cc:385] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.034859  9572 raft_consensus.cc:740] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.035854  9570 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:05.035621  9572 consensus_queue.cc:260] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.037954  9572 ts_tablet_manager.cc:1434] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:05.039510  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:05.040630  9566 tablet_bootstrap.cc:492] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:05.041582  9566 ts_tablet_manager.cc:1403] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.022s
I20260709 13:02:05.044245  9572 tablet_bootstrap.cc:492] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:05.046446  9566 raft_consensus.cc:359] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.047184  9566 raft_consensus.cc:385] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.047456  9566 raft_consensus.cc:740] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.048179  9566 consensus_queue.cc:260] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.050055  9566 ts_tablet_manager.cc:1434] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:05.051084  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:05.052202  9524 raft_consensus.cc:2393] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 1: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:05.053776  9566 tablet_bootstrap.cc:492] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:05.053987  9343 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:05.055660  9570 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.058959  9567 tablet_bootstrap.cc:492] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:05.059484  9567 ts_tablet_manager.cc:1403] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.144s	user 0.015s	sys 0.010s
I20260709 13:02:05.061354  9566 tablet_bootstrap.cc:654] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.062638  9567 raft_consensus.cc:359] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.063464  9567 raft_consensus.cc:385] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.063814  9567 raft_consensus.cc:740] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.065110  9273 catalog_manager.cc:5697] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 0 to 1, leader changed from <none> to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.069177  9570 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.070181  9567 consensus_queue.cc:260] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.073174  9572 tablet_bootstrap.cc:654] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.073405  9275 catalog_manager.cc:5697] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.083580  9572 tablet_bootstrap.cc:492] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:05.084017  9572 ts_tablet_manager.cc:1403] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.045s	user 0.006s	sys 0.007s
I20260709 13:02:05.085749  9567 ts_tablet_manager.cc:1434] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.005s
I20260709 13:02:05.089107  9567 tablet_bootstrap.cc:492] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:05.086712  9572 raft_consensus.cc:359] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.094630  9572 raft_consensus.cc:385] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.094965  9572 raft_consensus.cc:740] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.095919  9572 consensus_queue.cc:260] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.098341  9572 ts_tablet_manager.cc:1434] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:02:05.099681  9572 tablet_bootstrap.cc:492] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:05.100982  9567 tablet_bootstrap.cc:654] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.102355  9566 tablet_bootstrap.cc:492] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:05.102939  9566 ts_tablet_manager.cc:1403] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.020s
I20260709 13:02:05.105988  9572 tablet_bootstrap.cc:654] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.106216  9566 raft_consensus.cc:359] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.107007  9566 raft_consensus.cc:385] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.107319  9566 raft_consensus.cc:740] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.108397  9566 consensus_queue.cc:260] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.112978  9567 tablet_bootstrap.cc:492] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:05.113494  9572 tablet_bootstrap.cc:492] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:05.113525  9567 ts_tablet_manager.cc:1403] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.002s
I20260709 13:02:05.114073  9572 ts_tablet_manager.cc:1403] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:02:05.116312  9567 raft_consensus.cc:359] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.116696  9572 raft_consensus.cc:359] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.117184  9567 raft_consensus.cc:385] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.117436  9572 raft_consensus.cc:385] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.117486  9567 raft_consensus.cc:740] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.117841  9572 raft_consensus.cc:740] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.118317  9567 consensus_queue.cc:260] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.118547  9572 consensus_queue.cc:260] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.120327  9567 ts_tablet_manager.cc:1434] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:02:05.120824  9572 ts_tablet_manager.cc:1434] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:05.121649  9566 ts_tablet_manager.cc:1434] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 13:02:05.122040  9567 tablet_bootstrap.cc:492] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:05.122597  9566 tablet_bootstrap.cc:492] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:05.125283  9572 tablet_bootstrap.cc:492] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:05.132143  9572 tablet_bootstrap.cc:654] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.132640  9567 tablet_bootstrap.cc:654] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.135627  9566 tablet_bootstrap.cc:654] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.144100  9572 tablet_bootstrap.cc:492] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:05.144615  9572 ts_tablet_manager.cc:1403] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.000s
I20260709 13:02:05.145408  9567 tablet_bootstrap.cc:492] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:05.146104  9567 ts_tablet_manager.cc:1403] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.006s
I20260709 13:02:05.147215  9572 raft_consensus.cc:359] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.147959  9572 raft_consensus.cc:385] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.148264  9572 raft_consensus.cc:740] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.149230  9620 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.148909  9567 raft_consensus.cc:359] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.148917  9572 consensus_queue.cc:260] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.149657  9566 tablet_bootstrap.cc:492] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:05.149758  9567 raft_consensus.cc:385] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.149703  9620 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.150245  9566 ts_tablet_manager.cc:1403] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.015s
I20260709 13:02:05.150218  9567 raft_consensus.cc:740] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.151060  9567 consensus_queue.cc:260] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.152064  9620 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:05.152923  9566 raft_consensus.cc:359] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.153585  9566 raft_consensus.cc:385] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.153838  9566 raft_consensus.cc:740] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.154760  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:05.154548  9566 consensus_queue.cc:260] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.155054  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:05.157949  9567 ts_tablet_manager.cc:1434] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:02:05.159582  9668 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.156760  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:05.167001  9566 ts_tablet_manager.cc:1434] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:02:05.167622  9620 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.167433  9668 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.155578  9572 ts_tablet_manager.cc:1434] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 13:02:05.169164  9572 tablet_bootstrap.cc:492] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:05.171428  9566 tablet_bootstrap.cc:492] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:05.171627  9567 tablet_bootstrap.cc:492] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:05.176532  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:05.177868  9566 tablet_bootstrap.cc:654] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:05.178102  9492 leader_election.cc:343] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.180466  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:05.181331  9452 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:05.185422  9572 tablet_bootstrap.cc:654] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.185701  9490 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:05.186931  9646 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.187422  9646 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.187885  9646 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:05.195868  9323 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:05.198097  9572 tablet_bootstrap.cc:492] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:05.198635  9572 ts_tablet_manager.cc:1403] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.004s
I20260709 13:02:05.198734  9567 tablet_bootstrap.cc:654] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.201225  9620 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:05.202198  9572 raft_consensus.cc:359] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.203163  9572 raft_consensus.cc:385] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.203589  9572 raft_consensus.cc:740] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.204567  9572 consensus_queue.cc:260] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.207935  9572 ts_tablet_manager.cc:1434] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:02:05.209276  9572 tablet_bootstrap.cc:492] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:05.212554  9567 tablet_bootstrap.cc:492] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:05.212983  9567 ts_tablet_manager.cc:1403] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.007s
I20260709 13:02:05.215061  9668 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:05.217595  9572 tablet_bootstrap.cc:654] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.222579  9567 raft_consensus.cc:359] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.223337  9567 raft_consensus.cc:385] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.223671  9567 raft_consensus.cc:740] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.223655  9668 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.224754  9668 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.225544  9567 consensus_queue.cc:260] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.227752  9567 ts_tablet_manager.cc:1434] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 13:02:05.227947  9668 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:05.228767  9567 tablet_bootstrap.cc:492] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:05.229621  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:05.231163  9490 leader_election.cc:343] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.233057  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:05.235414  9646 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:05.238032  9492 leader_election.cc:343] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.238567  9492 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:05.242825  9668 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.246920  9567 tablet_bootstrap.cc:654] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.247227  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:05.247679  9646 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:05.250329  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:02:05.250916  9492 leader_election.cc:343] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.251012  9452 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.253644  9450 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.258585  9566 tablet_bootstrap.cc:492] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:05.259236  9566 ts_tablet_manager.cc:1403] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.088s	user 0.042s	sys 0.025s
I20260709 13:02:05.265746  9452 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:05.267022  9490 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:05.268254  9646 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.268743  9646 raft_consensus.cc:697] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:05.269603  9646 consensus_queue.cc:237] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.271281  9566 raft_consensus.cc:359] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.271941  9572 tablet_bootstrap.cc:492] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:05.272261  9566 raft_consensus.cc:385] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.272692  9572 ts_tablet_manager.cc:1403] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.016s
I20260709 13:02:05.272639  9566 raft_consensus.cc:740] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.273608  9617 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:05.275532  9572 raft_consensus.cc:359] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.276211  9572 raft_consensus.cc:385] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.276479  9572 raft_consensus.cc:740] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.277083  9572 consensus_queue.cc:260] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.273731  9566 consensus_queue.cc:260] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.281858  9572 ts_tablet_manager.cc:1434] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:02:05.282855  9572 tablet_bootstrap.cc:492] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:05.284361  9668 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.285378  9567 tablet_bootstrap.cc:492] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:05.284821  9668 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.285936  9567 ts_tablet_manager.cc:1403] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.015s
I20260709 13:02:05.287220  9668 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:05.287921  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:05.288552  9376 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:05.289371  9668 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.289871  9492 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:05.289878  9668 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.289939  9566 ts_tablet_manager.cc:1434] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.030s	user 0.015s	sys 0.000s
I20260709 13:02:05.290880  9666 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.291424  9666 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.291733  9566 tablet_bootstrap.cc:492] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:05.291821  9666 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.293720  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:05.301149  9668 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:05.302317  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:05.303211  9376 raft_consensus.cc:2393] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 1: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:05.304157  9666 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.309530  9567 raft_consensus.cc:359] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.309818  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:05.310292  9567 raft_consensus.cc:385] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.310587  9567 raft_consensus.cc:740] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.310516  9376 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.311353  9567 consensus_queue.cc:260] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.306892  9666 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:05.317569  9664 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.317649  9376 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:05.318215  9664 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.319542  9492 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:05.320621  9664 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:05.321230  9566 tablet_bootstrap.cc:654] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.322028  9668 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.322523  9668 raft_consensus.cc:697] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:05.322749  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:05.322834  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:05.324658  9418 leader_election.cc:343] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.323393  9668 consensus_queue.cc:237] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:05.326725  9418 leader_election.cc:343] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.327389  9418 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:05.328461  9617 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.330176  9572 tablet_bootstrap.cc:654] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.332597  9567 ts_tablet_manager.cc:1434] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 13:02:05.332679  9490 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:05.334115  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:05.335161  9703 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.341202  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:05.344223  9567 tablet_bootstrap.cc:492] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
W20260709 13:02:05.346370  9702 log.cc:927] Time spent T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:02:05.348059  9490 leader_election.cc:343] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.352252  9666 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.352747  9666 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:05.354254  9490 leader_election.cc:343] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.354883  9666 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:05.356508  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:05.360216  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:05.361418  9450 raft_consensus.cc:2393] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 1: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:05.362332  9567 tablet_bootstrap.cc:654] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.364631  9566 tablet_bootstrap.cc:492] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:05.365092  9566 ts_tablet_manager.cc:1403] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.074s	user 0.025s	sys 0.016s
I20260709 13:02:05.365868  9572 tablet_bootstrap.cc:492] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:05.366349  9572 ts_tablet_manager.cc:1403] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.000s
I20260709 13:02:05.367626  9566 raft_consensus.cc:359] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.368294  9566 raft_consensus.cc:385] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.368563  9566 raft_consensus.cc:740] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.369247  9566 consensus_queue.cc:260] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.371276  9566 ts_tablet_manager.cc:1434] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:02:05.372166  9566 tablet_bootstrap.cc:492] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:05.374500  9572 raft_consensus.cc:359] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.374883  9703 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.375584  9572 raft_consensus.cc:385] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.375937  9572 raft_consensus.cc:740] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.370939  9272 catalog_manager.cc:5697] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:05.376961  9572 consensus_queue.cc:260] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.381475  9566 tablet_bootstrap.cc:654] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.382007  9572 ts_tablet_manager.cc:1434] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:02:05.389384  9575 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:02:05.397365  9664 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:05.398138  9490 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:05.399309  9703 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.400708  9570 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.401288  9570 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.403590  9570 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:05.405913  9668 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.406376  9668 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.406828  9703 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.407394  9666 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.407918  9666 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.407960  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:05.409158  9450 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:05.410307  9666 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:05.413460  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:05.414378  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:05.414971  9492 leader_election.cc:343] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.414988  9376 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:05.416505  9341 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:05.417449  9492 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:05.418557  9601 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.418951  9601 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.419286  9601 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.420887  9666 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.421530  9666 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.421973  9666 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.424788  9566 tablet_bootstrap.cc:492] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:05.425444  9566 ts_tablet_manager.cc:1403] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.014s
I20260709 13:02:05.428112  9566 raft_consensus.cc:359] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.428773  9566 raft_consensus.cc:385] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.429085  9566 raft_consensus.cc:740] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.429355  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:05.429455  9666 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.408442  9668 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:05.429936  9566 consensus_queue.cc:260] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.430871  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:05.431483  9450 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:05.432351  9566 ts_tablet_manager.cc:1434] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:05.432261  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:05.433064  9374 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.433684  9566 tablet_bootstrap.cc:492] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:05.437158  9664 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.437736  9664 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.439865  9374 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:05.439931  9664 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:05.441201  9492 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:05.441548  9642 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.442102  9668 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.442227  9642 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.442631  9668 raft_consensus.cc:697] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:05.443533  9668 consensus_queue.cc:237] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.444437  9642 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:05.444808  9566 tablet_bootstrap.cc:654] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:05.446355  9490 leader_election.cc:343] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.446916  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:05.447707  9375 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:05.449262  9418 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:05.449280  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:05.450376  9664 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.446892  9490 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:05.455736  9664 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.457489  9664 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.459064  9703 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.459429  9666 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:05.466593  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:05.467413  9522 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:05.468398  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:05.469226  9343 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:05.471589  9570 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.472116  9570 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.472524  9570 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.460857  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:05.477033  9521 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
W20260709 13:02:05.480446  9341 leader_election.cc:343] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.489243  9570 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.490672  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:05.492316  9450 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.495294  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:05.499475  9572 tablet_bootstrap.cc:492] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:05.499073  9272 catalog_manager.cc:5697] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:05.496414  9601 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.514894  9575 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:05.530535  9668 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.531427  9575 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.531569  9668 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.531976  9575 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.534051  9575 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:05.534070  9668 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:05.519922  9566 tablet_bootstrap.cc:492] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:05.508183  9570 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:05.536618  9566 ts_tablet_manager.cc:1403] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.010s
I20260709 13:02:05.536936  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:05.539252  9418 leader_election.cc:343] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.540289  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:05.509083  9341 leader_election.cc:343] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.542925  9451 raft_consensus.cc:2468] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:05.546691  9567 tablet_bootstrap.cc:492] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:05.547231  9567 ts_tablet_manager.cc:1403] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.203s	user 0.023s	sys 0.052s
I20260709 13:02:05.551522  9490 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:05.552386  9668 raft_consensus.cc:2804] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.552774  9668 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.552793  9567 raft_consensus.cc:359] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.553623  9567 raft_consensus.cc:385] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.548532  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:05.553292  9668 raft_consensus.cc:3060] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.555968  9566 raft_consensus.cc:359] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.535929  9664 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.557673  9450 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
W20260709 13:02:05.557950  9418 leader_election.cc:343] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.556886  9566 raft_consensus.cc:385] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.559221  9566 raft_consensus.cc:740] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.558687  9567 raft_consensus.cc:740] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.561347  9567 consensus_queue.cc:260] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.560038  9664 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:05.561146  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:05.569785  9664 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.559917  9601 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:05.568957  9566 consensus_queue.cc:260] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.573159  9668 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.573521  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:05.574074  9376 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.574656  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:05.575299  9524 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.577699  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:05.578300  9451 raft_consensus.cc:3060] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.579028  9617 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:05.581073  9376 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:05.584263  9567 ts_tablet_manager.cc:1434] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
W20260709 13:02:05.565081  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 93770.7us
I20260709 13:02:05.585318  9567 tablet_bootstrap.cc:492] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:05.575310  9668 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:05.590587  9566 ts_tablet_manager.cc:1434] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:02:05.592073  9566 tablet_bootstrap.cc:492] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:05.583261  9575 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.594646  9272 catalog_manager.cc:5697] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:05.584761  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:05.597215  9450 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.598730  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:05.599309  9520 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.601440  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:05.606051  9418 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:05.606943  9664 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.607606  9664 raft_consensus.cc:697] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:05.608510  9664 consensus_queue.cc:237] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.596791  9451 raft_consensus.cc:2468] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:05.596925  9575 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.650656  9572 tablet_bootstrap.cc:654] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.653407  9566 tablet_bootstrap.cc:654] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.642333  9524 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:05.647639  9490 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:05.665831  9666 raft_consensus.cc:2804] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.666525  9666 raft_consensus.cc:697] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:05.667529  9666 consensus_queue.cc:237] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.669544  9450 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:05.674190  9575 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:05.675216  9341 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:05.679358  9601 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.679829  9601 raft_consensus.cc:697] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:05.680668  9601 consensus_queue.cc:237] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.681491  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:05.678085  9520 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:05.682842  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:05.685750  9567 tablet_bootstrap.cc:654] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.685652  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:05.689817  9642 consensus_queue.cc:1048] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:05.691071  9572 tablet_bootstrap.cc:492] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:05.691481  9572 ts_tablet_manager.cc:1403] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.192s	user 0.016s	sys 0.005s
W20260709 13:02:05.692239  9343 leader_election.cc:343] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:05.693648  9343 leader_election.cc:343] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.697398  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:05.693980  9418 leader_election.cc:343] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:05.704800  9418 leader_election.cc:343] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.705320  9418 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:05.704262  9272 catalog_manager.cc:5697] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 0 to 1, leader changed from <none> to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.706113  9664 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.708612  9567 tablet_bootstrap.cc:492] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:05.709089  9567 ts_tablet_manager.cc:1403] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.124s	user 0.017s	sys 0.004s
I20260709 13:02:05.711796  9572 raft_consensus.cc:359] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.712435  9572 raft_consensus.cc:385] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.712666  9572 raft_consensus.cc:740] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.713567  9343 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:05.714646  9642 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.715469  9642 raft_consensus.cc:697] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:05.716521  9642 consensus_queue.cc:237] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.719007  9572 consensus_queue.cc:260] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.721385  9572 ts_tablet_manager.cc:1434] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:02:05.722325  9572 tablet_bootstrap.cc:492] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
W20260709 13:02:05.724229  9492 leader_election.cc:343] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:05.726150  9492 leader_election.cc:343] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.733490  9273 catalog_manager.cc:5697] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:05.749859  9567 raft_consensus.cc:359] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.749712  9275 catalog_manager.cc:5697] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.750751  9567 raft_consensus.cc:385] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.751155  9567 raft_consensus.cc:740] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.751925  9567 consensus_queue.cc:260] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.754277  9567 ts_tablet_manager.cc:1434] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:02:05.757550  9567 tablet_bootstrap.cc:492] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:05.764221  9601 consensus_queue.cc:1048] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:05.766667  9566 tablet_bootstrap.cc:492] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:05.767071  9566 ts_tablet_manager.cc:1403] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.175s	user 0.019s	sys 0.013s
W20260709 13:02:05.766060  9490 consensus_peers.cc:597] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.769796  9718 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.770326  9718 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.772715  9718 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:05.776324  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:05.785929  9376 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:05.786444  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:05.787117  9524 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:05.787874  9418 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:05.790330  9620 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.790693  9620 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.790992  9620 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.791098  9567 tablet_bootstrap.cc:654] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.800400  9566 raft_consensus.cc:359] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.801141  9566 raft_consensus.cc:385] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.801391  9566 raft_consensus.cc:740] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.808909  9566 consensus_queue.cc:260] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.811661  9566 ts_tablet_manager.cc:1434] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:02:05.812559  9566 tablet_bootstrap.cc:492] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
W20260709 13:02:05.822023  9492 consensus_peers.cc:597] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.823326  9620 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.825217  9572 tablet_bootstrap.cc:654] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.815109  9272 catalog_manager.cc:5697] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.826573  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:05.827181  9376 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.831228  9620 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:05.836208  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:05.836869  9521 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.838585  9566 tablet_bootstrap.cc:654] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.841099  9570 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.841602  9570 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.843730  9570 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:05.845890  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:05.847358  9341 leader_election.cc:343] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.850262  9521 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:05.853488  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:05.854035  9418 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:05.855051  9343 leader_election.cc:343] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.855420  9620 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.855538  9343 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:05.856220  9620 raft_consensus.cc:697] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:05.848951  9376 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:05.857304  9570 raft_consensus.cc:2749] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.857302  9620 consensus_queue.cc:237] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.859169  9572 tablet_bootstrap.cc:492] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:05.859635  9572 ts_tablet_manager.cc:1403] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.138s	user 0.007s	sys 0.007s
I20260709 13:02:05.864895  9567 tablet_bootstrap.cc:492] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:05.865397  9567 ts_tablet_manager.cc:1403] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.108s	user 0.013s	sys 0.004s
I20260709 13:02:05.868187  9567 raft_consensus.cc:359] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.868867  9567 raft_consensus.cc:385] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.869199  9567 raft_consensus.cc:740] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.872526  9572 raft_consensus.cc:359] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.870915  9567 consensus_queue.cc:260] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.873291  9572 raft_consensus.cc:385] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.873636  9566 tablet_bootstrap.cc:492] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:05.873759  9572 raft_consensus.cc:740] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.874230  9566 ts_tablet_manager.cc:1403] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.002s
I20260709 13:02:05.874644  9572 consensus_queue.cc:260] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.875432  9567 ts_tablet_manager.cc:1434] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:02:05.927167  9572 ts_tablet_manager.cc:1434] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.001s
I20260709 13:02:05.927697  9566 raft_consensus.cc:359] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.940867  9566 raft_consensus.cc:385] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.941423  9566 raft_consensus.cc:740] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.876392  9567 tablet_bootstrap.cc:492] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:05.955432  9572 tablet_bootstrap.cc:492] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:05.949910  9566 consensus_queue.cc:260] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:05.964103  9668 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:05.966382  9703 consensus_queue.cc:1048] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:05.978560  9566 ts_tablet_manager.cc:1434] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.104s	user 0.010s	sys 0.004s
I20260709 13:02:05.980965  9272 catalog_manager.cc:5697] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 0 to 1, leader changed from <none> to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.983662  9567 tablet_bootstrap.cc:654] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.997799  9572 tablet_bootstrap.cc:654] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.006067  9566 tablet_bootstrap.cc:492] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:06.007738  9567 tablet_bootstrap.cc:492] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:06.008460  9567 ts_tablet_manager.cc:1403] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.132s	user 0.008s	sys 0.007s
I20260709 13:02:06.012030  9567 raft_consensus.cc:359] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.029187  9566 tablet_bootstrap.cc:654] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.037308  9572 tablet_bootstrap.cc:492] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:06.037784  9572 ts_tablet_manager.cc:1403] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.086s	user 0.012s	sys 0.005s
I20260709 13:02:06.040609  9572 raft_consensus.cc:359] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.041299  9572 raft_consensus.cc:385] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.041589  9572 raft_consensus.cc:740] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.042232  9572 consensus_queue.cc:260] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.012844  9567 raft_consensus.cc:385] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.043821  9567 raft_consensus.cc:740] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.045032  9566 tablet_bootstrap.cc:492] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:06.044616  9567 consensus_queue.cc:260] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.046555  9566 ts_tablet_manager.cc:1403] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.012s
I20260709 13:02:06.048264  9567 ts_tablet_manager.cc:1434] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.001s
I20260709 13:02:06.049746  9567 tablet_bootstrap.cc:492] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:06.046113  9572 ts_tablet_manager.cc:1434] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:06.050551  9703 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:06.050407  9566 raft_consensus.cc:359] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.051268  9566 raft_consensus.cc:385] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.051589  9566 raft_consensus.cc:740] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.052349  9566 consensus_queue.cc:260] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.056335  9566 ts_tablet_manager.cc:1434] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:06.057723  9566 tablet_bootstrap.cc:492] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:06.058724  9572 tablet_bootstrap.cc:492] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:06.064894  9566 tablet_bootstrap.cc:654] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.074048  9572 tablet_bootstrap.cc:654] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.076702  9703 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.077600  9703 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.082883  9738 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:06.089388  9703 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:06.097699  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:06.098891  9452 raft_consensus.cc:2393] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 1: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:06.101922  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:06.106145  9601 consensus_queue.cc:1048] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:06.107514  9567 tablet_bootstrap.cc:654] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.108233  9492 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:06.116353  9738 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.134282  9738 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.135804  9572 tablet_bootstrap.cc:492] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:06.140266  9572 ts_tablet_manager.cc:1403] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.082s	user 0.028s	sys 0.003s
I20260709 13:02:06.159389  9642 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.159935  9642 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.162403  9642 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:06.163703  9566 tablet_bootstrap.cc:492] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:06.164187  9566 ts_tablet_manager.cc:1403] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.107s	user 0.010s	sys 0.019s
I20260709 13:02:06.164453  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:06.167496  9566 raft_consensus.cc:359] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.168488  9566 raft_consensus.cc:385] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.168709  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:06.168867  9566 raft_consensus.cc:740] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.170111  9566 consensus_queue.cc:260] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.179620  9713 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.180362  9713 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.182360  9343 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:06.183192  9713 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:06.183923  9601 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.185066  9572 raft_consensus.cc:359] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.185782  9601 consensus_queue.cc:1048] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:06.186810  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:06.188942  9341 leader_election.cc:343] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.185781  9572 raft_consensus.cc:385] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.189685  9733 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.190630  9733 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.191784  9450 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.192899  9733 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:06.195360  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:06.196059  9452 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:06.197839  9490 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:06.198791  9733 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.199191  9733 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.199544  9733 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.201617  9738 consensus_queue.cc:1048] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:06.209208  9733 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.210299  9620 consensus_queue.cc:1048] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:06.212452  9566 ts_tablet_manager.cc:1434] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:02:06.214157  9733 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:06.216068  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:06.216743  9449 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.230789  9449 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:06.231900  9572 raft_consensus.cc:740] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.232853  9490 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:06.233732  9733 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:06.234236  9733 raft_consensus.cc:697] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:06.234481  9566 tablet_bootstrap.cc:492] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:06.235244  9733 consensus_queue.cc:237] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.246852  9566 tablet_bootstrap.cc:654] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.253355  9601 consensus_queue.cc:1048] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:06.256999  9601 consensus_queue.cc:1048] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:06.260030  9718 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.260572  9718 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.262976  9718 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:06.264627  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:06.265121  9273 catalog_manager.cc:5697] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:06.267181  9323 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:06.272557  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:06.277283  9524 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:06.273206  9566 tablet_bootstrap.cc:492] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:06.279160  9566 ts_tablet_manager.cc:1403] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.007s
I20260709 13:02:06.274494  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:06.275249  9572 consensus_queue.cc:260] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.281271  9521 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:06.285822  9572 ts_tablet_manager.cc:1434] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.145s	user 0.007s	sys 0.000s
I20260709 13:02:06.340179  9572 tablet_bootstrap.cc:492] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:06.291950  9620 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.341878  9418 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:06.350040  9620 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:06.350791  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 70834.3us
I20260709 13:02:06.342726  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:06.343936  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:06.352464  9620 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:06.346063  9377 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.353987  9567 tablet_bootstrap.cc:492] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:06.354494  9567 ts_tablet_manager.cc:1403] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.305s	user 0.062s	sys 0.076s
I20260709 13:02:06.347522  9566 raft_consensus.cc:359] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.357631  9566 raft_consensus.cc:385] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.358050  9566 raft_consensus.cc:740] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.357684  9567 raft_consensus.cc:359] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.358956  9567 raft_consensus.cc:385] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.359551  9567 raft_consensus.cc:740] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.359052  9566 consensus_queue.cc:260] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.361570  9567 consensus_queue.cc:260] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.363538  9572 tablet_bootstrap.cc:654] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.364243  9567 ts_tablet_manager.cc:1434] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:02:06.365609  9575 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.366006  9575 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.366386  9575 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.366484  9567 tablet_bootstrap.cc:492] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
W20260709 13:02:06.361109  9418 leader_election.cc:343] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.356900  9343 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:06.364811  9620 consensus_queue.cc:1048] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:02:06.370187  9755 raft_consensus.cc:2804] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.370641  9755 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.371006  9755 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.398775  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:06.399981  9374 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:06.403151  9738 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:06.412124  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 70213.3us
I20260709 13:02:06.413609  9738 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.463011  9575 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.463845  9418 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:06.464780  9755 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.466506  9567 tablet_bootstrap.cc:654] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.463701  9566 ts_tablet_manager.cc:1434] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.184s	user 0.011s	sys 0.011s
W20260709 13:02:06.470875  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 114053us
W20260709 13:02:06.475914  9492 consensus_peers.cc:597] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:06.476657  9492 leader_election.cc:343] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:06.477639  9492 leader_election.cc:343] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.473441  9718 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.479323  9755 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:06.480639  9566 tablet_bootstrap.cc:492] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:06.485347  9575 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:06.480660  9718 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.509299  9575 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.509495  9718 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.511018  9620 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.511574  9620 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.516956  9575 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.513892  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:02:06.469851  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 49992.3us
I20260709 13:02:06.513787  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:06.527369  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:06.515552  9738 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:06.520670  9575 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:06.581477  9341 leader_election.cc:343] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.581709  9760 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:06.633473  9572 tablet_bootstrap.cc:492] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:06.634095  9572 ts_tablet_manager.cc:1403] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.347s	user 0.018s	sys 0.015s
W20260709 13:02:06.634541  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 96474.5us
W20260709 13:02:06.635550  9418 leader_election.cc:343] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:06.643411  9418 leader_election.cc:343] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.645699  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:06.647307  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:06.647886  9450 raft_consensus.cc:2468] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:06.607513  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:06.650624  9718 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.637406  9620 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:06.606581  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:06.651147  9371 raft_consensus.cc:2468] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:06.661537  9567 tablet_bootstrap.cc:492] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:06.662287  9567 ts_tablet_manager.cc:1403] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.296s	user 0.009s	sys 0.018s
I20260709 13:02:06.664016  9566 tablet_bootstrap.cc:654] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.676059  9572 raft_consensus.cc:359] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.678475  9572 raft_consensus.cc:385] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.678861  9572 raft_consensus.cc:740] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
W20260709 13:02:06.680320  9418 leader_election.cc:343] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.660439  9375 raft_consensus.cc:2468] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:06.680858  9572 consensus_queue.cc:260] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.686300  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:06.687040  9524 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.693465  9418 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:06.694674  9492 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:06.695092  9572 ts_tablet_manager.cc:1434] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.005s
I20260709 13:02:06.695924  9733 raft_consensus.cc:2804] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.696314  9733 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.696589  9572 tablet_bootstrap.cc:492] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:06.696692  9733 raft_consensus.cc:3060] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.701202  9620 raft_consensus.cc:2804] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.701650  9620 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.702023  9620 raft_consensus.cc:3060] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.702253  9718 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:06.707893  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:06.723546  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:06.724275  9373 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.708942  9523 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.738505  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:06.742317  9620 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.745844  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:06.746135  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:06.746714  9377 raft_consensus.cc:3060] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.747498  9620 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:06.747267  9567 raft_consensus.cc:359] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.748481  9567 raft_consensus.cc:385] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.748948  9567 raft_consensus.cc:740] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.750133  9567 consensus_queue.cc:260] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.754459  9567 ts_tablet_manager.cc:1434] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.092s	user 0.009s	sys 0.000s
I20260709 13:02:06.755860  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:06.757061  9520 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.765341  9759 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:02:06.772161  9523 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:06.776415  9567 tablet_bootstrap.cc:492] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
W20260709 13:02:06.793205  9418 leader_election.cc:343] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.793869  9418 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:02:06.791478  9492 consensus_peers.cc:597] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:06.799866  9761 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.800616  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:06.802889  9418 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
W20260709 13:02:06.805426  9766 log.cc:927] Time spent T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:02:06.813251  9572 tablet_bootstrap.cc:654] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.809495  9620 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:06.818524  9620 raft_consensus.cc:697] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:06.819346  9524 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:06.819491  9620 consensus_queue.cc:237] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.824182  9377 raft_consensus.cc:2468] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:06.828948  9733 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.829661  9566 tablet_bootstrap.cc:492] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:06.830390  9521 raft_consensus.cc:2393] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 1: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:06.831187  9566 ts_tablet_manager.cc:1403] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.353s	user 0.027s	sys 0.022s
I20260709 13:02:06.831339  9733 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:06.832163  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:06.833115  9371 raft_consensus.cc:2393] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 1: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:06.830247  9373 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:06.837455  9418 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:06.837828  9520 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:06.838778  9418 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:06.839567  9759 raft_consensus.cc:2804] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:06.840303  9759 raft_consensus.cc:697] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:06.839653  9620 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:06.852178  9620 raft_consensus.cc:697] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:06.854517  9273 catalog_manager.cc:5697] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 0 to 1, leader changed from <none> to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:06.860324  9566 raft_consensus.cc:359] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.861362  9566 raft_consensus.cc:385] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.861716  9566 raft_consensus.cc:740] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.865059  9566 consensus_queue.cc:260] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.866978  9567 tablet_bootstrap.cc:654] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.867334  9566 ts_tablet_manager.cc:1434] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:02:06.868521  9566 tablet_bootstrap.cc:492] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:06.875260  9759 consensus_queue.cc:237] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.877688  9620 consensus_queue.cc:237] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.891513  9343 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:06.900089  9754 raft_consensus.cc:2804] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:06.911836  9452 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.917927  9754 raft_consensus.cc:697] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:06.918855  9754 consensus_queue.cc:237] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.925253  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:06.929296  9572 tablet_bootstrap.cc:492] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:06.929850  9572 ts_tablet_manager.cc:1403] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.234s	user 0.017s	sys 0.032s
I20260709 13:02:06.934538  9572 raft_consensus.cc:359] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.935264  9572 raft_consensus.cc:385] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.935564  9572 raft_consensus.cc:740] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.936203  9572 consensus_queue.cc:260] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.944253  9572 ts_tablet_manager.cc:1434] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:02:06.945434  9572 tablet_bootstrap.cc:492] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:06.948848  9570 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.949383  9570 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.954121  9566 tablet_bootstrap.cc:654] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.955163  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:06.956347  9567 tablet_bootstrap.cc:492] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:06.956800  9567 ts_tablet_manager.cc:1403] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.201s	user 0.012s	sys 0.006s
I20260709 13:02:06.959115  9570 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:06.959435  9567 raft_consensus.cc:359] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.960089  9567 raft_consensus.cc:385] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.960354  9567 raft_consensus.cc:740] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.965965  9572 tablet_bootstrap.cc:654] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.966399  9567 consensus_queue.cc:260] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.968739  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:06.969545  9490 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:06.973673  9738 raft_consensus.cc:2749] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.973667  9520 raft_consensus.cc:2393] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 1: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:06.975436  9567 ts_tablet_manager.cc:1434] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.001s
I20260709 13:02:06.976110  9566 tablet_bootstrap.cc:492] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:06.976496  9567 tablet_bootstrap.cc:492] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:06.976547  9566 ts_tablet_manager.cc:1403] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.108s	user 0.011s	sys 0.000s
I20260709 13:02:06.979897  9566 raft_consensus.cc:359] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.980801  9343 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:06.983676  9570 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.983525  9733 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:06.988418  9566 raft_consensus.cc:385] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.988741  9566 raft_consensus.cc:740] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.989415  9566 consensus_queue.cc:260] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:06.992766  9566 ts_tablet_manager.cc:1434] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 13:02:06.997337  9566 tablet_bootstrap.cc:492] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:07.005118  9572 tablet_bootstrap.cc:492] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:07.005663  9572 ts_tablet_manager.cc:1403] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.060s	user 0.016s	sys 0.008s
I20260709 13:02:07.008641  9572 raft_consensus.cc:359] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.009363  9572 raft_consensus.cc:385] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.009654  9572 raft_consensus.cc:740] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.010442  9572 consensus_queue.cc:260] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.010831  9570 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.014041  9572 ts_tablet_manager.cc:1434] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:07.015164  9572 tablet_bootstrap.cc:492] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:07.022747  9567 tablet_bootstrap.cc:654] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.027622  9566 tablet_bootstrap.cc:654] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.040552  9567 tablet_bootstrap.cc:492] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:07.041692  9273 catalog_manager.cc:5697] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 0 to 1, leader changed from <none> to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.042285  9572 tablet_bootstrap.cc:654] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.042994  9273 catalog_manager.cc:5697] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 0 to 1, leader changed from <none> to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.045620  9567 ts_tablet_manager.cc:1403] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.069s	user 0.017s	sys 0.000s
I20260709 13:02:07.048954  9567 raft_consensus.cc:359] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.049738  9567 raft_consensus.cc:385] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.050043  9567 raft_consensus.cc:740] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.050905  9567 consensus_queue.cc:260] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.053598  9567 ts_tablet_manager.cc:1434] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:02:07.054452  9567 tablet_bootstrap.cc:492] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:07.059211  9566 tablet_bootstrap.cc:492] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:07.059746  9567 tablet_bootstrap.cc:654] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.059804  9566 ts_tablet_manager.cc:1403] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.010s
I20260709 13:02:07.063258  9566 raft_consensus.cc:359] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.062842  9275 catalog_manager.cc:5697] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.063896  9566 raft_consensus.cc:385] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.064210  9566 raft_consensus.cc:740] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.065492  9567 tablet_bootstrap.cc:492] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:07.066083  9567 ts_tablet_manager.cc:1403] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:02:07.064847  9566 consensus_queue.cc:260] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.069270  9567 raft_consensus.cc:359] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.070041  9567 raft_consensus.cc:385] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.070298  9567 raft_consensus.cc:740] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.071305  9566 ts_tablet_manager.cc:1434] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:02:07.070935  9567 consensus_queue.cc:260] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.072356  9566 tablet_bootstrap.cc:492] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:07.073398  9567 ts_tablet_manager.cc:1434] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:07.074426  9567 tablet_bootstrap.cc:492] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:07.079357  9566 tablet_bootstrap.cc:654] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.080463  9567 tablet_bootstrap.cc:654] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.086237  9761 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.086879  9761 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.089774  9567 tablet_bootstrap.cc:492] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:07.090312  9572 tablet_bootstrap.cc:492] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:07.090312  9567 ts_tablet_manager.cc:1403] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:02:07.090883  9572 ts_tablet_manager.cc:1403] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.001s
I20260709 13:02:07.093844  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:07.094305  9761 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:07.095585  9418 leader_election.cc:343] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.093853  9567 raft_consensus.cc:359] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.096874  9572 raft_consensus.cc:359] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.097255  9567 raft_consensus.cc:385] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.097564  9572 raft_consensus.cc:385] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.097899  9572 raft_consensus.cc:740] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.097756  9567 raft_consensus.cc:740] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.096294  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:07.100088  9566 tablet_bootstrap.cc:492] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
W20260709 13:02:07.099924  9418 leader_election.cc:343] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.101110  9566 ts_tablet_manager.cc:1403] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.001s
I20260709 13:02:07.101029  9418 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:07.102295  9761 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.098582  9572 consensus_queue.cc:260] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.103816  9566 raft_consensus.cc:359] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.099588  9567 consensus_queue.cc:260] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.105341  9566 raft_consensus.cc:385] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.106442  9567 ts_tablet_manager.cc:1434] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:02:07.105643  9566 raft_consensus.cc:740] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.109305  9567 tablet_bootstrap.cc:492] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:07.109100  9566 consensus_queue.cc:260] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.111316  9566 ts_tablet_manager.cc:1434] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:02:07.112406  9566 tablet_bootstrap.cc:492] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:07.112399  9572 ts_tablet_manager.cc:1434] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:02:07.114045  9572 tablet_bootstrap.cc:492] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:07.115517  9567 tablet_bootstrap.cc:654] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.132550  9567 tablet_bootstrap.cc:492] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:07.133062  9567 ts_tablet_manager.cc:1403] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.004s
I20260709 13:02:07.134925  9567 raft_consensus.cc:359] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.135449  9567 raft_consensus.cc:385] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.135694  9567 raft_consensus.cc:740] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.136019  9572 tablet_bootstrap.cc:654] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.136247  9567 consensus_queue.cc:260] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.138764  9567 ts_tablet_manager.cc:1434] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:02:07.140288  9567 tablet_bootstrap.cc:492] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:07.140375  9566 tablet_bootstrap.cc:654] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.142431  9572 tablet_bootstrap.cc:492] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:07.142874  9572 ts_tablet_manager.cc:1403] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.029s	user 0.004s	sys 0.005s
I20260709 13:02:07.147074  9566 tablet_bootstrap.cc:492] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:07.147275  9373 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.147684  9566 ts_tablet_manager.cc:1403] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.002s
I20260709 13:02:07.149585  9567 tablet_bootstrap.cc:654] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.152499  9566 raft_consensus.cc:359] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.153292  9566 raft_consensus.cc:385] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.153626  9566 raft_consensus.cc:740] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.154102  9668 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.154515  9566 consensus_queue.cc:260] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.154543  9668 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.165256  9566 ts_tablet_manager.cc:1434] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:02:07.166424  9668 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:07.167980  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:07.170156  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:07.170318  9572 raft_consensus.cc:359] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:07.171247  9490 leader_election.cc:343] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.171366  9572 raft_consensus.cc:385] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.171823  9572 raft_consensus.cc:740] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
W20260709 13:02:07.172458  9492 leader_election.cc:343] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.172930  9492 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:07.172776  9572 consensus_queue.cc:260] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.174350  9668 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.175575  9566 tablet_bootstrap.cc:492] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:07.184026  9572 ts_tablet_manager.cc:1434] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.001s
I20260709 13:02:07.185706  9572 tablet_bootstrap.cc:492] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:07.190279  9566 tablet_bootstrap.cc:654] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.199971  9566 tablet_bootstrap.cc:492] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:07.200430  9566 ts_tablet_manager.cc:1403] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 13:02:07.203047  9566 raft_consensus.cc:359] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.203730  9566 raft_consensus.cc:385] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.204007  9566 raft_consensus.cc:740] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.204830  9567 tablet_bootstrap.cc:492] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:07.204622  9566 consensus_queue.cc:260] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.205313  9567 ts_tablet_manager.cc:1403] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.065s	user 0.030s	sys 0.018s
I20260709 13:02:07.208266  9567 raft_consensus.cc:359] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.209141  9572 tablet_bootstrap.cc:654] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.208901  9567 raft_consensus.cc:385] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.210330  9567 raft_consensus.cc:740] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.211045  9567 consensus_queue.cc:260] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.219709  9566 ts_tablet_manager.cc:1434] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:02:07.220293  9567 ts_tablet_manager.cc:1434] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.001s
I20260709 13:02:07.221748  9567 tablet_bootstrap.cc:492] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:07.229357  9566 tablet_bootstrap.cc:492] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:07.230263  9567 tablet_bootstrap.cc:654] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.235556  9572 tablet_bootstrap.cc:492] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:07.235904  9566 tablet_bootstrap.cc:654] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.236230  9572 ts_tablet_manager.cc:1403] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.016s
I20260709 13:02:07.239524  9572 raft_consensus.cc:359] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.240576  9572 raft_consensus.cc:385] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.241081  9572 raft_consensus.cc:740] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.242075  9572 consensus_queue.cc:260] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.250792  9572 ts_tablet_manager.cc:1434] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:02:07.254899  9567 tablet_bootstrap.cc:492] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:07.254952  9572 tablet_bootstrap.cc:492] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:07.255751  9567 ts_tablet_manager.cc:1403] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.013s
I20260709 13:02:07.257246  9566 tablet_bootstrap.cc:492] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:07.257948  9566 ts_tablet_manager.cc:1403] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.010s
I20260709 13:02:07.259716  9567 raft_consensus.cc:359] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.260488  9567 raft_consensus.cc:385] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.260803  9567 raft_consensus.cc:740] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.260967  9566 raft_consensus.cc:359] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.261760  9566 raft_consensus.cc:385] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.262048  9566 raft_consensus.cc:740] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.261525  9567 consensus_queue.cc:260] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.263409  9754 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.262672  9566 consensus_queue.cc:260] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.263885  9754 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.266031  9754 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:07.266287  9572 tablet_bootstrap.cc:654] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.268605  9567 ts_tablet_manager.cc:1434] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:02:07.270139  9567 tablet_bootstrap.cc:492] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:07.274639  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:07.276218  9566 ts_tablet_manager.cc:1434] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.004s
I20260709 13:02:07.276858  9567 tablet_bootstrap.cc:654] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.281332  9763 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.281898  9763 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.283565  9761 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.284471  9763 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:07.284175  9761 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.286357  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:07.286774  9761 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:07.291786  9753 consensus_queue.cc:1048] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:07.292954  9764 consensus_queue.cc:1048] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:07.287012  9373 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:07.293995  9601 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.289578  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:07.290906  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:07.294477  9601 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.295214  9449 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:07.288825  9566 tablet_bootstrap.cc:492] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:07.296380  9492 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:07.297755  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:07.300194  9763 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.300614  9763 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.300937  9763 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.303200  9566 tablet_bootstrap.cc:654] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.304118  9601 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:07.305047  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:07.306568  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:07.307174  9449 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:07.308003  9520 raft_consensus.cc:2393] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 1: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:07.308708  9341 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:07.310079  9601 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.311493  9601 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.313552  9418 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:07.314550  9764 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.314965  9601 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.315413  9738 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.315570  9566 tablet_bootstrap.cc:492] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:07.316092  9566 ts_tablet_manager.cc:1403] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.000s
I20260709 13:02:07.315932  9738 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.318342  9738 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:07.319511  9566 raft_consensus.cc:359] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.320194  9566 raft_consensus.cc:385] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.320358  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:07.320462  9566 raft_consensus.cc:740] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.321621  9566 consensus_queue.cc:260] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:07.322093  9492 leader_election.cc:343] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.322932  9764 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.324954  9566 ts_tablet_manager.cc:1434] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:07.326436  9566 tablet_bootstrap.cc:492] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:07.327469  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:07.329082  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:07.329753  9449 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:07.325798  9572 tablet_bootstrap.cc:492] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:07.331112  9341 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:07.331830  9572 ts_tablet_manager.cc:1403] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.077s	user 0.018s	sys 0.010s
I20260709 13:02:07.332450  9754 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.335081  9754 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.335705  9754 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.336058  9490 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:07.339135  9572 raft_consensus.cc:359] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.339861  9572 raft_consensus.cc:385] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.339970  9765 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.340137  9572 raft_consensus.cc:740] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.340498  9765 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.340924  9765 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.341717  9572 consensus_queue.cc:260] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.343761  9566 tablet_bootstrap.cc:654] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.345027  9572 ts_tablet_manager.cc:1434] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.007s
I20260709 13:02:07.349404  9567 tablet_bootstrap.cc:492] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:07.349929  9567 ts_tablet_manager.cc:1403] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.004s
I20260709 13:02:07.345963  9572 tablet_bootstrap.cc:492] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:07.354988  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:07.356280  9761 consensus_queue.cc:1048] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:07.364511  9754 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:07.355772  9765 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.367329  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:07.374723  9323 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:02:07.377650  9343 leader_election.cc:343] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.382805  9567 raft_consensus.cc:359] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.389371  9567 raft_consensus.cc:385] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.389780  9567 raft_consensus.cc:740] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.390543  9567 consensus_queue.cc:260] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.395792  9567 ts_tablet_manager.cc:1434] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
W20260709 13:02:07.392419  9341 leader_election.cc:343] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.398164  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:07.401971  9567 tablet_bootstrap.cc:492] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
W20260709 13:02:07.404584  9492 leader_election.cc:343] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.404417  9763 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.407166  9765 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:07.405648  9341 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:07.413259  9572 tablet_bootstrap.cc:654] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.411197  9566 tablet_bootstrap.cc:492] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:07.414191  9566 ts_tablet_manager.cc:1403] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.088s	user 0.030s	sys 0.017s
I20260709 13:02:07.415129  9520 raft_consensus.cc:2393] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 1: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:07.414964  9759 consensus_queue.cc:1048] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:07.415578  9601 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.417944  9601 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:07.419075  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:07.419893  9523 raft_consensus.cc:2393] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 1: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:07.420564  9570 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.430469  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:07.431123  9451 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.427847  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:07.436106  9452 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.426362  9377 raft_consensus.cc:3060] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.430060  9759 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.449546  9759 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.452615  9764 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.451303  9566 raft_consensus.cc:359] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.454180  9566 raft_consensus.cc:385] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.454860  9566 raft_consensus.cc:740] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.456063  9566 consensus_queue.cc:260] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.425631  9601 consensus_queue.cc:1048] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:02:07.457581  9620 consensus_queue.cc:1048] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:07.453131  9764 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.460738  9764 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:07.466285  9759 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:07.466455  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:07.519062  9375 raft_consensus.cc:2393] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 1: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:07.519409  9601 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.467993  9763 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:07.499716  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 45061.2us
I20260709 13:02:07.522176  9601 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.534106  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:07.545025  9601 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:07.553709  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:07.555006  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:07.555215  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:07.555663  9374 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:07.557183  9601 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:07.557322  9341 leader_election.cc:343] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.559991  9566 ts_tablet_manager.cc:1434] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.146s	user 0.020s	sys 0.011s
W20260709 13:02:07.561113  9418 leader_election.cc:343] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.562971  9418 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:07.563388  9566 tablet_bootstrap.cc:492] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:07.564862  9620 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.565301  9620 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.565667  9620 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.557654  9601 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.570858  9759 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.588996  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:07.589330  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:07.589993  9601 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:07.590067  9524 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:07.590157  9763 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.591584  9763 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:07.592005  9418 leader_election.cc:343] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.592409  9418 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:07.593094  9753 raft_consensus.cc:2749] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.579023  9759 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.594137  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:07.595942  9763 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:07.596055  9575 consensus_queue.cc:1048] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:07.597996  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:07.598639  9374 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:07.600016  9492 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:07.600982  9763 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.601532  9763 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.601969  9763 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.608712  9490 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:07.610292  9763 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.613565  9763 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:07.614779  9668 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.616776  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:07.622080  9371 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.622145  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:07.619699  9761 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.624001  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:07.624683  9520 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:07.624588  9761 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.626870  9761 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:07.627624  9570 consensus_queue.cc:1048] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:07.632989  9567 tablet_bootstrap.cc:654] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.638236  9452 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
W20260709 13:02:07.637681  9343 leader_election.cc:343] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.639278  9343 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:07.639954  9570 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.640384  9343 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:07.640942  9570 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.641270  9570 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.641561  9570 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.642465  9572 tablet_bootstrap.cc:492] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:07.643046  9572 ts_tablet_manager.cc:1403] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.297s	user 0.019s	sys 0.017s
I20260709 13:02:07.639873  9451 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:07.658219  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:07.660116  9371 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:07.661752  9759 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:07.662016  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:07.663828  9492 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:07.663949  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:07.664871  9490 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:07.665406  9341 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:07.663925  9620 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.666326  9754 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.666834  9754 raft_consensus.cc:697] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:07.666998  9566 tablet_bootstrap.cc:654] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.667086  9450 raft_consensus.cc:2393] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 1: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:07.670451  9759 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.667743  9754 consensus_queue.cc:237] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.670953  9759 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.673062  9759 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:07.674342  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:07.675302  9452 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:07.678170  9620 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:07.678763  9763 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.678918  9377 raft_consensus.cc:2393] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 1: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:07.685616  9570 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.687352  9817 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.688155  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:02:07.692888  9418 leader_election.cc:343] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.694440  9575 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.696357  9575 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.690290  9451 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.701447  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:07.690935  9763 raft_consensus.cc:697] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:07.712369  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:07.713405  9450 raft_consensus.cc:2393] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 1: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:07.717669  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:07.718371  9523 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.718565  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:07.729702  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:07.732165  9572 raft_consensus.cc:359] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.733196  9572 raft_consensus.cc:385] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.733553  9572 raft_consensus.cc:740] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.728369  9371 raft_consensus.cc:2393] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 1: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:07.738325  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:07.730495  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:07.738875  9418 leader_election.cc:343] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.740312  9738 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:07.750841  9418 leader_election.cc:343] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.752503  9418 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:07.756917  9753 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.761827  9763 consensus_queue.cc:237] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.764807  9754 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.765363  9754 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.773196  9575 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:07.773442  9754 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:07.776845  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:07.778695  9343 leader_election.cc:343] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.780885  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:07.786604  9418 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:02:07.791973  9808 log.cc:927] Time spent T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.233s	user 0.003s	sys 0.000s
I20260709 13:02:07.791671  9572 consensus_queue.cc:260] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.793987  9572 ts_tablet_manager.cc:1434] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.151s	user 0.008s	sys 0.004s
I20260709 13:02:07.800859  9570 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:07.804847  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:07.757408  9738 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:07.794514  9341 leader_election.cc:343] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.808418  9341 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:07.809623  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:07.810215  9570 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.810534  9451 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:07.790336  9817 raft_consensus.cc:697] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:07.810290  9522 raft_consensus.cc:2468] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:07.811163  9575 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:07.815501  9492 leader_election.cc:343] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.808859  9738 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:07.817764  9567 tablet_bootstrap.cc:492] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:07.818233  9567 ts_tablet_manager.cc:1403] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.416s	user 0.026s	sys 0.023s
I20260709 13:02:07.819000  9572 tablet_bootstrap.cc:492] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:07.833482  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:07.834209  9452 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
W20260709 13:02:07.833638  9418 leader_election.cc:343] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.838232  9490 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:07.842475  9418 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:07.850584  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:07.845847  9827 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.851388  9827 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.851890  9827 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.853617  9523 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:07.855010  9343 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:07.855365  9817 consensus_queue.cc:237] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.856194  9754 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.856748  9754 raft_consensus.cc:697] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:07.851392  9524 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:07.857833  9754 consensus_queue.cc:237] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.859064  9275 catalog_manager.cc:5697] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.862910  9418 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:07.872133  9827 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.877935  9418 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:07.883800  9812 raft_consensus.cc:2804] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.884462  9812 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.884935  9812 raft_consensus.cc:3060] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.875341  9575 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.896557  9566 tablet_bootstrap.cc:492] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:07.902837  9566 ts_tablet_manager.cc:1403] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.340s	user 0.018s	sys 0.003s
I20260709 13:02:07.911986  9827 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:07.893610  9761 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.897493  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:07.923476  9567 raft_consensus.cc:359] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.924275  9567 raft_consensus.cc:385] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.924604  9567 raft_consensus.cc:740] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.916684  9761 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.928218  9567 consensus_queue.cc:260] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:07.927480  9492 leader_election.cc:343] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.928022  9761 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.941162  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:07.940713  9566 raft_consensus.cc:359] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.946533  9566 raft_consensus.cc:385] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.946894  9566 raft_consensus.cc:740] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.944429  9567 ts_tablet_manager.cc:1434] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.126s	user 0.008s	sys 0.001s
I20260709 13:02:07.959285  9449 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.960729  9566 consensus_queue.cc:260] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:07.964196  9567 tablet_bootstrap.cc:492] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:07.971165  9566 ts_tablet_manager.cc:1434] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 13:02:07.975965  9566 tablet_bootstrap.cc:492] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:08.004582  9572 tablet_bootstrap.cc:654] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.010901  9449 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:08.011212  9567 tablet_bootstrap.cc:654] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.999758  9812 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.012300  9490 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:08.014009  9828 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:08.014573  9828 raft_consensus.cc:697] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:08.015309  9812 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:08.015527  9828 consensus_queue.cc:237] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.011215  9761 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.019887  9566 tablet_bootstrap.cc:654] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.020618  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:08.020686  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:08.023798  9812 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.028071  9521 raft_consensus.cc:3060] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.028092  9812 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.033591  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:08.034003  9572 tablet_bootstrap.cc:492] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:08.034313  9371 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:08.034849  9418 leader_election.cc:343] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.035465  9572 ts_tablet_manager.cc:1403] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.224s	user 0.016s	sys 0.010s
I20260709 13:02:08.042866  9572 raft_consensus.cc:359] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.044610  9572 raft_consensus.cc:385] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.048887  9812 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:08.049842  9761 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:08.050571  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:08.052836  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:08.050593  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:08.054592  9567 tablet_bootstrap.cc:492] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
W20260709 13:02:08.057898  9418 leader_election.cc:343] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.058157  9567 ts_tablet_manager.cc:1403] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.095s	user 0.014s	sys 0.002s
I20260709 13:02:08.060416  9567 raft_consensus.cc:359] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.060977  9567 raft_consensus.cc:385] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.061286  9567 raft_consensus.cc:740] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.061817  9371 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:08.062070  9567 consensus_queue.cc:260] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.055644  9273 catalog_manager.cc:5697] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:08.054396  9521 raft_consensus.cc:2468] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:08.057226  9517 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.065560  9418 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
W20260709 13:02:08.066661  9418 leader_election.cc:343] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.067073  9418 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:08.067862  9812 raft_consensus.cc:2804] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:08.068431  9812 raft_consensus.cc:697] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:08.069136  9834 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:08.069264  9273 catalog_manager.cc:5697] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:08.071178  9418 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:08.069440  9812 consensus_queue.cc:237] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.075685  9836 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:08.076440  9836 raft_consensus.cc:697] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:08.077711  9836 consensus_queue.cc:237] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.044934  9572 raft_consensus.cc:740] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.079505  9572 consensus_queue.cc:260] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.080062  9566 tablet_bootstrap.cc:492] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:08.080539  9566 ts_tablet_manager.cc:1403] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.105s	user 0.010s	sys 0.005s
I20260709 13:02:08.083285  9566 raft_consensus.cc:359] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.084054  9566 raft_consensus.cc:385] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.084372  9566 raft_consensus.cc:740] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.085769  9566 consensus_queue.cc:260] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.087971  9566 ts_tablet_manager.cc:1434] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:02:08.088615  9567 ts_tablet_manager.cc:1434] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.030s	user 0.001s	sys 0.004s
I20260709 13:02:08.088976  9566 tablet_bootstrap.cc:492] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:08.084292  9517 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:08.091086  9567 tablet_bootstrap.cc:492] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:08.092231  9572 ts_tablet_manager.cc:1434] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.003s
I20260709 13:02:08.093442  9572 tablet_bootstrap.cc:492] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:08.097182  9754 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.097721  9754 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.099910  9755 consensus_queue.cc:1048] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:08.099516  9274 catalog_manager.cc:5697] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:08.100914  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:08.101739  9449 raft_consensus.cc:2393] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 1: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:08.102270  9572 tablet_bootstrap.cc:654] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.134424  9566 tablet_bootstrap.cc:654] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.136400  9754 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:08.139369  9755 consensus_queue.cc:1048] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:08.141902  9272 catalog_manager.cc:5697] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 0 to 1, leader changed from <none> to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:08.143347  9567 tablet_bootstrap.cc:654] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.144135  9272 catalog_manager.cc:5697] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 0 to 1, leader changed from <none> to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:08.162744  9566 tablet_bootstrap.cc:492] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:08.163317  9566 ts_tablet_manager.cc:1403] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.018s
I20260709 13:02:08.158552  9567 tablet_bootstrap.cc:492] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:08.165728  9567 ts_tablet_manager.cc:1403] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.003s
I20260709 13:02:08.168965  9567 raft_consensus.cc:359] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.170244  9567 raft_consensus.cc:385] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.170580  9567 raft_consensus.cc:740] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.171255  9567 consensus_queue.cc:260] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.175478  9566 raft_consensus.cc:359] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.176271  9566 raft_consensus.cc:385] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.176585  9566 raft_consensus.cc:740] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.177522  9566 consensus_queue.cc:260] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.180259  9566 ts_tablet_manager.cc:1434] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:02:08.181418  9566 tablet_bootstrap.cc:492] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:08.182629  9572 tablet_bootstrap.cc:492] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:08.183350  9572 ts_tablet_manager.cc:1403] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.090s	user 0.020s	sys 0.035s
I20260709 13:02:08.188119  9566 tablet_bootstrap.cc:654] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.193210  9567 ts_tablet_manager.cc:1434] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.004s
I20260709 13:02:08.194092  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:08.194365  9567 tablet_bootstrap.cc:492] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:08.187282  9572 raft_consensus.cc:359] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.195060  9572 raft_consensus.cc:385] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.195508  9572 raft_consensus.cc:740] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.196652  9572 consensus_queue.cc:260] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.204036  9572 ts_tablet_manager.cc:1434] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:02:08.205710  9566 tablet_bootstrap.cc:492] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:08.206197  9566 ts_tablet_manager.cc:1403] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.003s
I20260709 13:02:08.206537  9567 tablet_bootstrap.cc:654] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.209267  9566 raft_consensus.cc:359] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.210105  9566 raft_consensus.cc:385] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.210579  9566 raft_consensus.cc:740] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.211046  9343 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:08.211215  9566 consensus_queue.cc:260] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.212122  9570 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.213654  9566 ts_tablet_manager.cc:1434] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:08.214701  9566 tablet_bootstrap.cc:492] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:08.218573  9570 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:08.226155  9566 tablet_bootstrap.cc:654] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.228399  9570 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.233989  9570 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.236209  9572 tablet_bootstrap.cc:492] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:08.237764  9570 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:08.238929  9836 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.239120  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:08.239425  9836 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:08.240527  9343 leader_election.cc:343] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.241879  9836 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:08.243281  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:08.243362  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:08.244071  9371 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:08.244203  9523 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:08.245211  9418 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:08.249615  9836 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:08.250072  9836 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.249871  9273 catalog_manager.cc:5697] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:08.252508  9828 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.253099  9828 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.254762  9836 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.265457  9828 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:08.266901  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:08.269177  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:08.269929  9449 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
W20260709 13:02:08.272053  9492 leader_election.cc:343] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.273197  9572 tablet_bootstrap.cc:654] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.276211  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:08.276821  9449 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:08.277861  9490 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:08.279593  9827 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:08.279981  9827 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.280296  9827 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.280843  9341 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:08.281651  9601 raft_consensus.cc:2804] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:08.281978  9601 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.282256  9601 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.288992  9601 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.291792  9601 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:08.296424  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:02:08.299240  9343 leader_election.cc:343] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.300266  9828 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:08.302950  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:08.304066  9827 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.304822  9447 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.292788  9836 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.311225  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:08.322546  9827 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:08.334504  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:08.335505  9449 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:08.352800  9492 leader_election.cc:343] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:08.358713  9492 consensus_peers.cc:597] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:08.373669  9567 tablet_bootstrap.cc:492] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:08.374171  9567 ts_tablet_manager.cc:1403] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.180s	user 0.039s	sys 0.049s
I20260709 13:02:08.380065  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:08.382529  9371 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.375516  9754 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:02:08.392113  9447 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:08.400046  9341 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:08.400549  9566 tablet_bootstrap.cc:492] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:08.430241  9567 raft_consensus.cc:359] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.443688  9566 ts_tablet_manager.cc:1403] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.229s	user 0.057s	sys 0.035s
I20260709 13:02:08.443856  9567 raft_consensus.cc:385] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.444195  9567 raft_consensus.cc:740] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.447145  9601 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:08.446827  9567 consensus_queue.cc:260] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.452073  9570 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.452579  9570 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.442728  9763 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:02:08.401619  9754 raft_consensus.cc:2804] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:08.401790  9836 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:08.456895  9566 raft_consensus.cc:359] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.458930  9566 raft_consensus.cc:385] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.459141  9566 raft_consensus.cc:740] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.407137  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:08.402442  9449 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:08.461417  9566 consensus_queue.cc:260] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.432560  9821 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:02:08.469177  9575 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.469744  9575 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.471997  9575 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:08.474743  9570 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:08.476644  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:08.478463  9566 ts_tablet_manager.cc:1434] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 13:02:08.478971  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:08.479868  9566 tablet_bootstrap.cc:492] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
W20260709 13:02:08.482209  9418 leader_election.cc:343] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.482374  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:08.483326  9567 ts_tablet_manager.cc:1434] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.109s	user 0.006s	sys 0.005s
I20260709 13:02:08.482278  9490 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:08.489562  9828 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:08.490567  9828 raft_consensus.cc:697] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:08.490357  9817 consensus_queue.cc:1048] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:08.491811  9828 consensus_queue.cc:237] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.484297  9371 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:08.464859  9754 raft_consensus.cc:697] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:08.498183  9343 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:08.496644  9754 consensus_queue.cc:237] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.502166  9601 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:08.507462  9812 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.508204  9812 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.510756  9812 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:08.511646  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:08.512559  9374 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:08.515745  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:08.514199  9418 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:08.514891  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:08.519824  9753 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:08.520375  9753 raft_consensus.cc:697] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:08.521311  9753 consensus_queue.cc:237] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:08.523422  9418 leader_election.cc:343] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.466378  9517 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.528332  9418 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:08.528939  9567 tablet_bootstrap.cc:492] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:08.532352  9575 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:02:08.535976  9418 consensus_peers.cc:597] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:08.540469  9418 leader_election.cc:343] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.541150  9418 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:08.532856  9575 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.543208  9572 tablet_bootstrap.cc:492] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:08.543699  9572 ts_tablet_manager.cc:1403] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.311s	user 0.010s	sys 0.013s
I20260709 13:02:08.543041  9575 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.545574  9812 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:08.562891  9566 tablet_bootstrap.cc:654] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.579629  9812 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.580204  9812 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.575546  9575 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.582408  9812 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:08.583096  9575 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:08.583668  9517 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:08.584690  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:08.587141  9375 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:08.587733  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:08.588757  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:08.589589  9375 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.588567  9418 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:08.592651  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:08.593180  9753 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:02:08.606886  9418 leader_election.cc:343] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.603910  9753 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.612998  9753 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.625355  9375 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:08.620728  9812 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:02:08.629336  9418 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:08.630316  9812 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:08.630481  9566 tablet_bootstrap.cc:492] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:08.630860  9812 raft_consensus.cc:697] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:08.631014  9566 ts_tablet_manager.cc:1403] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.151s	user 0.013s	sys 0.009s
I20260709 13:02:08.633756  9812 consensus_queue.cc:237] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.634670  9275 catalog_manager.cc:5697] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 0 to 1, leader changed from <none> to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:08.638700  9566 raft_consensus.cc:359] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.639531  9566 raft_consensus.cc:385] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.639874  9566 raft_consensus.cc:740] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.643699  9566 consensus_queue.cc:260] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.646426  9753 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.648628  9753 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:08.648998  9575 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.649943  9575 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.651302  9572 raft_consensus.cc:359] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.652081  9575 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:08.652376  9572 raft_consensus.cc:385] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.654934  9567 tablet_bootstrap.cc:654] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.652865  9572 raft_consensus.cc:740] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.665346  9566 ts_tablet_manager.cc:1434] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.002s
I20260709 13:02:08.664323  9572 consensus_queue.cc:260] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.668953  9668 consensus_queue.cc:1048] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:08.670482  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:08.670871  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:08.671516  9375 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.671875  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:08.675347  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:02:08.677240  9478 tablet.cc:2406] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260709 13:02:08.681876  9418 leader_election.cc:343] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:08.685148  9418 leader_election.cc:343] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:08.686988  9323 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:08.686385  9575 consensus_queue.cc:1048] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:02:08.687280  9418 leader_election.cc:343] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.693768  9418 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:08.694813  9572 ts_tablet_manager.cc:1434] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.151s	user 0.007s	sys 0.003s
I20260709 13:02:08.695250  9566 tablet_bootstrap.cc:492] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:08.695537  9620 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:08.687445  9753 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:02:08.702853  9375 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:08.707767  9418 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:08.710317  9753 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:08.711809  9753 raft_consensus.cc:697] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:08.712568  9522 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.727293  9753 consensus_queue.cc:237] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.740156  9566 tablet_bootstrap.cc:654] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.740753  9572 tablet_bootstrap.cc:492] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:08.754015  9275 catalog_manager.cc:5697] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 0 to 1, leader changed from <none> to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:08.756487  9272 catalog_manager.cc:5697] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:08.785952  9566 tablet_bootstrap.cc:492] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:08.786643  9566 ts_tablet_manager.cc:1403] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.092s	user 0.013s	sys 0.004s
I20260709 13:02:08.792176  9273 catalog_manager.cc:5697] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:08.816077  9567 tablet_bootstrap.cc:492] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:08.816639  9567 ts_tablet_manager.cc:1403] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.291s	user 0.028s	sys 0.019s
I20260709 13:02:08.817509  9522 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:08.822067  9572 tablet_bootstrap.cc:654] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.838778  9566 raft_consensus.cc:359] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.839594  9566 raft_consensus.cc:385] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.839905  9566 raft_consensus.cc:740] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.840720  9566 consensus_queue.cc:260] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.846925  9275 catalog_manager.cc:5697] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 0 to 1, leader changed from <none> to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:08.848901  9566 ts_tablet_manager.cc:1434] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.004s
I20260709 13:02:08.850558  9566 tablet_bootstrap.cc:492] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:08.854573  9572 tablet_bootstrap.cc:492] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:08.857096  9566 tablet_bootstrap.cc:654] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.860545  9572 ts_tablet_manager.cc:1403] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.129s	user 0.010s	sys 0.004s
I20260709 13:02:08.863767  9572 raft_consensus.cc:359] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.866765  9572 raft_consensus.cc:385] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.867755  9572 raft_consensus.cc:740] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.851969  9567 raft_consensus.cc:359] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.868728  9567 raft_consensus.cc:385] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.869140  9567 raft_consensus.cc:740] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.871843  9567 consensus_queue.cc:260] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.870085  9572 consensus_queue.cc:260] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.874922  9572 ts_tablet_manager.cc:1434] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:02:08.880717  9377 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.878211  9567 ts_tablet_manager.cc:1434] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.001s
I20260709 13:02:08.906342  9572 tablet_bootstrap.cc:492] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:08.907344  9567 tablet_bootstrap.cc:492] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:08.916883  9572 tablet_bootstrap.cc:654] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.917595  9567 tablet_bootstrap.cc:654] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.919441  9566 tablet_bootstrap.cc:492] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:08.919986  9566 ts_tablet_manager.cc:1403] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.023s
I20260709 13:02:08.924918  9566 raft_consensus.cc:359] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.925698  9566 raft_consensus.cc:385] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.926055  9566 raft_consensus.cc:740] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.926646  9572 tablet_bootstrap.cc:492] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:08.927121  9572 ts_tablet_manager.cc:1403] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.005s
I20260709 13:02:08.927446  9567 tablet_bootstrap.cc:492] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:08.927032  9566 consensus_queue.cc:260] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.927883  9567 ts_tablet_manager.cc:1403] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.003s
I20260709 13:02:08.930428  9566 ts_tablet_manager.cc:1434] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:02:08.930603  9567 raft_consensus.cc:359] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.931293  9567 raft_consensus.cc:385] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.931576  9567 raft_consensus.cc:740] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.931924  9566 tablet_bootstrap.cc:492] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:08.932355  9567 consensus_queue.cc:260] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.935364  9567 ts_tablet_manager.cc:1434] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:08.935518  9572 raft_consensus.cc:359] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.936200  9572 raft_consensus.cc:385] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.936486  9572 raft_consensus.cc:740] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.936574  9567 tablet_bootstrap.cc:492] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:08.944139  9567 tablet_bootstrap.cc:654] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.946368  9566 tablet_bootstrap.cc:654] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.949934  9572 consensus_queue.cc:260] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:08.958318  9572 ts_tablet_manager.cc:1434] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.001s
I20260709 13:02:08.959405  9572 tablet_bootstrap.cc:492] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:08.960110  9373 raft_consensus.cc:3060] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.965566  9572 tablet_bootstrap.cc:654] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.969465  9575 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:08.997790  9827 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.998473  9827 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.008574  9827 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:09.010967  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:09.012858  9375 raft_consensus.cc:2393] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 1: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:09.016232  9567 tablet_bootstrap.cc:492] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:09.016721  9567 ts_tablet_manager.cc:1403] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.080s	user 0.022s	sys 0.042s
I20260709 13:02:09.020284  9566 tablet_bootstrap.cc:492] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:09.020750  9566 ts_tablet_manager.cc:1403] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.000s
I20260709 13:02:09.021344  9567 raft_consensus.cc:359] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.022193  9567 raft_consensus.cc:385] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.022487  9567 raft_consensus.cc:740] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.023141  9567 consensus_queue.cc:260] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.023888  9566 raft_consensus.cc:359] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.024549  9566 raft_consensus.cc:385] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.024987  9566 raft_consensus.cc:740] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.026264  9566 consensus_queue.cc:260] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.027868  9566 ts_tablet_manager.cc:1434] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:09.033082  9566 tablet_bootstrap.cc:492] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:09.040071  9566 tablet_bootstrap.cc:654] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.036594  9567 ts_tablet_manager.cc:1434] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:02:09.041458  9567 tablet_bootstrap.cc:492] T a81c17774a484973a3b82a63d2a33ff0 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:09.048605  9827 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.049391  9827 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.053323  9827 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:09.054899  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:09.058097  9492 leader_election.cc:343] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.058629  9567 tablet_bootstrap.cc:654] T a81c17774a484973a3b82a63d2a33ff0 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.069726  9567 tablet_bootstrap.cc:492] T a81c17774a484973a3b82a63d2a33ff0 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:09.070235  9567 ts_tablet_manager.cc:1403] T a81c17774a484973a3b82a63d2a33ff0 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 13:02:09.063546  9375 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.075991  9572 tablet_bootstrap.cc:492] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:09.076881  9572 ts_tablet_manager.cc:1403] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.118s	user 0.014s	sys 0.011s
I20260709 13:02:09.079646  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:09.081272  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:09.081554  9572 raft_consensus.cc:359] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.082362  9572 raft_consensus.cc:385] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.082656  9572 raft_consensus.cc:740] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.083458  9572 consensus_queue.cc:260] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.084690  9566 tablet_bootstrap.cc:492] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:09.085258  9566 ts_tablet_manager.cc:1403] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.032s
I20260709 13:02:09.086150  9572 ts_tablet_manager.cc:1434] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:09.087675  9572 tablet_bootstrap.cc:492] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:09.088745  9566 raft_consensus.cc:359] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.089641  9566 raft_consensus.cc:385] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.089756  9490 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:09.090051  9566 raft_consensus.cc:740] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.090797  9827 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.091226  9566 consensus_queue.cc:260] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.093760  9566 ts_tablet_manager.cc:1434] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:09.094851  9566 tablet_bootstrap.cc:492] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:09.095412  9567 raft_consensus.cc:359] T a81c17774a484973a3b82a63d2a33ff0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.096158  9567 raft_consensus.cc:385] T a81c17774a484973a3b82a63d2a33ff0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.096441  9567 raft_consensus.cc:740] T a81c17774a484973a3b82a63d2a33ff0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.097172  9567 consensus_queue.cc:260] T a81c17774a484973a3b82a63d2a33ff0 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.101135  9827 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:09.102571  9566 tablet_bootstrap.cc:654] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.102918  9572 tablet_bootstrap.cc:654] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:09.106001  9343 consensus_peers.cc:597] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 -> Peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Couldn't send request to peer 6d50f1c263264b21919230bee398022b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:09.107136  9567 ts_tablet_manager.cc:1434] T a81c17774a484973a3b82a63d2a33ff0 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:02:09.108863  9567 tablet_bootstrap.cc:492] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
W20260709 13:02:09.114326  9490 leader_election.cc:343] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.114823  9490 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:09.116815  9753 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:09.119745  9567 tablet_bootstrap.cc:654] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.120339  9570 consensus_queue.cc:1048] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:09.120491  9763 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:09.126348  9827 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:09.129146  9763 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:09.138100  9572 tablet_bootstrap.cc:492] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:09.138846  9572 ts_tablet_manager.cc:1403] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.051s	user 0.007s	sys 0.009s
I20260709 13:02:09.149084  9763 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.149763  9763 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.152279  9763 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:09.155148  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:09.156126  9375 raft_consensus.cc:2468] T a81c17774a484973a3b82a63d2a33ff0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:09.144098  9572 raft_consensus.cc:359] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.157474  9572 raft_consensus.cc:385] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.158535  9572 raft_consensus.cc:740] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.157404  9492 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:09.160017  9827 raft_consensus.cc:2804] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:09.160570  9827 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.161096  9827 raft_consensus.cc:3060] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.166363  9836 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.167019  9836 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.169260  9836 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:09.174434  9753 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:09.175880  9566 tablet_bootstrap.cc:492] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:09.176505  9566 ts_tablet_manager.cc:1403] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.082s	user 0.007s	sys 0.021s
I20260709 13:02:09.179589  9566 raft_consensus.cc:359] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.180295  9566 raft_consensus.cc:385] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.180594  9566 raft_consensus.cc:740] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.181303  9566 consensus_queue.cc:260] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.183501  9566 ts_tablet_manager.cc:1434] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:02:09.183657  9827 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.184540  9566 tablet_bootstrap.cc:492] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:09.159488  9572 consensus_queue.cc:260] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.187417  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:09.188124  9375 raft_consensus.cc:3060] T a81c17774a484973a3b82a63d2a33ff0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.190464  9572 ts_tablet_manager.cc:1434] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.005s
I20260709 13:02:09.193076  9572 tablet_bootstrap.cc:492] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:09.193400  9566 tablet_bootstrap.cc:654] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.194020  9827 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:09.194192  9601 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.195513  9601 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.196849  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:09.202099  9452 raft_consensus.cc:2468] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:09.204886  9601 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:09.207902  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:09.208820  9452 raft_consensus.cc:3060] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.219267  9567 tablet_bootstrap.cc:492] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:09.219805  9567 ts_tablet_manager.cc:1403] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.111s	user 0.020s	sys 0.008s
I20260709 13:02:09.222724  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:09.223618  9450 raft_consensus.cc:2468] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:09.214834  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:09.228202  9343 leader_election.cc:343] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.229298  9341 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:09.231498  9601 raft_consensus.cc:2804] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:09.231971  9601 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.232381  9601 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.240670  9566 tablet_bootstrap.cc:492] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:09.241509  9566 ts_tablet_manager.cc:1403] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.005s
I20260709 13:02:09.245407  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:09.246207  9836 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.246755  9836 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.257534  9452 raft_consensus.cc:2468] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
W20260709 13:02:09.259616  9418 leader_election.cc:343] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.262650  9566 raft_consensus.cc:359] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.263994  9566 raft_consensus.cc:385] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.264034  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:09.264374  9566 raft_consensus.cc:740] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.265237  9668 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.265092  9566 consensus_queue.cc:260] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.265730  9668 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.266947  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:09.268988  9490 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:09.272287  9418 leader_election.cc:343] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.273294  9763 raft_consensus.cc:2804] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:09.273478  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:09.275465  9566 ts_tablet_manager.cc:1434] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:02:09.277405  9836 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:09.272907  9418 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:09.269871  9668 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:09.290678  9418 leader_election.cc:343] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.297905  9566 tablet_bootstrap.cc:492] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:09.291157  9836 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:09.304078  9572 tablet_bootstrap.cc:654] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.305253  9834 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.290239  9812 consensus_queue.cc:1048] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:02:09.304783  9567 raft_consensus.cc:359] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.310129  9567 raft_consensus.cc:385] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.292579  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:09.310861  9567 raft_consensus.cc:740] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.294741  9753 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:02:09.312539  9834 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.313388  9567 consensus_queue.cc:260] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.317948  9834 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:09.319751  9492 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:09.320533  9889 raft_consensus.cc:2749] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:09.320390  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:09.325600  9601 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.332044  9567 ts_tablet_manager.cc:1434] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.112s	user 0.009s	sys 0.000s
I20260709 13:02:09.335012  9567 tablet_bootstrap.cc:492] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:09.334882  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:09.335682  9522 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:09.310395  9763 raft_consensus.cc:697] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:09.324934  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:09.346693  9601 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:09.344949  9375 raft_consensus.cc:2468] T a81c17774a484973a3b82a63d2a33ff0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:09.352779  9763 consensus_queue.cc:237] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.354137  9418 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
W20260709 13:02:09.356168  9418 leader_election.cc:343] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:09.357910  9418 leader_election.cc:343] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.358423  9418 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:09.354821  9812 consensus_queue.cc:1048] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:02:09.363288  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:09.364214  9450 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.360116  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:02:09.366506  9343 leader_election.cc:343] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.359720  9834 raft_consensus.cc:2804] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:09.359444  9575 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:09.370347  9834 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.381577  9834 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.391681  9567 tablet_bootstrap.cc:654] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.394939  9572 tablet_bootstrap.cc:492] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:09.396313  9572 ts_tablet_manager.cc:1403] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.203s	user 0.021s	sys 0.011s
I20260709 13:02:09.407858  9566 tablet_bootstrap.cc:654] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.411944  9834 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.431087  9834 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:09.432331  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:09.432386  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:09.434616  9524 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:09.437567  9418 leader_election.cc:343] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.443500  9450 raft_consensus.cc:2468] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:09.445132  9341 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:09.453832  9570 raft_consensus.cc:2804] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:09.454404  9570 raft_consensus.cc:697] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:09.455161  9570 consensus_queue.cc:237] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.464936  9572 raft_consensus.cc:359] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.465802  9572 raft_consensus.cc:385] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.466176  9572 raft_consensus.cc:740] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.466388  9524 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:09.473258  9418 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:09.474334  9620 raft_consensus.cc:2804] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:09.474869  9620 raft_consensus.cc:697] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:09.475770  9620 consensus_queue.cc:237] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.469604  9572 consensus_queue.cc:260] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.481755  9572 ts_tablet_manager.cc:1434] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.000s
I20260709 13:02:09.482848  9572 tablet_bootstrap.cc:492] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:09.484650  9274 catalog_manager.cc:5697] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:09.488426  9567 tablet_bootstrap.cc:492] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:09.491274  9567 ts_tablet_manager.cc:1403] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.157s	user 0.017s	sys 0.010s
I20260709 13:02:09.494376  9572 tablet_bootstrap.cc:654] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.494205  9567 raft_consensus.cc:359] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.495028  9567 raft_consensus.cc:385] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.495522  9567 raft_consensus.cc:740] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.496428  9567 consensus_queue.cc:260] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.498348  9566 tablet_bootstrap.cc:492] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:09.498942  9566 ts_tablet_manager.cc:1403] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.211s	user 0.011s	sys 0.010s
I20260709 13:02:09.500067  9567 ts_tablet_manager.cc:1434] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:09.501240  9567 tablet_bootstrap.cc:492] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:09.507467  9567 tablet_bootstrap.cc:654] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.508477  9275 catalog_manager.cc:5697] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:09.518635  9566 raft_consensus.cc:359] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.520556  9566 raft_consensus.cc:385] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.520967  9566 raft_consensus.cc:740] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.520129  9620 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.525889  9620 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.528124  9620 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:09.531483  9566 consensus_queue.cc:260] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.531852  9272 catalog_manager.cc:5697] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 0 to 1, leader changed from <none> to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:09.534670  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:09.537209  9834 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.537897  9834 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.535002  9566 ts_tablet_manager.cc:1434] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.036s	user 0.002s	sys 0.007s
I20260709 13:02:09.536363  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:09.539927  9834 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:09.540946  9566 tablet_bootstrap.cc:492] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:09.537206  9572 tablet_bootstrap.cc:492] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:09.544106  9572 ts_tablet_manager.cc:1403] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.017s
W20260709 13:02:09.545720  9418 leader_election.cc:343] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.549757  9517 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.553298  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:09.555631  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:09.555831  9572 raft_consensus.cc:359] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.556792  9572 raft_consensus.cc:385] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.557235  9572 raft_consensus.cc:740] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.558606  9572 consensus_queue.cc:260] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.562441  9572 ts_tablet_manager.cc:1434] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
W20260709 13:02:09.563237  9418 leader_election.cc:343] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.564438  9418 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:09.565039  9572 tablet_bootstrap.cc:492] T a326e6d2c4664dbe9374e92fa4c42c93 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:09.553242  9566 tablet_bootstrap.cc:654] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:09.568111  9418 leader_election.cc:343] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.568126  9834 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:09.569514  9418 leader_election.cc:343] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.570122  9418 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:09.571878  9575 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:09.572625  9567 tablet_bootstrap.cc:492] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:09.573130  9567 ts_tablet_manager.cc:1403] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.072s	user 0.013s	sys 0.005s
I20260709 13:02:09.583024  9570 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.583081  9567 raft_consensus.cc:359] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.585180  9567 raft_consensus.cc:385] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.585666  9567 raft_consensus.cc:740] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.583797  9570 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.590132  9566 tablet_bootstrap.cc:492] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:09.590832  9566 ts_tablet_manager.cc:1403] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.007s
I20260709 13:02:09.597100  9570 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:09.599334  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:09.604228  9450 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:09.606180  9341 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:09.593744  9567 consensus_queue.cc:260] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.607339  9891 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:09.607949  9891 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.608419  9891 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.610039  9567 ts_tablet_manager.cc:1434] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 13:02:09.611706  9567 tablet_bootstrap.cc:492] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:09.623102  9567 tablet_bootstrap.cc:654] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.606176  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:09.628844  9524 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:09.643399  9566 raft_consensus.cc:359] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.644085  9566 raft_consensus.cc:385] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.644354  9566 raft_consensus.cc:740] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.644975  9566 consensus_queue.cc:260] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.650552  9566 ts_tablet_manager.cc:1434] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.059s	user 0.022s	sys 0.006s
I20260709 13:02:09.652050  9566 tablet_bootstrap.cc:492] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:09.650516  9834 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.653872  9834 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.656075  9891 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.664924  9891 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:09.667888  9834 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:09.668519  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:09.669305  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:09.669975  9524 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:09.670336  9418 leader_election.cc:343] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.668653  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:09.671007  9450 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.673585  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:09.675580  9418 leader_election.cc:343] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.675941  9418 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:09.676985  9620 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:09.678553  9567 tablet_bootstrap.cc:492] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:09.679137  9567 ts_tablet_manager.cc:1403] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.012s
I20260709 13:02:09.680914  9572 tablet_bootstrap.cc:654] T a326e6d2c4664dbe9374e92fa4c42c93 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.683236  9524 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:09.682425  9567 raft_consensus.cc:359] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.684772  9567 raft_consensus.cc:385] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.685041  9343 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:09.685532  9567 raft_consensus.cc:740] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.686329  9601 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:09.686880  9566 tablet_bootstrap.cc:654] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.686879  9601 raft_consensus.cc:697] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:09.686535  9567 consensus_queue.cc:260] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.687871  9601 consensus_queue.cc:237] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.688892  9567 ts_tablet_manager.cc:1434] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:02:09.689837  9567 tablet_bootstrap.cc:492] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:09.695986  9567 tablet_bootstrap.cc:654] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.698554  9566 tablet_bootstrap.cc:492] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:09.699433  9566 ts_tablet_manager.cc:1403] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.005s
I20260709 13:02:09.701934  9754 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.702657  9754 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.703660  9566 raft_consensus.cc:359] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.704425  9566 raft_consensus.cc:385] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.704734  9566 raft_consensus.cc:740] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.705588  9566 consensus_queue.cc:260] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.706046  9754 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:09.706269  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:09.709969  9450 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:09.713706  9566 ts_tablet_manager.cc:1434] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:02:09.714882  9566 tablet_bootstrap.cc:492] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:09.722508  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:09.723556  9517 raft_consensus.cc:2393] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 1: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:09.725131  9343 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:09.726588  9272 catalog_manager.cc:5697] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:09.727561  9834 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.728050  9834 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.729804  9601 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.737993  9834 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:09.740031  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:09.740747  9517 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:09.742110  9418 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:09.742921  9812 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:09.743316  9812 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.743685  9812 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.743603  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:09.745600  9418 leader_election.cc:343] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.747351  9601 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:09.755350  9812 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.757817  9812 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:09.759713  9566 tablet_bootstrap.cc:654] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.760874  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:09.770888  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:09.771548  9524 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.772660  9567 tablet_bootstrap.cc:492] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:09.773242  9567 ts_tablet_manager.cc:1403] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.084s	user 0.039s	sys 0.026s
I20260709 13:02:09.781807  9567 raft_consensus.cc:359] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.782897  9567 raft_consensus.cc:385] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.783203  9567 raft_consensus.cc:740] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.784560  9567 consensus_queue.cc:260] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:09.785869  9418 leader_election.cc:343] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.788875  9524 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:09.790894  9418 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:09.791424  9572 tablet_bootstrap.cc:492] T a326e6d2c4664dbe9374e92fa4c42c93 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:09.791759  9575 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:09.791972  9572 ts_tablet_manager.cc:1403] T a326e6d2c4664dbe9374e92fa4c42c93 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.227s	user 0.016s	sys 0.021s
I20260709 13:02:09.792301  9575 raft_consensus.cc:697] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:09.793123  9575 consensus_queue.cc:237] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.794498  9567 ts_tablet_manager.cc:1434] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:02:09.795543  9567 tablet_bootstrap.cc:492] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:09.795987  9566 tablet_bootstrap.cc:492] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:09.795225  9572 raft_consensus.cc:359] T a326e6d2c4664dbe9374e92fa4c42c93 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.797168  9572 raft_consensus.cc:385] T a326e6d2c4664dbe9374e92fa4c42c93 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.796499  9566 ts_tablet_manager.cc:1403] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.082s	user 0.003s	sys 0.009s
I20260709 13:02:09.797530  9572 raft_consensus.cc:740] T a326e6d2c4664dbe9374e92fa4c42c93 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.800218  9572 consensus_queue.cc:260] T a326e6d2c4664dbe9374e92fa4c42c93 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.802500  9572 ts_tablet_manager.cc:1434] T a326e6d2c4664dbe9374e92fa4c42c93 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:02:09.806027  9572 tablet_bootstrap.cc:492] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:09.806591  9566 raft_consensus.cc:359] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.811030  9566 raft_consensus.cc:385] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.811414  9566 raft_consensus.cc:740] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.811815  9567 tablet_bootstrap.cc:654] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.812161  9566 consensus_queue.cc:260] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.821056  9566 ts_tablet_manager.cc:1434] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.023s	user 0.001s	sys 0.005s
I20260709 13:02:09.822384  9566 tablet_bootstrap.cc:492] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:09.819841  9763 consensus_queue.cc:1048] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 13:02:09.822700  9323 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:09.826375  9572 tablet_bootstrap.cc:654] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.829349  9566 tablet_bootstrap.cc:654] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.837270  9895 consensus_queue.cc:1048] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:09.837695  9572 tablet_bootstrap.cc:492] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:09.838266  9572 ts_tablet_manager.cc:1403] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.012s
I20260709 13:02:09.841176  9572 raft_consensus.cc:359] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.842113  9572 raft_consensus.cc:385] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.843214  9572 raft_consensus.cc:740] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.844259  9572 consensus_queue.cc:260] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.850407  9572 ts_tablet_manager.cc:1434] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:02:09.864535  9566 tablet_bootstrap.cc:492] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:09.865267  9566 ts_tablet_manager.cc:1403] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.006s
I20260709 13:02:09.866420  9274 catalog_manager.cc:5697] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 0 to 1, leader changed from <none> to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:09.869994  9572 tablet_bootstrap.cc:492] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:09.879536  9572 tablet_bootstrap.cc:654] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.882524  9834 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.883128  9834 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:09.892661  9343 consensus_peers.cc:597] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 -> Peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Couldn't send request to peer 6d50f1c263264b21919230bee398022b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:09.893937  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:09.894281  9834 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:09.894688  9371 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:09.897223  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:09.898165  9418 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:09.904294  9566 raft_consensus.cc:359] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.905333  9566 raft_consensus.cc:385] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.905699  9566 raft_consensus.cc:740] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.906560  9566 consensus_queue.cc:260] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.917613  9566 ts_tablet_manager.cc:1434] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:02:09.918308  9834 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:09.918881  9834 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.919309  9834 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.930925  9566 tablet_bootstrap.cc:492] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
W20260709 13:02:09.939610  9418 leader_election.cc:343] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.941358  9834 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.944299  9834 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:09.951591  9601 consensus_queue.cc:1048] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:09.954137  9566 tablet_bootstrap.cc:654] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.961174  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:09.961876  9375 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.966415  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:09.967454  9620 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:09.968492  9567 tablet_bootstrap.cc:492] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:09.971103  9567 ts_tablet_manager.cc:1403] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.176s	user 0.050s	sys 0.048s
I20260709 13:02:09.974790  9572 tablet_bootstrap.cc:492] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:09.975301  9572 ts_tablet_manager.cc:1403] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.106s	user 0.015s	sys 0.003s
I20260709 13:02:09.977835  9572 raft_consensus.cc:359] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.978500  9572 raft_consensus.cc:385] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.978742  9572 raft_consensus.cc:740] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.974436  9567 raft_consensus.cc:359] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.979987  9567 raft_consensus.cc:385] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.980280  9567 raft_consensus.cc:740] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.979327  9572 consensus_queue.cc:260] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:09.988788  9418 leader_election.cc:343] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.990041  9572 ts_tablet_manager.cc:1434] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:02:09.991137  9572 tablet_bootstrap.cc:492] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:09.993602  9375 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:09.994854  9418 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:09.995667  9925 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:09.996104  9925 raft_consensus.cc:697] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:09.981071  9567 consensus_queue.cc:260] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.997814  9891 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.998296  9891 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:09.998979  9567 ts_tablet_manager.cc:1434] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:02:09.999884  9567 tablet_bootstrap.cc:492] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:10.000372  9891 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:09.997205  9925 consensus_queue.cc:237] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.005532  9834 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.006076  9834 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.006466  9567 tablet_bootstrap.cc:654] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.008023  9834 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:10.008910  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:10.009639  9517 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:10.009986  9570 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.011296  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:10.013381  9570 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.007961  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:10.014355  9452 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:10.015412  9570 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:10.016085  9418 leader_election.cc:343] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.016983  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:10.017751  9341 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:10.017904  9522 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:10.018831  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:10.019609  9452 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:10.020458  9570 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:10.020965  9570 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.021405  9570 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.009182  9572 tablet_bootstrap.cc:654] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.020411  9343 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:10.033758  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:10.036259  9418 leader_election.cc:343] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.036865  9418 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:10.038239  9891 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:10.038370  9620 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:10.040071  9891 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.040657  9891 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.052768  9601 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.057142  9834 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:10.053504  9601 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.080704  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:10.081426  9452 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:10.084105  9341 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:10.086217  9572 tablet_bootstrap.cc:492] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:10.086954  9754 raft_consensus.cc:2804] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:10.087262  9572 ts_tablet_manager.cc:1403] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.096s	user 0.014s	sys 0.000s
I20260709 13:02:10.087536  9754 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.088073  9754 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.097433  9572 raft_consensus.cc:359] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.098387  9572 raft_consensus.cc:385] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.098801  9572 raft_consensus.cc:740] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.099714  9572 consensus_queue.cc:260] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.102437  9572 ts_tablet_manager.cc:1434] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 13:02:10.105396  9572 tablet_bootstrap.cc:492] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:10.119740  9275 catalog_manager.cc:5697] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 0 to 1, leader changed from <none> to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.133453  9763 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.133668  9601 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:10.134157  9763 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.138738  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:10.139397  9452 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:10.141353  9490 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:10.142191  9895 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:10.142572  9895 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.142947  9895 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.159397  9895 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.160632  9763 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:10.164528  9572 tablet_bootstrap.cc:654] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.167868  9570 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:10.175310  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 56794.1us
I20260709 13:02:10.195370  9570 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:10.205933  9566 tablet_bootstrap.cc:492] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:10.206432  9566 ts_tablet_manager.cc:1403] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.276s	user 0.052s	sys 0.052s
I20260709 13:02:10.205824  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:10.208591  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:10.229642  9566 raft_consensus.cc:359] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.230144  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:10.232123  9566 raft_consensus.cc:385] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.233811  9566 raft_consensus.cc:740] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.244547  9566 consensus_queue.cc:260] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.235459  9447 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.235087  9525 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:10.256232  9566 ts_tablet_manager.cc:1434] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 13:02:10.263450  9891 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:10.264313  9492 leader_election.cc:343] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.265607  9891 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:10.265259  9754 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.276473  9895 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:10.279016  9447 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:10.280972  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:10.281584  9451 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.289499  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:10.290299  9448 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.290192  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:10.290586  9567 tablet_bootstrap.cc:492] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:10.291042  9567 ts_tablet_manager.cc:1403] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.291s	user 0.103s	sys 0.115s
I20260709 13:02:10.290872  9522 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.298092  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:10.298754  9526 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.294588  9936 consensus_queue.cc:1048] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:02:10.301146  9341 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:10.304994  9566 tablet_bootstrap.cc:492] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:10.305619  9567 raft_consensus.cc:359] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.306268  9567 raft_consensus.cc:385] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.306519  9567 raft_consensus.cc:740] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.307250  9567 consensus_queue.cc:260] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.309791  9570 consensus_queue.cc:1048] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:10.311146  9567 ts_tablet_manager.cc:1434] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:02:10.311060  9526 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:10.312222  9567 tablet_bootstrap.cc:492] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:10.312281  9754 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:10.313412  9570 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:10.316829  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:10.321156  9522 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:10.324719  9572 tablet_bootstrap.cc:492] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:10.325268  9572 ts_tablet_manager.cc:1403] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.220s	user 0.018s	sys 0.015s
I20260709 13:02:10.325795  9451 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:10.328665  9754 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.330610  9570 raft_consensus.cc:697] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:10.332065  9341 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:10.331451  9570 consensus_queue.cc:237] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.339622  9572 raft_consensus.cc:359] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.340333  9572 raft_consensus.cc:385] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.340615  9572 raft_consensus.cc:740] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.340953  9937 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:10.329173  9754 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.340520  9448 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:10.341380  9572 consensus_queue.cc:260] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.350446  9490 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:10.355365  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:10.356267  9452 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:10.357969  9341 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:10.366173  9601 raft_consensus.cc:2804] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:10.366622  9601 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.366935  9601 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.347167  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:10.368564  9895 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:10.351692  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:10.351413  9937 raft_consensus.cc:697] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:10.375905  9601 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.376711  9572 ts_tablet_manager.cc:1434] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
W20260709 13:02:10.380818  9492 leader_election.cc:343] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.383947  9601 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:10.375803  9447 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.390890  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:10.376183  9754 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:10.393725  9566 tablet_bootstrap.cc:654] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.376760  9522 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.395273  9937 consensus_queue.cc:237] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.398622  9812 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:10.380344  9895 raft_consensus.cc:697] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:10.401494  9895 consensus_queue.cc:237] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:10.402130  9418 consensus_peers.cc:597] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:10.403400  9343 leader_election.cc:343] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.407222  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:10.411192  9572 tablet_bootstrap.cc:492] T f7b2e1b1ef6540b1915f1dda8f95e81b P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
W20260709 13:02:10.416988  9343 leader_election.cc:343] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.412936  9567 tablet_bootstrap.cc:654] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.425560  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:10.426141  9452 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.435601  9447 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:10.442612  9620 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.444805  9452 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:10.443403  9620 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.480232  9620 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:10.479233  9341 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:10.503587  9341 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:10.508460  9937 raft_consensus.cc:2804] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:10.632440  9937 raft_consensus.cc:697] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:10.633598  9937 consensus_queue.cc:237] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.634646  9620 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.635129  9620 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.508693  9936 raft_consensus.cc:2804] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:10.636878  9936 raft_consensus.cc:697] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:10.636930  9620 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:10.631011  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 105164us
I20260709 13:02:10.637980  9572 tablet_bootstrap.cc:654] T f7b2e1b1ef6540b1915f1dda8f95e81b P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.638659  9936 consensus_queue.cc:237] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.633986  9522 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:10.642267  9567 tablet_bootstrap.cc:492] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:10.642832  9567 ts_tablet_manager.cc:1403] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.331s	user 0.017s	sys 0.015s
I20260709 13:02:10.644284  9566 tablet_bootstrap.cc:492] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:10.644744  9566 ts_tablet_manager.cc:1403] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.350s	user 0.021s	sys 0.015s
I20260709 13:02:10.651816  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:10.658861  9567 raft_consensus.cc:359] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.660766  9567 raft_consensus.cc:385] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.661098  9567 raft_consensus.cc:740] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.661587  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:10.661700  9567 consensus_queue.cc:260] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.666333  9567 ts_tablet_manager.cc:1434] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:02:10.672021  9566 raft_consensus.cc:359] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.672971  9566 raft_consensus.cc:385] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.673364  9566 raft_consensus.cc:740] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
W20260709 13:02:10.676393  9418 leader_election.cc:343] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:10.681586  9418 leader_election.cc:343] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.674747  9566 consensus_queue.cc:260] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:10.683825  9418 consensus_peers.cc:597] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 -> Peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Couldn't send request to peer 6d50f1c263264b21919230bee398022b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:10.679147  9942 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.688819  9942 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.692157  9566 ts_tablet_manager.cc:1434] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 13:02:10.697600  9572 tablet_bootstrap.cc:492] T f7b2e1b1ef6540b1915f1dda8f95e81b P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:10.698169  9572 ts_tablet_manager.cc:1403] T f7b2e1b1ef6540b1915f1dda8f95e81b P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.311s	user 0.009s	sys 0.005s
I20260709 13:02:10.701752  9942 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:10.702529  9566 tablet_bootstrap.cc:492] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:10.719147  9572 raft_consensus.cc:359] T f7b2e1b1ef6540b1915f1dda8f95e81b P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.719918  9572 raft_consensus.cc:385] T f7b2e1b1ef6540b1915f1dda8f95e81b P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.720345  9572 raft_consensus.cc:740] T f7b2e1b1ef6540b1915f1dda8f95e81b P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.721304  9575 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.721819  9575 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.723798  9575 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:10.720973  9572 consensus_queue.cc:260] T f7b2e1b1ef6540b1915f1dda8f95e81b P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.730338  9567 tablet_bootstrap.cc:492] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:10.730948  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:10.732263  9572 ts_tablet_manager.cc:1434] T f7b2e1b1ef6540b1915f1dda8f95e81b P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.034s	user 0.000s	sys 0.007s
I20260709 13:02:10.733429  9572 tablet_bootstrap.cc:492] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:10.741137  9925 consensus_queue.cc:1048] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:10.741484  9418 leader_election.cc:343] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.741906  9418 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:10.742702  9926 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:10.767580  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:10.771159  9566 tablet_bootstrap.cc:654] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.769313  9525 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.775024  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:10.777854  9572 tablet_bootstrap.cc:654] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.778249  9567 tablet_bootstrap.cc:654] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.782601  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:10.783569  9447 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:10.786203  9272 catalog_manager.cc:5697] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:10.791105  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:10.791762  9372 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:10.796114  9274 catalog_manager.cc:5697] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.798103  9492 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:10.800585  9895 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:10.801236  9895 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.801779  9895 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.797720  9274 catalog_manager.cc:5697] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.817966  9935 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:10.825713  9492 consensus_peers.cc:597] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:10.829998  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:10.813129  9418 leader_election.cc:343] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.832790  9418 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:10.839080  9834 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:10.845816  9418 leader_election.cc:343] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.881487  9567 tablet_bootstrap.cc:492] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:10.882051  9567 ts_tablet_manager.cc:1403] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.152s	user 0.038s	sys 0.014s
I20260709 13:02:10.886053  9567 raft_consensus.cc:359] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.886970  9567 raft_consensus.cc:385] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.887352  9567 raft_consensus.cc:740] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.888160  9567 consensus_queue.cc:260] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.889927  9566 tablet_bootstrap.cc:492] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:10.890347  9572 tablet_bootstrap.cc:492] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:10.890434  9566 ts_tablet_manager.cc:1403] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.188s	user 0.024s	sys 0.052s
I20260709 13:02:10.890967  9572 ts_tablet_manager.cc:1403] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.158s	user 0.020s	sys 0.010s
I20260709 13:02:10.890324  9567 ts_tablet_manager.cc:1434] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:02:10.895828  9567 tablet_bootstrap.cc:492] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:10.893927  9572 raft_consensus.cc:359] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.897449  9572 raft_consensus.cc:385] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.897778  9572 raft_consensus.cc:740] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.892246  9895 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:10.898912  9418 leader_election.cc:343] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.901579  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:10.902264  9368 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.895784  9566 raft_consensus.cc:359] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.903191  9566 raft_consensus.cc:385] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.903514  9566 raft_consensus.cc:740] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.904170  9566 consensus_queue.cc:260] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.906271  9566 ts_tablet_manager.cc:1434] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:02:10.901129  9418 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:10.907286  9834 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:10.908058  9937 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:10.909497  9567 tablet_bootstrap.cc:654] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.907301  9566 tablet_bootstrap.cc:492] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:10.898432  9572 consensus_queue.cc:260] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.930507  9572 ts_tablet_manager.cc:1434] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.002s
I20260709 13:02:10.940631  9572 tablet_bootstrap.cc:492] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:10.936264  9937 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:10.934669  9566 tablet_bootstrap.cc:654] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.955076  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:10.955664  9452 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.963039  9936 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:10.967444  9567 tablet_bootstrap.cc:492] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:10.967960  9567 ts_tablet_manager.cc:1403] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.000s
I20260709 13:02:10.970961  9567 raft_consensus.cc:359] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.990625  9567 raft_consensus.cc:385] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.991093  9567 raft_consensus.cc:740] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.991969  9567 consensus_queue.cc:260] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:10.993460  9941 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:10.988644  9274 catalog_manager.cc:5697] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 0 to 1, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:10.945111  9895 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:10.974198  9452 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:10.943250  9368 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:11.009091  9572 tablet_bootstrap.cc:654] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.028389  9490 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:11.038676  9942 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:11.039188  9942 raft_consensus.cc:697] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:11.039986  9942 consensus_queue.cc:237] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.030439  9567 ts_tablet_manager.cc:1434] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 13:02:11.044193  9567 tablet_bootstrap.cc:492] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:11.047755  9572 tablet_bootstrap.cc:492] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:11.048403  9572 ts_tablet_manager.cc:1403] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.108s	user 0.006s	sys 0.009s
I20260709 13:02:11.051287  9572 raft_consensus.cc:359] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.052290  9572 raft_consensus.cc:385] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.052635  9572 raft_consensus.cc:740] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.053319  9572 consensus_queue.cc:260] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.058135  9566 tablet_bootstrap.cc:492] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:11.059955  9566 ts_tablet_manager.cc:1403] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.153s	user 0.040s	sys 0.041s
I20260709 13:02:11.060479  9572 ts_tablet_manager.cc:1434] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
W20260709 13:02:11.064975  9343 consensus_peers.cc:597] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 -> Peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Couldn't send request to peer 6d50f1c263264b21919230bee398022b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:11.070287  9572 tablet_bootstrap.cc:492] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:11.074448  9567 tablet_bootstrap.cc:654] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.075008  9275 catalog_manager.cc:5697] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:11.077617  9323 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:11.108714  9566 raft_consensus.cc:359] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.109549  9566 raft_consensus.cc:385] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.109850  9566 raft_consensus.cc:740] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.110623  9566 consensus_queue.cc:260] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.112922  9566 ts_tablet_manager.cc:1434] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.000s
I20260709 13:02:11.112993  9937 consensus_queue.cc:1048] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:11.114104  9566 tablet_bootstrap.cc:492] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526: Bootstrap starting.
I20260709 13:02:11.123626  9567 tablet_bootstrap.cc:492] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:11.123206  9272 catalog_manager.cc:5697] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:11.124395  9567 ts_tablet_manager.cc:1403] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.080s	user 0.009s	sys 0.005s
I20260709 13:02:11.127240  9566 tablet_bootstrap.cc:654] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.139541  9567 raft_consensus.cc:359] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.142270  9567 raft_consensus.cc:385] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.142594  9567 raft_consensus.cc:740] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.143234  9567 consensus_queue.cc:260] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.145349  9567 ts_tablet_manager.cc:1434] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.005s
I20260709 13:02:11.146317  9567 tablet_bootstrap.cc:492] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:11.154934  9566 tablet_bootstrap.cc:492] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526: No bootstrap required, opened a new log
I20260709 13:02:11.155049  9572 tablet_bootstrap.cc:654] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.155629  9566 ts_tablet_manager.cc:1403] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.004s
I20260709 13:02:11.162648  9567 tablet_bootstrap.cc:654] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.162706  9937 consensus_queue.cc:1048] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:11.164461  9572 tablet_bootstrap.cc:492] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:11.164943  9572 ts_tablet_manager.cc:1403] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.101s	user 0.011s	sys 0.002s
I20260709 13:02:11.167964  9572 raft_consensus.cc:359] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.168613  9572 raft_consensus.cc:385] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.168908  9572 raft_consensus.cc:740] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.168694  9566 raft_consensus.cc:359] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.169534  9566 raft_consensus.cc:385] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.169842  9566 raft_consensus.cc:740] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.169673  9572 consensus_queue.cc:260] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.170466  9937 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.171825  9572 ts_tablet_manager.cc:1434] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:02:11.172785  9572 tablet_bootstrap.cc:492] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:11.171164  9937 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.182554  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:11.183223  9448 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:11.184196  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:11.187342  9341 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:11.170492  9566 consensus_queue.cc:260] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.189390  9566 ts_tablet_manager.cc:1434] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:02:11.191079  9601 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:11.191464  9601 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.191756  9601 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.195389  9572 tablet_bootstrap.cc:654] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.207032  9567 tablet_bootstrap.cc:492] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:11.207628  9567 ts_tablet_manager.cc:1403] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.004s
I20260709 13:02:11.210701  9567 raft_consensus.cc:359] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.211440  9567 raft_consensus.cc:385] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.211731  9567 raft_consensus.cc:740] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.212378  9567 consensus_queue.cc:260] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.216202  9567 ts_tablet_manager.cc:1434] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:02:11.218523  9567 tablet_bootstrap.cc:492] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:11.219810  9889 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.220312  9889 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.222026  9889 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:11.222095  9343 leader_election.cc:343] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.224650  9368 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.225179  9754 consensus_queue.cc:1048] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:11.235494  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:11.237260  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:11.237548  9937 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:11.237924  9447 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
W20260709 13:02:11.238432  9492 leader_election.cc:343] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.240140  9490 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:11.240724  9572 tablet_bootstrap.cc:492] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:11.242084  9572 ts_tablet_manager.cc:1403] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.000s
I20260709 13:02:11.243702  9371 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.250269  9889 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:11.250727  9889 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.251096  9889 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.260195  9889 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.261595  9523 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.264005  9567 tablet_bootstrap.cc:654] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.266142  9601 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.263439  9889 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:11.270689  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:11.271155  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:11.271401  9450 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.273712  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:11.274298  9452 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.265971  9572 raft_consensus.cc:359] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.282020  9941 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.277102  9572 raft_consensus.cc:385] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.283221  9572 raft_consensus.cc:740] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.280975  9450 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
W20260709 13:02:11.284222  9492 leader_election.cc:343] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.282524  9941 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.284644  9601 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:11.286262  9941 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:11.289947  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:11.289467  9572 consensus_queue.cc:260] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.292419  9572 ts_tablet_manager.cc:1434] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
W20260709 13:02:11.292627  9492 leader_election.cc:343] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.293411  9572 tablet_bootstrap.cc:492] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:11.296051  9452 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:11.296725  9490 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:11.296831  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:11.300482  9942 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:11.300737  9341 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:11.301038  9942 raft_consensus.cc:697] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:11.304967  9754 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:11.304662  9942 consensus_queue.cc:237] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.305598  9754 raft_consensus.cc:697] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:11.306689  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:11.306435  9754 consensus_queue.cc:237] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.307354  9452 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
W20260709 13:02:11.309657  9343 leader_election.cc:343] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.318405  9490 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:11.334487  9942 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:11.339541  9942 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.341534  9572 tablet_bootstrap.cc:654] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.339919  9942 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.416777  9620 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.417469  9620 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.434170  9620 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:11.455281  9939 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.473519  9939 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.475584  9567 tablet_bootstrap.cc:492] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:11.476132  9567 ts_tablet_manager.cc:1403] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.259s	user 0.021s	sys 0.034s
I20260709 13:02:11.482558  9942 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.483302  9274 catalog_manager.cc:5697] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:11.484347  9939 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:11.484601  9942 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:11.484719  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:11.488958  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:11.490309  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:11.500721  9368 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:11.493522  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:11.501446  9372 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:11.502194  9567 raft_consensus.cc:359] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.502938  9567 raft_consensus.cc:385] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:02:11.502532  9492 leader_election.cc:343] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.503240  9567 raft_consensus.cc:740] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.501663  9523 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:11.503690  9492 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:11.503975  9567 consensus_queue.cc:260] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.504621  9763 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:11.504976  9763 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.505335  9763 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.506834  9567 ts_tablet_manager.cc:1434] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.002s
I20260709 13:02:11.507859  9567 tablet_bootstrap.cc:492] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:11.513203  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:11.513682  9567 tablet_bootstrap.cc:654] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.513885  9447 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 0.
I20260709 13:02:11.516893  9763 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.513806  9418 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:11.520413  9575 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:11.520774  9575 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.521101  9575 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.526038  9572 tablet_bootstrap.cc:492] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:11.525681  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:11.526633  9447 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.527779  9572 ts_tablet_manager.cc:1403] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.235s	user 0.020s	sys 0.000s
I20260709 13:02:11.528720  9274 catalog_manager.cc:5697] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.530494  9572 raft_consensus.cc:359] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.531191  9572 raft_consensus.cc:385] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.531504  9572 raft_consensus.cc:740] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.532174  9572 consensus_queue.cc:260] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.536422  9447 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:11.536875  9572 ts_tablet_manager.cc:1434] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:02:11.539409  9575 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.541021  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:11.541625  9372 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.520141  9763 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:11.546427  9575 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:11.548324  9942 consensus_queue.cc:1048] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:11.553121  9942 consensus_queue.cc:1048] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:11.554035  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:11.556254  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:11.557044  9523 raft_consensus.cc:2393] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 1: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:11.558174  9567 tablet_bootstrap.cc:492] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:11.558650  9567 ts_tablet_manager.cc:1403] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.012s
I20260709 13:02:11.558709  9490 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:11.559566  9763 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:11.560141  9763 raft_consensus.cc:697] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:11.561261  9763 consensus_queue.cc:237] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.562430  9567 raft_consensus.cc:359] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.563164  9567 raft_consensus.cc:385] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.563418  9567 raft_consensus.cc:740] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.565450  9372 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:11.565608  9567 consensus_queue.cc:260] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.567178  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:11.567986  9447 raft_consensus.cc:2393] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 1: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:11.570359  9567 ts_tablet_manager.cc:1434] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:02:11.570261  9492 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:11.570612  9572 tablet_bootstrap.cc:492] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:11.571391  9567 tablet_bootstrap.cc:492] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:11.571457  9942 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:11.572052  9942 raft_consensus.cc:697] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:11.572872  9942 consensus_queue.cc:237] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.579492  9567 tablet_bootstrap.cc:654] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.579561  9941 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.580116  9941 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.586143  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:11.592243  9941 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:11.592967  9572 tablet_bootstrap.cc:654] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.596025  9567 tablet_bootstrap.cc:492] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:11.596459  9567 ts_tablet_manager.cc:1403] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.001s
I20260709 13:02:11.597110  9926 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.597584  9926 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.598994  9567 raft_consensus.cc:359] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.599639  9567 raft_consensus.cc:385] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.599882  9567 raft_consensus.cc:740] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.600880  9926 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:11.600549  9567 consensus_queue.cc:260] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.601794  9418 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:11.602571  9567 ts_tablet_manager.cc:1434] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
I20260709 13:02:11.602802  9575 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:11.603570  9567 tablet_bootstrap.cc:492] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:11.612401  9572 tablet_bootstrap.cc:492] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:11.612938  9572 ts_tablet_manager.cc:1403] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.000s
I20260709 13:02:11.613396  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:11.614111  9374 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 0.
I20260709 13:02:11.616065  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:11.619365  9567 tablet_bootstrap.cc:654] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.619236  9418 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:11.622553  9575 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:11.622891  9575 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.623229  9575 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.631561  9275 catalog_manager.cc:5697] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:11.632637  9572 raft_consensus.cc:359] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.637866  9572 raft_consensus.cc:385] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.638311  9572 raft_consensus.cc:740] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.639173  9572 consensus_queue.cc:260] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.641758  9572 ts_tablet_manager.cc:1434] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:02:11.643391  9572 tablet_bootstrap.cc:492] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:11.662318  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:11.663375  9447 raft_consensus.cc:2393] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 1: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
W20260709 13:02:11.674160  9418 leader_election.cc:343] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.656507  9575 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.678144  9490 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:11.679863  9889 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.692168  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:11.699847  9368 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.692866  9575 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:11.701628  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:11.693326  9567 tablet_bootstrap.cc:492] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:11.702535  9567 ts_tablet_manager.cc:1403] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.099s	user 0.039s	sys 0.017s
I20260709 13:02:11.697990  9572 tablet_bootstrap.cc:654] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:11.704613  9418 leader_election.cc:343] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.688992  9889 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:11.706231  9567 raft_consensus.cc:359] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.706899  9567 raft_consensus.cc:385] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.707307  9567 raft_consensus.cc:740] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.706879  9275 catalog_manager.cc:5697] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:11.708298  9567 consensus_queue.cc:260] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.709722  9992 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:11.710376  9567 ts_tablet_manager.cc:1434] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:11.711303  9567 tablet_bootstrap.cc:492] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947: Bootstrap starting.
I20260709 13:02:11.722298  9567 tablet_bootstrap.cc:654] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.734249  9601 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.734752  9601 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.738349  9601 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:11.738849  9992 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.738762  9368 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:11.742849  9992 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.743849  9572 tablet_bootstrap.cc:492] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:11.744055  9418 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:11.744302  9572 ts_tablet_manager.cc:1403] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.101s	user 0.021s	sys 0.011s
I20260709 13:02:11.744819  9575 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:11.740998  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:11.741458  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:11.745297  9575 raft_consensus.cc:697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:11.745416  9447 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:11.746059  9575 consensus_queue.cc:237] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.748180  9572 raft_consensus.cc:359] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.748512  9341 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:11.748899  9572 raft_consensus.cc:385] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.749215  9572 raft_consensus.cc:740] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.749528  9937 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:11.749899  9937 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.749869  9572 consensus_queue.cc:260] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.750311  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:11.752265  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:11.744925  9992 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:11.752981  9567 tablet_bootstrap.cc:492] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947: No bootstrap required, opened a new log
I20260709 13:02:11.753165  9448 raft_consensus.cc:2393] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 1: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:11.753501  9567 ts_tablet_manager.cc:1403] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.005s
I20260709 13:02:11.752518  9572 ts_tablet_manager.cc:1434] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:02:11.755627  9572 tablet_bootstrap.cc:492] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:11.756018  9567 raft_consensus.cc:359] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.756675  9567 raft_consensus.cc:385] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:02:11.759050  9343 leader_election.cc:343] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.759230  9368 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.756946  9567 raft_consensus.cc:740] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.750348  9937 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.765090  9572 tablet_bootstrap.cc:654] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.765156  9567 consensus_queue.cc:260] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.770105  9567 ts_tablet_manager.cc:1434] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:02:11.792649  9572 tablet_bootstrap.cc:492] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:11.793435  9572 ts_tablet_manager.cc:1403] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.006s
I20260709 13:02:11.796453  9572 raft_consensus.cc:359] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.797288  9572 raft_consensus.cc:385] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.799342  9572 raft_consensus.cc:740] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.800055  9572 consensus_queue.cc:260] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.809904  9343 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:11.810932  9936 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:11.811803  9942 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:11.816269  9572 ts_tablet_manager.cc:1434] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:02:11.817576  9572 tablet_bootstrap.cc:492] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b: Bootstrap starting.
I20260709 13:02:11.825853  9572 tablet_bootstrap.cc:654] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.827066  9935 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:11.830781  9937 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.836212  9942 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:11.840420  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:11.841035  9447 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.841897  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:11.842478  9523 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.832785  9937 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:11.846076  9572 tablet_bootstrap.cc:492] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b: No bootstrap required, opened a new log
I20260709 13:02:11.847049  9572 ts_tablet_manager.cc:1403] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.001s
I20260709 13:02:11.850021  9572 raft_consensus.cc:359] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.850770  9572 raft_consensus.cc:385] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.851105  9572 raft_consensus.cc:740] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.851926  9572 consensus_queue.cc:260] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.853489  9572 ts_tablet_manager.cc:1434] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:11.860129  9275 catalog_manager.cc:5697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 0 to 1, leader changed from <none> to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.869436  9989 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.869969  9989 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.870520  9523 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:11.871997  9989 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:11.873562  9343 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:11.874375  9990 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:11.874331  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:11.868795  9447 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:11.874998  9990 raft_consensus.cc:697] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:11.875360  9448 raft_consensus.cc:2393] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 1: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:11.875917  9990 consensus_queue.cc:237] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.877967  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:11.880537  9343 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:11.881343  9992 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.888563  9992 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:11.893884  9763 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.894604  9763 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.899029  9763 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:11.903754  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:11.909914  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:11.911950  9492 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:11.912886  9763 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:11.923218  9992 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.923727  9992 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.926676  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:11.927335  9447 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:11.930156  9341 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:11.931581  9992 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:11.932858  9992 raft_consensus.cc:2804] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:11.933261  9992 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.933601  9992 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.934921  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:11.935668  9526 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 0.
I20260709 13:02:11.941706  9992 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.944375  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:11.944954  9447 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.947309  9272 catalog_manager.cc:5697] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.952098  9447 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:11.953292  9341 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:11.953781  9992 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 1 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:11.953881  9990 raft_consensus.cc:2804] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:11.954542  9990 raft_consensus.cc:697] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:11.955451  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:11.956151  9526 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.955852  9990 consensus_queue.cc:237] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:11.963004  9526 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:11.970873  9272 catalog_manager.cc:5697] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.991123  9941 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:12.004092  9889 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:12.036481  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:12.044899 10015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:12.044970 10016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:12.056130 10018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:12.057931  8209 server_base.cc:1061] running on GCE node
I20260709 13:02:12.060338  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:12.060603  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:12.060832  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602132060806 us; error 0 us; skew 500 ppm
I20260709 13:02:12.061445  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:12.064636  8209 webserver.cc:533] Webserver started at http://127.8.4.68:34581/ using document root <none> and password file <none>
I20260709 13:02:12.065220  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:12.065449  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:12.065775  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:12.067194  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-3-root/instance:
uuid: "b0812463215649c3b011d36e2f0400c9"
format_stamp: "Formatted at 2026-07-09 13:02:12 on dist-test-slave-008w"
I20260709 13:02:12.073154  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:02:12.076736 10023 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:12.077658  8209 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:12.078049  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-3-root
uuid: "b0812463215649c3b011d36e2f0400c9"
format_stamp: "Formatted at 2026-07-09 13:02:12 on dist-test-slave-008w"
I20260709 13:02:12.078436  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:12.135360  9526 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.156920  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:12.157758  9889 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.158303  9889 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:12.158701  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:12.160377  9889 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:12.161284  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:12.162036  9371 raft_consensus.cc:2393] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 1: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:12.162770  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:12.167451  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:12.174968  9490 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:12.176250  9941 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.176574  9620 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:12.177779  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:12.178174  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:02:12.178574  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:12.178383  9889 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:12.179095  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:12.193892  9941 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:12.207405  9889 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:12.210386  9620 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:12.300361  9990 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:12.336174  9936 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:12.357774  9936 consensus_queue.cc:1048] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:12.407310  9937 consensus_queue.cc:1048] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:12.487069  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.68:43623
I20260709 13:02:12.487164 10094 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.68:43623 every 8 connection(s)
I20260709 13:02:12.492759  8209 auto_leader_rebalancer-test.cc:384] add a tserver: b0812463215649c3b011d36e2f0400c9
I20260709 13:02:12.512156 10095 heartbeater.cc:344] Connected to a master server at 127.8.4.126:34725
I20260709 13:02:12.512672 10095 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:12.513499 10095 heartbeater.cc:507] Master 127.8.4.126:34725 requested a full tablet report, sending...
I20260709 13:02:12.515645  9275 ts_manager.cc:194] Registered new tserver with Master: b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:12.517577  9275 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51440
I20260709 13:02:13.229491  9371 consensus_queue.cc:237] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:13.237684  9526 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:13.238000  9447 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:13.238940  9936 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:13.239809  9937 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:13.262029  9342 consensus_peers.cc:597] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a326e6d2c4664dbe9374e92fa4c42c93. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:13.268663  9936 raft_consensus.cc:2955] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:13.274338  9447 raft_consensus.cc:2955] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:13.277312  9524 raft_consensus.cc:2955] T a326e6d2c4664dbe9374e92fa4c42c93 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:13.299886  9371 consensus_queue.cc:237] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:13.315793  9275 catalog_manager.cc:5697] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:13.353471  9342 consensus_peers.cc:597] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f70a11c5ae574b43ab50a91cfb6e293c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:13.355682  9447 raft_consensus.cc:1275] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:13.360919  9524 raft_consensus.cc:1275] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:13.362586  9990 consensus_queue.cc:1048] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:13.366339 10107 consensus_queue.cc:1048] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:13.380774 10107 raft_consensus.cc:2955] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:13.392949  9526 raft_consensus.cc:2955] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:13.402685  9447 raft_consensus.cc:2955] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:13.429548  9273 catalog_manager.cc:5697] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b reported cstate change: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:13.428555  9448 consensus_queue.cc:237] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:13.455262  9371 raft_consensus.cc:1275] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:13.455377  9523 raft_consensus.cc:1275] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:13.456683  9575 consensus_queue.cc:1048] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:13.458010  9926 consensus_queue.cc:1048] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:13.466238 10106 raft_consensus.cc:2955] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:13.467573  9371 raft_consensus.cc:2955] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
W20260709 13:02:13.473229  9417 consensus_peers.cc:597] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 895d29bbb65c4b67a479a2dc2f3cbb83. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:13.482362  9523 raft_consensus.cc:2955] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:13.484182  9275 catalog_manager.cc:5697] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:13.488900  9374 consensus_queue.cc:237] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:13.497220  9523 raft_consensus.cc:1275] T f7b2e1b1ef6540b1915f1dda8f95e81b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:13.499621  9990 consensus_queue.cc:1048] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:13.503154  9342 consensus_peers.cc:597] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f7b2e1b1ef6540b1915f1dda8f95e81b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:13.503625  9448 raft_consensus.cc:1275] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:13.505218  9990 consensus_queue.cc:1048] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:13.517596 10107 raft_consensus.cc:2955] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:13.520260 10095 heartbeater.cc:499] Master 127.8.4.126:34725 was elected leader, sending a full tablet report...
I20260709 13:02:13.519845  9523 raft_consensus.cc:2955] T f7b2e1b1ef6540b1915f1dda8f95e81b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:13.523180  9448 raft_consensus.cc:2955] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:13.539986  9272 catalog_manager.cc:5697] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:13.819165 10126 ts_tablet_manager.cc:933] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
I20260709 13:02:13.825799 10126 tablet_copy_client.cc:323] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.65:37547
I20260709 13:02:13.838990  9387 tablet_copy_service.cc:140] P 925acbe78db14db3b9e4cfc857717947: Received BeginTabletCopySession request for tablet a326e6d2c4664dbe9374e92fa4c42c93 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:50568)
I20260709 13:02:13.839643  9387 tablet_copy_service.cc:161] P 925acbe78db14db3b9e4cfc857717947: Beginning new tablet copy session on tablet a326e6d2c4664dbe9374e92fa4c42c93 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:50568: session id = b0812463215649c3b011d36e2f0400c9-a326e6d2c4664dbe9374e92fa4c42c93
I20260709 13:02:13.849313  9387 tablet_copy_source_session.cc:215] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:13.857558 10126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a326e6d2c4664dbe9374e92fa4c42c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.879110 10130 ts_tablet_manager.cc:933] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
I20260709 13:02:13.889088 10130 tablet_copy_client.cc:323] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.65:37547
I20260709 13:02:13.893347 10126 tablet_copy_client.cc:806] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:13.894091 10126 tablet_copy_client.cc:670] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:13.896510  9387 tablet_copy_service.cc:140] P 925acbe78db14db3b9e4cfc857717947: Received BeginTabletCopySession request for tablet f7b2e1b1ef6540b1915f1dda8f95e81b from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:50568)
I20260709 13:02:13.897135  9387 tablet_copy_service.cc:161] P 925acbe78db14db3b9e4cfc857717947: Beginning new tablet copy session on tablet f7b2e1b1ef6540b1915f1dda8f95e81b from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:50568: session id = b0812463215649c3b011d36e2f0400c9-f7b2e1b1ef6540b1915f1dda8f95e81b
I20260709 13:02:13.907554 10126 tablet_copy_client.cc:538] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:13.912334  9387 tablet_copy_source_session.cc:215] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:13.917702 10126 tablet_bootstrap.cc:492] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:02:13.918332 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b2e1b1ef6540b1915f1dda8f95e81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.933358 10132 ts_tablet_manager.cc:933] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
I20260709 13:02:13.938175 10132 tablet_copy_client.cc:323] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.65:37547
I20260709 13:02:13.940623  9387 tablet_copy_service.cc:140] P 925acbe78db14db3b9e4cfc857717947: Received BeginTabletCopySession request for tablet f70a11c5ae574b43ab50a91cfb6e293c from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:50568)
I20260709 13:02:13.941740  9387 tablet_copy_service.cc:161] P 925acbe78db14db3b9e4cfc857717947: Beginning new tablet copy session on tablet f70a11c5ae574b43ab50a91cfb6e293c from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:50568: session id = b0812463215649c3b011d36e2f0400c9-f70a11c5ae574b43ab50a91cfb6e293c
I20260709 13:02:13.958381  9387 tablet_copy_source_session.cc:215] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:13.961800 10132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f70a11c5ae574b43ab50a91cfb6e293c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.963667 10130 tablet_copy_client.cc:806] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:13.964342 10130 tablet_copy_client.cc:670] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:13.985775 10126 tablet_bootstrap.cc:492] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:13.986138 10130 tablet_copy_client.cc:538] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:13.986819 10126 tablet_bootstrap.cc:492] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:02:13.987568 10126 ts_tablet_manager.cc:1403] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.070s	user 0.018s	sys 0.012s
I20260709 13:02:13.990831 10126 raft_consensus.cc:359] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:13.991711 10126 raft_consensus.cc:740] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:02:13.992388 10126 consensus_queue.cc:260] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:13.996090 10132 tablet_copy_client.cc:806] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:13.996745 10132 tablet_copy_client.cc:670] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:14.002442 10130 tablet_bootstrap.cc:492] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:02:14.008051 10132 tablet_copy_client.cc:538] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:14.009325 10126 ts_tablet_manager.cc:1434] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.014s
I20260709 13:02:14.013384  9387 tablet_copy_service.cc:342] P 925acbe78db14db3b9e4cfc857717947: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-a326e6d2c4664dbe9374e92fa4c42c93 received from {username='slave'} at 127.0.0.1:50568
I20260709 13:02:14.013913  9387 tablet_copy_service.cc:434] P 925acbe78db14db3b9e4cfc857717947: ending tablet copy session b0812463215649c3b011d36e2f0400c9-a326e6d2c4664dbe9374e92fa4c42c93 on tablet a326e6d2c4664dbe9374e92fa4c42c93 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:02:14.018878 10132 tablet_bootstrap.cc:492] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:02:14.043869 10130 tablet_bootstrap.cc:492] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:14.044870 10130 tablet_bootstrap.cc:492] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:02:14.045704 10130 ts_tablet_manager.cc:1403] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.043s	user 0.020s	sys 0.007s
I20260709 13:02:14.052486 10130 raft_consensus.cc:359] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:14.053507 10130 raft_consensus.cc:740] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:02:14.054698 10126 ts_tablet_manager.cc:933] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:14.054236 10130 consensus_queue.cc:260] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:14.057238 10126 tablet_copy_client.cc:323] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.66:45279
I20260709 13:02:14.058112 10132 tablet_bootstrap.cc:492] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:14.059105 10132 tablet_bootstrap.cc:492] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:02:14.059850 10132 ts_tablet_manager.cc:1403] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.011s
I20260709 13:02:14.063244 10132 raft_consensus.cc:359] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:14.064180 10132 raft_consensus.cc:740] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:02:14.064708 10130 ts_tablet_manager.cc:1434] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.004s
I20260709 13:02:14.064895 10132 consensus_queue.cc:260] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:14.066744  9387 tablet_copy_service.cc:342] P 925acbe78db14db3b9e4cfc857717947: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-f7b2e1b1ef6540b1915f1dda8f95e81b received from {username='slave'} at 127.0.0.1:50568
I20260709 13:02:14.067231  9387 tablet_copy_service.cc:434] P 925acbe78db14db3b9e4cfc857717947: ending tablet copy session b0812463215649c3b011d36e2f0400c9-f7b2e1b1ef6540b1915f1dda8f95e81b on tablet f7b2e1b1ef6540b1915f1dda8f95e81b with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:02:14.068063 10132 ts_tablet_manager.cc:1434] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 13:02:14.070156  9387 tablet_copy_service.cc:342] P 925acbe78db14db3b9e4cfc857717947: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-f70a11c5ae574b43ab50a91cfb6e293c received from {username='slave'} at 127.0.0.1:50568
I20260709 13:02:14.070619  9387 tablet_copy_service.cc:434] P 925acbe78db14db3b9e4cfc857717947: ending tablet copy session b0812463215649c3b011d36e2f0400c9-f70a11c5ae574b43ab50a91cfb6e293c on tablet f70a11c5ae574b43ab50a91cfb6e293c with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:02:14.090759  9462 tablet_copy_service.cc:140] P d62c9d5a052b42ce8675f8438f846526: Received BeginTabletCopySession request for tablet 895d29bbb65c4b67a479a2dc2f3cbb83 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:45366)
I20260709 13:02:14.091456  9462 tablet_copy_service.cc:161] P d62c9d5a052b42ce8675f8438f846526: Beginning new tablet copy session on tablet 895d29bbb65c4b67a479a2dc2f3cbb83 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:45366: session id = b0812463215649c3b011d36e2f0400c9-895d29bbb65c4b67a479a2dc2f3cbb83
I20260709 13:02:14.100950  9462 tablet_copy_source_session.cc:215] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:14.104027 10126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 895d29bbb65c4b67a479a2dc2f3cbb83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.117660 10126 tablet_copy_client.cc:806] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:14.118234 10126 tablet_copy_client.cc:670] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:14.129853 10126 tablet_copy_client.cc:538] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:14.140899 10126 tablet_bootstrap.cc:492] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:02:14.160893 10126 tablet_bootstrap.cc:492] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:14.161803 10126 tablet_bootstrap.cc:492] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:02:14.162464 10126 ts_tablet_manager.cc:1403] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.005s
I20260709 13:02:14.165568 10126 raft_consensus.cc:359] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:14.166342 10126 raft_consensus.cc:740] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:02:14.167028 10126 consensus_queue.cc:260] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:14.169741 10126 ts_tablet_manager.cc:1434] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:02:14.173264  9462 tablet_copy_service.cc:342] P d62c9d5a052b42ce8675f8438f846526: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-895d29bbb65c4b67a479a2dc2f3cbb83 received from {username='slave'} at 127.0.0.1:45366
I20260709 13:02:14.173719  9462 tablet_copy_service.cc:434] P d62c9d5a052b42ce8675f8438f846526: ending tablet copy session b0812463215649c3b011d36e2f0400c9-895d29bbb65c4b67a479a2dc2f3cbb83 on tablet 895d29bbb65c4b67a479a2dc2f3cbb83 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:02:14.310241 10070 raft_consensus.cc:1217] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:14.350104 10070 raft_consensus.cc:1217] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:14.384318 10070 raft_consensus.cc:1217] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:14.649098 10070 raft_consensus.cc:1217] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:14.827097 10142 raft_consensus.cc:1064] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:02:14.829900 10142 consensus_queue.cc:237] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:14.838327  9990 raft_consensus.cc:1064] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:02:14.841409  9990 consensus_queue.cc:237] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:14.846258 10070 raft_consensus.cc:1275] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:14.847316  9526 raft_consensus.cc:1275] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:14.849164 10107 consensus_queue.cc:1048] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:14.856940 10107 consensus_queue.cc:1048] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:14.880445 10142 raft_consensus.cc:1064] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:02:14.880326 10070 raft_consensus.cc:1275] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:14.883375 10142 consensus_queue.cc:237] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:14.886950  9447 raft_consensus.cc:1275] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:14.890429 10146 consensus_queue.cc:1048] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:14.895017  9447 raft_consensus.cc:1275] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:14.924122 10069 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:14.926456 10146 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:14.936147 10142 consensus_queue.cc:1048] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:14.944630 10151 consensus_queue.cc:1048] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:02:14.947127  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 75434us
I20260709 13:02:14.949087  9447 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:14.949265  9523 raft_consensus.cc:1275] T f7b2e1b1ef6540b1915f1dda8f95e81b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:14.949702  9524 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:14.956907 10107 consensus_queue.cc:1048] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:14.957051 10146 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:14.986680 10146 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:14.993202  9524 raft_consensus.cc:2955] T f7b2e1b1ef6540b1915f1dda8f95e81b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:14.997859  9449 raft_consensus.cc:2955] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:14.991096 10151 raft_consensus.cc:2955] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.020890  9990 raft_consensus.cc:2955] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.026913  9275 catalog_manager.cc:5697] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.029053 10142 raft_consensus.cc:2955] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.030360  9525 raft_consensus.cc:2955] T a326e6d2c4664dbe9374e92fa4c42c93 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.036407 10069 raft_consensus.cc:2955] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.026386  9526 raft_consensus.cc:2955] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.053823  9273 catalog_manager.cc:5697] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.060039  9447 raft_consensus.cc:2955] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.065548  9448 raft_consensus.cc:2955] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.080137  9274 catalog_manager.cc:5697] T a326e6d2c4664dbe9374e92fa4c42c93 P 6d50f1c263264b21919230bee398022b reported cstate change: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.085165 10070 raft_consensus.cc:2955] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.081717 10069 raft_consensus.cc:2955] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.120117  9371 consensus_queue.cc:237] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:15.131493 10069 raft_consensus.cc:1275] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:15.134855  9990 consensus_queue.cc:1048] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:15.138854  9524 raft_consensus.cc:1275] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:15.141543 10146 consensus_queue.cc:1048] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:15.142848 10151 raft_consensus.cc:2955] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.147333  9371 consensus_queue.cc:237] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:15.152818  9448 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:15.152980  9524 raft_consensus.cc:2955] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.154980 10150 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:15.156800  9371 consensus_queue.cc:237] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:15.157308 10069 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:15.157461 10070 raft_consensus.cc:2955] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.159933 10145 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:15.164289 10068 raft_consensus.cc:1275] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:15.166385  9449 raft_consensus.cc:1275] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:15.171988 10145 consensus_queue.cc:1048] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:15.174427 10142 raft_consensus.cc:2955] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.182363 10150 consensus_queue.cc:1048] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:15.186213  9447 raft_consensus.cc:2955] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.189697  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f70a11c5ae574b43ab50a91cfb6e293c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:15.194548  9274 catalog_manager.cc:5697] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b reported cstate change: config changed from index 3 to 4, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.194751 10067 raft_consensus.cc:2955] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.201560  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a326e6d2c4664dbe9374e92fa4c42c93 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:15.219307  9575 raft_consensus.cc:1064] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:02:15.218776 10142 raft_consensus.cc:2955] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.221477  9575 consensus_queue.cc:237] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:15.221501  9449 raft_consensus.cc:2955] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.235855  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f7b2e1b1ef6540b1915f1dda8f95e81b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:15.224874 10069 raft_consensus.cc:2955] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.270308  9272 catalog_manager.cc:5697] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index 3 to 4, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.272401  9371 raft_consensus.cc:1275] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:15.276532  9526 raft_consensus.cc:1275] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:15.281035 10143 consensus_queue.cc:1048] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:15.282814  9575 consensus_queue.cc:1048] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:15.300426  9435 tablet_service.cc:1558] Processing DeleteTablet for tablet f70a11c5ae574b43ab50a91cfb6e293c with delete_type TABLET_DATA_TOMBSTONED (TS d62c9d5a052b42ce8675f8438f846526 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51006
I20260709 13:02:15.301728 10067 raft_consensus.cc:1275] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:15.325326  9508 tablet_service.cc:1558] Processing DeleteTablet for tablet a326e6d2c4664dbe9374e92fa4c42c93 with delete_type TABLET_DATA_TOMBSTONED (TS 6d50f1c263264b21919230bee398022b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46892
I20260709 13:02:15.330155 10167 consensus_queue.cc:1048] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:15.360697  9275 catalog_manager.cc:5697] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index 3 to 4, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:02:15.367097  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 47881us
I20260709 13:02:15.389542  9516 tablet_service.cc:1558] Processing DeleteTablet for tablet f7b2e1b1ef6540b1915f1dda8f95e81b with delete_type TABLET_DATA_TOMBSTONED (TS 6d50f1c263264b21919230bee398022b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46892
I20260709 13:02:15.417471 10173 tablet_replica.cc:333] T a326e6d2c4664dbe9374e92fa4c42c93 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:02:15.418503 10173 raft_consensus.cc:2243] T a326e6d2c4664dbe9374e92fa4c42c93 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:15.419250 10173 raft_consensus.cc:2272] T a326e6d2c4664dbe9374e92fa4c42c93 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:15.421579 10170 tablet_replica.cc:333] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:02:15.426350 10143 raft_consensus.cc:2955] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.430967 10173 ts_tablet_manager.cc:1916] T a326e6d2c4664dbe9374e92fa4c42c93 P 6d50f1c263264b21919230bee398022b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:15.433187 10067 raft_consensus.cc:2955] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.443392  9525 raft_consensus.cc:2955] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.444753  9371 raft_consensus.cc:2955] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.450834  9275 catalog_manager.cc:5697] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.460933 10170 raft_consensus.cc:2243] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:15.461826 10170 raft_consensus.cc:2272] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:15.465925 10170 ts_tablet_manager.cc:1916] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:15.476675 10173 ts_tablet_manager.cc:1929] T a326e6d2c4664dbe9374e92fa4c42c93 P 6d50f1c263264b21919230bee398022b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:15.477317 10173 log.cc:1199] T a326e6d2c4664dbe9374e92fa4c42c93 P 6d50f1c263264b21919230bee398022b: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-2-root/wals/a326e6d2c4664dbe9374e92fa4c42c93
I20260709 13:02:15.479243 10173 tablet_replica.cc:333] T f7b2e1b1ef6540b1915f1dda8f95e81b P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:02:15.481215  9262 catalog_manager.cc:5028] TS 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): tablet a326e6d2c4664dbe9374e92fa4c42c93 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:02:15.482837 10173 raft_consensus.cc:2243] T f7b2e1b1ef6540b1915f1dda8f95e81b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:15.485054 10173 raft_consensus.cc:2272] T f7b2e1b1ef6540b1915f1dda8f95e81b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:15.490126 10173 ts_tablet_manager.cc:1916] T f7b2e1b1ef6540b1915f1dda8f95e81b P 6d50f1c263264b21919230bee398022b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:15.489781  9452 consensus_queue.cc:237] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:15.505960 10067 raft_consensus.cc:1275] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:15.508189  9526 raft_consensus.cc:1275] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:15.510347 10170 ts_tablet_manager.cc:1929] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:15.510175  9926 consensus_queue.cc:1048] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:15.511929  9575 consensus_queue.cc:1048] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:15.515156 10170 log.cc:1199] T f70a11c5ae574b43ab50a91cfb6e293c P d62c9d5a052b42ce8675f8438f846526: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-1-root/wals/f70a11c5ae574b43ab50a91cfb6e293c
I20260709 13:02:15.516767 10173 ts_tablet_manager.cc:1929] T f7b2e1b1ef6540b1915f1dda8f95e81b P 6d50f1c263264b21919230bee398022b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:15.517274 10173 log.cc:1199] T f7b2e1b1ef6540b1915f1dda8f95e81b P 6d50f1c263264b21919230bee398022b: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-2-root/wals/f7b2e1b1ef6540b1915f1dda8f95e81b
I20260709 13:02:15.517431  9260 catalog_manager.cc:5028] TS d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): tablet f70a11c5ae574b43ab50a91cfb6e293c (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:02:15.519776  9262 catalog_manager.cc:5028] TS 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): tablet f7b2e1b1ef6540b1915f1dda8f95e81b (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:02:15.522872 10143 raft_consensus.cc:2955] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.524791 10067 raft_consensus.cc:2955] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.524319  9526 raft_consensus.cc:2955] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.533247  9260 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 895d29bbb65c4b67a479a2dc2f3cbb83 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:15.540890  9275 catalog_manager.cc:5697] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 3 to 4, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:15.553186  9359 tablet_service.cc:1558] Processing DeleteTablet for tablet 895d29bbb65c4b67a479a2dc2f3cbb83 with delete_type TABLET_DATA_TOMBSTONED (TS 925acbe78db14db3b9e4cfc857717947 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52546
I20260709 13:02:15.562817 10175 tablet_replica.cc:333] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:02:15.564024 10175 raft_consensus.cc:2243] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:15.564736 10175 raft_consensus.cc:2272] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:15.567862 10175 ts_tablet_manager.cc:1916] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:15.581900 10175 ts_tablet_manager.cc:1929] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:15.582346 10175 log.cc:1199] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 925acbe78db14db3b9e4cfc857717947: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-0-root/wals/895d29bbb65c4b67a479a2dc2f3cbb83
I20260709 13:02:15.584327  9262 catalog_manager.cc:5028] TS 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): tablet 895d29bbb65c4b67a479a2dc2f3cbb83 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:02:16.688998  9525 consensus_queue.cc:237] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:16.703580  9447 raft_consensus.cc:1275] T 9c4c96d6eb2446529db451af4486b758 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:16.703862  9371 raft_consensus.cc:1275] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:16.705312 10181 consensus_queue.cc:1048] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:16.711232 10141 consensus_queue.cc:1048] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:16.744169 10181 raft_consensus.cc:2955] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:16.746495  9371 raft_consensus.cc:2955] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:16.746500  9447 raft_consensus.cc:2955] T 9c4c96d6eb2446529db451af4486b758 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
W20260709 13:02:16.749840  9491 consensus_peers.cc:597] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9c4c96d6eb2446529db451af4486b758. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:16.768656  9272 catalog_manager.cc:5697] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:16.769688  9526 consensus_queue.cc:237] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
W20260709 13:02:16.782819  9491 consensus_peers.cc:597] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a81c17774a484973a3b82a63d2a33ff0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:16.783403  9452 raft_consensus.cc:1275] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:16.785233  9374 raft_consensus.cc:1275] T a81c17774a484973a3b82a63d2a33ff0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:16.785046 10189 consensus_queue.cc:1048] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:16.786576 10141 consensus_queue.cc:1048] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:16.798696 10181 raft_consensus.cc:2955] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:16.800320  9374 raft_consensus.cc:2955] T a81c17774a484973a3b82a63d2a33ff0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:16.812173  9452 raft_consensus.cc:2955] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:16.819741  9368 consensus_queue.cc:237] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:16.832295  9452 raft_consensus.cc:1275] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:02:16.833227  9342 consensus_peers.cc:597] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6e8f1f59b3d149e09a5d394c216144b9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:16.834128  9990 consensus_queue.cc:1048] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:16.836942  9526 raft_consensus.cc:1275] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:16.836386  9275 catalog_manager.cc:5697] T a81c17774a484973a3b82a63d2a33ff0 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:16.841521  9990 consensus_queue.cc:1048] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:16.845582 10179 raft_consensus.cc:2955] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:16.856308  9447 raft_consensus.cc:2955] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:16.869925  9524 raft_consensus.cc:2955] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:16.875608  9275 catalog_manager.cc:5697] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:16.878314  9525 consensus_queue.cc:237] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
W20260709 13:02:16.894951  9491 consensus_peers.cc:597] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83531d29bc754f95b7c86cb864a9e096. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:16.899533  9374 raft_consensus.cc:1275] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:16.903021 10189 consensus_queue.cc:1048] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:16.906289  9447 raft_consensus.cc:1275] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:16.915129 10189 consensus_queue.cc:1048] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:16.927881 10189 raft_consensus.cc:2955] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:16.931733  9368 raft_consensus.cc:2955] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:16.945996  9452 raft_consensus.cc:2955] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:16.960780  9272 catalog_manager.cc:5697] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b reported cstate change: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:17.251870 10205 ts_tablet_manager.cc:933] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:17.256071 10205 tablet_copy_client.cc:323] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.67:35929
I20260709 13:02:17.294296 10210 ts_tablet_manager.cc:933] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
I20260709 13:02:17.327953 10207 ts_tablet_manager.cc:933] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:17.334013 10210 tablet_copy_client.cc:323] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.65:37547
I20260709 13:02:17.337730  9387 tablet_copy_service.cc:140] P 925acbe78db14db3b9e4cfc857717947: Received BeginTabletCopySession request for tablet 6e8f1f59b3d149e09a5d394c216144b9 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:50568)
I20260709 13:02:17.338351  9387 tablet_copy_service.cc:161] P 925acbe78db14db3b9e4cfc857717947: Beginning new tablet copy session on tablet 6e8f1f59b3d149e09a5d394c216144b9 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:50568: session id = b0812463215649c3b011d36e2f0400c9-6e8f1f59b3d149e09a5d394c216144b9
I20260709 13:02:17.345660  9387 tablet_copy_source_session.cc:215] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:17.346751 10207 tablet_copy_client.cc:323] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.67:35929
I20260709 13:02:17.349123  9536 tablet_copy_service.cc:140] P 6d50f1c263264b21919230bee398022b: Received BeginTabletCopySession request for tablet a81c17774a484973a3b82a63d2a33ff0 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:52502)
I20260709 13:02:17.349395  9535 tablet_copy_service.cc:140] P 6d50f1c263264b21919230bee398022b: Received BeginTabletCopySession request for tablet 9c4c96d6eb2446529db451af4486b758 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:52502)
I20260709 13:02:17.349819  9536 tablet_copy_service.cc:161] P 6d50f1c263264b21919230bee398022b: Beginning new tablet copy session on tablet a81c17774a484973a3b82a63d2a33ff0 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:52502: session id = b0812463215649c3b011d36e2f0400c9-a81c17774a484973a3b82a63d2a33ff0
I20260709 13:02:17.350600 10210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e8f1f59b3d149e09a5d394c216144b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.350543  9535 tablet_copy_service.cc:161] P 6d50f1c263264b21919230bee398022b: Beginning new tablet copy session on tablet 9c4c96d6eb2446529db451af4486b758 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:52502: session id = b0812463215649c3b011d36e2f0400c9-9c4c96d6eb2446529db451af4486b758
I20260709 13:02:17.358716  9535 tablet_copy_source_session.cc:215] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:17.364943  9536 tablet_copy_source_session.cc:215] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:17.366732 10207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4c96d6eb2446529db451af4486b758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.368746 10205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a81c17774a484973a3b82a63d2a33ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.386790 10210 tablet_copy_client.cc:806] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:17.386930 10207 tablet_copy_client.cc:806] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:17.388833 10207 tablet_copy_client.cc:670] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:17.388140 10213 ts_tablet_manager.cc:933] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:17.391528 10210 tablet_copy_client.cc:670] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:17.397982 10210 tablet_copy_client.cc:538] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:17.414167 10205 tablet_copy_client.cc:806] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:17.416013 10205 tablet_copy_client.cc:670] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:17.420940 10210 tablet_bootstrap.cc:492] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:02:17.422174 10213 tablet_copy_client.cc:323] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.67:35929
I20260709 13:02:17.424559  9535 tablet_copy_service.cc:140] P 6d50f1c263264b21919230bee398022b: Received BeginTabletCopySession request for tablet 83531d29bc754f95b7c86cb864a9e096 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:52502)
I20260709 13:02:17.425155  9535 tablet_copy_service.cc:161] P 6d50f1c263264b21919230bee398022b: Beginning new tablet copy session on tablet 83531d29bc754f95b7c86cb864a9e096 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:52502: session id = b0812463215649c3b011d36e2f0400c9-83531d29bc754f95b7c86cb864a9e096
I20260709 13:02:17.426045 10205 tablet_copy_client.cc:538] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:17.432942  9535 tablet_copy_source_session.cc:215] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:17.438627 10207 tablet_copy_client.cc:538] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:17.452330 10213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83531d29bc754f95b7c86cb864a9e096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:17.476094 10207 tablet_bootstrap.cc:492] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:02:17.478518 10205 tablet_bootstrap.cc:492] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:02:17.481071 10210 tablet_bootstrap.cc:492] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:17.482163 10210 tablet_bootstrap.cc:492] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:02:17.482908 10210 ts_tablet_manager.cc:1403] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.062s	user 0.019s	sys 0.012s
I20260709 13:02:17.489518 10210 raft_consensus.cc:359] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:17.490471 10210 raft_consensus.cc:740] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:02:17.508787 10210 consensus_queue.cc:260] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:17.528086 10213 tablet_copy_client.cc:806] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:17.528891 10213 tablet_copy_client.cc:670] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:17.534395 10210 ts_tablet_manager.cc:1434] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.003s
I20260709 13:02:17.536861 10213 tablet_copy_client.cc:538] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:17.537418  9387 tablet_copy_service.cc:342] P 925acbe78db14db3b9e4cfc857717947: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-6e8f1f59b3d149e09a5d394c216144b9 received from {username='slave'} at 127.0.0.1:50568
I20260709 13:02:17.538187  9387 tablet_copy_service.cc:434] P 925acbe78db14db3b9e4cfc857717947: ending tablet copy session b0812463215649c3b011d36e2f0400c9-6e8f1f59b3d149e09a5d394c216144b9 on tablet 6e8f1f59b3d149e09a5d394c216144b9 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:02:17.546669 10213 tablet_bootstrap.cc:492] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:02:17.556524 10205 tablet_bootstrap.cc:492] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:17.557616 10205 tablet_bootstrap.cc:492] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:02:17.558316 10205 ts_tablet_manager.cc:1403] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.080s	user 0.017s	sys 0.019s
I20260709 13:02:17.561746 10205 raft_consensus.cc:359] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:17.562629 10205 raft_consensus.cc:740] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:02:17.563298 10205 consensus_queue.cc:260] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:17.576048 10205 ts_tablet_manager.cc:1434] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:02:17.588866  9535 tablet_copy_service.cc:342] P 6d50f1c263264b21919230bee398022b: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-a81c17774a484973a3b82a63d2a33ff0 received from {username='slave'} at 127.0.0.1:52502
I20260709 13:02:17.589452  9535 tablet_copy_service.cc:434] P 6d50f1c263264b21919230bee398022b: ending tablet copy session b0812463215649c3b011d36e2f0400c9-a81c17774a484973a3b82a63d2a33ff0 on tablet a81c17774a484973a3b82a63d2a33ff0 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:02:17.591967 10207 tablet_bootstrap.cc:492] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:17.593060 10207 tablet_bootstrap.cc:492] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:02:17.593835 10207 ts_tablet_manager.cc:1403] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.118s	user 0.022s	sys 0.029s
I20260709 13:02:17.596321 10213 tablet_bootstrap.cc:492] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:17.597187 10213 tablet_bootstrap.cc:492] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:02:17.597085 10207 raft_consensus.cc:359] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:17.597883 10213 ts_tablet_manager.cc:1403] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.051s	user 0.032s	sys 0.013s
I20260709 13:02:17.598065 10207 raft_consensus.cc:740] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:02:17.600889 10213 raft_consensus.cc:359] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:17.601764 10213 raft_consensus.cc:740] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:02:17.598753 10207 consensus_queue.cc:260] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:17.605162 10207 ts_tablet_manager.cc:1434] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:02:17.602401 10213 consensus_queue.cc:260] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:17.607014  9535 tablet_copy_service.cc:342] P 6d50f1c263264b21919230bee398022b: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-9c4c96d6eb2446529db451af4486b758 received from {username='slave'} at 127.0.0.1:52502
I20260709 13:02:17.607417  9535 tablet_copy_service.cc:434] P 6d50f1c263264b21919230bee398022b: ending tablet copy session b0812463215649c3b011d36e2f0400c9-9c4c96d6eb2446529db451af4486b758 on tablet 9c4c96d6eb2446529db451af4486b758 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:02:17.620819 10213 ts_tablet_manager.cc:1434] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:02:17.623975  9535 tablet_copy_service.cc:342] P 6d50f1c263264b21919230bee398022b: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-83531d29bc754f95b7c86cb864a9e096 received from {username='slave'} at 127.0.0.1:52502
I20260709 13:02:17.624428  9535 tablet_copy_service.cc:434] P 6d50f1c263264b21919230bee398022b: ending tablet copy session b0812463215649c3b011d36e2f0400c9-83531d29bc754f95b7c86cb864a9e096 on tablet 83531d29bc754f95b7c86cb864a9e096 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:02:17.709681 10067 raft_consensus.cc:1217] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:17.781198 10067 raft_consensus.cc:1217] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:17.841610 10067 raft_consensus.cc:1217] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:17.846413 10067 raft_consensus.cc:1217] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:18.099606 10179 raft_consensus.cc:1064] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:02:18.102264 10179 consensus_queue.cc:237] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:18.112790 10067 raft_consensus.cc:1275] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:18.114027  9524 raft_consensus.cc:1275] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:18.114478 10179 consensus_queue.cc:1048] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:18.115464  9448 raft_consensus.cc:1275] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:18.116820 10201 consensus_queue.cc:1048] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:18.117687 10216 consensus_queue.cc:1048] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:18.135126 10201 raft_consensus.cc:2955] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.141144  9524 raft_consensus.cc:2955] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.149739  9448 raft_consensus.cc:2955] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.159889  9274 catalog_manager.cc:5697] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b reported cstate change: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.173251 10067 raft_consensus.cc:2955] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.207901  9368 consensus_queue.cc:237] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:18.217061 10067 raft_consensus.cc:1275] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:18.217895  9448 raft_consensus.cc:1275] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:18.218472 10201 consensus_queue.cc:1048] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:18.219529 10216 consensus_queue.cc:1048] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:18.234853  9447 raft_consensus.cc:2955] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.238595 10201 raft_consensus.cc:2955] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.259035  9275 catalog_manager.cc:5697] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index 3 to 4, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.261605 10223 raft_consensus.cc:1064] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:02:18.280974 10223 consensus_queue.cc:237] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:18.286161  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6e8f1f59b3d149e09a5d394c216144b9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:18.304452 10189 raft_consensus.cc:1064] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:02:18.310657 10189 consensus_queue.cc:237] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:18.316773  9508 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e8f1f59b3d149e09a5d394c216144b9 with delete_type TABLET_DATA_TOMBSTONED (TS 6d50f1c263264b21919230bee398022b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46892
I20260709 13:02:18.369416 10067 raft_consensus.cc:2955] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.391490 10069 raft_consensus.cc:1275] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:18.403301  9368 raft_consensus.cc:1275] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:18.400990  9452 raft_consensus.cc:1275] T 9c4c96d6eb2446529db451af4486b758 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:18.411633 10234 consensus_queue.cc:1048] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:18.414746 10189 raft_consensus.cc:1064] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:02:18.420189 10238 consensus_queue.cc:1048] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:18.423488 10189 consensus_queue.cc:237] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:18.436559 10238 consensus_queue.cc:1048] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:18.447471 10236 tablet_replica.cc:333] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:02:18.451296 10236 raft_consensus.cc:2243] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:18.452076 10236 raft_consensus.cc:2272] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:18.460614 10236 ts_tablet_manager.cc:1916] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:18.470258 10234 raft_consensus.cc:2955] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.476097  9368 raft_consensus.cc:2955] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.478694 10067 raft_consensus.cc:2955] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.491796 10236 ts_tablet_manager.cc:1929] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:18.492364 10236 log.cc:1199] T 6e8f1f59b3d149e09a5d394c216144b9 P 6d50f1c263264b21919230bee398022b: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-2-root/wals/6e8f1f59b3d149e09a5d394c216144b9
I20260709 13:02:18.493543  9452 raft_consensus.cc:1275] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:18.495512 10069 raft_consensus.cc:1275] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:18.495594 10223 consensus_queue.cc:1048] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:18.497313 10238 consensus_queue.cc:1048] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:18.498826  9368 raft_consensus.cc:1275] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:18.501674 10242 consensus_queue.cc:1048] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:18.506075  9262 catalog_manager.cc:5028] TS 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): tablet 6e8f1f59b3d149e09a5d394c216144b9 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:02:18.504914  9275 catalog_manager.cc:5697] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.527048  9447 raft_consensus.cc:2955] T 9c4c96d6eb2446529db451af4486b758 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.535903 10070 raft_consensus.cc:1275] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:18.544401  9448 raft_consensus.cc:1275] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:18.545512 10223 consensus_queue.cc:1048] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:18.548447 10234 consensus_queue.cc:1048] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:18.555323  9524 consensus_queue.cc:237] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:18.583125 10070 raft_consensus.cc:1275] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:18.595026 10238 consensus_queue.cc:1048] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:18.603062 10223 raft_consensus.cc:2955] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.607250 10067 raft_consensus.cc:2955] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.622285  9275 catalog_manager.cc:5697] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 3 to 4, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.628384  9374 raft_consensus.cc:1275] T a81c17774a484973a3b82a63d2a33ff0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:18.633491  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9c4c96d6eb2446529db451af4486b758 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:18.636397  9372 raft_consensus.cc:1275] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:18.646215 10189 consensus_queue.cc:1048] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:18.648063 10189 consensus_queue.cc:1048] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:18.671690  9435 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c4c96d6eb2446529db451af4486b758 with delete_type TABLET_DATA_TOMBSTONED (TS d62c9d5a052b42ce8675f8438f846526 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51006
I20260709 13:02:18.677093 10254 tablet_replica.cc:333] T 9c4c96d6eb2446529db451af4486b758 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:02:18.680034 10189 raft_consensus.cc:2955] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.685766 10069 raft_consensus.cc:2955] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.694022  9368 raft_consensus.cc:2955] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.717140 10242 raft_consensus.cc:2955] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.725939  9275 catalog_manager.cc:5697] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b reported cstate change: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:18.741641  9448 raft_consensus.cc:2955] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.747529  9371 raft_consensus.cc:2955] T a81c17774a484973a3b82a63d2a33ff0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.742787  9372 raft_consensus.cc:2955] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.754069  9447 raft_consensus.cc:2955] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.759452 10254 raft_consensus.cc:2243] T 9c4c96d6eb2446529db451af4486b758 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:18.760346 10254 raft_consensus.cc:2272] T 9c4c96d6eb2446529db451af4486b758 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:18.781092 10254 ts_tablet_manager.cc:1916] T 9c4c96d6eb2446529db451af4486b758 P d62c9d5a052b42ce8675f8438f846526: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:18.781411 10069 raft_consensus.cc:2955] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.813272  9273 catalog_manager.cc:5697] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.857115 10254 ts_tablet_manager.cc:1929] T 9c4c96d6eb2446529db451af4486b758 P d62c9d5a052b42ce8675f8438f846526: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:18.857672 10254 log.cc:1199] T 9c4c96d6eb2446529db451af4486b758 P d62c9d5a052b42ce8675f8438f846526: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-1-root/wals/9c4c96d6eb2446529db451af4486b758
I20260709 13:02:18.864332  9260 catalog_manager.cc:5028] TS d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): tablet 9c4c96d6eb2446529db451af4486b758 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:02:18.869445  9526 consensus_queue.cc:237] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:18.869438  9524 consensus_queue.cc:237] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:18.889947 10069 raft_consensus.cc:1275] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:18.891438 10242 consensus_queue.cc:1048] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:18.892792  9448 raft_consensus.cc:1275] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:18.894683 10069 raft_consensus.cc:1275] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:18.895633  9448 raft_consensus.cc:1275] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:18.895594 10189 consensus_queue.cc:1048] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:18.898065 10235 consensus_queue.cc:1048] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:18.900691 10189 consensus_queue.cc:1048] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:18.900334 10223 raft_consensus.cc:2955] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.906550 10069 raft_consensus.cc:2955] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.910714 10242 raft_consensus.cc:2955] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.919001 10070 raft_consensus.cc:2955] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.930311  9452 raft_consensus.cc:2955] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.938043  9448 raft_consensus.cc:2955] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.946102  9275 catalog_manager.cc:5697] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 3 to 4, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.947930  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a81c17774a484973a3b82a63d2a33ff0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:18.953787  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 83531d29bc754f95b7c86cb864a9e096 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:18.967482  9272 catalog_manager.cc:5697] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index 3 to 4, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New cstate: current_term: 1 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:18.969316  9359 tablet_service.cc:1558] Processing DeleteTablet for tablet a81c17774a484973a3b82a63d2a33ff0 with delete_type TABLET_DATA_TOMBSTONED (TS 925acbe78db14db3b9e4cfc857717947 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52546
I20260709 13:02:18.974634 10258 tablet_replica.cc:333] T a81c17774a484973a3b82a63d2a33ff0 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:02:18.976649 10258 raft_consensus.cc:2243] T a81c17774a484973a3b82a63d2a33ff0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:18.977761 10258 raft_consensus.cc:2272] T a81c17774a484973a3b82a63d2a33ff0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:18.982929 10258 ts_tablet_manager.cc:1916] T a81c17774a484973a3b82a63d2a33ff0 P 925acbe78db14db3b9e4cfc857717947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:18.984601  9359 tablet_service.cc:1558] Processing DeleteTablet for tablet 83531d29bc754f95b7c86cb864a9e096 with delete_type TABLET_DATA_TOMBSTONED (TS 925acbe78db14db3b9e4cfc857717947 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52546
I20260709 13:02:18.998296 10258 ts_tablet_manager.cc:1929] T a81c17774a484973a3b82a63d2a33ff0 P 925acbe78db14db3b9e4cfc857717947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:18.998759 10258 log.cc:1199] T a81c17774a484973a3b82a63d2a33ff0 P 925acbe78db14db3b9e4cfc857717947: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-0-root/wals/a81c17774a484973a3b82a63d2a33ff0
I20260709 13:02:19.000535 10258 tablet_replica.cc:333] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:02:19.000600  9262 catalog_manager.cc:5028] TS 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): tablet a81c17774a484973a3b82a63d2a33ff0 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:02:19.001511 10258 raft_consensus.cc:2243] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:19.002223 10258 raft_consensus.cc:2272] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:19.004783 10258 ts_tablet_manager.cc:1916] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:19.023661 10258 ts_tablet_manager.cc:1929] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:19.024073 10258 log.cc:1199] T 83531d29bc754f95b7c86cb864a9e096 P 925acbe78db14db3b9e4cfc857717947: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-0-root/wals/83531d29bc754f95b7c86cb864a9e096
I20260709 13:02:19.025631  9262 catalog_manager.cc:5028] TS 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): tablet 83531d29bc754f95b7c86cb864a9e096 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:02:20.074429  9371 consensus_queue.cc:237] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
W20260709 13:02:20.096108  9342 consensus_peers.cc:597] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7260766fbe5c43b1aab09346a89d9ac6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:20.096424  9447 raft_consensus.cc:1275] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:20.095638  9524 raft_consensus.cc:1275] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:20.098182 10232 consensus_queue.cc:1048] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:20.101930 10216 consensus_queue.cc:1048] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:20.109782 10240 raft_consensus.cc:2955] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:20.111408  9447 raft_consensus.cc:2955] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:20.111902  9523 raft_consensus.cc:2955] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:20.130776  9374 consensus_queue.cc:237] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:20.131045  9272 catalog_manager.cc:5697] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:20.157480  9524 raft_consensus.cc:1275] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:02:20.157670  9342 consensus_peers.cc:597] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f6a0d9dc457d47bc801e795a2a573601. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:20.158147  9447 raft_consensus.cc:1275] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:20.159031 10216 consensus_queue.cc:1048] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:20.160303 10263 consensus_queue.cc:1048] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:20.187680 10216 raft_consensus.cc:2955] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:20.189481  9448 raft_consensus.cc:2955] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:20.191798  9524 raft_consensus.cc:2955] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:20.203063  9447 consensus_queue.cc:237] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:20.217680  9524 raft_consensus.cc:1275] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:20.217341  9275 catalog_manager.cc:5697] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b reported cstate change: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:20.219780 10177 consensus_queue.cc:1048] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:20.220889  9374 raft_consensus.cc:1275] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:02:20.218686  9417 consensus_peers.cc:597] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 31a8af9a9a6948d584c9c4c96ee8c808. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:20.228470 10274 consensus_queue.cc:1048] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:20.238554 10274 raft_consensus.cc:2955] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:20.241581  9374 raft_consensus.cc:2955] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:20.241819  9524 raft_consensus.cc:2955] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:20.258958  9275 catalog_manager.cc:5697] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:20.262488  9374 consensus_queue.cc:237] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
W20260709 13:02:20.277704  9342 consensus_peers.cc:597] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5a227bc15c0427bbed0fbbe37f826f1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:20.281544  9447 raft_consensus.cc:1275] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:20.281544  9524 raft_consensus.cc:1275] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:20.283049 10264 consensus_queue.cc:1048] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:20.283910 10216 consensus_queue.cc:1048] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:20.301949 10216 raft_consensus.cc:2955] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:20.304280  9447 raft_consensus.cc:2955] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:20.312343  9524 raft_consensus.cc:2955] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:20.321765  9275 catalog_manager.cc:5697] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:20.593104 10281 ts_tablet_manager.cc:933] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
I20260709 13:02:20.595013 10281 tablet_copy_client.cc:323] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.65:37547
I20260709 13:02:20.596515  9387 tablet_copy_service.cc:140] P 925acbe78db14db3b9e4cfc857717947: Received BeginTabletCopySession request for tablet 7260766fbe5c43b1aab09346a89d9ac6 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:50568)
I20260709 13:02:20.597095  9387 tablet_copy_service.cc:161] P 925acbe78db14db3b9e4cfc857717947: Beginning new tablet copy session on tablet 7260766fbe5c43b1aab09346a89d9ac6 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:50568: session id = b0812463215649c3b011d36e2f0400c9-7260766fbe5c43b1aab09346a89d9ac6
I20260709 13:02:20.604735  9387 tablet_copy_source_session.cc:215] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:20.608163 10281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7260766fbe5c43b1aab09346a89d9ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:20.641829 10281 tablet_copy_client.cc:806] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:20.642522 10281 tablet_copy_client.cc:670] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:20.682089 10284 ts_tablet_manager.cc:933] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:20.689043 10281 tablet_copy_client.cc:538] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:20.694998 10284 tablet_copy_client.cc:323] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.66:45279
I20260709 13:02:20.697185  9462 tablet_copy_service.cc:140] P d62c9d5a052b42ce8675f8438f846526: Received BeginTabletCopySession request for tablet 31a8af9a9a6948d584c9c4c96ee8c808 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:45366)
I20260709 13:02:20.697773  9462 tablet_copy_service.cc:161] P d62c9d5a052b42ce8675f8438f846526: Beginning new tablet copy session on tablet 31a8af9a9a6948d584c9c4c96ee8c808 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:45366: session id = b0812463215649c3b011d36e2f0400c9-31a8af9a9a6948d584c9c4c96ee8c808
I20260709 13:02:20.707583  9462 tablet_copy_source_session.cc:215] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:20.712042 10283 ts_tablet_manager.cc:933] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
I20260709 13:02:20.713733 10284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31a8af9a9a6948d584c9c4c96ee8c808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:20.713343 10281 tablet_bootstrap.cc:492] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:02:20.747465 10284 tablet_copy_client.cc:806] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:20.748564 10284 tablet_copy_client.cc:670] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:20.755654 10284 tablet_copy_client.cc:538] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:20.769358 10283 tablet_copy_client.cc:323] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.65:37547
I20260709 13:02:20.771090  9387 tablet_copy_service.cc:140] P 925acbe78db14db3b9e4cfc857717947: Received BeginTabletCopySession request for tablet f6a0d9dc457d47bc801e795a2a573601 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:50568)
I20260709 13:02:20.771719  9387 tablet_copy_service.cc:161] P 925acbe78db14db3b9e4cfc857717947: Beginning new tablet copy session on tablet f6a0d9dc457d47bc801e795a2a573601 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:50568: session id = b0812463215649c3b011d36e2f0400c9-f6a0d9dc457d47bc801e795a2a573601
I20260709 13:02:20.773358 10284 tablet_bootstrap.cc:492] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:02:20.780498  9387 tablet_copy_source_session.cc:215] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:20.781308 10281 tablet_bootstrap.cc:492] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:20.782230 10281 tablet_bootstrap.cc:492] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:02:20.782954 10281 ts_tablet_manager.cc:1403] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.070s	user 0.018s	sys 0.011s
I20260709 13:02:20.784447 10283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6a0d9dc457d47bc801e795a2a573601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:20.788177 10281 raft_consensus.cc:359] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:20.789077 10281 raft_consensus.cc:740] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:02:20.790201 10281 consensus_queue.cc:260] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:20.807348 10283 tablet_copy_client.cc:806] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:20.808808 10283 tablet_copy_client.cc:670] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:20.812862 10283 tablet_copy_client.cc:538] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:20.814319 10281 ts_tablet_manager.cc:1434] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.031s	user 0.014s	sys 0.010s
I20260709 13:02:20.816038  9387 tablet_copy_service.cc:342] P 925acbe78db14db3b9e4cfc857717947: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-7260766fbe5c43b1aab09346a89d9ac6 received from {username='slave'} at 127.0.0.1:50568
I20260709 13:02:20.816480  9387 tablet_copy_service.cc:434] P 925acbe78db14db3b9e4cfc857717947: ending tablet copy session b0812463215649c3b011d36e2f0400c9-7260766fbe5c43b1aab09346a89d9ac6 on tablet 7260766fbe5c43b1aab09346a89d9ac6 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:02:20.826517 10283 tablet_bootstrap.cc:492] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:02:20.832399 10284 tablet_bootstrap.cc:492] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:20.833459 10284 tablet_bootstrap.cc:492] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:02:20.834198 10284 ts_tablet_manager.cc:1403] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.018s
I20260709 13:02:20.837414 10284 raft_consensus.cc:359] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:20.842141 10284 raft_consensus.cc:740] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:02:20.842793 10284 consensus_queue.cc:260] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:20.845175 10284 ts_tablet_manager.cc:1434] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:02:20.855224  9462 tablet_copy_service.cc:342] P d62c9d5a052b42ce8675f8438f846526: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-31a8af9a9a6948d584c9c4c96ee8c808 received from {username='slave'} at 127.0.0.1:45366
I20260709 13:02:20.855849  9462 tablet_copy_service.cc:434] P d62c9d5a052b42ce8675f8438f846526: ending tablet copy session b0812463215649c3b011d36e2f0400c9-31a8af9a9a6948d584c9c4c96ee8c808 on tablet 31a8af9a9a6948d584c9c4c96ee8c808 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:02:20.864851 10283 tablet_bootstrap.cc:492] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:20.865954 10283 tablet_bootstrap.cc:492] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:02:20.866694 10283 ts_tablet_manager.cc:1403] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.008s
I20260709 13:02:20.869975 10283 raft_consensus.cc:359] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:20.870915 10283 raft_consensus.cc:740] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:02:20.871629 10283 consensus_queue.cc:260] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:20.876268 10284 ts_tablet_manager.cc:933] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
I20260709 13:02:20.884585 10283 ts_tablet_manager.cc:1434] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:02:20.886421  9387 tablet_copy_service.cc:342] P 925acbe78db14db3b9e4cfc857717947: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-f6a0d9dc457d47bc801e795a2a573601 received from {username='slave'} at 127.0.0.1:50568
I20260709 13:02:20.886938  9387 tablet_copy_service.cc:434] P 925acbe78db14db3b9e4cfc857717947: ending tablet copy session b0812463215649c3b011d36e2f0400c9-f6a0d9dc457d47bc801e795a2a573601 on tablet f6a0d9dc457d47bc801e795a2a573601 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:02:20.889972 10284 tablet_copy_client.cc:323] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.65:37547
I20260709 13:02:20.891789  9387 tablet_copy_service.cc:140] P 925acbe78db14db3b9e4cfc857717947: Received BeginTabletCopySession request for tablet b5a227bc15c0427bbed0fbbe37f826f1 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:50568)
I20260709 13:02:20.892408  9387 tablet_copy_service.cc:161] P 925acbe78db14db3b9e4cfc857717947: Beginning new tablet copy session on tablet b5a227bc15c0427bbed0fbbe37f826f1 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:50568: session id = b0812463215649c3b011d36e2f0400c9-b5a227bc15c0427bbed0fbbe37f826f1
I20260709 13:02:20.899194  9387 tablet_copy_source_session.cc:215] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:20.902761 10284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5a227bc15c0427bbed0fbbe37f826f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:20.929973 10284 tablet_copy_client.cc:806] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:20.930595 10284 tablet_copy_client.cc:670] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:20.936558 10284 tablet_copy_client.cc:538] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:20.950394 10284 tablet_bootstrap.cc:492] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:02:22.018043 10216 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.035326 10216 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.047226 10216 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.084225 10295 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.084916 10295 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.086642 10280 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.087209 10295 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.087222 10280 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.090014 10280 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.093830 10301 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.094135 10216 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.094485 10223 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.095301 10223 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.095052 10216 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.097195 10301 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.098177 10216 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.099069 10301 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.101567 10223 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.104270 10280 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.104986 10280 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.109304 10293 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.110055 10293 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.114933 10296 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.115561 10296 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.116935 10288 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.117630 10288 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:22.119391 10297 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.120057 10297 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.122995 10297 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.114995 10293 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.132201 10294 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.133512 10296 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.136653 10257 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.129130 10288 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.138768 10288 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.140458 10288 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:22.138736 10257 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.143535 10257 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.145887 10223 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.146727 10223 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.132817 10294 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.149127 10223 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.152303 10223 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.152933 10295 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.153920 10295 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:22.158885  9306 debug-util.cc:398] Leaking SignalData structure 0x7b0800034ee0 after lost signal to thread 8212
I20260709 13:02:22.160264 10223 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.105420 10303 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.177718 10304 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.179283 10309 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.180110 10312 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.190418 10223 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.191463 10223 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.160010 10294 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.192103 10223 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:22.198397 10223 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.201136 10294 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.201999 10302 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.202356 10294 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.194231 10303 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.189730 10304 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.202777 10280 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.202572 10302 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:22.244834 10288 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.245421 10288 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.377195 10223 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.377954 10223 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.224439 10307 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.230082 10311 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.389389 10223 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.202035 10308 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.202961  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:22.224110 10305 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.391062 10216 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.245915 10288 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:22.394867 10216 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.391727 10298 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.400348 10223 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.200362 10312 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:22.403059 10223 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.406693 10216 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.407163 10216 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.407538 10216 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:22.391754 10300 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.200137 10309 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.412209 10216 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:22.412751 10216 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.429348 10315 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.430279 10315 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.433097 10310 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.399770 10295 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.434664 10216 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.398388 10307 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.404500 10296 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.455672 10299 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.455955 10303 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.409485 10263 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.460598 10216 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.411898 10293 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.411044 10306 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.469056 10317 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.456800 10313 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.474638 10216 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.400509 10308 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:22.477363 10216 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.479735 10308 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.480492 10308 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.403590 10305 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.484342 10315 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.484460 10305 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.485865 10305 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.486203 10216 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.486680 10305 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.402091 10311 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:22.485257 10223 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.489241 10223 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.489883 10223 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.491230 10311 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.487804 10308 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:22.492012  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:22.493541 10308 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.494525 10223 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.494825  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:22.494988 10223 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.495428 10223 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.497141 10305 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.484975 10315 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.497884 10223 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.497926 10305 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.498278 10315 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.499194 10305 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:22.486699 10216 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.500545 10216 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:22.474166  9306 debug-util.cc:398] Leaking SignalData structure 0x7b08000355c0 after lost signal to thread 9309
I20260709 13:02:22.453398 10295 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.457254 10302 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:22.502662 10305 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.433862 10298 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.451040 10310 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.516835 10288 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.474772 10293 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:22.458002 10296 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.456410 10299 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.532114 10216 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.506764 10263 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.550346 10223 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.548250 10315 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.551024 10223 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.551980 10307 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.553236 10312 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.553788 10223 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.518155 10306 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.554467  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:22.555305  9374 raft_consensus.cc:2468] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 1.
I20260709 13:02:22.512401 10313 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.555640 10306 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.524345 10295 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:22.543036 10305 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.541221 10318 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.547037 10297 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.564395 10295 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.510973 10317 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.451243 10300 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.559005 10257 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.565519 10319 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.575565 10298 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.565356 10307 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.565256 10303 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.565573 10314 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.576684 10322 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.577076 10293 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.578616 10257 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.566149 10296 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.581837 10310 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.565464 10324 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.565603 10320 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.569584 10316 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.570338 10299 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.566763 10313 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.569620 10318 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.586380 10300 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.565271 10305 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:22.580361 10307 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.568677 10297 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.588536 10320 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.565147 10323 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.596531 10313 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.581852 10027 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:02:22.582517 10303 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.596822 10320 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.601953  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:22.587743 10314 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:22.589895 10316 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.598084 10294 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.585530 10319 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:22.592381 10324 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:22.629495  9417 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.345s	user 0.001s	sys 0.011s
W20260709 13:02:22.632643  9417 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.348s	user 0.002s	sys 0.011s
I20260709 13:02:22.629678  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:22.630795 10303 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.587106 10322 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.630815  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:22.603201 10313 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:22.613420 10263 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.636339  9523 raft_consensus.cc:2468] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 1.
I20260709 13:02:22.631433  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:22.634337  9306 debug-util.cc:398] Leaking SignalData structure 0x7b08000a6e40 after lost signal to thread 9401
I20260709 13:02:22.627424 10294 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.639012 10296 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.646921 10294 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.647182 10296 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.632699 10320 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.648043 10223 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.651523 10223 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.653934 10302 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.654110 10327 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.654945 10223 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.654546 10302 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.644325 10295 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.649897 10312 raft_consensus.cc:2804] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:22.658034 10315 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.648133 10303 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.641065 10317 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:22.625607 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 68872us
I20260709 13:02:22.606714 10323 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.658052 10293 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.654654 10327 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.664637 10257 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:22.669446  9306 debug-util.cc:398] Leaking SignalData structure 0x7b08002cde20 after lost signal to thread 9476
I20260709 13:02:22.655402 10320 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.661626 10310 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.670039 10305 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.670697 10314 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.664165 10295 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.672762 10307 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.688827 10300 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.689640 10329 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.673848 10297 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.666671 10315 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:22.670516 10303 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.685401 10317 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.712430 10321 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.719743  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:22.719697 10306 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.722211 10294 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.724002  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:22.715312 10263 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.724741 10263 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.725169 10302 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.721174 10327 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.721371 10318 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.726820 10263 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.727739 10295 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.728001 10320 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.728695 10315 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.729257 10296 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.722361 10306 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.690383 10310 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.731218 10306 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.732172 10310 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.732807 10303 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.698805 10293 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:22.715875  9306 debug-util.cc:398] Leaking SignalData structure 0x7b0800320140 after lost signal to thread 9550
I20260709 13:02:22.736297 10312 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.736788 10312 raft_consensus.cc:3060] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:22.716960 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:22.695760 10307 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.737739  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:22.701104 10297 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.739899 10324 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.742739  9525 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 1.
I20260709 13:02:22.739411  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:22.713378 10321 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.740806 10066 raft_consensus.cc:2468] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:22.700893 10300 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.737782 10313 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:22.717413 10317 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.762050 10216 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.760241 10027 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:02:22.785753 10317 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.785966 10068 raft_consensus.cc:1217] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:22.745888 10293 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.771348  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:22.772027  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:22.772262  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:22.773181  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:22.776681 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:22.777309 10324 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.777418 10302 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.777652 10303 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.777818 10274 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.778669 10216 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.778163  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:22.780230  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:22.780853  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:22.781052 10319 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.781461  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:22.781723  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:22.782298  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:22.782807 10280 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.783003 10327 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.783807  9417 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:22.765184 10323 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.787070  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:22.787595 10326 raft_consensus.cc:2804] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:22.788003 10027 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:02:22.788714 10316 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.745553 10306 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.745735 10296 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.789224 10309 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.722862 10329 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.928362 10314 raft_consensus.cc:2804] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:22.928177 10296 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.929061 10314 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.929313 10323 raft_consensus.cc:2804] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:22.929493 10314 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:22.928290 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 140351us
I20260709 13:02:22.746189 10307 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:22.929981  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 146234us
I20260709 13:02:22.935063  9525 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:22.930111  9448 raft_consensus.cc:2468] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 1.
I20260709 13:02:22.942071 10326 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.942322 10304 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.942603 10306 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.929770 10323 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.943691 10300 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.946647  9526 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:22.951704 10302 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.952140 10322 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:22.953925 10329 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.945587 10326 raft_consensus.cc:3060] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:22.947095  9452 raft_consensus.cc:2468] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 1.
I20260709 13:02:22.747435 10297 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.957445  9451 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 1.
I20260709 13:02:22.964848 10297 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.948091  9449 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 1.
I20260709 13:02:22.955020 10274 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.938373 10298 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:22.937278 10307 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.927284 10334 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.761955 10325 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:22.972435 10025 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:22.947571 10321 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.945031 10303 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.973527 10296 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.972731 10274 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.943810 10327 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.948477 10323 raft_consensus.cc:3060] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:22.976810 10306 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.987874 10216 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.957322 10324 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:22.975224  9306 debug-util.cc:398] Leaking SignalData structure 0x7b0800044c40 after lost signal to thread 10094
I20260709 13:02:22.982954 10334 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.991349 10312 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:22.992380 10284 tablet_bootstrap.cc:492] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:22.992633 10025 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:22.988847 10296 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.993541 10288 raft_consensus.cc:2804] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:22.994024 10303 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.983103 10300 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.975383 10298 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.996176 10216 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:22.954753 10302 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:22.963029 10280 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.977144 10314 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:22.992658 10324 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:23.028262 10216 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:22.999176 10306 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:23.001845 10263 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:23.047075 10216 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:23.003863 10288 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:23.044978 10066 raft_consensus.cc:1240] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:23.028774 10300 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:23.062080 10068 raft_consensus.cc:1217] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:23.050056 10288 raft_consensus.cc:3060] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.070668 10070 raft_consensus.cc:2393] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 2: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:02:22.987669 10325 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:23.059545 10302 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:23.030231 10296 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:23.050128 10263 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:23.060655 10284 tablet_bootstrap.cc:492] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:02:23.048069 10306 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:23.058769 10324 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:23.088681  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.089604  9452 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:23.089854  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.093395  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.077507 10327 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:23.085253 10335 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:23.091671 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:23.112871  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.107688 10284 ts_tablet_manager.cc:1403] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 2.158s	user 0.018s	sys 0.025s
I20260709 13:02:23.087088 10302 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:23.106216 10312 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:23.095371 10324 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:23.107107 10338 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:23.127223  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.131789  9448 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:23.140137  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.140708  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.141208  9443 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:23.142163  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.142539  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.120525 10332 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:23.151999  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.155823 10067 raft_consensus.cc:1217] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:23.156071  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.157743 10263 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:23.160208 10296 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:23.137281 10312 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:23.163182 10312 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:23.163580 10312 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.163654 10325 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:23.165532 10314 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:23.113529 10335 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:23.166234 10298 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:23.148103 10334 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:23.137566 10338 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:23.145404 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 145195us
I20260709 13:02:23.166455 10280 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:23.275151  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.322449  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.324824 10025 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:23.325464  9524 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:23.326016  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.327533  9521 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:23.327641  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.276889  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:23.263372  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.343096  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.342840  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.349643  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.179616 10332 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:23.348831  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:23.354489  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.352144  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.346877  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.353050  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.349941 10306 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:23.352982  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.353511  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.341961 10341 raft_consensus.cc:2804] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:23.342538 10300 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:23.351202 10065 raft_consensus.cc:1240] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:23.362371  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.367059  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.371296  9374 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:23.372685  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.374392  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.372766  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.378722  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.371496 10302 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:23.367588 10341 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:23.370029 10324 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:23.356709 10025 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:23.377305  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.394508 10323 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:23.396001  9447 raft_consensus.cc:2393] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 in current term 2: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:23.398103 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:23.505189 10338 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:23.527156  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.542817  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.543841  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.545176  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.545756  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.545997  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.502713  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.530673  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.547130  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.547068  9369 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:23.532042  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.421686 10335 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:23.500263 10332 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:23.401784  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.384050 10341 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.514684  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:23.495021 10326 consensus_meta.cc:287] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9: Time spent flushing consensus metadata: real 0.540s	user 0.013s	sys 0.030s
I20260709 13:02:23.496223  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.564502  9524 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:23.502938  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.503508  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.404364  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.544096  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.568212  9518 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:23.568408  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.569200  9525 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:23.569922  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.570206  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.571149  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.571303  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.419956 10312 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:23.565796  9523 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:23.548486  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.405951 10288 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:23.552017  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.578943  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.579540  9450 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:23.580155 10312 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:23.580403  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.563692  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.404386 10342 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:23.581883 10342 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:23.582288 10342 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.569201  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.583534 10332 consensus_queue.cc:1059] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:23.584254  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.584656 10332 raft_consensus.cc:3055] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:23.585038 10332 raft_consensus.cc:740] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:23.585271  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.585913 10332 consensus_queue.cc:260] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:23.586406  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.587206 10332 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.587486  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.418032 10323 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:23.590770  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.593102 10342 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:23.555191  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.595018  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.555933  9446 raft_consensus.cc:1240] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:23.556136 10325 consensus_queue.cc:1059] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:23.556818  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.596328  9520 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
W20260709 13:02:23.559814 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 211040us
I20260709 13:02:23.559989 10302 raft_consensus.cc:1064] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:02:23.597810 10025 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:23.598076 10342 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:23.567525  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.575866  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.577368  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.580892 10067 raft_consensus.cc:1240] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:23.602455 10302 consensus_queue.cc:237] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:23.604379  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.605437  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.605610  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:23.606202  9443 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.606287  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.588537  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:23.606475  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.607507  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.607722  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:23.607980  9341 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:23.608122  9375 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:23.552134  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.611692  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.607141  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.612216  9444 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:23.554369  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.596383 10325 raft_consensus.cc:3055] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:23.613839 10325 raft_consensus.cc:740] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:23.598642 10312 raft_consensus.cc:3060] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.410831  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.566962 10326 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:23.602211  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.608505  9452 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.609333 10338 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:23.609937  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.610291 10306 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:23.620355 10338 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:23.621619 10306 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:23.622036 10306 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.610744 10070 raft_consensus.cc:1240] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:23.611505  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.611403 10321 consensus_queue.cc:1059] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:23.575021  9451 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:23.528855 10284 raft_consensus.cc:359] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:23.638438 10284 raft_consensus.cc:740] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:02:23.639223 10284 consensus_queue.cc:260] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:23.640415 10312 raft_consensus.cc:2749] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:23.620500  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.614733 10325 consensus_queue.cc:260] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:23.641700  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.642221 10325 raft_consensus.cc:3060] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.642522  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.625192  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.625624  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.627189  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.628189  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.629608 10069 raft_consensus.cc:1240] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:23.647641  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.629829 10306 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:23.630369  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.630679 10326 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:23.631908  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:23.633741 10338 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:23.633865  9445 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:23.655584  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.656831  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.658072  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.658766  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.659147  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.659297  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.660113  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.660341  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.661950 10306 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:23.637727 10322 consensus_queue.cc:1059] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:23.662443  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.637964  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.662736  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.646875  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.646056  9522 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:23.664224  9341 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:23.661877  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.665149  9341 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:23.634668  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:23.671068  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.666101 10323 consensus_queue.cc:1059] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:02:23.671378  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.674590  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.672344 10335 raft_consensus.cc:3055] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:23.677297 10335 raft_consensus.cc:740] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:23.677366 10025 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:23.677798  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:23.682789  9452 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 2.
I20260709 13:02:23.683472  9448 raft_consensus.cc:1240] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:23.688095  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.689594  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.689870 10288 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:23.678644 10326 raft_consensus.cc:2749] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:23.692332 10025 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:23.692946  9341 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:23.694299 10321 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:02:23.694482  9490 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.503s (SENT) [suppressed 1 similar messages]
I20260709 13:02:23.694806 10321 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:23.695366 10321 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.696247 10340 raft_consensus.cc:3055] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:23.696655 10340 raft_consensus.cc:740] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:23.678942 10338 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:23.697450 10338 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:23.697841 10338 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.702069  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.703380 10069 raft_consensus.cc:1275] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:23.703703  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.704946  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.705224  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.704950  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.707806  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.708099  9341 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:23.710378  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.713536  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.678735 10298 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:23.724228  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.727481  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.678234 10335 consensus_queue.cc:260] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:23.707271 10326 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:23.733055  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.723726 10306 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:23.737929  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.741367  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.743623  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:23.744717  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.725790 10298 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:23.722802 10323 consensus_queue.cc:1048] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:02:23.753994  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.754546  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.756083 10345 raft_consensus.cc:3055] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:23.756466 10345 raft_consensus.cc:740] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:23.757337 10345 consensus_queue.cc:260] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:23.758525 10345 raft_consensus.cc:3060] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.759035  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.760226  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.760712  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.734887  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.762660  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.764076  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.737454 10306 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:23.764593  9368 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:23.764724  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.765518  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.738463 10340 consensus_queue.cc:260] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:23.774958 10340 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.765916  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.776345  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.777071  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.777437  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.768433 10341 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:23.778116  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.766517  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.770697 10284 ts_tablet_manager.cc:1434] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.655s	user 0.014s	sys 0.018s
I20260709 13:02:23.771080 10027 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:23.751283 10298 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.751041 10326 raft_consensus.cc:697] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 2 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:02:23.780375  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.781728  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.762064 10335 raft_consensus.cc:3060] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.753216  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.784013  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.781875  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.789002  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:23.787526  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 65239.3us
I20260709 13:02:23.775801 10070 raft_consensus.cc:1240] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:23.778841 10306 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:23.786597  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.793045 10288 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:23.795589  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.795986 10325 consensus_queue.cc:1059] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:23.797224 10344 raft_consensus.cc:3055] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:23.797627 10344 raft_consensus.cc:740] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:02:23.783475 10284 ts_tablet_manager.cc:1467] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9: Tablet startup took 667ms
I20260709 13:02:23.799860  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.789120  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.802376  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:23.803436  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:23.805884  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:23.804941 10070 raft_consensus.cc:1240] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:23.812356  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.804937  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:23.816816  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.817953  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.818101  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.818214  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.820664  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.820907  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.809608  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:23.824018 10027 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:23.824728 10334 consensus_queue.cc:1059] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:23.825311 10288 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:23.811750  9443 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 2.
W20260709 13:02:23.800760 10284 ts_tablet_manager.cc:1469] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9: Trace:
0709 13:02:20.875359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.875620 (+   261us) service_pool.cc:224] Handling call
0709 13:02:20.876678 (+  1058us) ts_tablet_manager.cc:934] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
0709 13:02:20.901375 (+ 24697us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:02:20.915856 (+ 14481us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:20.915988 (+   132us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:02:20.927295 (+ 11307us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:02:20.927609 (+   314us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:20.928011 (+   402us) ts_tablet_manager.cc:989] Replica registered.
0709 13:02:20.928088 (+    77us) inbound_call.cc:177] Queueing success response
0709 13:02:20.949987 (+ 21899us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:02:23.116036 (+2166049us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:02:23.179687 (+ 63651us) tablet_replica.cc:261] Starting instrumentation
0709 13:02:23.338512 (+158825us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":270,"mutex_wait_us":3620,"raft.queue_time_us":297,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":104,"tablet-copy.queue_time_us":142,"tablet-download-pool.queue_time_us":784,"tablet-download-pool.run_cpu_time_us":1107,"tablet-download-pool.run_wall_time_us":4325,"thread_start_us":12329,"threads_started":1}
I20260709 13:02:23.830288 10025 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:23.835003  9446 raft_consensus.cc:1240] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:23.837088  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.819514 10326 consensus_queue.cc:237] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:23.839839 10288 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:23.840456 10288 raft_consensus.cc:697] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 2 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:02:23.841316 10288 consensus_queue.cc:237] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:23.842546 10299 raft_consensus.cc:1064] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:02:23.841473 10306 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:23.858363  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 45502.8us
I20260709 13:02:23.860854  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.872732  9387 tablet_copy_service.cc:342] P 925acbe78db14db3b9e4cfc857717947: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-b5a227bc15c0427bbed0fbbe37f826f1 received from {username='slave'} at 127.0.0.1:50568
I20260709 13:02:23.873265  9387 tablet_copy_service.cc:434] P 925acbe78db14db3b9e4cfc857717947: ending tablet copy session b0812463215649c3b011d36e2f0400c9-b5a227bc15c0427bbed0fbbe37f826f1 on tablet b5a227bc15c0427bbed0fbbe37f826f1 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:02:23.833945 10344 consensus_queue.cc:260] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:23.849304 10332 raft_consensus.cc:3055] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:23.876704 10332 raft_consensus.cc:740] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:23.877808  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:23.877543 10332 consensus_queue.cc:260] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:23.849936  9371 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 2.
I20260709 13:02:23.897939 10027 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:23.899291 10312 raft_consensus.cc:2804] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:23.899842 10312 raft_consensus.cc:697] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 2 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:02:23.900780 10312 consensus_queue.cc:237] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:23.902105  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:23.923151 10338 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:23.912964 10321 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:23.931087 10321 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:23.934064  9368 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 2.
I20260709 13:02:23.946782 10298 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:23.949816 10298 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:23.950619 10332 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:23.952013  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:23.953636  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 150106us
W20260709 13:02:23.977373  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 121878us
I20260709 13:02:24.014127  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:23.989202 10344 raft_consensus.cc:3060] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.989666 10341 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:24.017154  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.019596  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.017084  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.022130  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:23.982542 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 84703.3us
I20260709 13:02:24.030009  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.023825  9341 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:24.041415 10329 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:24.041872 10329 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:24.041455  9341 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:24.042264 10329 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.043838  9418 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:24.045248 10298 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:24.045706 10298 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:24.046514 10298 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.046991  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.048077  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.049379 10280 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:24.049832 10280 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:24.050210 10280 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.023073 10338 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:24.050545  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.054559  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.016094 10299 consensus_queue.cc:237] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:24.049422  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.055032  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.058264  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.058363  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:24.058503  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.061511  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.062796  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.063048 10354 consensus_queue.cc:1059] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:24.066886  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:24.067065  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.067245 10354 raft_consensus.cc:3055] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:24.067649 10354 raft_consensus.cc:740] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:24.068182  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:24.076566  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:24.078212  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.072924  9418 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:24.079931 10352 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:24.080024  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.080428 10352 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:24.080884 10352 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.084822  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:24.071995  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.086470  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.086508  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.088164 10306 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:24.093858  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.094514  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.096868  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.068430 10354 consensus_queue.cc:260] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:24.111768  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:24.113276  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:24.114662  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:24.116959  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:24.117398  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.122223  9343 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.125586  9343 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.128289 10338 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:24.129220 10338 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:24.129621 10338 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:24.134909  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 74791.6us
I20260709 13:02:24.141849 10354 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.144510  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:24.147562 10352 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.148619 10280 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.149097 10351 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:24.149592 10351 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:24.150125 10351 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.151547  9343 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:24.153113  9376 raft_consensus.cc:2468] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 2.
I20260709 13:02:24.153211 10298 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.154018  9275 catalog_manager.cc:5697] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 1 to 2, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 2 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:24.155350 10027 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.155786 10306 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.156584 10326 raft_consensus.cc:2804] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:24.156229  9275 catalog_manager.cc:5697] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 1 to 2, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 2 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:24.157092 10298 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:24.158355  9343 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.157375 10326 raft_consensus.cc:697] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 2 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:02:24.159446 10351 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.160351 10326 consensus_queue.cc:237] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:24.161643 10069 raft_consensus.cc:1275] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:24.150887 10280 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:24.163473 10306 consensus_queue.cc:1048] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:24.162097  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.165650  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:24.167696  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:24.158396  9275 catalog_manager.cc:5697] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 1 to 2, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 2 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:24.172128 10298 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.174590  9492 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:24.174882 10329 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.184100 10344 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:24.184517 10344 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:24.185110 10344 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.186971  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.187529  9492 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:24.189656  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:24.190524  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:24.193132 10329 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:24.175576 10351 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:24.176028 10352 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:24.164139 10338 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.177461  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:24.198424 10356 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:24.198907 10356 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:24.199345 10356 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.178696  9343 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.178776  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:24.179601  9490 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.180292  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.182685  9445 raft_consensus.cc:1275] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:24.207697  9526 raft_consensus.cc:1275] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:24.201759  9343 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.210898  9343 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.213763  9368 raft_consensus.cc:1275] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:24.216229  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:24.215166 10338 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:24.216543  9492 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:24.216718 10298 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.219640  9343 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.202600  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:24.203366 10351 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.210222 10322 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:24.215412  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.218047 10329 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.200634  9521 raft_consensus.cc:2468] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:24.229306  9343 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.235332 10306 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.236102 10344 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.237278 10325 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.238503 10344 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:24.233860  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:24.246110  9343 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.234745 10338 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.223762 10354 consensus_queue.cc:1048] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
W20260709 13:02:24.248656  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 44643.8us
I20260709 13:02:24.251967  9490 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.258909  9343 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.259815  9490 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.250236 10299 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:24.261231  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 44759.6us
I20260709 13:02:24.261082 10321 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.266199 10362 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.260035 10345 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.279743  9343 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.281021  9343 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.281939 10321 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.289227 10325 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.288724 10356 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.292727 10356 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:24.313535  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 52196.6us
I20260709 13:02:24.285676  9343 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.318993  9343 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.323254  9490 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.324448  9490 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.325131 10344 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.324734  9343 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.325155 10347 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.325932 10354 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.327504  9343 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.328151 10354 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.328336  9521 raft_consensus.cc:1275] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:24.329377  9343 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.330754 10344 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.331127 10321 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.332219  9490 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.332362  9343 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.322196 10306 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.333911 10321 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.334462 10344 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.335162  9343 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.336097  9490 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:24.337128  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 107459us
I20260709 13:02:24.303520 10351 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.338470 10306 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.338550 10345 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.338919  9418 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.339571  9343 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.346339  9343 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.347427  9343 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.339576  9490 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.355400  9343 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.358565  9343 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.354628 10354 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.359431 10299 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.354662 10321 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.353832 10326 consensus_queue.cc:1048] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:02:24.356163 10351 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:02:24.367868 10365 log.cc:927] Time spent T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e: Append to log took a long time: real 0.066s	user 0.002s	sys 0.000s
I20260709 13:02:24.371006  9343 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.372352  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.378916 10335 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:24.354943 10280 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.379347 10335 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:24.379894 10335 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.373291 10368 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.372049 10351 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.381451  9418 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.383174  9418 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.389349 10323 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.391577  9418 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.383767 10280 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:24.382998 10351 raft_consensus.cc:2955] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:24.373903 10347 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.397137 10280 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:24.397761 10280 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.405779  9446 raft_consensus.cc:2955] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:24.374168  9490 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.408557 10368 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.409936  9490 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.379575  9343 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.410961 10369 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.419996 10348 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.418810 10069 raft_consensus.cc:2955] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:24.423985 10335 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.425554 10368 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.427515  9490 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.435513 10368 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.443089  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.444114 10369 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.445613  9490 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.446457 10368 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.450742  9490 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.433463 10335 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:24.452072  9376 raft_consensus.cc:1275] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:24.460886 10368 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.462241 10326 consensus_queue.cc:1048] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:24.464304  9446 raft_consensus.cc:1240] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:24.468274 10299 consensus_queue.cc:1059] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.469345 10348 raft_consensus.cc:3055] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:24.469470 10351 raft_consensus.cc:1064] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:02:24.469779 10348 raft_consensus.cc:740] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:24.470693 10348 consensus_queue.cc:260] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.472183 10348 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.475353  9370 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:24.477667 10312 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:24.472550 10351 consensus_queue.cc:237] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:24.431556 10280 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.462266  9490 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.459786  9418 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.502790 10335 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.505789  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:24.507718 10368 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.509948 10069 raft_consensus.cc:1217] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:24.517258  9368 raft_consensus.cc:1275] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:24.517577  9272 catalog_manager.cc:5697] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:24.521994  9418 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:02:24.518848  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 56659.1us
I20260709 13:02:24.518971 10341 consensus_queue.cc:1048] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:24.523283  9490 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.519937 10280 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:24.521493  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:24.521831  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:24.531874 10069 raft_consensus.cc:1275] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:24.533646 10351 consensus_queue.cc:1048] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:24.535238  9446 raft_consensus.cc:1275] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:24.539882 10351 consensus_queue.cc:1048] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:24.548439  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:24.549402 10335 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.549922  9368 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:24.550876  9418 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.552035 10368 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.551606  9275 catalog_manager.cc:5697] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 1 to 2, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 2 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:24.561393  9443 raft_consensus.cc:1275] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:24.564226 10326 consensus_queue.cc:1048] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:24.566829  9490 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.569034  9490 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.567682 10368 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.571421 10370 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.570860  9490 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.574854 10368 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.576078  9490 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.576860 10368 raft_consensus.cc:2749] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.577934  9490 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.579097 10368 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.580237  9490 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.580938 10368 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.581305  9490 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.581841  9373 raft_consensus.cc:1240] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:24.582167 10368 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.582554  9490 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.583446 10368 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.583808  9490 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.584515 10368 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.585484  9490 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.586315 10368 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.586678  9490 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.587363 10368 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.587700  9490 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.588372 10368 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.588730  9490 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.589958  9490 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.590682 10370 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.590996  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:24.591257 10370 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.593021  9373 raft_consensus.cc:1240] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:24.594543  9373 raft_consensus.cc:1240] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:24.596046  9373 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:24.597517  9373 raft_consensus.cc:1240] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:24.599293  9373 raft_consensus.cc:1240] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:24.604626 10280 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:24.604741  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 53973.8us
I20260709 13:02:24.605522  9418 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.606563  9418 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.607223 10323 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.607296 10335 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.607682  9418 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.608683 10323 raft_consensus.cc:2804] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:24.609066 10323 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:24.609428 10323 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.612382  9490 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.618208 10321 raft_consensus.cc:2955] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:24.621237 10368 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.623453  9444 raft_consensus.cc:2955] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:24.627972  9446 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:24.630892 10312 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:24.636078  9492 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.636518  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:24.637319  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:24.637387  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:24.638265  9521 raft_consensus.cc:1275] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:24.638675  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:24.639252 10370 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.639907  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:24.640116  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:24.640522  9519 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.643494 10370 consensus_queue.cc:1059] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.644541 10370 raft_consensus.cc:3055] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:24.644871 10370 raft_consensus.cc:740] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:24.645889 10370 consensus_queue.cc:260] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.650244 10370 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.651274 10368 consensus_queue.cc:1059] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:24.652829 10325 raft_consensus.cc:3055] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:24.638716  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:24.653403 10325 raft_consensus.cc:740] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:24.654611  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:24.654749 10325 consensus_queue.cc:260] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.660131  9519 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:24.661715 10325 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.664943  9522 raft_consensus.cc:1275] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:02:24.671186  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 63563us
I20260709 13:02:24.673239 10345 consensus_queue.cc:1059] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:24.674116 10362 consensus_queue.cc:1059] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:24.675709 10368 consensus_queue.cc:1059] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:24.678165  9376 raft_consensus.cc:1275] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:24.688505  9343 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.688556  9418 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.679891 10322 consensus_queue.cc:1059] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:24.694020  9343 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.618163 10323 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.687414 10344 consensus_queue.cc:1059] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
W20260709 13:02:24.744170  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 50215.1us
I20260709 13:02:24.725677 10069 raft_consensus.cc:2955] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:24.703397 10363 raft_consensus.cc:3055] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:24.694082  9418 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.693502 10280 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.744486 10344 raft_consensus.cc:3055] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:24.749346 10351 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.749675 10344 raft_consensus.cc:740] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:24.750578 10344 consensus_queue.cc:260] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.751932 10344 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.752315 10345 raft_consensus.cc:3055] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:24.752751 10345 raft_consensus.cc:740] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:24.730564 10356 raft_consensus.cc:3055] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:24.753379 10356 raft_consensus.cc:740] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:24.753775 10345 consensus_queue.cc:260] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.755062 10345 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.756317 10323 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:24.747931 10335 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:24.759148 10335 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:24.759558 10335 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.759367  9275 catalog_manager.cc:5697] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:24.754215 10356 consensus_queue.cc:260] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:24.761579 10385 log.cc:927] Time spent T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:02:24.745038  9343 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.717470 10312 consensus_queue.cc:1048] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:02:24.764699 10354 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.767374 10332 consensus_queue.cc:1048] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:24.768900 10356 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.767668  9443 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.766162  9343 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.774545 10335 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.780117 10335 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:24.694103 10348 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:02:24.748186  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 54184us
I20260709 13:02:24.781386 10332 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.783309  9418 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.784217 10369 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.785772  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.786510 10369 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.787868  9418 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.788993 10369 raft_consensus.cc:2804] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:24.789986  9418 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.789371 10369 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:24.747021 10363 raft_consensus.cc:740] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:24.791917 10369 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.794339 10363 consensus_queue.cc:260] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.795344 10363 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.792251 10280 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:24.799937 10280 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:24.800449 10280 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.791554  9418 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.792719 10322 raft_consensus.cc:3055] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:24.805328 10322 raft_consensus.cc:740] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:24.806209  9418 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.806413 10322 consensus_queue.cc:260] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.807118 10323 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.807871 10323 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.813501 10322 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.814328  9418 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.817863 10369 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:24.820703 10323 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.823844 10369 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:24.822533  9418 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.825481  9418 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.826299 10335 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:24.826727 10335 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:24.827093 10335 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.829365 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:24.821310  9520 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:24.791356  9343 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.836694 10369 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.836776 10348 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.837098  9446 raft_consensus.cc:1240] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
W20260709 13:02:24.837934  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 46648.3us
I20260709 13:02:24.838017  9418 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.840406  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.812856 10280 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.838761 10348 consensus_queue.cc:1059] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.842201 10354 raft_consensus.cc:3055] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:24.842571 10354 raft_consensus.cc:740] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:24.843667 10354 consensus_queue.cc:260] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.845258 10335 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.847257 10335 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:24.847992 10323 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:24.848415 10323 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:24.848773 10323 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.844945 10354 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.856032 10323 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:24.857169 10369 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.858858 10323 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:24.860605 10352 consensus_queue.cc:1048] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:24.842614 10280 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:24.861675  9444 raft_consensus.cc:1240] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
W20260709 13:02:24.862692  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.862999  9418 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:02:24.863471 10351 consensus_queue.cc:1059] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:24.864379 10352 raft_consensus.cc:2804] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:24.864493 10351 raft_consensus.cc:3055] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:24.864923 10352 raft_consensus.cc:697] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 2 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:24.865054 10351 raft_consensus.cc:740] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:24.865998 10352 consensus_queue.cc:237] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:24.866405 10351 consensus_queue.cc:260] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:24.868455 10351 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.869355  9343 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.874967  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:24.875295  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:24.872974 10332 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.874972  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:24.876704  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:24.877210  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:24.877480  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:24.878342  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:24.879786  9447 raft_consensus.cc:1240] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:24.884335  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:24.885666  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:24.886699  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:24.892134  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:24.893473  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:24.893576  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:24.893682  9490 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.895098 10363 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.895740  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:24.897025  9490 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.898243 10363 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.898532  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:24.899346  9490 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.900136 10363 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.896950  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:02:24.900978  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.900931  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:24.902359  9490 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.902581  9519 raft_consensus.cc:1240] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:24.903203 10363 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.904871  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:24.905303  9443 raft_consensus.cc:1275] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:24.907262  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:24.892359  9370 raft_consensus.cc:1240] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:24.918041  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:24.927917  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:24.934118  9368 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:24.934751  9374 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:24.937141  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:24.937486  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:24.937723  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:24.938014  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:24.923352  9343 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.923869  9418 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.924683  9490 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.925623 10312 consensus_queue.cc:1048] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:24.926558  9522 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:24.938472  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:24.939531  9490 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.939615  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:24.940369 10356 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.940913 10370 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.941457 10335 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.942852  9418 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.943085 10356 consensus_queue.cc:1059] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:24.943570 10352 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.944789  9418 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.944723 10356 raft_consensus.cc:3055] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:24.945523 10356 raft_consensus.cc:740] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:24.946574  9418 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:24.945602 10352 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.947472 10335 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:24.946631 10356 consensus_queue.cc:260] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.948028 10352 consensus_queue.cc:1048] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:24.949100 10356 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.956674  9343 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:24.937211  9374 raft_consensus.cc:1240] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:24.957530 10348 consensus_queue.cc:1048] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:24.958876 10354 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:24.962507  9372 raft_consensus.cc:1240] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:24.967031 10354 raft_consensus.cc:697] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:24.968071 10354 consensus_queue.cc:237] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.971982 10321 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:24.972548 10321 raft_consensus.cc:697] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:24.973557 10321 consensus_queue.cc:237] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:24.997687 10356 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:24.998203 10335 consensus_queue.cc:1059] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.998402 10356 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:24.999641 10323 raft_consensus.cc:3055] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:25.000028 10323 raft_consensus.cc:740] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:25.000921 10323 consensus_queue.cc:260] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:25.003528 10323 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.005704  9520 raft_consensus.cc:2955] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:25.008930 10356 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:25.010288 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:25.016597 10069 raft_consensus.cc:2393] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 2: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:02:25.021729  9521 raft_consensus.cc:2955] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:25.023329  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:25.033828  9446 raft_consensus.cc:1240] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:25.035534 10321 consensus_queue.cc:1059] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:25.036579 10335 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:25.037189 10335 raft_consensus.cc:697] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 2 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:25.037819  9370 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:25.038090 10335 consensus_queue.cc:237] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:25.038619 10354 raft_consensus.cc:3055] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:25.038991 10354 raft_consensus.cc:740] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:25.039844 10354 consensus_queue.cc:260] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:25.041216 10354 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.042472  9418 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:25.046344  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.048026 10280 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:25.048595 10280 raft_consensus.cc:697] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 2 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:25.049762 10280 consensus_queue.cc:237] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:25.053763  9446 raft_consensus.cc:1240] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:25.058192 10321 consensus_queue.cc:1059] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:25.058818  9446 raft_consensus.cc:1240] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:25.059437 10348 raft_consensus.cc:3055] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:25.059813 10348 raft_consensus.cc:740] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:25.060469 10347 consensus_queue.cc:1059] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:25.060576 10348 consensus_queue.cc:260] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:25.061518 10347 raft_consensus.cc:3055] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:25.061542 10348 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.062022 10347 raft_consensus.cc:740] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:25.062834 10347 consensus_queue.cc:260] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:25.064092 10347 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.070923 10323 consensus_queue.cc:1059] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:25.072978 10352 raft_consensus.cc:3055] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:25.073396 10352 raft_consensus.cc:740] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:25.084348  9445 raft_consensus.cc:1240] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:25.074203 10352 consensus_queue.cc:260] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:25.080161  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:25.086133 10352 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.086055  9446 raft_consensus.cc:2468] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:25.090065  9272 catalog_manager.cc:5697] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 1 to 2, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 2 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.093559  9418 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:25.097965  9273 catalog_manager.cc:5697] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 1 to 2, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 2 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.100293  9273 catalog_manager.cc:5697] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 1 to 2, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 2 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.095804 10369 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:25.102051 10348 consensus_queue.cc:1059] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:02:25.106278 10348 raft_consensus.cc:3055] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:25.106796 10348 raft_consensus.cc:740] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:25.108538 10348 consensus_queue.cc:260] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:25.120987 10321 raft_consensus.cc:1064] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:02:25.122323 10348 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.131007 10321 consensus_queue.cc:237] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:25.151981  9275 catalog_manager.cc:5697] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 1 to 2, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 2 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.156010  9275 catalog_manager.cc:5697] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 1 to 2, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 2 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:25.157310  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 61904.2us
I20260709 13:02:25.158071  9418 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:25.158865 10323 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:25.160185  9418 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:25.160990 10323 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:25.162176  9418 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:25.163054 10323 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:25.163262 10341 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.163964 10341 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:25.165776 10323 consensus_queue.cc:1059] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:25.166932 10400 raft_consensus.cc:3055] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:25.167263 10400 raft_consensus.cc:740] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:25.167454 10069 raft_consensus.cc:1275] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:25.168102 10400 consensus_queue.cc:260] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:25.169066  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:25.169723 10400 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.169842  9521 raft_consensus.cc:1275] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:25.171387 10354 consensus_queue.cc:1048] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:25.171620  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:25.172320  9521 raft_consensus.cc:2468] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 2.
I20260709 13:02:25.173143 10348 consensus_queue.cc:1048] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:25.173702 10027 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:25.174723 10312 raft_consensus.cc:2804] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:25.175149 10312 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.175537 10312 raft_consensus.cc:3060] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:25.176260  9446 raft_consensus.cc:1275] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:25.178275 10351 consensus_queue.cc:1048] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:25.185158 10341 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:25.195300 10312 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:25.199294  9445 raft_consensus.cc:1240] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:25.202062 10351 consensus_queue.cc:1059] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:25.203698 10351 raft_consensus.cc:3055] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:25.204068 10351 raft_consensus.cc:740] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:25.205166 10351 consensus_queue.cc:260] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:25.206657 10351 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.209100  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:02:25.211180  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 46472.5us
I20260709 13:02:25.212044  9418 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:25.219096  9418 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:25.226038  9418 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:25.229396  9418 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:25.232492 10312 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:25.222726 10352 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:25.222224 10323 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:25.236666 10280 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:25.237186 10280 raft_consensus.cc:697] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 2 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:25.236681  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:25.238029 10280 consensus_queue.cc:237] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:25.238687  9521 raft_consensus.cc:3060] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:25.233064 10324 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:25.246928 10323 raft_consensus.cc:2955] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:25.252616 10070 raft_consensus.cc:2955] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:25.264001  9490 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:02:25.265370 10370 raft_consensus.cc:2804] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:25.265777 10370 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:25.266152 10370 raft_consensus.cc:3060] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.267163  9521 raft_consensus.cc:2468] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 3.
I20260709 13:02:25.273336 10027 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:25.275463 10370 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:25.285099  9520 raft_consensus.cc:2955] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:25.277387 10312 raft_consensus.cc:2804] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:25.300937 10312 raft_consensus.cc:697] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 3 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:02:25.301817 10312 consensus_queue.cc:237] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:25.277369 10354 raft_consensus.cc:2955] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:25.276935 10067 raft_consensus.cc:2955] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:25.293538  9275 catalog_manager.cc:5697] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 1 to 2, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 2 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.322382  9522 raft_consensus.cc:2955] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:25.325315 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:25.326098 10069 raft_consensus.cc:2393] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 2: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:02:25.326144 10370 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:25.364084  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:25.368417  9526 raft_consensus.cc:1240] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:25.372542  9275 catalog_manager.cc:5697] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:25.376361  9274 catalog_manager.cc:5697] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:25.376063  9372 raft_consensus.cc:2955] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:25.377614  9446 raft_consensus.cc:2955] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:25.382745 10369 consensus_queue.cc:1059] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:25.384821 10400 raft_consensus.cc:3055] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:25.385324 10400 raft_consensus.cc:740] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:25.386178 10400 consensus_queue.cc:260] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:25.387904 10400 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.399420  9448 raft_consensus.cc:2468] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:25.400360  9525 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:25.403786 10348 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:25.405918  9490 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:02:25.407332 10370 raft_consensus.cc:2804] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:25.407874 10370 raft_consensus.cc:697] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:25.407493  9448 consensus_queue.cc:237] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:25.408720 10370 consensus_queue.cc:237] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:25.401389  9370 consensus_queue.cc:237] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:25.418165 10067 raft_consensus.cc:1275] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:25.423175 10321 consensus_queue.cc:1048] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:25.439337  9448 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.438849 10351 raft_consensus.cc:2955] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:25.453850  9370 raft_consensus.cc:1275] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:25.449083 10067 raft_consensus.cc:2955] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:25.457808 10400 consensus_queue.cc:1048] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:25.460405 10356 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.460981 10356 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:25.462985  9518 raft_consensus.cc:1240] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:25.463124 10356 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:25.464798  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:25.465510  9372 raft_consensus.cc:2468] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:25.466687  9492 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:25.467458 10325 raft_consensus.cc:2804] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:25.467837 10325 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.468189 10325 raft_consensus.cc:3060] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:25.474367 10400 consensus_queue.cc:1059] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:25.475698 10400 raft_consensus.cc:3055] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:25.476032 10400 raft_consensus.cc:740] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:25.477425 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:25.478720 10065 raft_consensus.cc:2468] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:25.476804 10400 consensus_queue.cc:260] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:25.486728  9445 raft_consensus.cc:1275] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:25.477610 10325 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:25.492405 10321 consensus_queue.cc:1048] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:25.493876 10400 raft_consensus.cc:3060] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:25.499518  9274 catalog_manager.cc:5697] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 2 to 3, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 3 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:25.502131  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b5a227bc15c0427bbed0fbbe37f826f1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:25.501888 10341 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.505826 10325 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:25.505628 10341 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:25.506160 10369 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:25.507217 10369 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:25.507853 10341 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:25.508526  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:25.509174  9372 raft_consensus.cc:3060] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:02:25.511770 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:25.511940  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:25.512430 10067 raft_consensus.cc:3060] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:25.512898  9452 raft_consensus.cc:2468] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 1.
I20260709 13:02:25.521445  9448 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:25.526789 10067 raft_consensus.cc:2468] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:25.534929  9525 raft_consensus.cc:1275] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:25.534420  9491 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:02:25.540622  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:25.525557 10370 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.541919 10069 raft_consensus.cc:1275] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:25.558094  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:25.560294 10369 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:25.561434 10323 consensus_queue.cc:1048] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:02:25.565907 10407 log.cc:927] Time spent T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:02:25.540463 10356 raft_consensus.cc:2804] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:25.543222 10348 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:02:25.540102 10025 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:25.587697 10356 raft_consensus.cc:697] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:25.603092 10356 consensus_queue.cc:237] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:25.605295  9522 raft_consensus.cc:1275] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:02:25.609926 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 75777.5us
I20260709 13:02:25.610984 10341 raft_consensus.cc:2804] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:25.611552 10341 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.611968 10341 raft_consensus.cc:3060] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:25.556972 10370 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:25.620824  9374 raft_consensus.cc:1275] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:02:25.634783 10365 log.cc:927] Time spent T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:02:25.645057  9525 raft_consensus.cc:2468] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:25.635162  9520 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.657531 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:25.657820 10370 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:25.634081 10335 consensus_queue.cc:1048] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:02:25.634276 10369 consensus_queue.cc:1048] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:02:25.633077  9372 raft_consensus.cc:2468] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
W20260709 13:02:25.674003  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 81015.1us
I20260709 13:02:25.680676  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:25.681397  9445 raft_consensus.cc:2468] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:25.682655  9443 raft_consensus.cc:1275] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:02:25.685250 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 119892us
I20260709 13:02:25.752053  9490 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:25.763379  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 88202us
I20260709 13:02:25.764413 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:25.732726 10332 consensus_queue.cc:1048] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:02:25.788422  9418 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:25.770421 10325 raft_consensus.cc:2804] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:25.780544 10326 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.798247 10414 raft_consensus.cc:2804] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:25.795895 10325 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.808642  9519 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.815646 10414 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:25.818750 10325 raft_consensus.cc:3060] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:25.803347 10326 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:25.847849 10414 raft_consensus.cc:3060] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.844391 10341 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:02:25.921375  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 133046us
I20260709 13:02:25.933399 10069 raft_consensus.cc:2368] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:25.954717 10417 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.960326 10417 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:25.942667  9520 raft_consensus.cc:1275] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:25.979146  9519 raft_consensus.cc:1275] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:25.979660 10312 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:25.998514 10312 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:25.998099 10413 raft_consensus.cc:2955] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:25.994344  9275 catalog_manager.cc:5697] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 1 to 2, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 2 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.991555  9273 catalog_manager.cc:5697] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index 3 to 4, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:26.012617  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:26.013844  9452 raft_consensus.cc:2393] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 in current term 2: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:26.014489 10326 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.018181 10312 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.024367 10341 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.079891  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:26.081079  9374 raft_consensus.cc:2393] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 in current term 2: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:26.083351  9371 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:26.089188  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:26.078446 10416 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.081027 10417 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:26.206944  9417 leader_election.cc:400] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Vote denied by peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623) with higher term. Message: Invalid argument: T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
W20260709 13:02:26.207773  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 49772.6us
I20260709 13:02:26.216029 10070 raft_consensus.cc:2955] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:26.282908 10418 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.283675 10418 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.286985  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:26.167667  9443 raft_consensus.cc:1275] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:02:26.306787 10417 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.307655 10417 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.161048 10416 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.319993 10025 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:26.166761  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:26.322508 10312 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:26.291208  9443 pending_rounds.cc:85] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 4
I20260709 13:02:26.205966  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:26.329846  9446 raft_consensus.cc:2468] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 2.
I20260709 13:02:26.334173 10312 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:26.231508 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 70545us
I20260709 13:02:26.342697  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:26.348059 10025 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:26.389231 10312 raft_consensus.cc:2804] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:26.389874 10312 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.390334 10312 raft_consensus.cc:3060] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:26.393697 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 45765.2us
I20260709 13:02:26.415172 10416 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:26.381039 10418 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:26.382618 10325 consensus_meta.cc:287] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.000s
I20260709 13:02:26.428129 10325 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:26.431207 10325 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:26.380293 10417 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:26.296147 10414 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:26.436153 10414 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:02:26.482340  9415 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.011s	sys 0.014s
W20260709 13:02:26.483407  9415 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.011s	sys 0.014s
W20260709 13:02:26.487756  9418 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.059s	sys 0.145s
W20260709 13:02:26.488430  9418 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.059s	sys 0.145s
W20260709 13:02:26.488940  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 548376us
I20260709 13:02:26.489140  9445 raft_consensus.cc:3060] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:26.488315  9443 pending_rounds.cc:107] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:02:26.493911  9443 raft_consensus.cc:2889] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:26.504063  9492 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.096s	sys 0.161s
W20260709 13:02:26.504628  9492 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.096s	sys 0.161s
W20260709 13:02:26.505053  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 735035us
I20260709 13:02:26.512244  9523 raft_consensus.cc:2955] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:26.523528  9525 raft_consensus.cc:2393] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 in current term 3: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:26.524017  9526 raft_consensus.cc:1275] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:02:26.532339  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 367236us
W20260709 13:02:26.540681 10332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.030s	sys 0.020s
W20260709 13:02:26.541378 10332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.031s	sys 0.020s
I20260709 13:02:26.542040 10332 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.544974 10332 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.546356 10325 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:26.547355 10325 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.548264 10332 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.549049 10332 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:26.550009 10332 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.551337 10326 consensus_queue.cc:1048] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:26.552559 10332 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.553221 10332 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:26.554235 10332 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.564371 10369 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:26.565811 10348 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.566224 10351 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.566823 10348 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.567190 10351 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.569481 10352 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:26.570263 10348 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.570411 10352 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.565776 10369 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.573433 10356 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.574366 10356 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.578648 10356 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:26.579370 10356 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.580108 10356 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.582144 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:26.583407 10065 raft_consensus.cc:2368] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:26.583801 10356 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:26.585445 10323 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:26.586390 10323 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.587663  9520 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:26.589780 10370 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:26.590718 10280 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.590679 10370 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.591533 10280 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.585250 10356 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:26.593361 10324 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:26.594312 10324 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.574335 10369 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.545385 10322 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.599807 10322 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:26.601495  9416 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.013s	sys 0.047s
W20260709 13:02:26.601894  9416 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.013s	sys 0.048s
I20260709 13:02:26.602563  9417 leader_election.cc:400] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Vote denied by peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623) with higher term. Message: Invalid argument: T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:26.602979  9417 leader_election.cc:403] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:02:26.605943 10369 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:26.606623 10369 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.609225 10335 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.609858 10335 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.612030 10322 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:26.613616 10370 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:26.614639 10322 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:26.615324 10322 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:26.617496 10341 consensus_queue.cc:1048] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:26.608934 10369 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.621650 10325 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:26.624281 10325 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.625052 10351 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.594040 10356 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:02:26.649194  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 88260.8us
I20260709 13:02:26.650535 10069 raft_consensus.cc:1275] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:26.653540 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:26.654503 10067 raft_consensus.cc:2393] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 3: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:02:26.625061 10335 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.625111 10325 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.663810 10432 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.631544 10332 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.666210 10323 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.689832 10439 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:26.690734 10439 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.693157 10440 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:26.694015 10440 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.697048 10280 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.681434 10352 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.699156 10356 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:26.701632 10322 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:26.703868 10325 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:26.706676 10414 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.707682 10414 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:26.697082 10442 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.710769 10440 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:26.710163 10442 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.711388 10430 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:02:26.673954  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:26.713246 10430 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:26.734808  9520 raft_consensus.cc:2368] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:26.721377 10440 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:02:26.758306  9343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.005s	sys 0.010s
I20260709 13:02:26.758455 10428 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:26.759289 10428 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:26.758769  9343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.005s	sys 0.010s
I20260709 13:02:26.744915 10324 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.750945 10439 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.766939 10449 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:26.767503 10413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51006 (request call id 62) took 1361 ms. Trace:
I20260709 13:02:26.756750 10442 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:26.767565 10280 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.765497 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:26.745479 10430 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.744215 10325 consensus_queue.cc:1048] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:02:26.789938 10069 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:26.788908 10356 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:02:26.793834  9341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.010s	sys 0.005s
W20260709 13:02:26.794294  9341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.010s	sys 0.005s
I20260709 13:02:26.794179 10356 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:26.797650 10356 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:26.802693 10312 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:26.804602 10067 raft_consensus.cc:1240] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:26.807967 10324 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.808635 10324 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.767724 10449 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.812058 10324 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.768815 10440 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.814639 10312 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.816771  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:26.816874  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:26.815855 10440 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:26.817811  9450 raft_consensus.cc:3060] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:26.818735  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:26.770447 10280 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.820336  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:26.813666 10430 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.748394 10432 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.822391  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:26.820971  9447 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:26.829305  9448 raft_consensus.cc:2393] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 2: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:26.832155  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:26.832955  9447 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:26.834295  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:26.835275  9447 raft_consensus.cc:2393] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 2: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:26.836076  9445 raft_consensus.cc:2468] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 3.
I20260709 13:02:26.836345  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:26.837126  9447 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:26.838789  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:26.839417  9447 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:26.768107 10413 rpcz_store.cc:276] 0709 13:02:25.405790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.405936 (+   146us) service_pool.cc:224] Handling call
0709 13:02:25.410195 (+  4259us) log.cc:844] Serialized 480 byte log entry
0709 13:02:26.767255 (+1357060us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":941,"raft.run_cpu_time_us":1060,"raft.run_wall_time_us":1060}
I20260709 13:02:26.838555 10437 consensus_queue.cc:1048] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:02:26.821841 10280 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.822695 10428 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:26.821640  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:26.823781  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:26.853477  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:26.854489  9448 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:26.848452  9508 tablet_service.cc:1558] Processing DeleteTablet for tablet b5a227bc15c0427bbed0fbbe37f826f1 with delete_type TABLET_DATA_TOMBSTONED (TS 6d50f1c263264b21919230bee398022b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46892
I20260709 13:02:26.855233  9449 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:26.856060 10299 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.859757 10299 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.856537 10449 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:26.863022 10299 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.824319 10430 consensus_queue.cc:1048] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:02:26.830955  9451 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:26.869755 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:26.871368 10432 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.865455 10447 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.872818 10447 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:26.875717 10447 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:26.837387 10369 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623) with higher term. Message: Invalid argument: T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:26.860270  9372 consensus_queue.cc:237] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:26.890983 10443 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:26.891222 10332 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.891790 10443 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:26.892128 10332 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.880743 10439 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.894371 10439 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.895231 10332 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.896534 10439 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.899365 10443 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:26.901196  9446 raft_consensus.cc:2393] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 2: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:26.901559  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:26.902218  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:26.902477  9443 raft_consensus.cc:2393] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 2: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:26.901226 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:26.902908 10432 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:26.904559 10432 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.905000  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:26.905750 10414 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:26.905963  9443 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:26.906687 10432 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.907351  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:26.878249 10299 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:26.909552 10299 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.912473 10299 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:26.877210 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 222159us
I20260709 13:02:26.903817  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:26.919421  9450 raft_consensus.cc:2468] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 3.
I20260709 13:02:26.921491 10332 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.921707  9444 raft_consensus.cc:1240] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:26.922171 10332 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.924700 10332 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.926813 10443 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:26.929201  9447 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:26.934439  9418 leader_election.cc:400] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:26.943562 10025 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:26.945209 10312 raft_consensus.cc:2804] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:26.945923 10312 raft_consensus.cc:697] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 3 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:02:26.944154  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:26.947521  9448 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:26.947343 10312 consensus_queue.cc:237] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:26.950343 10447 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.951056 10447 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.953276  9446 raft_consensus.cc:2393] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 2: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:26.918998 10414 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:02:26.962881 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:26.966431 10069 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:26.921108  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:26.971411 10443 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.954491  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:26.974494 10443 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.986770 10443 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:26.987748 10443 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.988544 10351 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.989434 10351 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.991976 10351 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.993242 10447 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:26.994065  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:26.994231 10325 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.994732  9526 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:26.994889 10325 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.995859  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:26.996546  9518 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:26.997762  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:26.998522  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:26.999382 10427 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.999784  9520 raft_consensus.cc:2393] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 2: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:26.999972 10427 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.000455  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.001206  9370 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:27.002405 10427 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:27.003211  9368 raft_consensus.cc:1275] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:27.003574 10428 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.004184 10440 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:27.004354 10428 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:27.004806 10440 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.003500 10322 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:27.003285  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.008354  9371 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:27.010859 10458 tablet_replica.cc:333] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:02:26.997795  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.008404 10449 consensus_queue.cc:1059] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:02:27.015074  9525 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:27.015630 10449 raft_consensus.cc:3055] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:27.016158 10449 raft_consensus.cc:740] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:26.985292 10424 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:27.017728 10424 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.018687 10332 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:27.019377 10332 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:26.979987  9273 catalog_manager.cc:5697] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 3 to 4, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New cstate: current_term: 1 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:27.006239 10025 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
W20260709 13:02:27.021169  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 51690.4us
I20260709 13:02:27.022199 10326 raft_consensus.cc:2804] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:27.022738 10326 raft_consensus.cc:697] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 3 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:02:27.022936  9521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 804) took 1239 ms. Trace:
I20260709 13:02:26.971417  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:26.981030  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 47147.8us
I20260709 13:02:27.024060 10369 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:27.031322 10443 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:27.031955  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.032720  9517 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:27.032928 10449 consensus_queue.cc:260] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:27.034372 10449 raft_consensus.cc:3060] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.035144  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.020781 10424 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:27.031777 10369 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:27.037814  9447 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:27.044183  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.047318  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.048236  9374 raft_consensus.cc:2393] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 2: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:27.023849 10326 consensus_queue.cc:237] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:27.056321  9260 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 31a8af9a9a6948d584c9c4c96ee8c808 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:27.056686 10324 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.057273 10324 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.059113  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:27.059900  9450 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:27.057273  9490 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:27.061854  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.062419  9526 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:27.058488  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.064833  9368 raft_consensus.cc:2393] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 2: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:27.065321 10458 raft_consensus.cc:2243] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:27.061554  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:27.066919  9490 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:27.067798  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.068544  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.069128  9374 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:27.050392 10070 raft_consensus.cc:1275] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:27.024344 10322 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.009605 10351 consensus_queue.cc:1048] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:02:27.093485  9490 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:27.023448  9521 rpcz_store.cc:276] 0709 13:02:25.783268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.783413 (+   145us) service_pool.cc:224] Handling call
0709 13:02:25.783788 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:26.155436 (+371648us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:26.155480 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:26.209807 (+ 54327us) log.cc:844] Serialized 26 byte log entry
0709 13:02:26.784296 (+574489us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:26.842112 (+ 57816us) log.cc:844] Serialized 14 byte log entry
0709 13:02:26.984529 (+142417us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b180001fae0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb5833f7c0a 00007fb58cb37219 00007fb58347fa40 00007fb58347a4e4 00007fb58347a455 00007fb586562060 00007fb586574716 00007fb586585287 00007fb586585208
0709 13:02:27.006932 (+ 22403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.022424 (+ 15492us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:27.022478 (+    54us) raft_consensus.cc:1685] finished
0709 13:02:27.022578 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.022726 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":113,"prepare.queue_time_us":20343,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":1067,"raft.queue_time_us":186475,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":5067,"spinlock_wait_cycles":6104448,"thread_start_us":715060,"threads_started":2,"wal-append.queue_time_us":364004}
I20260709 13:02:27.097805 10458 raft_consensus.cc:2272] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:27.098739 10356 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:27.092041 10442 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:27.100283 10440 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:27.100558  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.101755  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.092249 10428 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:27.112820 10356 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.113317 10356 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.114001  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.116516  9368 raft_consensus.cc:2393] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 2: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:27.069070  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.104054  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.118894  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.119738  9526 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:27.122833  9375 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:27.108265  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.124406  9369 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:27.112236  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.125444  9377 raft_consensus.cc:2393] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 2: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:27.125272  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.125793  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.126036  9370 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
W20260709 13:02:27.126650  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 60488.6us
I20260709 13:02:27.138739  9517 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:27.116986 10322 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:27.124439  9372 raft_consensus.cc:2393] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 2: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:27.139104  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.140194  9374 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:27.150444  9490 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:27.142082  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.142921 10458 ts_tablet_manager.cc:1916] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:27.143635  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.140205  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.155393  9526 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:27.140530  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.101781 10324 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:27.127410 10332 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:27.112614 10325 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:27.117122 10442 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.155478  9521 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:27.152163  9525 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:27.150074 10440 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:27.181844  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:27.186859  9450 raft_consensus.cc:2393] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 2: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:27.181751  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.164184 10322 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:27.186570  9490 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:27.186540  9524 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:27.187402  9371 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:27.191113  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:27.191915  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:27.190464  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.205713  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.206557  9526 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:27.189281 10442 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.219673  9377 raft_consensus.cc:2410] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:27.220255 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:27.226706  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:27.217144 10369 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:27.226187  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:27.198263 10440 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.214768 10428 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:27.265547  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.269817  9371 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:27.179584 10299 consensus_queue.cc:1048] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:02:27.208899  9520 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:27.200747 10322 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:27.258061  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 86530.6us
W20260709 13:02:27.264869  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 46972.7us
I20260709 13:02:27.271276  9452 raft_consensus.cc:2393] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 2: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:27.280906 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:27.290644  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.296211  9524 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:27.266746 10440 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.287137 10322 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.307701  9418 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:27.296105 10325 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:27.320145  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.282706  9443 raft_consensus.cc:2468] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:27.312654  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.322849  9374 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:27.328532  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.329377  9518 raft_consensus.cc:1803] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: voting while tombstoned based on last-logged opid 1.3
I20260709 13:02:27.330035  9518 raft_consensus.cc:2468] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:27.330113  9341 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:27.332439  9490 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:27.332439  9418 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:27.335732  9418 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:27.297658 10428 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.336887  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.319746  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.340687  9377 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:27.342162 10433 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:27.342599 10433 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.342957 10433 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.338471  9374 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:27.339133 10443 raft_consensus.cc:2804] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:27.339740  9490 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:27.320119 10351 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:27.350051 10443 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.350298 10414 raft_consensus.cc:2804] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:27.350534 10443 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.350708 10414 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.351115 10414 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.352166 10418 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:27.352567 10418 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:27.354794  9341 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:27.358032  9418 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:27.353457  9490 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:27.363631  9418 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:27.352948 10418 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.364610 10324 raft_consensus.cc:2804] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:27.365182 10369 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:27.365597 10369 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.365926 10369 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.368044 10442 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:27.372803 10465 log.cc:927] Time spent T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:02:27.375237  9418 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:27.377811  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.375655  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:27.385603  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.375777  9341 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:27.345270 10437 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:27.369360 10324 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.375372 10299 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:27.392900  9418 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:27.362177  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.396000  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.385267  9522 raft_consensus.cc:2368] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:27.402554 10442 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:27.402658 10428 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:27.404219  9341 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:27.404666  9370 raft_consensus.cc:2393] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 2: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:27.387290  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.406689  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.538455  9368 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:27.391220 10437 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.409574  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.409742  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.411648 10325 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.394210 10434 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:27.420118 10418 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.399432 10324 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.399717 10299 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.544665 10299 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.425494  9519 raft_consensus.cc:2410] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:02:27.426491 10356 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.428695  9343 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:27.433105 10431 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:27.550814 10431 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:27.551136  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 122546us
I20260709 13:02:27.389835 10351 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.433374 10433 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.553223 10439 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:27.553870 10439 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:27.554319 10439 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.391115 10435 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:27.436800  9490 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:27.555167 10433 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:27.555603  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 118869us
I20260709 13:02:27.555949 10433 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:27.556456 10433 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.553261  9523 raft_consensus.cc:1275] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:27.394200 10424 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:27.557562  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.557992 10424 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.558477 10424 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.443467  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.452962  9443 raft_consensus.cc:1275] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:27.455927  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.456519 10440 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.560034 10418 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:27.463266 10414 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.474109 10449 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:27.474804 10471 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:27.453156  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.561344 10471 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.493827 10322 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.561967 10414 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:27.469961 10369 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.497864  9446 raft_consensus.cc:1275] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:27.563848 10471 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:27.564095 10369 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:27.509428 10352 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:27.479380 10443 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.564904 10352 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.566484 10352 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.566962 10443 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:27.534868 10432 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:27.567770 10432 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:27.568262 10432 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.543308  9369 raft_consensus.cc:2393] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 2: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:27.541909 10325 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.543912  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.540321 10437 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.551240 10431 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.553352 10351 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:27.509788  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 117040us
W20260709 13:02:27.533759  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 129587us
I20260709 13:02:27.566152  9374 raft_consensus.cc:2368] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:27.540868  9375 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:27.553226  9343 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:27.556871 10433 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.563871 10322 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:27.551262 10356 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:27.581146 10427 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:27.582126  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:27.560885 10449 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.586428  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:27.590852  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:27.593353  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:27.594800  9524 raft_consensus.cc:1275] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:02:27.595196  9524 pending_rounds.cc:85] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 4
I20260709 13:02:27.595235 10449 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:27.595561  9524 pending_rounds.cc:107] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:02:27.601037  9524 raft_consensus.cc:2889] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:27.600111  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:27.589253  9452 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:27.631614  9448 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:27.588070 10427 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:27.637568 10427 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:27.664194  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 85450.6us
I20260709 13:02:27.639304  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:27.630213  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:27.668301  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:27.669303  9448 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:27.671701  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.671783  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.672380  9526 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:27.672596  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.673484  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.671957  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.670729  9418 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:27.673522  9518 raft_consensus.cc:2393] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:27.680169 10322 consensus_queue.cc:1048] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:27.680763 10312 consensus_queue.cc:1048] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:27.682379 10430 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:27.664814 10471 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:27.683676  9418 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:27.684005 10471 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.684952 10430 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:27.685461 10430 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:27.685920 10430 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.686247 10471 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:27.674171  9520 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:27.689569  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:27.690282  9448 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:27.688580  9418 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:27.693622  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:27.678557 10427 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:27.677697  9446 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:27.674952  9443 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:27.665242 10438 consensus_queue.cc:1048] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:02:27.700726  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.705564  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:27.706815  9492 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:27.688089 10299 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.712261  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.723249  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:27.724011  9368 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.723886  9418 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:27.723171  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.724570  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:27.725193 10483 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:27.725654 10483 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:27.726061 10483 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.726199  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:27.726871  9375 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.706396  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.704425  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.728338  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:27.728457  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.731377  9492 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:27.732295  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.730420  9524 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:27.733173  9492 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:27.733420  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.717384 10471 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:27.734469  9374 raft_consensus.cc:2393] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 2: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:27.718557 10369 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:27.737531 10369 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:27.737982 10369 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.738076 10322 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:27.732916  9526 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:27.708896  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.741179  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:27.746433  9492 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:27.747704 10288 consensus_queue.cc:1048] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:02:27.749738 10473 log.cc:927] Time spent T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.213s	user 0.001s	sys 0.003s
I20260709 13:02:27.752532  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:27.753254  9373 raft_consensus.cc:2368] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:27.751803  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.756098  9492 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:27.751681 10430 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.769053  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.770339 10299 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:27.771396 10474 log.cc:927] Time spent T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:02:27.772233 10440 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:27.773280 10431 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.745834 10356 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:27.722534 10458 ts_tablet_manager.cc:1929] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:27.794296  9525 raft_consensus.cc:1275] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:27.740340 10439 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.765622  9519 raft_consensus.cc:2393] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
W20260709 13:02:27.812988  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 85697.7us
I20260709 13:02:27.759625  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:27.819844  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.767127 10449 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:27.808213 10356 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:27.751708 10352 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.860718 10480 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:27.861194  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:27.809250 10324 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:27.865890 10356 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.868139 10431 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:27.817056  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:27.871927 10324 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:27.872874  9444 raft_consensus.cc:2393] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:27.873100 10480 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:27.881698 10480 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.876196 10433 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.877184 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:27.883054 10070 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.864125 10424 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.827389 10458 log.cc:1199] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-2-root/wals/b5a227bc15c0427bbed0fbbe37f826f1
I20260709 13:02:27.880081 10437 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:27.830264  9492 raft_consensus.cc:2686] T b5a227bc15c0427bbed0fbbe37f826f1 P 6d50f1c263264b21919230bee398022b: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:02:27.898298  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 142272us
I20260709 13:02:27.854614 10449 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:27.899878  9492 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:27.885937  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:27.900830  9524 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.878937 10325 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.911453  9447 raft_consensus.cc:2393] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:27.889501  9368 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:27.895287  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.817392 10440 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:27.885457  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.905401  9343 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:27.919866  9523 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:27.903653  9492 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:27.909255  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:27.866425  9372 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:27.909967  9517 raft_consensus.cc:2368] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3.
I20260709 13:02:27.856992 10448 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:27.884932 10433 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:27.921219  9343 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:27.928251  9521 raft_consensus.cc:2393] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:27.875559 10432 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.925827  9371 raft_consensus.cc:2393] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 3: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:27.928876  9343 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:27.932323  9343 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:27.859369  9376 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:27.902634 10449 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.926146  9448 raft_consensus.cc:2393] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:27.902262 10418 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:27.935011  9492 leader_election.cc:400] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:27.895001 10288 consensus_queue.cc:1048] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:02:27.930362  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:27.918903 10434 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:27.942907  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:27.933477 10322 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.934396 10443 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:27.925199 10447 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:27.926790 10356 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.956866 10325 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:27.937929 10440 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.938920  9492 leader_election.cc:403] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:27.926046  9519 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:02:27.937351  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 84493.6us
I20260709 13:02:27.931492 10430 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:27.963737 10440 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:27.969503 10347 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:27.973953 10347 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.974452 10347 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.952770 10443 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.975580 10443 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.957502 10356 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:27.970372  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:27.970819 10458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46892 (request call id 65) took 1201 ms. Trace:
I20260709 13:02:27.953950 10447 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.987445 10483 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.991060  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:27.991245  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:27.952932 10427 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:27.994180 10437 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:27.995226 10439 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:27.943897 10418 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:27.995924  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:27.943398 10434 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:27.997833  9375 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:27.995893  9519 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:28.008774  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:02:28.018493  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 56213.6us
I20260709 13:02:28.012629 10433 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:28.012727 10442 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:28.008975 10440 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:27.988799 10352 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:28.021914  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:28.019675  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 87434us
I20260709 13:02:28.009440 10447 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:27.965507 10070 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:28.091648  9418 leader_election.cc:400] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:28.033119 10325 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:28.033051 10347 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:28.034049  9444 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:28.015749  9524 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:27.940922 10448 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:28.092097  9418 leader_election.cc:403] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:28.021481 10424 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:28.112545  9343 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:28.116569  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:28.028834 10434 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.091475  9445 raft_consensus.cc:2393] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
W20260709 13:02:28.118436  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 82138.3us
I20260709 13:02:28.028126 10483 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:28.035434 10443 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:28.121837  9450 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:28.025976  9446 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:28.140204 10496 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:28.026332 10369 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:28.092674 10442 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:28.165681 10487 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:02:28.120922  9451 raft_consensus.cc:2955] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:28.166074 10352 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:28.166498 10492 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:28.168004 10439 consensus_queue.cc:1048] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:28.173451  9490 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:28.095022 10440 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:28.113373 10433 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:28.189659  9450 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
W20260709 13:02:28.119867 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 125543us
I20260709 13:02:28.194085  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:28.211871  9523 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:28.189605 10496 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.998805 10458 rpcz_store.cc:276] 0709 13:02:26.830532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.847992 (+ 17460us) service_pool.cc:224] Handling call
0709 13:02:27.010224 (+162232us) ts_tablet_manager.cc:1151] Deleting tablet b5a227bc15c0427bbed0fbbe37f826f1
0709 13:02:27.010345 (+   121us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:02:27.448425 (+438080us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:27.719013 (+270588us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:27.970723 (+251710us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35647,"tablet-delete.queue_time_us":154822,"thread_start_us":107566,"threads_started":1}
I20260709 13:02:28.201406  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:02:28.223583  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 50202.6us
W20260709 13:02:28.223383  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 100235us
I20260709 13:02:28.224426 10499 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:28.228119  9490 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:28.229112  9341 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:28.229753 10471 raft_consensus.cc:2749] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:28.224170 10498 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:28.231029  9341 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:28.231520 10498 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:28.226876  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:28.233795  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:28.226826  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:28.235160  9448 raft_consensus.cc:2393] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 2: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:28.214457 10432 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:28.252061  9449 raft_consensus.cc:2368] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3.
I20260709 13:02:28.214947  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:28.255425  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:28.256129  9377 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:28.203586 10352 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:28.216220 10496 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:28.225723  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:28.259294  9369 raft_consensus.cc:2393] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 3: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:28.267108 10491 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:28.270253  9520 raft_consensus.cc:2393] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 3: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:28.261811 10442 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:28.214749 10492 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:28.260428  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:28.293490  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:28.320467  9525 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:28.298781  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:28.320693  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:28.275894  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:28.331424  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:28.340194  9377 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:28.284397 10432 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:28.283787  9372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52562 (request call id 611) took 1078 ms. Trace:
I20260709 13:02:28.297454 10347 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:28.295387 10487 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
W20260709 13:02:28.347941  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 116970us
I20260709 13:02:28.273969 10369 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:28.290024  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:28.287963 10498 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:28.295615 10418 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:28.347325  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:28.292246 10448 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:28.346064 10322 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:28.360085  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 125137us
W20260709 13:02:28.350582  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 121188us
I20260709 13:02:28.353319  9341 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:28.329950 10324 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:28.283794 10447 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:28.352008  9522 raft_consensus.cc:2368] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:28.362792  9341 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:28.350561  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:28.348196 10430 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:28.349644 10432 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:28.367372  9343 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:28.368636  9341 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:28.369964  9343 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:28.366699 10489 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:28.370035  9521 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:28.372830  9523 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:28.373373  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:28.360208  9370 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:28.359861  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:28.367077 10351 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:02:28.390081 10493 log.cc:927] Time spent T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:02:28.393524 10433 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:28.369391 10443 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:28.376854 10432 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.377674  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:28.405385  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:28.431206  9447 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:28.364977 10324 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:28.385996  9518 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:28.350185  9372 rpcz_store.cc:276] 0709 13:02:27.211544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.227221 (+ 15677us) service_pool.cc:224] Handling call
0709 13:02:27.443278 (+216057us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b5800000f98. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b5300a0 00007fb58b52f984 00007fb584aaa6d4 00007fb584aaa662
0709 13:02:28.283569 (+840291us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54000c0154. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:28.283689 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":722538624}
I20260709 13:02:28.442073  9371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52562 (request call id 618) took 1033 ms. Trace:
I20260709 13:02:28.392799 10440 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:28.448657  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 80080.3us
I20260709 13:02:28.452235  9341 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:28.453980  9341 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:28.449339  9371 rpcz_store.cc:276] 0709 13:02:27.372154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.385507 (+ 13353us) service_pool.cc:224] Handling call
0709 13:02:27.455714 (+ 70207us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b5800000f98. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b5300a0 00007fb58b52f984 00007fb584aaa6d4 00007fb584aaa662
0709 13:02:28.405040 (+949326us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b540014d554. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:28.405221 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":832876672}
I20260709 13:02:28.394457 10351 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:28.499894  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:02:28.500351  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 130434us
I20260709 13:02:28.401988  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:28.501093  9343 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:28.502451  9449 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:28.385685 10430 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:28.500793  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 46931.9us
I20260709 13:02:28.509547  9447 raft_consensus.cc:2368] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:28.511128  9341 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:28.526911 10434 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:28.528627  9524 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:28.501894 10443 raft_consensus.cc:2764] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:02:28.512341  9519 raft_consensus.cc:2368] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:28.501185 10351 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.501744 10347 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:28.512578 10448 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:28.394734 10489 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:28.536291 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:28.570751 10447 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:28.544564 10504 raft_consensus.cc:2764] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:02:28.545329 10501 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:28.549152 10498 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:28.550128 10439 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:28.550546 10492 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:28.562845 10352 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:28.561595  9524 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:28.521291 10322 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:28.523460  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:02:28.568466  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 55340.5us
I20260709 13:02:28.543708 10502 raft_consensus.cc:2804] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:28.534857 10505 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:02:28.569466 10497 log.cc:927] Time spent T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.300s	user 0.000s	sys 0.011s
I20260709 13:02:28.572547 10448 raft_consensus.cc:697] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:28.576463 10471 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:28.584230 10501 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:28.611037  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:28.600440 10471 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:28.601541  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:28.597987 10505 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.602437 10332 raft_consensus.cc:2955] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:28.608819 10448 consensus_queue.cc:237] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:28.610092  9443 raft_consensus.cc:2368] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:28.611832  9492 leader_election.cc:400] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:28.630797  9492 leader_election.cc:403] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:28.614460  9452 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:28.615357  9341 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:28.615410 10502 raft_consensus.cc:697] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:28.619683  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:28.631765  9492 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:28.633908  9377 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:28.620447 10505 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:28.631765  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:28.621095  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:28.622197  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:28.622385 10471 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:28.622623  9370 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:28.588250 10498 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:28.653064 10498 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:28.632763  9341 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:28.642105 10440 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:28.654613 10440 raft_consensus.cc:697] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:28.655464 10440 consensus_queue.cc:237] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:28.634424  9492 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:28.657799  9492 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:28.611073 10501 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:28.615154 10449 consensus_meta.cc:287] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.674s	user 0.012s	sys 0.000s
W20260709 13:02:28.582403 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 81420.1us
I20260709 13:02:28.629197 10489 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:28.638562  9525 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:28.646879  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:28.647015 10502 consensus_queue.cc:237] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:28.595664 10322 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:28.661285  9521 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:28.628953 10325 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:28.628388  9518 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:28.620122 10434 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:28.718852  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 86137.4us
W20260709 13:02:28.719177  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 53414.9us
I20260709 13:02:28.721328  9452 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:28.670028  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:28.718086  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:28.764400  9377 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:28.759909 10325 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:28.773038 10503 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:28.773779 10503 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:28.774328 10503 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.760854 10438 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:28.763036  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:28.764575  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:28.766369  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:28.640671 10433 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:28.768375  9341 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:28.769115  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:28.729949  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:28.640942 10443 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:28.772190  9273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 58) took 1974 ms. Trace:
I20260709 13:02:28.764719 10322 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:28.778700  9374 raft_consensus.cc:2368] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:28.780119  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:28.781127  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:28.788636  9447 raft_consensus.cc:2393] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 3: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:28.788951  9341 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:28.766826  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:28.666209  9451 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:28.791225  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:28.648734 10430 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:28.798569  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:02:28.724071 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 80268us
I20260709 13:02:28.832504  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:28.837999  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:28.839102  9449 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:28.839138  9374 raft_consensus.cc:2368] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:28.832122  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:28.810134  9341 leader_election.cc:400] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3.
I20260709 13:02:28.840514  9341 leader_election.cc:403] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:02:28.721855 10424 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:28.721494 10449 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
W20260709 13:02:28.836516 10480 consensus_meta.cc:287] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.954s	user 0.012s	sys 0.000s
I20260709 13:02:28.722226 10471 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:28.790952  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:28.798159 10439 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:28.792577 10510 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:28.848140  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 48142.5us
I20260709 13:02:28.794323  9376 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:28.790752  9370 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
W20260709 13:02:28.844655  9444 consensus_meta.cc:287] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.703s	user 0.009s	sys 0.005s
I20260709 13:02:28.803194 10325 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:28.786605 10438 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:28.845294 10498 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:28.859109 10427 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3.
I20260709 13:02:28.890522 10439 raft_consensus.cc:697] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:28.786863  9273 rpcz_store.cc:276] 0709 13:02:26.798176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.977116 (+178940us) service_pool.cc:224] Handling call
0709 13:02:28.772061 (+1794945us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:27.221227 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:27.221965 (+   738us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:27.222013 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:02:27.222046 (+    33us) tablet.cc:662] Decoding operations
0709 13:02:27.222495 (+   449us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:27.222577 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:27.222608 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:27.222898 (+   290us) tablet.cc:701] Row locks acquired
0709 13:02:27.222947 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:02:27.223107 (+   160us) write_op.cc:270] Start()
0709 13:02:27.223251 (+   144us) write_op.cc:276] Timestamp: P: 1783602147223055 usec, L: 0
0709 13:02:27.223290 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:02:27.224129 (+   839us) log.cc:844] Serialized 526 byte log entry
0709 13:02:27.534716 (+310587us) op_driver.cc:464] REPLICATION: finished
0709 13:02:27.599716 (+ 65000us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb5834600ac 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb589fa0ef0
0709 13:02:27.954286 (+354570us) write_op.cc:301] APPLY: starting
0709 13:02:27.965254 (+ 10968us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:27.981180 (+ 15926us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:27.981214 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:27.986498 (+  5284us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:27.986892 (+   394us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:02:27.986958 (+    66us) write_op.cc:312] APPLY: finished
0709 13:02:27.987337 (+   379us) log.cc:844] Serialized 22 byte log entry
0709 13:02:27.987606 (+   269us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:27.987710 (+   104us) write_op.cc:454] Released schema lock
0709 13:02:27.987782 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:27.988248 (+   466us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:27.988274 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":26624,"child_traces":[["op",{"apply.queue_time_us":396024,"apply.run_cpu_time_us":2993,"apply.run_wall_time_us":48584,"num_ops":1,"prepare.queue_time_us":197056,"prepare.run_cpu_time_us":17745,"prepare.run_wall_time_us":80549,"replication_time_us":311117,"spinlock_wait_cycles":7573504,"thread_start_us":413467,"threads_started":2}]]}
I20260709 13:02:28.875875 10471 raft_consensus.cc:697] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:28.859261 10480 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:28.877727  9444 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:28.898561 10498 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:28.948441  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:28.905550 10424 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:28.914696 10512 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:28.913947 10509 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:28.989879  9274 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43240 (request call id 175) took 1410 ms. Trace:
I20260709 13:02:29.011627  9274 rpcz_store.cc:276] 0709 13:02:27.579643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.579802 (+   159us) service_pool.cc:224] Handling call
0709 13:02:27.948446 (+368644us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b540016e4d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d4090 00007fb586572f3a 00007fb58c3291cc 00007fb58c42737e 00007fb58a8e82a4 00007fb58a8e8232 00007fb58a8e8161 00007fb58a8e80dc 00007fb58a8e7392 00007fb5848a548c 00007fb5848a48c6
0709 13:02:28.989706 (+1041260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":408558,"reported_tablets":1,"spinlock_wait_cycles":731222272}
I20260709 13:02:28.991151  9275 catalog_manager.cc:5697] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:28.363268  9262 catalog_manager.cc:5028] TS 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): tablet b5a227bc15c0427bbed0fbbe37f826f1 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:02:28.998492  9452 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:28.998739  9449 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
W20260709 13:02:29.014343  9262 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 684454us
I20260709 13:02:29.014922  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:29.016100  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:29.036204 10509 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.039793  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:29.016536 10512 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:29.015241 10424 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.052250 10351 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.032505 10471 consensus_queue.cc:237] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.053771 10449 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:29.033893 10439 consensus_queue.cc:237] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.054922 10480 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:29.055529 10496 consensus_meta.cc:287] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.753s	user 0.008s	sys 0.008s
I20260709 13:02:29.055944  9449 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:29.058367  9446 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 886) took 1292 ms (client timeout 1643 ms). Trace:
I20260709 13:02:29.059208 10501 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.041285  9443 raft_consensus.cc:2393] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
W20260709 13:02:29.001065 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 61443us
I20260709 13:02:29.065239  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:29.013463  9444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 903) took 1018 ms. Trace:
W20260709 13:02:29.067638 10432 consensus_meta.cc:287] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.617s	user 0.013s	sys 0.000s
I20260709 13:02:29.072233  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:29.073452  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:29.074205  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:02:29.074673 10520 log.cc:927] Time spent T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:02:29.074831 10325 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:29.074774  9451 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:29.075841 10299 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:29.076294 10322 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:29.077986  9492 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:29.111208  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:29.111930  9523 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:29.112131  9492 leader_election.cc:400] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:29.112607  9492 leader_election.cc:403] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:02:29.113917  9492 leader_election.cc:400] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:29.114250  9492 leader_election.cc:403] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:02:29.075752  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:29.079888  9452 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:29.083549  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:29.117419  9526 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:29.118089  9492 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:29.090065  9447 raft_consensus.cc:2393] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:29.090318  9343 leader_election.cc:400] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3.
I20260709 13:02:29.091106  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:29.121059  9524 raft_consensus.cc:2368] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3.
I20260709 13:02:29.086308 10067 raft_consensus.cc:2955] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:29.096123  9368 raft_consensus.cc:2368] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:29.094413  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:29.122362  9377 raft_consensus.cc:2393] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 3: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:29.095772  9374 raft_consensus.cc:1240] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:29.075969 10498 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:29.097357 10432 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.097321 10324 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:29.094254  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:29.127552  9519 raft_consensus.cc:2368] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3.
I20260709 13:02:29.090795  9444 rpcz_store.cc:276] 0709 13:02:27.992934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.008469 (+ 15535us) service_pool.cc:224] Handling call
0709 13:02:29.011096 (+1002627us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:29.128093  9369 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:29.097309  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:29.128927 10432 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:29.129513 10498 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:29.129961 10498 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:29.116273 10299 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:29.130398 10498 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:29.133633 10322 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:29.134735  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:29.134817 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:29.135717  9444 raft_consensus.cc:2368] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3.
I20260709 13:02:29.138228 10424 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:29.139077 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:29.134265 10509 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:29.103026  9449 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:29.085742 10505 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.136631  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:29.105679 10325 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.182170  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:29.183146  9368 raft_consensus.cc:2368] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:29.090123 10496 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:29.087024  9446 rpcz_store.cc:269] 0709 13:02:27.766528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.774961 (+  8433us) service_pool.cc:224] Handling call
0709 13:02:29.015893 (+1240932us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b540012b954. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:29.058274 (+ 42381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348351744}
I20260709 13:02:29.153895  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:02:29.197268  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 79255.8us
I20260709 13:02:29.141525 10434 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:29.125296 10449 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:29.125499 10433 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:29.256215  9523 raft_consensus.cc:2393] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:29.267666 10512 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:29.269055 10505 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:29.270289  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:29.205144  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:29.217160  9490 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:29.208438  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:29.136837 10322 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:29.218209  9359 tablet_service.cc:1558] Processing DeleteTablet for tablet 31a8af9a9a6948d584c9c4c96ee8c808 with delete_type TABLET_DATA_TOMBSTONED (TS 925acbe78db14db3b9e4cfc857717947 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52546
I20260709 13:02:29.199127 10438 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:29.204001  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:29.277496  9376 raft_consensus.cc:2393] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 3: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:29.278220  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:29.278999  9525 raft_consensus.cc:2368] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:29.279211 10433 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:29.132941 10299 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:29.226799  9375 raft_consensus.cc:2393] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 3: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
W20260709 13:02:29.227164  9341 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.643s (SENT) [suppressed 7 similar messages]
I20260709 13:02:29.205142  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:29.227728  9343 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:29.227399  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:29.211397 10491 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:29.284848  9518 raft_consensus.cc:2393] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:29.284962 10491 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:29.285992  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:29.230798  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:29.233471 10480 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:29.233677 10496 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:29.221151 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 290986us
I20260709 13:02:29.210239  9492 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:02:29.297520  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 87361.7us
I20260709 13:02:29.300406  9492 leader_election.cc:400] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:29.302860 10440 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:29.291043  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:29.300829  9492 leader_election.cc:403] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:02:29.306070  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:29.306371 10433 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:29.241123  9373 raft_consensus.cc:2393] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 3: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:29.250662 10501 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:29.254304  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:29.313937  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:29.314528  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:29.316380  9369 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:29.280128  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:29.279227  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:29.318602  9373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52548 (request call id 734) took 1148 ms. Trace:
I20260709 13:02:29.319144  9373 rpcz_store.cc:276] 0709 13:02:28.169996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.190165 (+ 20169us) service_pool.cc:224] Handling call
0709 13:02:29.318350 (+1128185us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b54000618d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:29.318526 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2191741184}
W20260709 13:02:29.283432  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 55811.4us
I20260709 13:02:29.320700  9343 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:29.322106 10433 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:29.322393  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:29.323276  9371 raft_consensus.cc:2368] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:29.290056 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:29.281168 10434 raft_consensus.cc:697] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:29.333920 10434 consensus_queue.cc:237] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.289959 10480 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:29.291043  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:29.291880  9522 raft_consensus.cc:2393] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:29.292915 10325 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:29.293442  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:29.293902 10347 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:29.350065 10347 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:29.350515 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:29.276115  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:29.305580 10440 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:29.246060  9418 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:29.312763  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:29.350564 10347 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:29.353440  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 107460us
I20260709 13:02:29.354660 10490 raft_consensus.cc:2804] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:29.355238  9418 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:29.356220 10324 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:29.356675 10324 raft_consensus.cc:697] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:29.357664 10324 consensus_queue.cc:237] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.294896  9368 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:29.289081 10491 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:29.339780  9521 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:29.273747 10351 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:29.342526  9343 leader_election.cc:400] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3.
I20260709 13:02:29.360879  9343 leader_election.cc:403] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:02:29.316035 10498 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.345202 10424 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:29.362257  9418 leader_election.cc:400] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:29.362521  9524 raft_consensus.cc:1240] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:29.362250  9343 leader_election.cc:400] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3.
I20260709 13:02:29.363526 10351 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:29.350757 10352 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:29.364290 10352 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.353196 10440 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:29.362452 10424 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:29.366611 10424 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:29.366314 10325 consensus_queue.cc:1059] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:29.367815 10325 raft_consensus.cc:3055] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:29.368252 10325 raft_consensus.cc:740] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:29.347973 10480 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:29.321072  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:29.341789 10027 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:29.370232  9418 leader_election.cc:403] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:02:29.383785 10512 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:29.384796 10488 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:29.366362 10352 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:29.373806 10498 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:29.392078  9445 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:29.380220 10325 consensus_queue.cc:260] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.352762  9372 raft_consensus.cc:2368] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:29.411141  9445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51016 (request call id 643) took 1087 ms. Trace:
I20260709 13:02:29.411432 10325 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:29.396193  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:29.397264  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:29.401419 10490 raft_consensus.cc:697] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:29.418627 10490 consensus_queue.cc:237] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:29.403680  9370 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:29.405187  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:29.404964 10347 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.379204 10440 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.408082  9418 leader_election.cc:400] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:29.423156  9418 leader_election.cc:403] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:02:29.087240 10503 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:29.276368  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 59417us
I20260709 13:02:29.425530  9490 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:29.427574  9490 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:29.419508 10351 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3.
I20260709 13:02:29.403296  9492 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:29.401280 10488 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:29.430492  9490 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:29.424618  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 197461us
I20260709 13:02:29.445730  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:29.446586  9452 raft_consensus.cc:2393] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:29.449967  9418 leader_election.cc:400] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:29.451196  9418 leader_election.cc:403] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:02:29.452801 10322 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:29.461444 10480 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:29.462199  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:29.461359  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:29.462595 10487 consensus_queue.cc:1059] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:29.463518  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:29.464330  9444 raft_consensus.cc:2393] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:29.464771  9341 leader_election.cc:400] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3.
I20260709 13:02:29.465126  9341 leader_election.cc:403] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:02:29.443557 10471 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:29.466214 10440 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:29.466384 10503 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:29.467396  9525 raft_consensus.cc:1240] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:29.464790 10487 raft_consensus.cc:3055] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:29.467878 10027 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:29.468024 10487 raft_consensus.cc:740] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:29.435884 10498 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:29.454612 10430 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:29.467193 10503 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:29.454874 10433 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:29.469688 10433 raft_consensus.cc:697] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:29.470611 10433 consensus_queue.cc:237] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.472180  9492 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:29.473426  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:29.475261  9370 raft_consensus.cc:2393] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 2: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:29.476082 10492 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3.
I20260709 13:02:29.474220 10332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:52546 (request call id 67) took 2581 ms. Trace:
I20260709 13:02:29.476500  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:29.474903  9341 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:29.411600  9445 rpcz_store.cc:276] 0709 13:02:28.323563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.367139 (+ 43576us) service_pool.cc:224] Handling call
0709 13:02:29.410943 (+1043804us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b540006bdd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:29.411078 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1685348608}
W20260709 13:02:29.478820  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 48462.1us
I20260709 13:02:29.481606  9341 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:29.482741 10533 tablet_replica.cc:333] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:02:29.483348 10501 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:29.480163  9490 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:29.482620 10351 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:29.505717  9445 raft_consensus.cc:1275] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:29.508064 10347 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:29.492113 10512 raft_consensus.cc:2749] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:29.505465  9520 raft_consensus.cc:2955] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:29.476648 10332 rpcz_store.cc:276] 0709 13:02:26.855101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.857155 (+  2054us) service_pool.cc:224] Handling call
0709 13:02:26.925615 (+ 68460us) log.cc:844] Serialized 480 byte log entry
0709 13:02:27.115657 (+190042us) spinlock_profiling.cc:243] Waited 6.68 ms on lock 0x7b54000d23a0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5864dfdbe 00007fb5864ea930 00007fb5864ea8d8 00007fb5864ea858 00007fb5864ea813 00007fb5864e9a9c 00007fb58c3d5626 00007fb58c3cfdd8 00007fb5865267cb 00007fb5865292c0
0709 13:02:29.436799 (+2321142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2755,"raft.queue_time_us":6816,"raft.run_cpu_time_us":1623,"raft.run_wall_time_us":68845,"spinlock_wait_cycles":15355136,"thread_start_us":83117,"threads_started":1,"wal-append.queue_time_us":119417,"wal-append.run_cpu_time_us":4472,"wal-append.run_wall_time_us":1072763}
I20260709 13:02:29.511485  9490 leader_election.cc:400] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:29.512436  9490 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:29.513635  9490 leader_election.cc:400] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:29.514045  9490 leader_election.cc:403] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:02:29.515216 10440 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:29.515410  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f6a0d9dc457d47bc801e795a2a573601 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:29.516211  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:29.516228 10503 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:29.514055 10351 raft_consensus.cc:697] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:02:29.521025  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 71258.2us
I20260709 13:02:29.473481 10487 consensus_queue.cc:260] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.525763  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:29.525812 10351 consensus_queue.cc:237] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:29.529930  9443 raft_consensus.cc:1275] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:29.529803 10424 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.532471 10424 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:29.517351  9445 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:29.516779 10434 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:29.534430 10347 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:29.540639  9418 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:29.544123  9341 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:29.538071  9490 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:29.536542 10501 consensus_queue.cc:1048] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:02:29.541360  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:29.541927 10498 raft_consensus.cc:2749] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:29.547674  9490 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:29.554934 10471 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:29.555807  9490 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:29.543974 10434 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:29.549325 10487 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:29.549861 10503 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:29.550665 10347 raft_consensus.cc:2764] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:02:29.559098  9418 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:29.561748  9450 raft_consensus.cc:1275] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:29.557433 10471 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:29.563252 10533 raft_consensus.cc:2243] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.563211 10537 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:29.564114 10537 raft_consensus.cc:697] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:29.564306 10533 raft_consensus.cc:2272] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.565150 10537 consensus_queue.cc:237] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.560928 10503 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:29.566843 10503 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:29.567570 10533 ts_tablet_manager.cc:1916] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:29.571017  9418 leader_election.cc:400] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:29.571475  9418 leader_election.cc:403] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:02:29.573742 10347 consensus_queue.cc:1048] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:29.558552 10434 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:29.558001  9274 catalog_manager.cc:5697] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 2 to 3, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 3 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:29.585438  9418 leader_election.cc:400] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:29.584975  9274 catalog_manager.cc:5697] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 1 to 3, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 3 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:29.586735  9418 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:29.588922  9490 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:29.601894  9418 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:29.602957  9490 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:29.583199 10541 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:02:29.669440  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 64219.4us
I20260709 13:02:29.669576 10492 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:29.605347 10325 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:29.674566  9418 leader_election.cc:400] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:29.675968  9418 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:02:29.673046  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 70144.8us
I20260709 13:02:29.677791 10492 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.689349  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:29.677786 10471 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:29.680361 10490 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:29.680174 10488 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:29.692135  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:29.685881 10480 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:29.685527 10498 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:29.703241  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:29.706019  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:29.708608  9525 raft_consensus.cc:2393] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:29.710618  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:29.712597  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:29.713698  9521 raft_consensus.cc:2393] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:29.720820  9525 raft_consensus.cc:1275] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:29.723788  9525 raft_consensus.cc:1275] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:29.736889  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:29.742532  9524 raft_consensus.cc:2393] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 2: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:29.702574 10471 raft_consensus.cc:697] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:29.708091 10490 raft_consensus.cc:697] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:29.731930 10501 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:29.725343 10488 raft_consensus.cc:697] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:29.740674 10510 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:29.765789  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:29.714854 10498 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.748384 10487 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:29.789755  9343 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:29.772351  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:29.770448  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:29.787768  9525 raft_consensus.cc:1275] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:29.794099  9343 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:29.765215 10502 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:29.812259  9520 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
W20260709 13:02:29.840611  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 164689us
I20260709 13:02:29.842702  9418 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:29.795378 10424 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:29.785702 10501 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.838459 10439 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:29.792430 10510 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.843341 10299 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:29.846583 10554 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:02:29.901274  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 107239us
I20260709 13:02:29.806080 10503 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.847663 10496 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:29.913426  9343 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:29.899377 10439 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.803248 10488 consensus_queue.cc:237] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.908576 10492 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:29.919883 10439 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:29.923382 10533 ts_tablet_manager.cc:1929] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:29.924247 10533 log.cc:1199] T 31a8af9a9a6948d584c9c4c96ee8c808 P 925acbe78db14db3b9e4cfc857717947: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-0-root/wals/31a8af9a9a6948d584c9c4c96ee8c808
I20260709 13:02:29.925259 10554 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.928367 10554 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:29.931190 10498 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:29.912498 10480 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:29.910669 10449 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:29.942283 10492 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:29.942839 10492 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.938081 10449 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.963181  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:29.846005 10502 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:29.961374  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:29.939194 10347 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:29.807075 10471 consensus_queue.cc:237] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.970376  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:29.944868 10492 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:29.975461  9343 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:29.911312 10434 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.891830 10490 consensus_queue.cc:237] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.979564  9449 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:02:29.981159  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 133464us
I20260709 13:02:29.983922  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:29.936280 10496 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:29.984925 10487 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:29.999626  9526 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:30.000068  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:30.000767 10510 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:30.027015 10496 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:30.027601 10502 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:30.027941 10449 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:30.028954 10501 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:30.030696 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:30.032104 10434 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:30.058336  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:30.061525  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:30.037220 10503 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:30.025811 10324 consensus_queue.cc:1059] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:02:30.064774 10324 raft_consensus.cc:3055] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:30.065202 10324 raft_consensus.cc:740] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:30.066071 10324 consensus_queue.cc:260] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:30.067297 10324 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:30.068879  9518 raft_consensus.cc:1275] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:30.069475  9517 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:30.036141  9275 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43252 (request call id 165) took 2477 ms. Trace:
W20260709 13:02:30.021495 10538 log.cc:927] Time spent T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:02:30.021668 10537 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:30.019685 10557 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:30.078922 10067 raft_consensus.cc:1275] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:30.072057 10352 consensus_queue.cc:1059] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:02:30.080372 10352 raft_consensus.cc:3055] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:30.081156 10352 raft_consensus.cc:740] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:30.082031 10352 consensus_queue.cc:260] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:30.083796 10352 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:30.088111 10558 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:30.092617  9273 catalog_manager.cc:5697] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 3 to 4, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New cstate: current_term: 1 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:30.070593  9275 rpcz_store.cc:276] 0709 13:02:27.558959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.559442 (+   483us) service_pool.cc:224] Handling call
0709 13:02:27.947205 (+387763us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b540016e4d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d4090 00007fb586572f3a 00007fb58c3291cc 00007fb58c42737e 00007fb58a8e82a4 00007fb58a8e8232 00007fb58a8e8161 00007fb58a8e80dc 00007fb58a8e7392 00007fb5848a548c 00007fb5848a48c6
0709 13:02:30.036041 (+2088836us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:29.244097 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:29.345482 (+101385us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:29.345522 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:02:29.345547 (+    25us) tablet.cc:662] Decoding operations
0709 13:02:29.345938 (+   391us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:29.346020 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:29.346058 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:29.346259 (+   201us) tablet.cc:701] Row locks acquired
0709 13:02:29.346285 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:02:29.346432 (+   147us) write_op.cc:270] Start()
0709 13:02:29.346564 (+   132us) write_op.cc:276] Timestamp: P: 1783602149346378 usec, L: 0
0709 13:02:29.346588 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:02:29.347347 (+   759us) log.cc:844] Serialized 526 byte log entry
0709 13:02:29.672377 (+325030us) op_driver.cc:464] REPLICATION: finished
0709 13:02:29.897493 (+225116us) write_op.cc:301] APPLY: starting
0709 13:02:29.908702 (+ 11209us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:29.915783 (+  7081us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:29.940865 (+ 25082us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:29.941173 (+   308us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:29.941347 (+   174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:02:29.941400 (+    53us) write_op.cc:312] APPLY: finished
0709 13:02:29.941576 (+   176us) log.cc:844] Serialized 22 byte log entry
0709 13:02:29.941738 (+   162us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:29.941809 (+    71us) write_op.cc:454] Released schema lock
0709 13:02:29.941843 (+    34us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:29.942155 (+   312us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:29.942184 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":332350,"reported_tablets":2,"spinlock_wait_cycles":780133632,"child_traces":[["op",{"apply.queue_time_us":175856,"apply.run_cpu_time_us":1989,"apply.run_wall_time_us":53946,"num_ops":1,"prepare.queue_time_us":204092,"prepare.run_cpu_time_us":10128,"prepare.run_wall_time_us":197610,"raft.queue_time_us":135578,"raft.run_cpu_time_us":57199,"raft.run_wall_time_us":121576,"replication_time_us":325587,"thread_start_us":386984,"threads_started":4,"wal-append.queue_time_us":135720}]]}
I20260709 13:02:30.118984  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:30.143054  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:02:30.146700  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 164571us
I20260709 13:02:30.147881  9374 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:30.150637  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:30.169242  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 193845us
I20260709 13:02:30.170113  9343 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:30.137358 10559 consensus_queue.cc:1048] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:02:30.175634  9373 raft_consensus.cc:1240] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:30.164289 10491 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.165410  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:30.143834 10558 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:30.185563  9374 raft_consensus.cc:1240] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:30.179443 10501 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:02:30.177096 10564 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:30.187587 10510 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:02:30.194463  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:30.195122  9444 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:30.190099 10503 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.195986 10503 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:30.191838  9518 raft_consensus.cc:1240] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:30.193707  9517 raft_consensus.cc:1275] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:30.204833  9418 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:30.210032  9368 raft_consensus.cc:1275] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:30.214027  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:30.213198  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:30.229317  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 50192.6us
I20260709 13:02:30.229727  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:30.230464  9450 raft_consensus.cc:2368] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:30.228618  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:30.232296  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:30.234189  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:30.235466  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:30.230377  9343 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:30.236406  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:30.229156  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:30.238318  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:30.196007  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:30.250429  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:30.252321  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:30.254045  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:30.261322  9452 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:30.228709 10480 raft_consensus.cc:2749] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:30.262617  9343 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:30.185747 10491 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:30.242092 10427 consensus_queue.cc:1048] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:02:30.208072 10537 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:02:30.258898 10439 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:30.287532  9449 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:30.279124 10471 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:30.294018  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 80547us
I20260709 13:02:30.269240 10559 consensus_queue.cc:1059] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:02:30.326864  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:30.290779 10558 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:02:30.342290  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 79753.6us
I20260709 13:02:30.296378 10332 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:30.346127  9262 catalog_manager.cc:5028] TS 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): tablet 31a8af9a9a6948d584c9c4c96ee8c808 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
W20260709 13:02:30.347460  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 550784us
I20260709 13:02:30.317510 10503 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:30.355993  9418 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:30.357110  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:30.357672 10558 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:30.360031  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:30.315511 10471 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:30.361501  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:30.362576  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:30.371865  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:30.373214  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:30.345227 10480 consensus_queue.cc:1059] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:02:30.365768 10471 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:30.361763 10559 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:30.363993 10491 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:02:30.384703 10569 log.cc:927] Time spent T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:02:30.385089 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:02:30.426915  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 70991.1us
W20260709 13:02:30.511756  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 83852.7us
I20260709 13:02:30.514384 10067 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:30.516461 10439 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:30.517127  9341 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:30.518537 10496 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:30.523314 10496 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:30.525715 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 112915us
I20260709 13:02:30.523473 10424 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:30.526880 10496 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:30.527815 10434 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.522701  9368 raft_consensus.cc:1275] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:30.536504  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:30.526916  9490 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:30.541905 10541 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:30.542145  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:30.543460 10433 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:30.544006 10433 raft_consensus.cc:697] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:30.544903 10433 consensus_queue.cc:237] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:30.516950 10332 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:30.547646 10332 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:30.549388 10434 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:30.551554 10332 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:30.551738 10434 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:30.535485 10559 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:02:30.556324  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:30.558211  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:30.519660  9444 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:30.561826  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:30.563467  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:30.564208  9371 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:30.572748 10576 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:30.573347 10576 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:30.573777 10541 consensus_queue.cc:1048] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:30.576035  9376 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:30.576540  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:30.577293  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:30.579455  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:30.580045 10576 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:30.582197 10440 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:30.563686 10491 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.583806 10491 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:30.585114  9369 raft_consensus.cc:1275] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:30.586073 10491 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:30.520676  9445 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:30.587085  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:30.589474  9343 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:30.587522  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:30.590167  9452 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:30.634222  9490 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:30.635000  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:30.635541  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 46141.6us
I20260709 13:02:30.635625  9452 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:30.636538  9492 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:30.636670  9343 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:30.638027  9490 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:30.644085  9368 raft_consensus.cc:1240] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:30.642483  9371 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:30.649399  9490 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:30.541643 10439 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:30.648397  9343 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:30.651721  9524 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:30.652375  9343 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:30.657554  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:30.658540  9451 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:30.662523 10471 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:30.662843 10352 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:30.663477 10352 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:30.664891  9369 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:30.665478 10568 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:30.665930 10568 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:30.666369 10568 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:30.671108 10439 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:30.671622  9341 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:30.674082 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:30.676242  9343 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:30.676906 10299 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:30.651690 10503 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:30.677793 10565 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:30.677418 10299 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:30.647855 10440 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:30.651103 10347 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:30.661154 10449 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:30.682569  9343 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:30.678369 10565 raft_consensus.cc:697] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:30.685559 10352 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:30.643167 10332 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:30.679409 10564 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:30.681097  9341 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:30.647688 10492 consensus_queue.cc:1048] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:02:30.680291 10299 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:30.691313  9343 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:30.683326 10449 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.697189  9343 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:30.696403  9341 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:30.700943  9343 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:30.696038 10575 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:30.693444 10427 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:30.704872  9343 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:30.696276 10564 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:30.697504 10449 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:30.700271 10573 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:30.707337 10510 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:30.702665 10347 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:30.711603 10564 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:30.721489 10557 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:30.736392 10487 raft_consensus.cc:3055] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:30.736821 10487 raft_consensus.cc:740] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:30.737617 10487 consensus_queue.cc:260] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:30.741127 10564 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:30.770459  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 121109us
I20260709 13:02:30.729771 10440 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:02:30.733430 10347 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:30.748889 10571 log.cc:927] Time spent T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.387s	user 0.000s	sys 0.006s
I20260709 13:02:30.781525  9490 leader_election.cc:400] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:30.730103 10434 consensus_queue.cc:1048] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:02:30.784721  9451 raft_consensus.cc:1275] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:30.788156  9447 raft_consensus.cc:1275] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:30.805871  9490 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:30.807725  9490 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:30.811129  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:30.817075  9490 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:30.817454  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:30.818336  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:30.818967  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:30.820097  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:30.824213  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:30.825659  9447 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:30.820721  9449 raft_consensus.cc:2376] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3. Re-sending same reply.
I20260709 13:02:30.830215 10503 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:30.838124  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:30.845501 10579 consensus_queue.cc:1059] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:30.838408  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:30.857079 10574 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:30.857484 10332 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:30.858211 10332 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:30.859217 10574 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:30.733881 10565 consensus_queue.cc:237] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:30.863041  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:30.863830  9525 raft_consensus.cc:2393] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 2: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:30.863682 10568 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:30.810082 10433 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:30.804243 10347 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:30.870226  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:30.827282 10471 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:30.874814  9520 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:30.878209 10574 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:30.879081  9371 raft_consensus.cc:1275] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:30.880157  9371 raft_consensus.cc:1240] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:30.881273  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:30.890303  9377 raft_consensus.cc:1240] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:30.892292 10503 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:30.895401  9490 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:30.897771 10503 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:30.917578  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:30.920177  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.925046  9490 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:30.926246  9490 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:30.927258  9490 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:30.936689 10299 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:30.938344  9374 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:30.939209 10324 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:30.943146  9273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 59) took 1342 ms. Trace:
I20260709 13:02:30.953248  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:30.954627  9445 raft_consensus.cc:2393] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 2: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:30.956589 10449 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:30.959331 10299 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:30.959939 10449 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:30.926614 10555 raft_consensus.cc:3055] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:30.985203  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:30.943833  9273 rpcz_store.cc:276] 0709 13:02:29.600534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.605292 (+  4758us) service_pool.cc:224] Handling call
0709 13:02:30.943056 (+1337764us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:30.155439 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:30.212087 (+ 56648us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:30.229089 (+ 17002us) write_op.cc:435] Acquired schema lock
0709 13:02:30.234563 (+  5474us) tablet.cc:662] Decoding operations
0709 13:02:30.279225 (+ 44662us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:30.281531 (+  2306us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:30.283387 (+  1856us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:30.315692 (+ 32305us) tablet.cc:701] Row locks acquired
0709 13:02:30.317128 (+  1436us) write_op.cc:260] PREPARE: finished
0709 13:02:30.347851 (+ 30723us) write_op.cc:270] Start()
0709 13:02:30.352787 (+  4936us) write_op.cc:276] Timestamp: P: 1783602150347794 usec, L: 0
0709 13:02:30.354332 (+  1545us) op_driver.cc:348] REPLICATION: starting
0709 13:02:30.385255 (+ 30923us) log.cc:844] Serialized 526 byte log entry
0709 13:02:30.512122 (+126867us) op_driver.cc:464] REPLICATION: finished
0709 13:02:30.513579 (+  1457us) write_op.cc:301] APPLY: starting
0709 13:02:30.513680 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:30.513776 (+    96us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:30.513869 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:30.517380 (+  3511us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:30.517552 (+   172us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:02:30.517609 (+    57us) write_op.cc:312] APPLY: finished
0709 13:02:30.517797 (+   188us) log.cc:844] Serialized 22 byte log entry
0709 13:02:30.517964 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:30.518038 (+    74us) write_op.cc:454] Released schema lock
0709 13:02:30.518075 (+    37us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":7445,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":566,"apply.run_cpu_time_us":3602,"apply.run_wall_time_us":4800,"num_ops":1,"prepare.queue_time_us":95,"prepare.run_cpu_time_us":4185,"prepare.run_wall_time_us":230200,"replication_time_us":54135,"spinlock_wait_cycles":21376}]]}
I20260709 13:02:30.966506 10433 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:30.960898 10449 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:31.021631  9418 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:30.928660 10503 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:30.986536 10471 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:31.026674 10578 consensus_queue.cc:1059] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:02:30.982980 10555 raft_consensus.cc:740] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:31.031587 10583 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:31.024284 10324 consensus_queue.cc:1059] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:02:31.020082  9275 catalog_manager.cc:5697] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.011871  9518 raft_consensus.cc:1240] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:02:31.020072  9373 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:02:31.036695  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 54811.8us
I20260709 13:02:31.034849  9418 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:31.020288 10332 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:31.032222 10537 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:31.055379  9275 catalog_manager.cc:5697] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.012843 10574 consensus_queue.cc:1048] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:02:31.057672  9275 catalog_manager.cc:5697] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:31.027135  9435 tablet_service.cc:1558] Processing DeleteTablet for tablet f6a0d9dc457d47bc801e795a2a573601 with delete_type TABLET_DATA_TOMBSTONED (TS d62c9d5a052b42ce8675f8438f846526 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51006
W20260709 13:02:31.061997  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 72044.6us
I20260709 13:02:31.074437 10491 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.065788  9275 catalog_manager.cc:5697] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 1 to 3, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 3 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.075021 10491 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:31.055066 10579 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:31.075513 10487 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.064594  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:31.092913 10471 raft_consensus.cc:697] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:31.091280  9275 catalog_manager.cc:5697] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.078043 10568 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:31.111711 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:02:31.120666  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 51986us
W20260709 13:02:31.125970  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 75216.2us
I20260709 13:02:31.107766 10433 raft_consensus.cc:697] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:02:31.160177  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 120027us
I20260709 13:02:31.139284 10480 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.169938  9490 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:31.090474 10555 consensus_queue.cc:260] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:31.149173 10564 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:31.181330 10578 raft_consensus.cc:3055] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:31.181803 10578 raft_consensus.cc:740] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:31.182713 10578 consensus_queue.cc:260] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:31.184118 10578 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:31.193698  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:31.194516  9443 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:31.196944 10488 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.197474 10488 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:31.174229 10596 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:02:31.199535 10488 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:31.199615 10559 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.172730 10583 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:31.122771 10590 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:02:31.160614 10471 consensus_queue.cc:237] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:31.216563  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:31.217173  9377 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:31.214474  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:31.219853  9490 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:31.219403  9418 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:31.200356 10491 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:31.192577 10347 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:31.172135 10480 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:31.247277  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:31.245097 10599 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:02:31.255330  9490 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:31.200290 10559 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:31.237805 10541 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:31.257329  9368 raft_consensus.cc:1240] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:02:31.244042 10503 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:31.260043 10607 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:31.258558 10555 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:31.176265 10598 consensus_queue.cc:1048] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 13:02:31.242293  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:31.258494 10541 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.329612  9490 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:31.355984  9490 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:31.357577  9490 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:31.359454 10607 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:31.360164 10607 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:31.360685 10607 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:31.329928 10503 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:31.363416  9490 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:31.363173 10503 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:31.365887 10607 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:31.365993 10503 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:31.366314 10607 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:31.366762 10607 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:31.371783  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:31.373507  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:31.379321  9526 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:31.380544  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:31.336998 10583 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:02:31.387097 10604 log.cc:927] Time spent T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:02:31.389902  9517 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:31.390519 10559 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:31.391747 10480 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:31.380594 10347 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:31.393254 10537 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:31.406729  9521 raft_consensus.cc:1240] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:31.258122 10433 consensus_queue.cc:237] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:31.403364  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:31.394322 10564 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:31.346843 10541 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:31.403622  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 158643us
W20260709 13:02:31.410883  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 169936us
I20260709 13:02:31.418957  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:31.420198  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:31.426102  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:31.426712  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:31.428851  9450 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:31.427736 10557 consensus_queue.cc:1059] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:31.428058  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:31.445071  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:31.451406  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:31.428243  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:31.465819  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:31.466480  9374 raft_consensus.cc:1240] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:31.466601  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:31.453969  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:31.470309  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:31.474238  9374 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:31.474524  9343 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:31.478319  9343 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:31.480897  9490 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:31.447125  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:31.437692 10347 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:02:31.487658  9343 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:31.546948  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 59422.2us
I20260709 13:02:31.547909  9343 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:31.548940 10332 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:02:31.549225  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 66640.5us
W20260709 13:02:31.549753 10610 log.cc:927] Time spent T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:02:31.483786 10424 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:02:31.554141  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 73364.5us
I20260709 13:02:31.541631  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:31.571573  9490 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:31.548575 10564 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:31.551589 10491 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:31.544660  9375 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:31.559515 10503 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:31.568378 10488 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.572391 10598 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:02:31.597906 10440 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:02:31.611887 10613 consensus_queue.cc:1059] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:02:31.624778  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:31.625715  9449 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:31.626977  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:31.600657 10583 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:02:31.628644 10611 log.cc:927] Time spent T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:02:31.637642 10597 consensus_queue.cc:1059] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
W20260709 13:02:31.644282 10609 log.cc:927] Time spent T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:02:31.664081  9518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 793) took 1026 ms. Trace:
I20260709 13:02:31.664726  9518 rpcz_store.cc:276] 0709 13:02:30.637875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.643000 (+  5125us) service_pool.cc:224] Handling call
0709 13:02:30.664299 (+ 21299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.042721 (+378422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.663699 (+620978us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b54003200d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:31.663990 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":682961664}
I20260709 13:02:31.671437  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:31.675750  9341 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:31.678355 10594 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.604032 10488 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:31.673494 10491 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:31.695216 10433 raft_consensus.cc:3055] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:31.703583 10433 raft_consensus.cc:740] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:31.715221 10433 consensus_queue.cc:260] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:31.716760 10433 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:31.732090 10501 raft_consensus.cc:3055] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:02:31.735642  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 60014.2us
I20260709 13:02:31.713562 10491 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:31.732767 10501 raft_consensus.cc:740] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:31.762038 10501 consensus_queue.cc:260] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:31.735046 10607 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:31.932054 10607 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:31.932946 10438 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:31.933733 10438 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:02:31.955232  9451 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.046s	sys 0.092s
W20260709 13:02:31.956353  9451 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.046s	sys 0.092s
W20260709 13:02:31.809815 10487 consensus_meta.cc:287] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.707s	user 0.009s	sys 0.003s
W20260709 13:02:31.954963  9370 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.035s	sys 0.099s
I20260709 13:02:31.698536 10594 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
W20260709 13:02:32.018118 10538 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.037s	sys 0.091s
W20260709 13:02:31.991727 10555 consensus_meta.cc:287] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.000s
W20260709 13:02:32.018812 10538 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.037s	sys 0.091s
W20260709 13:02:32.026153  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 454643us
I20260709 13:02:32.062054 10608 tablet_replica.cc:333] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:02:32.122218  9445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 983) took 1144 ms. Trace:
I20260709 13:02:32.122836  9445 rpcz_store.cc:276] 0709 13:02:30.977896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.983895 (+  5999us) service_pool.cc:224] Handling call
0709 13:02:32.032815 (+1048920us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b5800003098. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445eee 0000000000375939 00007fb58b4b91e0 00007fb58b5820c4 00007fb58b582131 00007fb58b543fc0 00007fb58b52e929 00007fb58b52e3d2 00007fb584aa5bd4
0709 13:02:32.121467 (+ 88652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.121728 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.121768 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:32.121832 (+    64us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:32.121878 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.121959 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.122118 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14508288}
W20260709 13:02:32.120769 10541 consensus_meta.cc:287] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.683s	user 0.008s	sys 0.002s
W20260709 13:02:32.176160  9522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.017s	sys 0.015s
W20260709 13:02:32.176559  9522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.017s	sys 0.015s
W20260709 13:02:32.217857  9526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.009s	sys 0.013s
W20260709 13:02:32.218365  9526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.009s	sys 0.013s
W20260709 13:02:32.186326 10434 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.001s	sys 0.018s
I20260709 13:02:32.173027 10541 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:32.237910 10434 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.002s	sys 0.018s
W20260709 13:02:32.238523  9369 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.003s	sys 0.020s
I20260709 13:02:32.271971 10541 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:32.261703 10299 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:02:32.273262  9369 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.003s	sys 0.020s
I20260709 13:02:32.273083 10487 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:32.278249  9446 raft_consensus.cc:1240] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:02:32.295974 10595 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.309842 10491 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:32.311455 10614 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:02:32.353266  9417 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.022s	sys 0.018s
W20260709 13:02:32.353710  9417 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.022s	sys 0.018s
I20260709 13:02:32.331512 10488 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:32.329615 10598 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:32.323200 10615 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:32.311796 10487 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:02:32.376376  9418 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.020s	sys 0.037s
I20260709 13:02:32.353798 10594 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:32.324534 10595 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:32.391673  9521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 902) took 1020 ms. Trace:
I20260709 13:02:32.448509  9521 rpcz_store.cc:276] 0709 13:02:31.370777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.376951 (+  6174us) service_pool.cc:224] Handling call
0709 13:02:31.377259 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:31.407257 (+ 29998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.391340 (+984083us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b54001a04d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:32.391593 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67312000}
I20260709 13:02:32.338635 10558 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:32.334590 10618 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:02:32.400126  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 140460us
I20260709 13:02:32.355728 10555 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.402496  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:32.413542  9418 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.020s	sys 0.037s
I20260709 13:02:32.388845 10438 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:32.396404 10565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.014s	sys 0.047s
I20260709 13:02:32.394367  9370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 689) took 1177 ms. Trace:
I20260709 13:02:32.375283 10614 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:32.471954 10565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.014s	sys 0.047s
I20260709 13:02:32.449644  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:32.499526  9522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 906) took 1127 ms. Trace:
W20260709 13:02:32.499872 10628 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:02:32.501426  9371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 696) took 1044 ms. Trace:
I20260709 13:02:32.501770  9371 rpcz_store.cc:276] 0709 13:02:31.456665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.456796 (+   131us) service_pool.cc:224] Handling call
0709 13:02:31.458817 (+  2021us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.459147 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.459177 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.473591 (+ 14414us) log.cc:844] Serialized 26 byte log entry
0709 13:02:32.251957 (+778366us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:32.252002 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.252092 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.501205 (+249113us) raft_consensus.cc:1685] finished
0709 13:02:32.501233 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.501369 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1574,"raft.queue_time_us":4858,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":6519,"thread_start_us":465325,"threads_started":1,"wal-append.queue_time_us":769886}
I20260709 13:02:32.505496 10608 raft_consensus.cc:2243] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:32.510722 10625 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:32.511487 10625 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:32.470870 10558 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:32.414604 10598 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:32.525339 10629 log.cc:927] Time spent T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:02:32.526698  9526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 908) took 1146 ms. Trace:
I20260709 13:02:32.487375  9373 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:32.533761 10601 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:32.534351 10601 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:32.536494 10439 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:32.537057 10439 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:32.537532 10576 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:32.538044 10576 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:32.534440 10299 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:32.533926 10565 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.471990 10555 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:32.527431 10627 log.cc:927] Time spent T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:02:32.558621 10565 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:32.527304  9526 rpcz_store.cc:276] 0709 13:02:31.385579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.471221 (+ 85642us) service_pool.cc:224] Handling call
0709 13:02:31.473117 (+  1896us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.542041 (+ 68924us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.542075 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.548306 (+  6231us) log.cc:844] Serialized 26 byte log entry
0709 13:02:32.218807 (+670501us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:32.489224 (+270417us) log.cc:844] Serialized 14 byte log entry
0709 13:02:32.493411 (+  4187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.494103 (+   692us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.526412 (+ 32309us) raft_consensus.cc:1685] finished
0709 13:02:32.526445 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.526621 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56870,"raft.queue_time_us":80852,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":25190,"thread_start_us":865548,"threads_started":2,"wal-append.queue_time_us":763177}
I20260709 13:02:32.538779  9372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 695) took 1082 ms. Trace:
I20260709 13:02:32.472362  9370 rpcz_store.cc:276] 0709 13:02:31.210713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.216762 (+  6049us) service_pool.cc:224] Handling call
0709 13:02:31.448738 (+231976us) spinlock_profiling.cc:243] Waited 7.58 ms on lock 0x7b5800000f98. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b543fc0 00007fb58b52e929 00007fb58b52e3d2 00007fb584aa5bd4
0709 13:02:31.448925 (+   187us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.449286 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.449317 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.449842 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:02:31.989838 (+539996us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:31.989895 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.989972 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.333519 (+343547us) raft_consensus.cc:1685] finished
0709 13:02:32.333568 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.376526 (+ 42958us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2202,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":8142,"spinlock_wait_cycles":17423744,"thread_start_us":537710,"threads_started":1,"wal-append.queue_time_us":876803}
I20260709 13:02:32.574436  9375 raft_consensus.cc:2393] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 2: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:32.528656 10488 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.416533 10615 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:32.625901  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:32.615000  9377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 701) took 1152 ms. Trace:
I20260709 13:02:32.627326  9377 rpcz_store.cc:276] 0709 13:02:31.462387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.552112 (+ 89725us) service_pool.cc:224] Handling call
0709 13:02:31.553379 (+  1267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:31.579182 (+ 25803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.579212 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:31.579252 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:31.579282 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.614746 (+1035464us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b540027cc54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:32.614807 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.614943 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58897792}
I20260709 13:02:32.557214 10299 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:32.503538  9522 rpcz_store.cc:276] 0709 13:02:31.379644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.381634 (+  1990us) service_pool.cc:224] Handling call
0709 13:02:31.450220 (+ 68586us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b5800188498. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b543fc0 00007fb58b52e929 00007fb58b52e3d2 00007fb584aa5bd4
0709 13:02:31.450391 (+   171us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.450709 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.450745 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.457914 (+  7169us) log.cc:844] Serialized 26 byte log entry
0709 13:02:32.176992 (+719078us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:32.498762 (+321770us) log.cc:844] Serialized 14 byte log entry
0709 13:02:32.498987 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.499062 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.499101 (+    39us) raft_consensus.cc:1685] finished
0709 13:02:32.499301 (+   200us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.499461 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2270,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":12918,"spinlock_wait_cycles":9244928,"thread_start_us":931708,"threads_started":2,"wal-append.queue_time_us":870189}
W20260709 13:02:32.619622  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 300041us
I20260709 13:02:32.623569  9417 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:32.637640 10576 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:32.635999 10633 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.647339 10565 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:32.636499 10632 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:02:32.639187 10634 log.cc:927] Time spent T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:02:32.649781 10555 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:32.475895 10618 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:32.630506 10488 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:32.745608 10488 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:32.644001 10615 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:32.657142  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:32.631946  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 229957us
I20260709 13:02:32.746657 10299 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:32.747885  9343 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:32.748639 10299 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:32.667848  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 217288us
W20260709 13:02:32.687366  9523 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46902 (request call id 823) took 1202 ms (client timeout 1530 ms). Trace:
W20260709 13:02:32.753616  9523 rpcz_store.cc:269] 0709 13:02:31.453484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.461121 (+  7637us) service_pool.cc:224] Handling call
0709 13:02:32.625702 (+1164581us) spinlock_profiling.cc:243] Waited 54.9 ms on lock 0x7b5800188498. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b5300a0 00007fb58b52f984 00007fb584aaa6d4 00007fb584aaa662
0709 13:02:32.655870 (+ 30168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126176128}
I20260709 13:02:32.754328  9341 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:32.624473 10608 raft_consensus.cc:2272] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:32.626881 10487 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:32.617779  9372 rpcz_store.cc:276] 0709 13:02:31.456302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.460929 (+  4627us) service_pool.cc:224] Handling call
0709 13:02:32.537814 (+1076885us) spinlock_profiling.cc:243] Waited 8.52 ms on lock 0x7b5800000f98. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b543fc0 00007fb58b52e929 00007fb58b52e3d2 00007fb584aa5bd4
0709 13:02:32.538081 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.538302 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.538343 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:32.538405 (+    62us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:32.538463 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.538549 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.538703 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19603328}
W20260709 13:02:32.687479  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 65133.4us
I20260709 13:02:32.732324 10583 raft_consensus.cc:3055] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:32.664760 10502 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:32.879271 10502 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:32.687525 10575 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:32.750068 10640 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.724303 10639 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:32.829727 10576 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:32.724872 10633 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:32.805760 10439 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:02:32.876057 10637 log.cc:927] Time spent T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:02:32.877712 10583 raft_consensus.cc:740] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:32.829545 10615 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:32.829227 10555 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:32.830384  9448 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:32.892037 10575 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:32.732431 10632 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:32.906700 10640 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:32.938925 10595 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:32.922940 10638 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:32.940136 10640 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:32.940639 10638 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:32.941628 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:32.942721 10638 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:32.942653 10575 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:32.943638  9451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 702) took 1513 ms. Trace:
I20260709 13:02:32.944849 10502 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:32.944039  9451 rpcz_store.cc:276] 0709 13:02:31.430067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.430206 (+   139us) service_pool.cc:224] Handling call
0709 13:02:31.430548 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.956964 (+526416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.957026 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:32.253457 (+296431us) log.cc:844] Serialized 26 byte log entry
0709 13:02:32.470823 (+217366us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:32.470859 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.470921 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.943407 (+472486us) raft_consensus.cc:1685] finished
0709 13:02:32.943428 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.943578 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29194,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":6019,"thread_start_us":711851,"threads_started":2,"wal-append.queue_time_us":302357}
I20260709 13:02:32.911509 10576 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:32.947566 10576 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:32.948074  9376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 704) took 1287 ms. Trace:
I20260709 13:02:32.948439  9376 rpcz_store.cc:276] 0709 13:02:31.660929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.728430 (+ 67501us) service_pool.cc:224] Handling call
0709 13:02:32.252157 (+523727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.393278 (+141121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.393328 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:32.637992 (+244664us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b2c0001afe8. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb584e63a11 00007fb584e73372 00007fb5865a5a01 00007fb58656a43a 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2
0709 13:02:32.638502 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:02:32.826661 (+188159us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:32.826715 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.826814 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.947819 (+121005us) raft_consensus.cc:1685] finished
0709 13:02:32.947839 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.948013 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1860,"raft.queue_time_us":47465,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":7845,"spinlock_wait_cycles":4200192,"thread_start_us":328151,"threads_started":2,"wal-append.queue_time_us":307754}
I20260709 13:02:32.951012 10632 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:32.905335 10598 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:32.908824 10601 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:32.930356 10565 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:32.958967 10598 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:32.961043 10583 consensus_queue.cc:260] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:32.783427 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 136817us
I20260709 13:02:32.963599 10583 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:32.919863 10618 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:32.954753 10555 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:32.966863  9373 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:32.967469 10564 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:32.967089 10555 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:32.954602 10615 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:32.961264 10558 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:32.971058 10615 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:32.953711 10633 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:32.978262  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 223974us
I20260709 13:02:32.962491 10598 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:32.980050  9450 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:32.981933 10598 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:32.984800 10449 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:32.987089 10641 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:32.987639 10641 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:32.986461 10449 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:32.990175 10641 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:32.990901 10449 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:32.991647 10632 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:32.992141 10632 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:32.994146 10439 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:32.994717 10439 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:32.995520 10503 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:32.996694 10439 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:32.997184 10434 consensus_queue.cc:1059] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:32.999620 10434 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:33.000327 10615 raft_consensus.cc:3055] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:33.000113 10434 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:33.000401 10440 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:33.001247 10596 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:33.001328 10440 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.001793 10596 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.002236 10434 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:33.002799 10434 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:33.003232 10434 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.003846 10596 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:33.004359 10596 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:33.004539 10440 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:33.000730 10615 raft_consensus.cc:740] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:32.997825 10590 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:32.998148 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:33.005414 10434 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:32.923552 10625 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:33.027477 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:33.032929  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:32.996342 10503 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:33.037863  9341 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:33.038159  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.018891 10299 consensus_queue.cc:1059] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
W20260709 13:02:33.034065 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 45834.5us
I20260709 13:02:33.041221  9418 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:33.040619  9490 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:33.016561  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:33.045096  9374 raft_consensus.cc:2393] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 2: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:33.046311  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.047935  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.004789 10596 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.021992 10632 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:33.064091  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:33.036314 10638 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:33.016360 10590 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.068451  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.080438  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:33.042178 10595 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:33.085758 10595 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.058151  9372 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:33.051258 10641 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:33.081743  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:33.065891 10625 consensus_queue.cc:1059] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:02:33.088816  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:33.096869  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.080802  9374 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:33.098122  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:33.099823  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:33.073453  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.072115 10599 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:33.103019  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:33.103013  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.088290 10558 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:33.078547 10650 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:33.106722  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:33.107013  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:33.113648  9447 raft_consensus.cc:2468] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:33.110993  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.113734  9449 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:33.088011 10595 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:33.101954 10502 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:33.118989  9374 raft_consensus.cc:2393] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 3: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:33.097252 10449 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:02:33.121057  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 80523.9us
I20260709 13:02:33.102365 10598 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:33.122740  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:33.123526  9447 raft_consensus.cc:2468] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:33.071597 10615 consensus_queue.cc:260] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:33.116164 10651 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:02:33.113158 10558 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.093122 10638 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.108944 10565 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:33.130455  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.135139  9492 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:33.115976 10655 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:33.111984 10599 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.123330 10434 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.120013 10595 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:33.140004 10598 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.162168  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.171455 10595 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.172045 10590 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:33.115262 10502 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:33.139468 10558 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:33.187448  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.185034  9374 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:33.173446 10640 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:33.165545 10565 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.192651  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.127947 10449 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.173843 10615 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:33.160333 10659 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:33.195856  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.117901 10650 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.199954  9374 raft_consensus.cc:2393] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 2: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:33.200385  9377 raft_consensus.cc:2468] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 3.
I20260709 13:02:33.202227  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.183727 10434 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.203651  9374 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:33.200503 10299 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:33.194324  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:33.208753  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.210813 10299 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.219913 10596 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:33.210562  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.191241 10660 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.236315  9374 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
W20260709 13:02:33.231307  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 96249.5us
I20260709 13:02:33.192233 10598 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.244621  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.231155  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:33.251039  9374 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:33.252374  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.207777 10656 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:33.255213  9374 raft_consensus.cc:2468] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:33.197992 10640 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.173769 10655 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.231155  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:33.207943 10590 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:02:33.279745  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.284225  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.284869  9374 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:33.258214 10449 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:33.286126  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.259511 10502 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:33.287472 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:33.258438 10503 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:33.288235  9374 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:33.289414 10658 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:02:33.265729  9445 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:33.283236  9444 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:33.258996 10299 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:33.293864  9372 raft_consensus.cc:2410] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:33.293987 10640 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:33.265424 10583 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:33.288895  9492 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:33.201498 10659 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.258045 10648 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:02:33.289988 10624 raft_consensus.cc:670] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopped
I20260709 13:02:33.254154 10660 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.298447 10643 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:33.257238 10663 raft_consensus.cc:2804] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:33.302213 10595 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:33.303369  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:33.304257 10670 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.305943 10650 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:33.307492 10434 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:33.268863 10654 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:02:33.328018  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 196330us
I20260709 13:02:33.296708 10599 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:33.343653  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:33.267275 10656 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.349661  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:33.320770  9446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 699) took 1896 ms. Trace:
I20260709 13:02:33.345698  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:33.352190  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:33.333596  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.320837 10541 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:33.320912 10487 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:02:33.355141  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 66317.2us
I20260709 13:02:33.353570  9374 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:33.355593  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:33.347649 10594 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:33.357641  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:33.357897 10541 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.350252 10503 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:33.470757  9444 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:33.470568 10594 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.471251 10503 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.471829  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:33.472527 10541 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:33.477643  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 131125us
I20260709 13:02:33.340490 10663 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:33.351473  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.332608 10583 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.472683  9444 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:33.520273  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:33.360455 10595 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:33.532140  9522 raft_consensus.cc:2393] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 2: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:33.344588 10654 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.343917 10670 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.548278  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.504626 10663 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:33.507674 10541 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:33.555917  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.524770 10503 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:33.507380 10624 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:33.342538 10648 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:33.507627 10599 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:02:33.524662 10594 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:33.590075 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:33.559286  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:33.533464 10595 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:33.356159 10487 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.561630  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:33.583758 10427 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.588382 10673 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.591583  9525 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:33.558807  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:33.352409  9446 rpcz_store.cc:276] 0709 13:02:31.424124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.425357 (+  1233us) service_pool.cc:224] Handling call
0709 13:02:31.425731 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.306403 (+880672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.296287 (+989884us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54001f9ad4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:33.310483 (+ 14196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1889635584}
I20260709 13:02:33.630017 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:33.585722  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:33.590252 10503 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:33.611539 10672 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.569842  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:33.630865 10069 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:33.628059  9522 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:33.560766 10541 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.623208  9491 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
W20260709 13:02:33.678222  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 55134.5us
I20260709 13:02:33.587379 10662 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:33.613180  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.357897 10643 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.685346  9448 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:33.618036 10655 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:33.734015  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:33.668671 10595 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:33.736191  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.618399 10594 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:33.741103 10678 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.741276 10594 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.741659 10678 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.744087 10678 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:33.744349 10594 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:33.747198  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:33.748157  9525 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:33.750011  9374 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:33.739269  9445 raft_consensus.cc:2410] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:33.681933 10669 raft_consensus.cc:2749] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:33.728359 10648 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:33.686396  9444 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:33.738996 10655 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:33.765671  9341 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:02:33.614804 10624 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.766577  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:33.675560 10673 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.631137 10427 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.753188  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:33.751377 10660 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:33.679069 10503 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.728327 10662 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.737520 10672 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:33.768217  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:33.944254  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:34.007393  9371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 813) took 1323 ms. Trace:
I20260709 13:02:33.778903  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:34.012428  9371 rpcz_store.cc:276] 0709 13:02:32.680610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.681586 (+   976us) service_pool.cc:224] Handling call
0709 13:02:32.688268 (+  6682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.941149 (+252881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.941180 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:32.941222 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:32.941255 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.000733 (+1059478us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54000613d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:34.000795 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.000947 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581102464}
I20260709 13:02:34.017937  9491 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:02:34.021401  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.756273 10326 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:34.014719 10670 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.022171  9371 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 3.
I20260709 13:02:33.764077  9518 raft_consensus.cc:2393] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 4: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:33.778962 10674 raft_consensus.cc:2804] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:33.761173 10667 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:33.999567  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:33.796715 10631 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:34.032460  9371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 817) took 1345 ms. Trace:
I20260709 13:02:34.024152 10669 raft_consensus.cc:2804] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:34.036058  9371 rpcz_store.cc:276] 0709 13:02:32.686584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.029402 (+1342818us) service_pool.cc:224] Handling call
0709 13:02:34.032140 (+  2738us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.032259 (+   119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.032275 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.032301 (+    26us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:34.032318 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.032349 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.032420 (+    71us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:33.853915  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:33.923714  9373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 815) took 1237 ms. Trace:
I20260709 13:02:33.852831  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:33.922063 10638 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:33.797551 10659 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:34.029928  9520 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.008s	sys 0.016s
W20260709 13:02:34.043120  9520 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.008s	sys 0.016s
I20260709 13:02:33.967483 10541 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.034478  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:33.770393 10655 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.040863  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:34.043474  9371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 820) took 1117 ms. Trace:
I20260709 13:02:34.043946 10654 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:34.038338  9373 rpcz_store.cc:276] 0709 13:02:32.686028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.967750 (+281722us) service_pool.cc:224] Handling call
0709 13:02:33.922914 (+955164us) spinlock_profiling.cc:243] Waited 958 us on lock 0x7b5800000f98. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b543fc0 00007fb58b52e929 00007fb58b52e3d2 00007fb584aa5bd4
0709 13:02:33.923122 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:33.923335 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:33.923363 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:33.923412 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:33.923460 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.923521 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.923640 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2202496}
I20260709 13:02:34.044610  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:34.033619 10674 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:34.047570  9525 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:34.047605  9371 rpcz_store.cc:276] 0709 13:02:32.925770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.041060 (+1115290us) service_pool.cc:224] Handling call
0709 13:02:34.042902 (+  1842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.043180 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.043206 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.043248 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:34.043276 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.043329 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.043426 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.031093 10326 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:34.049716 10663 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.050455  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:34.046196 10608 ts_tablet_manager.cc:1916] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:02:34.108189  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.038403 10669 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:02:34.042877 10615 consensus_meta.cc:287] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.843s	user 0.011s	sys 0.001s
I20260709 13:02:34.051971 10643 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.109939  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:34.113205  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:34.115001 10326 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:34.110921 10558 consensus_meta.cc:287] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.915s	user 0.012s	sys 0.000s
I20260709 13:02:34.133833  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:34.135103  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:34.136229  9376 raft_consensus.cc:2410] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:34.111912 10674 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:34.140173  9376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52548 (request call id 819) took 1402 ms. Trace:
I20260709 13:02:34.040772  9444 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:34.040567 10487 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.117591 10624 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.140723  9376 rpcz_store.cc:276] 0709 13:02:32.738375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.950137 (+211762us) service_pool.cc:224] Handling call
0709 13:02:34.134917 (+1184780us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b5800000f98. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b5300a0 00007fb58b52f984 00007fb584aaa6d4 00007fb584aaa662
0709 13:02:34.140111 (+  5194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3899264}
I20260709 13:02:34.039834 10667 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.143085  9376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50568 (request call id 81) took 1216 ms. Trace:
I20260709 13:02:34.143980  9376 rpcz_store.cc:276] 0709 13:02:32.926451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.142263 (+1215812us) service_pool.cc:224] Handling call
0709 13:02:34.142573 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.142747 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.142774 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.142816 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:34.142848 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.142904 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.143021 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.144681  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:34.045806  9372 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:34.042634 10631 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.118386 10655 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.140558 10558 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.132845  9517 raft_consensus.cc:1240] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:34.118786 10596 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.125976  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:34.031347  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:34.112515 10503 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:34.137466  9341 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:34.117666 10427 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.163177 10427 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:34.163281 10595 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.163657 10427 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.164181 10427 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:34.146243  9376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50568 (request call id 82) took 1219 ms. Trace:
I20260709 13:02:34.147069  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:34.147449 10673 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.172552  9523 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:34.128698 10669 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:34.153854  9450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45366 (request call id 78) took 1277 ms. Trace:
I20260709 13:02:34.175313  9450 rpcz_store.cc:276] 0709 13:02:32.876979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.153088 (+1276109us) service_pool.cc:224] Handling call
0709 13:02:34.153368 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.153539 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.153562 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.153602 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:34.153630 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.153691 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.153802 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.176577  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:34.177167  9450 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:34.180485 10575 raft_consensus.cc:3055] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:34.183112 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:34.183856 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:34.184173 10614 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:34.185156 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:34.150734 10644 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:34.161852  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:34.142082 10615 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.164925  9341 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:34.166960  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:34.172839  9376 rpcz_store.cc:276] 0709 13:02:32.926777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.145492 (+1218715us) service_pool.cc:224] Handling call
0709 13:02:34.145795 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.145947 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.145971 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.146014 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:34.146039 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.146096 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.146194 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.145092  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:34.197714  9341 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:34.148620  9452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 696) took 2725 ms. Trace:
I20260709 13:02:34.144668 10662 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.152971  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:34.154717 10585 raft_consensus.cc:3055] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:34.202358 10585 raft_consensus.cc:740] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:34.156561 10558 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.180913 10575 raft_consensus.cc:740] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:34.153674 10672 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:34.156318 10656 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:34.160758 10654 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:34.165153 10643 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:34.204667  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:34.218616  9525 raft_consensus.cc:2468] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 1.
I20260709 13:02:34.201092 10673 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:34.192548 10488 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:34.225037  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:34.206260  9517 raft_consensus.cc:1240] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:34.199261  9452 rpcz_store.cc:276] 0709 13:02:31.423294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.429592 (+  6298us) service_pool.cc:224] Handling call
0709 13:02:31.434916 (+  5324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.443041 (+  8125us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.443075 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.729753 (+286678us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b2c00010c48. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb584e63a11 00007fb584e73372 00007fb5865a5a01 00007fb58656a43a 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2
0709 13:02:32.252517 (+522764us) log.cc:844] Serialized 26 byte log entry
0709 13:02:32.326421 (+ 73904us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b4800380058. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58b493aa1 00007fb58b48ab37 00007fb58b48a9ca 00007fb58b58226f 00007fb58b581f37 00007fb58b59655c 00007fb58b596508 00007fb58b596488 00007fb58b596443 00007fb58b5956ec 00007fb58a4bfa96
0709 13:02:32.476985 (+150564us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:32.727518 (+250533us) log.cc:844] Serialized 14 byte log entry
0709 13:02:34.002964 (+1275446us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b18000d26a0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58347d3f3 00007fb58347f7c1 00007fb58347f779 00007fb58347f709 00007fb58347f6d1 00007fb58347e9cd 000000000038f354 000000000038f199 00007fb58346083a
0709 13:02:34.148115 (+145151us) spinlock_profiling.cc:243] Waited 9.72 ms on lock 0x7b18000d26a0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb5861124bc 00007fb58346048b 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347a455 00007fb586562060 00007fb586574716 00007fb586585287
0709 13:02:34.148268 (+   153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.148355 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.148393 (+    38us) raft_consensus.cc:1685] finished
0709 13:02:34.148403 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.148519 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42304,"prepare.queue_time_us":476224,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":113734,"raft.run_cpu_time_us":9350,"raft.run_wall_time_us":859318,"spinlock_wait_cycles":94515968,"thread_start_us":558821,"threads_started":3,"wal-append.queue_time_us":308763,"wal-append.run_cpu_time_us":6143,"wal-append.run_wall_time_us":1374600}
I20260709 13:02:34.203855 10299 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:34.206945  9446 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
W20260709 13:02:34.210531  9377 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50568 (request call id 83) took 1283 ms (client timeout 1704 ms). Trace:
I20260709 13:02:34.228291  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:34.228094  9377 rpcz_store.cc:269] 0709 13:02:32.927082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.945967 (+ 18885us) service_pool.cc:224] Handling call
0709 13:02:33.187321 (+241354us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b5800000f98. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b5300a0 00007fb58b52f984 00007fb584aaa6d4 00007fb584aaa662
0709 13:02:34.210367 (+1023046us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b540027cc54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:34.210475 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23141120}
I20260709 13:02:34.228960  9452 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:34.211027 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:34.231307  9447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 711) took 1122 ms. Trace:
I20260709 13:02:34.201188  9341 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:34.166234 10596 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:34.235530 10681 log.cc:927] Time spent T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:02:34.222522 10673 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.236320 10673 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:34.237097  9377 raft_consensus.cc:1240] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:34.237351 10596 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:34.237886  9377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 716) took 1169 ms. Trace:
I20260709 13:02:34.238268  9377 rpcz_store.cc:276] 0709 13:02:33.068634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.229152 (+1160518us) service_pool.cc:224] Handling call
0709 13:02:34.230359 (+  1207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.237648 (+  7289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.237836 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.201471 10615 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.239492  9521 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:34.200439  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:34.237152 10496 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:34.230026 10488 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.201813 10427 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.217722 10595 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:34.234398  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.196910 10487 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:34.231784  9447 rpcz_store.cc:276] 0709 13:02:33.109292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.228918 (+1119626us) service_pool.cc:224] Handling call
0709 13:02:34.230748 (+  1830us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.230913 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.230947 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.231004 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:34.231047 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.231119 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.231243 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.214087  9518 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:34.203269 10585 consensus_queue.cc:260] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.256042 10585 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:34.228384 10299 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.222935 10643 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.248956 10575 consensus_queue.cc:260] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.259654 10575 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:34.260525 10643 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:34.263527  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.240571 10615 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:34.240722 10439 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:34.265709 10439 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.267409 10501 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:34.268846  9445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 713) took 1159 ms. Trace:
I20260709 13:02:34.269697  9445 rpcz_store.cc:276] 0709 13:02:33.109785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.242146 (+1132361us) service_pool.cc:224] Handling call
0709 13:02:34.267443 (+ 25297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.268054 (+   611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.268131 (+    77us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.268199 (+    68us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:34.268254 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.268342 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.268763 (+   421us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.273502  9521 raft_consensus.cc:1240] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:34.275553  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:34.253153 10027 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:34.248704 10496 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.294363  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:34.295017  9525 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:34.273219 10299 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:34.241235 10654 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:34.304092  9375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 809) took 1641 ms. Trace:
I20260709 13:02:34.285265 10558 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.268864 10439 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.290700 10496 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:34.321307 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 78735.2us
I20260709 13:02:34.322680 10631 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.323508 10427 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.325693 10558 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.326421 10669 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:34.328400 10488 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.252526 10487 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:34.330219 10438 raft_consensus.cc:2804] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:34.329879 10650 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.537446  9492 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:02:34.627697  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 90393.3us
I20260709 13:02:34.304557  9375 rpcz_store.cc:276] 0709 13:02:32.662752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.666004 (+  3252us) service_pool.cc:224] Handling call
0709 13:02:34.303343 (+1637339us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b5800000f98. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445eee 0000000000375939 00007fb58b4b91e0 00007fb58b5820c4 00007fb58b582131 00007fb58b543fc0 00007fb58b52e929 00007fb58b52e3d2 00007fb584aa5bd4
0709 13:02:34.303510 (+   167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.303705 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.303731 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.303774 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:34.303808 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.303867 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.304026 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4427136}
I20260709 13:02:34.639793  9520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 831) took 1295 ms. Trace:
W20260709 13:02:34.587980  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.648684  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:34.650038  9452 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:34.650774  9452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 714) took 1538 ms. Trace:
W20260709 13:02:34.651436  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.651183  9452 rpcz_store.cc:276] 0709 13:02:33.111932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.359836 (+1247904us) service_pool.cc:224] Handling call
0709 13:02:34.647499 (+287663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.650469 (+  2970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.650712 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3840}
I20260709 13:02:34.402971 10578 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:34.640358  9520 rpcz_store.cc:276] 0709 13:02:33.344779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.345966 (+  1187us) service_pool.cc:224] Handling call
0709 13:02:33.346220 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:33.350620 (+  4400us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:33.359843 (+  9223us) log.cc:844] Serialized 14 byte log entry
0709 13:02:34.043534 (+683691us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.043579 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:34.043614 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.639484 (+595870us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b54000a6754. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:34.639550 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.639722 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9031,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":10775,"raft.queue_time_us":85,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":26936,"spinlock_wait_cycles":9646336,"thread_start_us":683331,"threads_started":1,"wal-append.queue_time_us":751112}
I20260709 13:02:34.646706  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:34.663431  9521 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:34.575353 10576 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:34.574958 10438 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:34.601464  9519 raft_consensus.cc:2393] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 in current term 4: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:34.678409 10578 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.678766 10576 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.678864 10438 raft_consensus.cc:3060] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:34.363955 10565 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.662410  9492 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:34.683413  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:34.684132  9525 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:34.602089 10624 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:34.656672 10615 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:34.680646 10576 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.376760 10496 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.680680 10578 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.692844 10614 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:34.692595 10596 consensus_queue.cc:1059] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:02:34.663483 10673 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.705494 10558 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:34.707166  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.719524 10672 raft_consensus.cc:3055] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:34.720203 10672 raft_consensus.cc:740] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:34.720742  9370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 811) took 2056 ms. Trace:
I20260709 13:02:34.721081 10496 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.721185  9370 rpcz_store.cc:276] 0709 13:02:32.664402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.664746 (+   344us) service_pool.cc:224] Handling call
0709 13:02:34.195855 (+1531109us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b5800000f98. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b543fc0 00007fb58b52e929 00007fb58b52e3d2 00007fb584aa5bd4
0709 13:02:34.719933 (+524078us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b5800000f98. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445e9c 00007fb583445a5b 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b543fc0 00007fb58b52e929 00007fb58b52e3d2 00007fb584aa5bd4
0709 13:02:34.720119 (+   186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.720311 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.720341 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.720459 (+   118us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:34.720499 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.720562 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.720683 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14369792}
I20260709 13:02:34.721293 10672 consensus_queue.cc:260] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.723083 10672 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:34.714931 10614 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:34.725232  9377 raft_consensus.cc:1240] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 5. Ops: []
I20260709 13:02:34.725507 10614 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:34.725711  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:34.727468  9377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 717) took 1658 ms. Trace:
I20260709 13:02:34.696916 10615 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:34.730001 10615 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:34.730667  9450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1012) took 1651 ms. Trace:
I20260709 13:02:34.731189  9450 rpcz_store.cc:276] 0709 13:02:33.078983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.177784 (+1098801us) service_pool.cc:224] Handling call
0709 13:02:34.178082 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.178281 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.178305 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:34.187088 (+  8783us) log.cc:844] Serialized 26 byte log entry
0709 13:02:34.297891 (+110803us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:34.297936 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.298028 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.730352 (+432324us) raft_consensus.cc:1685] finished
0709 13:02:34.730384 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.730592 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":92136,"threads_started":1,"wal-append.queue_time_us":528599}
I20260709 13:02:34.732393 10598 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:34.715394 10565 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:34.733582  9522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 935) took 1249 ms. Trace:
I20260709 13:02:34.733656  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:34.734131  9522 rpcz_store.cc:276] 0709 13:02:33.484686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.191666 (+706980us) service_pool.cc:224] Handling call
0709 13:02:34.207466 (+ 15800us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.207760 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.207799 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:34.216830 (+  9031us) log.cc:844] Serialized 26 byte log entry
0709 13:02:34.292357 (+ 75527us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:34.292390 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.292462 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.733322 (+440860us) raft_consensus.cc:1685] finished
0709 13:02:34.733361 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.733490 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":49544,"threads_started":1,"wal-append.queue_time_us":479159}
I20260709 13:02:34.735209 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:34.736447  9341 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:34.727883  9377 rpcz_store.cc:276] 0709 13:02:33.068867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.239048 (+1170181us) service_pool.cc:224] Handling call
0709 13:02:34.239342 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.725692 (+486350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.727214 (+  1522us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b5400045bd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:34.727398 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1116921088}
I20260709 13:02:34.702397  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:34.750277  9341 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:34.748427  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:34.752866  9377 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:34.754465  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:34.755790  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:34.756451  9377 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:34.757591  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:34.758589  9448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 1029) took 1030 ms. Trace:
I20260709 13:02:34.603950 10650 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:34.711428  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.758927  9448 rpcz_store.cc:276] 0709 13:02:33.728217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.735808 (+  7591us) service_pool.cc:224] Handling call
0709 13:02:34.757425 (+1021617us) spinlock_profiling.cc:243] Waited 8.2 ms on lock 0x7b5800003098. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445e9c 00007fb583445a5b 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b5300a0 00007fb58b52f984 00007fb584aaa6d4 00007fb584aaa662
0709 13:02:34.758524 (+  1099us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18856448}
I20260709 13:02:34.727854  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:34.696106 10624 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.712487  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:34.774434  9374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 816) took 2088 ms. Trace:
W20260709 13:02:34.777984  9451 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 1006) took 1701 ms (client timeout 1541 ms). Trace:
I20260709 13:02:34.736447 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:34.754400 10496 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:34.754854 10427 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:02:34.781602  9451 rpcz_store.cc:269] 0709 13:02:33.077073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.777805 (+1700732us) service_pool.cc:211] Skipping call since client already timed out
0709 13:02:34.777924 (+   119us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:02:34.781370  9374 rpcz_store.cc:276] 0709 13:02:32.686310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.024644 (+1338334us) service_pool.cc:224] Handling call
0709 13:02:34.027576 (+  2932us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.028072 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.028117 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:34.031461 (+  3344us) log.cc:844] Serialized 26 byte log entry
0709 13:02:34.126323 (+ 94862us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:34.126372 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.126450 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.150703 (+ 24253us) raft_consensus.cc:1685] finished
0709 13:02:34.150727 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.755030 (+604303us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b5400186d50. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865698ad 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:34.774367 (+ 19337us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1181,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":9890,"spinlock_wait_cycles":5541120,"thread_start_us":83119,"threads_started":1,"wal-append.queue_time_us":110612}
I20260709 13:02:34.789467  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:34.790225  9451 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:34.753392 10565 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.785229  9518 raft_consensus.cc:2393] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 3: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:34.796659  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:34.798544  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:34.799772  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:34.808470  9377 raft_consensus.cc:2410] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:34.787861 10496 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.801259  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:34.813418  9450 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:34.811596  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:34.809902  9449 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:34.806345  9370 raft_consensus.cc:2393] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 4: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:34.787726 10427 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.808490  9368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 814) took 2113 ms. Trace:
I20260709 13:02:34.812661 10575 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.826725 10575 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.793936 10643 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:34.827908 10643 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.828469 10565 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.829227 10663 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:34.809597 10438 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:34.825356  9368 rpcz_store.cc:276] 0709 13:02:32.682190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.685505 (+  3315us) service_pool.cc:224] Handling call
0709 13:02:34.794662 (+2109157us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b5800000f98. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b543fc0 00007fb58b52e929 00007fb58b52e3d2 00007fb584aa5bd4
0709 13:02:34.794851 (+   189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.795017 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.795040 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.795076 (+    36us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:34.795102 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.795191 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.795284 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3198208}
I20260709 13:02:34.834080  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:34.834905  9368 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:34.836534  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:34.837141  9368 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
W20260709 13:02:34.830389 10299 consensus_meta.cc:287] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.001s
I20260709 13:02:34.836184 10558 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:34.838742  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:34.838614 10558 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.839859 10643 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.809551 10487 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:34.830260 10427 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:34.839030 10689 log.cc:927] Time spent T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:02:34.830197 10496 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:34.839886  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:34.851344  9368 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:34.825819  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:34.846037  9449 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:34.846319  9418 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:34.839044 10438 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.853385  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:34.858867  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:34.859980  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:34.860167  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:34.858337  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:34.860822  9370 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:34.861765  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:34.861815  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:34.862445  9370 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:34.862474  9377 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:34.862747 10650 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.837486 10644 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:34.864017  9370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 823) took 1789 ms. Trace:
I20260709 13:02:34.864213 10644 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.865363 10487 raft_consensus.cc:2749] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:34.864198  9377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 723) took 1590 ms. Trace:
I20260709 13:02:34.866573  9377 rpcz_store.cc:276] 0709 13:02:33.273832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.863531 (+1589699us) service_pool.cc:224] Handling call
0709 13:02:34.863762 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.863900 (+   138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.863922 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.863955 (+    33us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:34.864019 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.864069 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.864154 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:34.806053 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 384653us
I20260709 13:02:34.870301  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:34.871763  9377 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:34.872617  9377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 725) took 1598 ms. Trace:
I20260709 13:02:34.873229  9377 rpcz_store.cc:276] 0709 13:02:33.274641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.871297 (+1596656us) service_pool.cc:224] Handling call
0709 13:02:34.871593 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.872321 (+   728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.872553 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.874480  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:34.877039  9450 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:34.848321 10643 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:34.897267 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 195385us
I20260709 13:02:34.909164 10643 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.911893 10643 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.848901  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:34.902626  9377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 726) took 1627 ms. Trace:
I20260709 13:02:34.921625  9377 rpcz_store.cc:276] 0709 13:02:33.274975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.901904 (+1626929us) service_pool.cc:224] Handling call
0709 13:02:34.902180 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.902339 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.902364 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.902403 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:34.902432 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.902481 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.902573 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.924263  9377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 728) took 1648 ms. Trace:
I20260709 13:02:34.949090  9377 rpcz_store.cc:276] 0709 13:02:33.275777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.923060 (+1647283us) service_pool.cc:224] Handling call
0709 13:02:34.923481 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.923806 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.923848 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.923906 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:34.923950 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.924030 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.924193 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.958446  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:34.958463  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 88223us
I20260709 13:02:34.959534  9524 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:34.959649  9418 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:34.960314  9524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46902 (request call id 837) took 1603 ms (client timeout 1846 ms). Trace:
I20260709 13:02:34.967139  9523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 926) took 1487 ms. Trace:
I20260709 13:02:34.968034 10601 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:34.841974 10299 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:34.967569  9523 rpcz_store.cc:276] 0709 13:02:33.480157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.175166 (+695009us) service_pool.cc:224] Handling call
0709 13:02:34.966436 (+791270us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5800188498. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b543fc0 00007fb58b52e929 00007fb58b52e3d2 00007fb584aa5bd4
0709 13:02:34.966634 (+   198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.966827 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.966853 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.966891 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:34.966919 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.966973 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.967081 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25380736}
I20260709 13:02:34.970341  9377 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:34.969019 10583 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:34.974547  9444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1028) took 1282 ms. Trace:
I20260709 13:02:34.915277 10558 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.968735 10696 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:34.995018 10696 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.995440 10696 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:34.995826 10299 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:34.998615 10674 consensus_meta.cc:287] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.842s	user 0.012s	sys 0.000s
I20260709 13:02:34.978920 10644 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:34.999049 10674 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:34.999274 10644 consensus_queue.cc:1059] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:35.000324 10644 raft_consensus.cc:3055] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:35.000648 10644 raft_consensus.cc:740] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:34.901757 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:35.001473 10644 consensus_queue.cc:260] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.001559 10615 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.002712 10644 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:35.003841 10615 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:34.954903 10673 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:34.965591 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 63636.8us
I20260709 13:02:34.968467 10601 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:35.005273 10601 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:35.004197 10614 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:34.960831  9524 rpcz_store.cc:269] 0709 13:02:33.356468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.356586 (+   118us) service_pool.cc:224] Handling call
0709 13:02:34.958246 (+1601660us) spinlock_profiling.cc:243] Waited 879 us on lock 0x7b5800188498. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b5300a0 00007fb58b52f984 00007fb584aaa6d4 00007fb584aaa662
0709 13:02:34.960237 (+  1991us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2022272}
I20260709 13:02:35.009742  9376 raft_consensus.cc:1240] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:34.864449  9370 rpcz_store.cc:276] 0709 13:02:33.074857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.863244 (+1788387us) service_pool.cc:224] Handling call
0709 13:02:34.863535 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.863699 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.863727 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.863773 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:34.863804 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.863865 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.863966 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.981040  9444 rpcz_store.cc:276] 0709 13:02:33.692682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.271765 (+579083us) service_pool.cc:224] Handling call
0709 13:02:34.272426 (+   661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.289842 (+ 17416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.291938 (+  2096us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.297058 (+  5120us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:34.305674 (+  8616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.974319 (+668645us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b54000d7d54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:34.974366 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.974491 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5865088}
I20260709 13:02:35.011369  9376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50568 (request call id 85) took 2023 ms. Trace:
I20260709 13:02:35.011739  9376 rpcz_store.cc:276] 0709 13:02:32.987811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.197387 (+1209576us) service_pool.cc:224] Handling call
0709 13:02:34.756556 (+559169us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b5800000f98. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b543fc0 00007fb58b52e929 00007fb58b52e3d2 00007fb584aa5bd4
0709 13:02:34.756760 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.010357 (+253597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.011096 (+   739us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b540014da54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:35.011315 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":584377088}
I20260709 13:02:34.998487  9418 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:35.014381  9418 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:34.969043  9375 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
W20260709 13:02:35.018723 10027 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.704s (SENT) [suppressed 1 similar messages]
I20260709 13:02:35.020364 10558 consensus_queue.cc:1059] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:35.021396 10608 ts_tablet_manager.cc:1929] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:35.021585 10558 raft_consensus.cc:3055] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:35.013453 10496 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.021975 10558 raft_consensus.cc:740] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:35.023005  9445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1037) took 1001 ms. Trace:
W20260709 13:02:35.018486 10692 log.cc:927] Time spent T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.239s	user 0.003s	sys 0.004s
I20260709 13:02:35.023705 10578 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:35.023875 10496 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:35.024282 10578 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:35.025247 10669 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:35.021435 10427 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.026502  9273 catalog_manager.cc:5697] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 1 to 3, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 3 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:35.028100 10575 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:35.028620 10667 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:34.162918  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:35.028864  9373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 821) took 2102 ms. Trace:
I20260709 13:02:35.031605 10601 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:35.029529 10700 log.cc:927] Time spent T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:02:35.027470 10427 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:35.032140 10488 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:35.031402  9373 rpcz_store.cc:276] 0709 13:02:32.926148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.116666 (+1190518us) service_pool.cc:224] Handling call
0709 13:02:34.116967 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.192242 (+ 75275us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:34.216457 (+ 24215us) log.cc:844] Serialized 14 byte log entry
0709 13:02:34.291708 (+ 75251us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.291764 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:34.291802 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.028647 (+736845us) spinlock_profiling.cc:243] Waited 75.1 ms on lock 0x7b540037aad4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:35.028692 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.028813 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":42914,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":1299,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":10295,"spinlock_wait_cycles":172659072,"thread_start_us":89122,"threads_started":2,"wal-append.queue_time_us":538770}
I20260709 13:02:35.017292  9418 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:35.024780 10578 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:35.022957 10558 consensus_queue.cc:260] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.021884  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52502 (request call id 68) took 1092 ms. Trace:
I20260709 13:02:35.021903 10608 log.cc:1199] T f6a0d9dc457d47bc801e795a2a573601 P d62c9d5a052b42ce8675f8438f846526: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-1-root/wals/f6a0d9dc457d47bc801e795a2a573601
I20260709 13:02:35.057775 10558 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:35.059041 10608 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51006 (request call id 63) took 4092 ms. Trace:
I20260709 13:02:35.059511 10608 rpcz_store.cc:276] 0709 13:02:30.990531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.026834 (+ 36303us) service_pool.cc:224] Handling call
0709 13:02:31.262271 (+235437us) ts_tablet_manager.cc:1151] Deleting tablet f6a0d9dc457d47bc801e795a2a573601
0709 13:02:32.061645 (+799374us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:02:34.783941 (+2722296us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:35.021267 (+237326us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:35.058934 (+ 37667us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":198875,"tablet-delete.queue_time_us":172088,"thread_start_us":56744,"threads_started":1}
I20260709 13:02:35.046558  9418 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:35.061192 10067 raft_consensus.cc:1240] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:35.062002  9418 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:35.062958 10541 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:35.063277  9372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50568 (request call id 84) took 2088 ms. Trace:
I20260709 13:02:35.063344 10541 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:35.063845 10541 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:35.063758  9372 rpcz_store.cc:276] 0709 13:02:32.974748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.190139 (+1215391us) service_pool.cc:224] Handling call
0709 13:02:35.062515 (+872376us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b5800000f98. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445e9c 00007fb583445a5b 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b543fc0 00007fb58b52e929 00007fb58b52e3d2 00007fb584aa5bd4
0709 13:02:35.062718 (+   203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.062885 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.062913 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.062963 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:35.063005 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.063068 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.063181 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7771520}
I20260709 13:02:35.066082  9374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 718) took 1997 ms. Trace:
I20260709 13:02:35.066448  9374 rpcz_store.cc:276] 0709 13:02:33.069130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.792310 (+1723180us) service_pool.cc:224] Handling call
0709 13:02:34.792593 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.830672 (+ 38079us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.830703 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.830741 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:34.830775 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.065836 (+235061us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b5400379bd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:35.065883 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.066004 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87134080}
I20260709 13:02:35.068296  9368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 822) took 1997 ms. Trace:
I20260709 13:02:35.068698  9368 rpcz_store.cc:276] 0709 13:02:33.071192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.861550 (+1790358us) service_pool.cc:224] Handling call
0709 13:02:35.067574 (+206024us) spinlock_profiling.cc:243] Waited 4.61 ms on lock 0x7b5800000f98. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b543fc0 00007fb58b52e929 00007fb58b52e3d2 00007fb584aa5bd4
0709 13:02:35.067805 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.067978 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.068004 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.068046 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:35.068077 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.068132 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.068241 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10595200}
I20260709 13:02:35.071502  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:35.073196  9418 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:02:35.048897  9446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1020) took 1377 ms. Trace:
I20260709 13:02:35.038430 10696 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.039115  9447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1021) took 1366 ms. Trace:
I20260709 13:02:35.086374  9447 rpcz_store.cc:276] 0709 13:02:33.673079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.406458 (+733379us) service_pool.cc:224] Handling call
0709 13:02:35.038297 (+631839us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b5800003098. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b543fc0 00007fb58b52e929 00007fb58b52e3d2 00007fb584aa5bd4
0709 13:02:35.038528 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.038756 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.038794 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.038847 (+    53us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:35.038888 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.038956 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.039061 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4154112}
I20260709 13:02:35.045786 10488 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:35.038064  9517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52502 (request call id 65) took 1297 ms. Trace:
I20260709 13:02:35.051756 10697 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:35.052362  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:35.057574  9519 rpcz_store.cc:276] 0709 13:02:33.929629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.044361 (+114732us) service_pool.cc:224] Handling call
0709 13:02:35.021657 (+977296us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54003241d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:35.021819 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":676468608}
I20260709 13:02:35.092566 10488 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:35.095350 10696 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:35.097182 10697 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:35.097764 10697 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:35.086189  9446 rpcz_store.cc:276] 0709 13:02:33.671439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.264098 (+592659us) service_pool.cc:224] Handling call
0709 13:02:35.048114 (+784016us) spinlock_profiling.cc:243] Waited 8.46 ms on lock 0x7b5800003098. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b543fc0 00007fb58b52e929 00007fb58b52e3d2 00007fb584aa5bd4
0709 13:02:35.048324 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.048504 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.048575 (+    71us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.048630 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:35.048664 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.048728 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.048838 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19446528}
I20260709 13:02:35.098251 10601 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:35.052534 10654 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:35.054391  9369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 812) took 2379 ms. Trace:
I20260709 13:02:35.056536 10624 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:35.033499 10674 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:35.048686  9443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 709) took 2069 ms. Trace:
I20260709 13:02:35.074781  9418 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:35.023526  9445 rpcz_store.cc:276] 0709 13:02:34.021322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.680249 (+658927us) service_pool.cc:224] Handling call
0709 13:02:34.680569 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.800393 (+119824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.807443 (+  7050us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.811175 (+  3732us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:34.813429 (+  2254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.022752 (+209323us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54001581d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:35.022800 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.022943 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246474496}
I20260709 13:02:35.099351  9275 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43240 (request call id 176) took 4882 ms. Trace:
I20260709 13:02:35.096386 10541 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.038048 10614 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:35.092876 10576 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:35.092499 10555 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:35.034878 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:35.107318  9418 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:35.098922 10352 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:35.117321 10352 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:35.118333 10352 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:35.101992  9443 rpcz_store.cc:276] 0709 13:02:32.979660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.689261 (+1709601us) service_pool.cc:224] Handling call
0709 13:02:34.717710 (+ 28449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.780350 (+ 62640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.782113 (+  1763us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:34.835739 (+ 53626us) log.cc:844] Serialized 26 byte log entry
0709 13:02:34.968262 (+132523us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:34.968315 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.968391 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:35.028937 (+ 60546us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:02:35.048275 (+ 19338us) raft_consensus.cc:1685] finished
0709 13:02:35.048302 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.048594 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":830,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":3315,"spinlock_wait_cycles":8667904,"thread_start_us":66805,"threads_started":1,"wal-append.queue_time_us":120233}
I20260709 13:02:35.106441  9275 rpcz_store.cc:276] 0709 13:02:30.209336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.209572 (+   236us) service_pool.cc:224] Handling call
0709 13:02:35.091975 (+4882403us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:31.225660 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:31.226222 (+   562us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:31.226258 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:02:31.236679 (+ 10421us) tablet.cc:662] Decoding operations
0709 13:02:31.383917 (+147238us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:31.383970 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:31.383999 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:02:31.386829 (+  2830us) tablet.cc:701] Row locks acquired
0709 13:02:31.386853 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:02:31.386980 (+   127us) write_op.cc:270] Start()
0709 13:02:31.387116 (+   136us) write_op.cc:276] Timestamp: P: 1783602151386941 usec, L: 0
0709 13:02:31.387138 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:02:31.437636 (+ 50498us) log.cc:844] Serialized 2044 byte log entry
0709 13:02:32.354009 (+916373us) op_driver.cc:464] REPLICATION: finished
0709 13:02:33.005902 (+651893us) write_op.cc:301] APPLY: starting
0709 13:02:33.006011 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:33.006258 (+   247us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:33.028447 (+ 22189us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:33.118189 (+ 89742us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:33.140094 (+ 21905us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:02:33.165115 (+ 25021us) write_op.cc:312] APPLY: finished
0709 13:02:33.191829 (+ 26714us) log.cc:844] Serialized 46 byte log entry
0709 13:02:33.271234 (+ 79405us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:33.271344 (+   110us) write_op.cc:454] Released schema lock
0709 13:02:33.271395 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:33.271853 (+   458us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:33.271883 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5232,"reported_tablets":12,"spinlock_wait_cycles":274688,"child_traces":[["op",{"apply.queue_time_us":649380,"apply.run_cpu_time_us":16273,"apply.run_wall_time_us":265901,"num_ops":5,"prepare.queue_time_us":97998,"prepare.run_cpu_time_us":4984,"prepare.run_wall_time_us":219859,"replication_time_us":942795,"thread_start_us":412535,"threads_started":3,"wal-append.queue_time_us":76524,"wal-append.run_cpu_time_us":1150,"wal-append.run_wall_time_us":1001177}]]}
I20260709 13:02:35.110953 10555 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.119218 10555 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:35.119340 10624 raft_consensus.cc:2764] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:02:35.092651  9517 rpcz_store.cc:276] 0709 13:02:33.740840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.237684 (+496844us) service_pool.cc:224] Handling call
0709 13:02:34.237973 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.389356 (+151383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.407905 (+ 18549us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.579435 (+171530us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:34.592392 (+ 12957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.037748 (+445356us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400199e54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:35.037813 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.037986 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254525184}
I20260709 13:02:35.130300  9418 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:02:35.131546  9418 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:35.134720 10576 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:35.100636  9369 rpcz_store.cc:276] 0709 13:02:32.674870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.687156 (+ 12286us) service_pool.cc:224] Handling call
0709 13:02:34.698839 (+2011683us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b5800000f98. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b543fc0 00007fb58b52e929 00007fb58b52e3d2 00007fb584aa5bd4
0709 13:02:35.053199 (+354360us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b5800000f98. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445e9c 00007fb583445a5b 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b543fc0 00007fb58b52e929 00007fb58b52e3d2 00007fb584aa5bd4
0709 13:02:35.053420 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.053711 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.053785 (+    74us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.053985 (+   200us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:35.054047 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.054134 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.054296 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9135744}
I20260709 13:02:35.136544 10624 raft_consensus.cc:2804] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:35.136986 10624 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:35.137061  9418 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:35.137526 10624 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:35.137948 10487 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:35.139303  9418 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:02:35.140684  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:35.141515 10576 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:35.141968 10576 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:35.142330 10576 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:35.143755  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 334890us
I20260709 13:02:35.109512 10601 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:35.150080  9418 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:02:35.146247  9490 connection.cc:256] RPC call timeout handler was delayed by -1.0741048720000208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
I20260709 13:02:35.162904  9418 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
W20260709 13:02:35.164326  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.166206 10644 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:35.167752  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:35.138732 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 110226us
I20260709 13:02:35.158813 10697 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.160108  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:35.169260  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.147209 10487 consensus_queue.cc:1059] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:02:35.144872 10541 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:35.168408  9524 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
W20260709 13:02:35.173846  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.174453  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.174621  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.175776  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.175911  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.176455  9518 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:35.176596  9522 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:35.176678  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.170145  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:35.171756  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.178889  9523 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:35.172832  9521 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:35.170145  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.180517  9520 raft_consensus.cc:2393] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 4: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:35.180487  9524 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:35.181191  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:35.181963  9374 raft_consensus.cc:2393] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 3: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:35.172142  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:35.184886  9490 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:02:35.172431 10644 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:35.188038  9490 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.188427  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:35.189567  9490 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:35.182538 10696 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:35.192015  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.178439 10487 raft_consensus.cc:3055] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:35.179702  9372 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:35.193476  9490 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
W20260709 13:02:35.180699 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 272845us
I20260709 13:02:35.196611 10658 raft_consensus.cc:2804] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:35.198525 10654 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:35.208469  9490 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:35.209548  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:35.199831  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.197232 10614 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:35.183560  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.207012 10658 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:35.212604  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:35.197499 10487 raft_consensus.cc:740] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:35.193032 10644 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:35.213953 10644 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:35.208694 10654 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:35.213902 10487 consensus_queue.cc:260] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:35.214604 10654 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:35.208161 10667 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:35.213124 10658 raft_consensus.cc:3060] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:35.216111  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:35.210724  9522 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:35.221129 10667 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:35.222543 10667 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:35.216696  9490 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:35.207378 10488 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.220494  9343 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.205302 10576 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:35.215189 10487 raft_consensus.cc:3060] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:35.227105  9343 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:35.227435 10672 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:35.234192  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.234361  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.221274 10614 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:35.229143 10632 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:35.230986  9490 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:35.232329  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.232762 10669 consensus_queue.cc:1059] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:35.245934  9443 raft_consensus.cc:1240] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:35.233042  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:35.245916  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.237324  9343 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.247180  9444 raft_consensus.cc:2368] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 4.
I20260709 13:02:35.247542 10677 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:35.247764  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.235998  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.238029 10595 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:35.220028 10352 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:35.238456 10578 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.239554  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.251236  9447 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:35.251572  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.240177 10488 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:35.240305  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.246411 10576 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:35.241371 10555 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.242244  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.256999  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.257543  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.230719  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:35.236502 10672 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:35.246311 10615 raft_consensus.cc:3055] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:35.247941  9343 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.269405  9343 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:35.270009 10427 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:35.238016 10674 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:35.248795  9449 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:35.268460 10615 raft_consensus.cc:740] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:35.271697  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.271925 10615 consensus_queue.cc:260] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.272838  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.246589 10614 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:35.275436 10614 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:35.276266 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:35.240931  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.270509  9343 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.253582  9490 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.254115  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.257624  9448 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:35.253175  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.247990  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.263484  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.255460 10595 raft_consensus.cc:697] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:35.265865 10578 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:35.266418  9445 raft_consensus.cc:1240] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:35.267040 10352 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:35.267129 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:35.268438 10672 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:35.273124 10615 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:35.279341  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:35.307868 10644 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.243093 10632 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:35.279354  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.280081  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:35.281585  9525 raft_consensus.cc:1240] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:35.270967 10427 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:35.327133  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.300740 10669 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:35.280778  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.283334  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:35.283564  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.285200  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.286090  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:35.286588  9260 catalog_manager.cc:5028] TS d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): tablet f6a0d9dc457d47bc801e795a2a573601 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
W20260709 13:02:35.331857  9260 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 45287.6us
I20260709 13:02:35.335691  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:35.336519  9372 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:35.287564  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:35.339499  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:35.339788  9375 raft_consensus.cc:2393] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 4: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:35.290196  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.290868  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.341331  9520 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:35.291221  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:35.342342  9370 raft_consensus.cc:2393] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 2: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:35.291970  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:35.292091  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.292686  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:35.297183  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:35.298878  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:35.299707  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:35.300101  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.345520  9369 raft_consensus.cc:1240] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:35.346465  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.347576  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.348335  9449 raft_consensus.cc:2410] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:35.305989  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:35.348387  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:35.349843  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.317237 10438 consensus_queue.cc:1059] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:02:35.350972  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.351384 10438 raft_consensus.cc:3055] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:35.351994  9444 raft_consensus.cc:2393] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 3: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:35.308291 10555 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:35.309201  9343 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.310511  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:02:35.354066  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 44942.4us
I20260709 13:02:35.354913  9343 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.355912 10496 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:35.328781 10632 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:35.338223 10667 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.338395 10595 consensus_queue.cc:237] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.339040 10644 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:35.340737  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.355484 10658 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:35.319036  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.319031 10674 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:35.309125 10694 consensus_queue.cc:1059] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:02:35.327133  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:35.360878  9449 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:02:35.379841  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:35.352037 10438 raft_consensus.cc:740] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:02:35.369936  9517 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:35.374396 10674 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:35.317099 10027 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.344485 10654 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.373785  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:35.362218 10575 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:35.286888  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.370267  9448 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:35.356889  9343 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:35.375885  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 229361us
I20260709 13:02:35.385648  9374 raft_consensus.cc:2393] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 4: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:35.386219  9452 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:35.391158  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:35.411855  9525 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:02:35.394243  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:35.413846  9376 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:02:35.406719  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:02:35.400872  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 71446.1us
I20260709 13:02:35.410693  9418 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:35.398954  9343 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.417433  9418 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:35.420521  9521 raft_consensus.cc:2393] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 3: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
W20260709 13:02:35.407473  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.398837  9341 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:35.423432  9418 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:35.422207  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:35.378180 10624 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:35.427249  9374 raft_consensus.cc:2368] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:35.421650  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.391134 10674 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:35.391680 10677 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:35.393095 10326 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:35.427583 10555 raft_consensus.cc:2749] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:35.440641 10352 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:35.386933 10438 consensus_queue.cc:260] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:35.395062  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:35.421759 10643 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:35.430083  9418 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:35.387161  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:35.450177  9524 raft_consensus.cc:1240] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:35.450634  9490 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.405582 10575 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:35.469477  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:35.449162  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:35.390682 10667 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:35.470381  9375 raft_consensus.cc:2393] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 4: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
W20260709 13:02:35.392920 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 75954.9us
I20260709 13:02:35.470458 10667 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:35.471377 10027 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.455080 10352 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:35.472059 10352 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:35.393558 10697 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:35.441923  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:35.468747  9517 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:35.456462 10438 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:35.469980  9490 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.474593  9490 leader_election.cc:400] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 4.
I20260709 13:02:35.389530 10694 raft_consensus.cc:3055] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:35.447757  9522 raft_consensus.cc:1240] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:35.465945  9376 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:35.419551 10706 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:35.480690  9525 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:35.475059  9490 leader_election.cc:403] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:35.474537  9343 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.430632  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:35.491346  9343 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.493189  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:35.494309  9377 raft_consensus.cc:2393] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 3: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
W20260709 13:02:35.501865  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 103090us
I20260709 13:02:35.405718 10487 consensus_queue.cc:1059] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:02:35.502374  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:35.502954  9490 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.504637  9343 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.507302  9490 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.509035  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:35.510280  9490 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:35.511453 10583 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:35.511952 10583 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.512178  9446 raft_consensus.cc:1240] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:35.512465 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:35.513465 10714 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:35.513816 10599 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:35.466969 10654 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:35.462569 10693 consensus_queue.cc:1059] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:02:35.517287  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:35.518229  9519 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:35.470505 10624 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:35.482122 10694 raft_consensus.cc:740] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:02:35.522653 10669 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:35.466434 10643 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:35.522917 10694 consensus_queue.cc:260] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:35.523767 10643 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:35.524189 10694 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:35.501926 10326 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:35.508903 10576 consensus_queue.cc:1059] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:02:35.512337 10583 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:35.529966  9341 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:35.530107 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:35.502561 10667 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:35.447602 10427 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:35.536235  9343 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.533222 10670 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:35.541739  9343 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.543063  9522 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:35.464216 10672 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.558758 10714 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:35.559825 10672 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:35.456532 10658 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:35.544420 10575 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:35.560751 10575 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:35.444777 10595 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.116s
I20260709 13:02:35.508525 10590 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 4.
I20260709 13:02:35.545626 10487 raft_consensus.cc:3055] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:35.545643 10427 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:35.546033 10576 raft_consensus.cc:3055] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:35.538596 10299 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:35.508687 10677 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:35.509806 10614 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.551501  9517 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:35.565387  9343 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.531134  9341 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:35.554638 10643 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.555152  9376 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:35.555743 10670 raft_consensus.cc:697] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:35.539968  9490 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.561173 10575 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:35.572261 10590 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:35.488855 10555 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:35.573866  9490 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.574366 10555 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:35.574787 10555 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:35.575278 10352 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.576064  9490 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.563176 10576 raft_consensus.cc:740] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:35.577474 10352 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:35.577759 10590 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:35.567298  9343 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.563854 10299 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:35.580485 10299 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:35.580588 10673 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:35.581151 10673 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:35.581568 10673 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:35.583278 10576 consensus_queue.cc:260] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.584606 10576 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:35.586814 10326 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:35.561944 10487 raft_consensus.cc:740] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:35.597486 10487 consensus_queue.cc:260] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:35.598636 10487 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:35.548615 10632 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.566897 10496 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:35.570727 10698 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:35.601588 10698 raft_consensus.cc:697] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:35.602828 10632 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:35.602620 10698 consensus_queue.cc:237] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.566046 10677 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:35.606083 10677 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:35.580830  9445 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:35.571563 10670 consensus_queue.cc:237] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.609567 10714 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:02:35.567965 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 95264.4us
I20260709 13:02:35.577203 10658 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:35.588418 10352 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.612883  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:35.613746  9376 raft_consensus.cc:2368] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:35.589290 10673 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.592577 10672 consensus_queue.cc:1059] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:35.593441  9490 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:35.594537  9492 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.594945 10674 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.596529 10067 raft_consensus.cc:2468] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:35.601649  9371 raft_consensus.cc:1240] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:35.562969 10427 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:35.571705 10614 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:35.625698 10555 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.618887 10575 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.589511 10299 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.617798  9492 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.628094 10555 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:35.613979 10027 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:35.618706  9490 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:35.622025  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:02:35.568380  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 80733.1us
I20260709 13:02:35.652777  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:02:35.628651  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 97580us
I20260709 13:02:35.656826  9417 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:35.629158  9492 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.659904  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.615801 10326 raft_consensus.cc:3055] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:35.618883 10595 raft_consensus.cc:2804] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:35.616784 10673 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:35.659044 10299 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:35.661882  9492 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.667912  9492 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.617970 10658 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:35.615128 10672 raft_consensus.cc:3055] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:35.665655  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:35.721359  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:35.721828  9517 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:35.721896  9451 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:35.628744 10590 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:35.662555  9418 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:35.721906  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:35.723321  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.723379  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:35.611549 10583 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.668869  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.669888  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.614538 10693 consensus_queue.cc:1059] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:02:35.659546 10615 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:35.691958  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:35.670706 10658 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.614308 10352 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.693958  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:35.740577  9519 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:35.664495 10326 raft_consensus.cc:740] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:02:35.731789 10576 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:35.654330 10677 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.696717 10644 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:35.664501 10614 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:35.664624  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:35.692920 10669 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:35.659348 10694 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:35.700263  9492 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:35.702867  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.704732  9446 raft_consensus.cc:1240] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:35.705271 10674 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:35.706187 10667 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:35.706928 10643 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:35.677484 10595 raft_consensus.cc:697] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:35.710371  9273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 61) took 3196 ms. Trace:
I20260709 13:02:35.724442  9525 raft_consensus.cc:2393] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 4: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:35.723027  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:35.971391  9526 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:35.972105  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:35.722520  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:35.973330  9523 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:35.747675  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:35.714257  9274 catalog_manager.cc:5697] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.758250  9343 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:02:35.801571  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:35.726469  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 63989.6us
I20260709 13:02:36.470849  9418 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:36.471740 10487 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:35.714093  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:36.475216  9447 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:36.476290  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:36.476397  9341 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:35.714367  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:35.775077  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:35.735095  9451 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:35.715668  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:36.087677  9274 catalog_manager.cc:5697] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 1 to 3, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 3 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:36.781404  9525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 985) took 1032 ms. Trace:
I20260709 13:02:36.476975  9447 raft_consensus.cc:2368] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3.
I20260709 13:02:35.977065  9273 rpcz_store.cc:276] 0709 13:02:32.513582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.513738 (+   156us) service_pool.cc:224] Handling call
0709 13:02:33.305284 (+791546us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b540016e4d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d4090 00007fb586572f3a 00007fb58c3291cc 00007fb58c42737e 00007fb58a8e82a4 00007fb58a8e8232 00007fb58a8e8161 00007fb58a8e80dc 00007fb58a8e7392 00007fb5848a548c 00007fb5848a48c6
0709 13:02:35.710309 (+2405025us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:35.161061 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:35.164058 (+  2997us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:35.164092 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:02:35.165488 (+  1396us) tablet.cc:662] Decoding operations
0709 13:02:35.165831 (+   343us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:35.165906 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:35.165940 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:35.166148 (+   208us) tablet.cc:701] Row locks acquired
0709 13:02:35.166164 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:02:35.166301 (+   137us) write_op.cc:270] Start()
0709 13:02:35.166417 (+   116us) write_op.cc:276] Timestamp: P: 1783602155166256 usec, L: 0
0709 13:02:35.166440 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:02:35.167094 (+   654us) log.cc:844] Serialized 586 byte log entry
0709 13:02:35.439563 (+272469us) op_driver.cc:464] REPLICATION: finished
0709 13:02:35.698210 (+258647us) write_op.cc:301] APPLY: starting
0709 13:02:35.698294 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:35.698389 (+    95us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:35.698498 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:35.698702 (+   204us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:35.698860 (+   158us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:02:35.698905 (+    45us) write_op.cc:312] APPLY: finished
0709 13:02:35.705100 (+  6195us) log.cc:844] Serialized 22 byte log entry
0709 13:02:35.706734 (+  1634us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:35.706826 (+    92us) write_op.cc:454] Released schema lock
0709 13:02:35.706864 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:35.707226 (+   362us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:35.707256 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1718921,"reported_tablets":1,"spinlock_wait_cycles":467937664,"child_traces":[["op",{"apply.queue_time_us":258340,"apply.run_cpu_time_us":1800,"apply.run_wall_time_us":8991,"num_ops":1,"prepare.queue_time_us":130661,"prepare.run_cpu_time_us":18137,"prepare.run_wall_time_us":95466,"raft.queue_time_us":143597,"raft.run_cpu_time_us":9728,"raft.run_wall_time_us":202936,"replication_time_us":255152,"thread_start_us":320801,"threads_started":4,"wal-append.queue_time_us":97459}]]}
I20260709 13:02:36.833539  9447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 1067) took 1107 ms. Trace:
I20260709 13:02:35.715324  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:36.472767  9418 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:02:35.765292  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 65088.2us
I20260709 13:02:35.770948  9445 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:35.750116  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:35.720681  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:36.479753  9444 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:36.860435  9449 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:36.860502  9444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 1054) took 1146 ms. Trace:
I20260709 13:02:36.861239  9449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 1062) took 1141 ms. Trace:
I20260709 13:02:36.861152  9444 rpcz_store.cc:276] 0709 13:02:35.714004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.714122 (+   118us) service_pool.cc:224] Handling call
0709 13:02:36.860313 (+1146191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.861737  9449 rpcz_store.cc:276] 0709 13:02:35.720151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.720441 (+   290us) service_pool.cc:224] Handling call
0709 13:02:36.861170 (+1140729us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.085127  9526 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:36.864773  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:36.865738  9526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46894 (request call id 971) took 1143 ms. Trace:
I20260709 13:02:36.865979  9449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 1078) took 1077 ms. Trace:
I20260709 13:02:36.866189  9526 rpcz_store.cc:276] 0709 13:02:35.722493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.722810 (+   317us) service_pool.cc:224] Handling call
0709 13:02:36.865463 (+1142653us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.866420  9449 rpcz_store.cc:276] 0709 13:02:35.788988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.862763 (+1073775us) service_pool.cc:224] Handling call
0709 13:02:36.865901 (+  3138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.725338  9520 raft_consensus.cc:1240] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:36.871223  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:36.871802  9520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 973) took 1148 ms. Trace:
I20260709 13:02:36.872263  9520 rpcz_store.cc:276] 0709 13:02:35.724363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.724907 (+   544us) service_pool.cc:224] Handling call
0709 13:02:35.725196 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.871253 (+1146057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.871597 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.745720  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:36.874351  9519 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:36.873584  9449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 1071) took 1137 ms. Trace:
I20260709 13:02:36.874830  9449 rpcz_store.cc:276] 0709 13:02:35.741434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.870762 (+1129328us) service_pool.cc:224] Handling call
0709 13:02:36.873520 (+  2758us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.876058  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:35.743630  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:36.878468  9524 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:35.758620  9517 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
W20260709 13:02:36.882400  9517 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46894 (request call id 963) took 1224 ms (client timeout 1604 ms). Trace:
W20260709 13:02:36.882812  9517 rpcz_store.cc:269] 0709 13:02:35.658403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.658519 (+   116us) service_pool.cc:224] Handling call
0709 13:02:36.882221 (+1223702us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:36.786649  9523 consensus_meta.cc:287] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.813s	user 0.009s	sys 0.014s
I20260709 13:02:36.885468  9523 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:36.886165  9523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46894 (request call id 970) took 1164 ms. Trace:
I20260709 13:02:36.886518  9523 rpcz_store.cc:276] 0709 13:02:35.722191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.722311 (+   120us) service_pool.cc:224] Handling call
0709 13:02:36.886094 (+1163783us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.886569 10731 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:36.888154 10731 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:36.477241 10299 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:35.713253 10427 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.695902 10575 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:35.666658 10555 raft_consensus.cc:2804] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:35.727123 10632 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:35.762029 10669 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:35.722985 10672 raft_consensus.cc:740] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:35.774395 10595 consensus_queue.cc:237] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:35.719195  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:35.767518 10614 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:35.788220 10677 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:36.481420 10487 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.452868 10641 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:35.723014 10590 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:35.774375 10352 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:36.095981 10670 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:02:36.089457  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 332226us
I20260709 13:02:36.092193 10724 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.756443 10717 raft_consensus.cc:3055] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:36.778496 10728 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:35.749341 10583 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:36.787875  9451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 1060) took 1068 ms. Trace:
I20260709 13:02:36.773031 10696 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:36.774663 10585 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.747160 10326 consensus_queue.cc:260] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:35.741505 10658 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:35.796465 10576 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:36.094568  9518 raft_consensus.cc:1240] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:36.448004 10438 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:35.736232 10615 raft_consensus.cc:697] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 4 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:35.746843  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:35.761883 10644 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:36.742404 10727 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:36.830643  9274 catalog_manager.cc:5697] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:36.834154  9447 rpcz_store.cc:276] 0709 13:02:35.725544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.476033 (+750489us) service_pool.cc:224] Handling call
0709 13:02:36.833217 (+357184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.713809  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:36.829370  9525 rpcz_store.cc:276] 0709 13:02:35.748677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.975503 (+226826us) service_pool.cc:224] Handling call
0709 13:02:35.975828 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.976005 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.976036 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.976144 (+   108us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:35.976183 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.976244 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.781347 (+805103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.836632 10674 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.787189  9446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 1068) took 1060 ms. Trace:
I20260709 13:02:36.846874  9452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 1055) took 1131 ms. Trace:
I20260709 13:02:36.924485 10496 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:36.942418  9451 rpcz_store.cc:276] 0709 13:02:35.719525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.721154 (+  1629us) service_pool.cc:224] Handling call
0709 13:02:36.787811 (+1066657us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.942960 10496 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:36.943351  9525 raft_consensus.cc:1240] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:36.863297  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:36.945363 10299 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:36.945297 10576 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:36.946049 10299 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:36.946300  9444 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 1074) took 1183 ms (client timeout 1576 ms). Trace:
I20260709 13:02:36.947175  9450 raft_consensus.cc:2393] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 4: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
W20260709 13:02:36.947027  9444 rpcz_store.cc:269] 0709 13:02:35.762851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.862713 (+1099862us) service_pool.cc:224] Handling call
0709 13:02:36.946210 (+ 83497us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.947799  9450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 1052) took 1234 ms. Trace:
I20260709 13:02:36.947436 10438 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:02:36.850629  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 377769us
I20260709 13:02:36.949525 10487 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:36.951231  9418 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:36.854322  9492 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:36.951642 10641 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:36.856190  9445 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 1051) took 1185 ms (client timeout 1519 ms). Trace:
I20260709 13:02:36.876894  9449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 1073) took 1114 ms. Trace:
I20260709 13:02:36.936005  9520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52502 (request call id 77) took 1157 ms. Trace:
I20260709 13:02:36.948239  9450 rpcz_store.cc:276] 0709 13:02:35.713397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.713537 (+   140us) service_pool.cc:224] Handling call
0709 13:02:36.947718 (+1234181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.954206  9449 rpcz_store.cc:276] 0709 13:02:35.762544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.875660 (+1113116us) service_pool.cc:224] Handling call
0709 13:02:36.876824 (+  1164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.955132  9525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52502 (request call id 78) took 1166 ms. Trace:
I20260709 13:02:36.849871 10730 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:36.888825  9523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52502 (request call id 76) took 1111 ms. Trace:
I20260709 13:02:36.946092 10667 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:36.954372  9520 rpcz_store.cc:276] 0709 13:02:35.778082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.934258 (+1156176us) service_pool.cc:224] Handling call
0709 13:02:36.934898 (+   640us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.935503 (+   605us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.935545 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:36.935635 (+    90us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:36.935681 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.935765 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.935930 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.929291  9526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 989) took 1165 ms. Trace:
I20260709 13:02:36.957321  9523 rpcz_store.cc:276] 0709 13:02:35.777824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.887455 (+1109631us) service_pool.cc:224] Handling call
0709 13:02:36.888016 (+   561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.888435 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.888464 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:36.888522 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:36.888589 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.888649 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.888775 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.955613  9525 rpcz_store.cc:276] 0709 13:02:35.778503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.942273 (+1163770us) service_pool.cc:224] Handling call
0709 13:02:36.942931 (+   658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.945078 (+  2147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.945334 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.957755  9526 rpcz_store.cc:276] 0709 13:02:35.763511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.868042 (+1104531us) service_pool.cc:224] Handling call
0709 13:02:36.868681 (+   639us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.928720 (+ 60039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.928766 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:36.928848 (+    82us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:36.928893 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.928977 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.929184 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.932251  9517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52502 (request call id 75) took 1107 ms. Trace:
I20260709 13:02:36.962270  9517 rpcz_store.cc:276] 0709 13:02:35.777509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.883635 (+1106126us) service_pool.cc:224] Handling call
0709 13:02:36.884218 (+   583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.884620 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.884644 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:36.884700 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:36.884757 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.884811 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.884924 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.964269  9443 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:36.953701  9452 rpcz_store.cc:276] 0709 13:02:35.715005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.715118 (+   113us) service_pool.cc:224] Handling call
0709 13:02:36.846714 (+1131596us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.973891 10718 consensus_queue.cc:1059] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:02:36.974550 10614 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:36.908663  9341 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:36.977099 10677 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:36.977401 10427 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:36.978498  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 70313.9us
I20260709 13:02:36.978649 10427 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:36.978044 10677 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:36.979136 10693 consensus_queue.cc:1059] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:36.979285 10667 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:36.980448  9341 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:36.955304  9445 rpcz_store.cc:269] 0709 13:02:35.670942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.702598 (+ 31656us) service_pool.cc:224] Handling call
0709 13:02:36.855978 (+1153380us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.977334 10698 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:36.982719 10438 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:36.983618 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:36.984473 10067 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:36.984310 10672 consensus_queue.cc:260] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:36.985437 10352 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:36.985790 10672 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:36.986124 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:36.986228 10352 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:36.987072 10669 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:36.983428 10698 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:36.988978 10728 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:36.990316 10698 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:36.987257 10065 raft_consensus.cc:2393] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 2: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:02:36.990573 10721 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:36.991264 10721 raft_consensus.cc:697] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:36.991791  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:36.992018 10677 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:36.993057 10614 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:36.992590 10721 consensus_queue.cc:237] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:36.993721 10614 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:36.991293 10674 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:36.995865  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:36.996244 10614 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:36.997464 10717 raft_consensus.cc:740] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:02:36.996471 10674 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:36.996876 10427 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.941537 10590 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:36.982512 10667 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:36.949249  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:36.992682  9447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 1072) took 1230 ms. Trace:
I20260709 13:02:37.001591 10670 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.941736 10585 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:36.944410 10696 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:36.982190  9446 rpcz_store.cc:276] 0709 13:02:35.726376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.774809 (+ 48433us) service_pool.cc:224] Handling call
0709 13:02:36.787092 (+1012283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.997663 10727 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:37.004947 10644 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.004976 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:02:37.033633  9398 debug-util.cc:398] Leaking SignalData structure 0x7b08000dff80 after lost signal to thread 8212
I20260709 13:02:37.040342  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:37.024338  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.042193  9450 raft_consensus.cc:1240] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:37.016899  9274 catalog_manager.cc:5697] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 1 to 3, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 3 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:37.028237 10632 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:02:37.049744  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 195826us
I20260709 13:02:37.042128  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:02:37.047184  9398 debug-util.cc:398] Leaking SignalData structure 0x7b08000ddc40 after lost signal to thread 9309
I20260709 13:02:37.019873  9524 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:37.052775  9492 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:37.019414  9447 rpcz_store.cc:276] 0709 13:02:35.762295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.991414 (+1229119us) service_pool.cc:224] Handling call
0709 13:02:36.992629 (+  1215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:37.034875  9341 leader_election.cc:400] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3.
I20260709 13:02:37.058495  9341 leader_election.cc:403] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:37.036032  9449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1063) took 1315 ms. Trace:
I20260709 13:02:37.062542 10352 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.015515  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:37.026767  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:37.059638  9449 rpcz_store.cc:276] 0709 13:02:35.720443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.034445 (+1314002us) service_pool.cc:224] Handling call
0709 13:02:37.035121 (+   676us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.035555 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.035597 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.035661 (+    64us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:37.035700 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.035775 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.035933 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:37.065639  9450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1064) took 1337 ms. Trace:
I20260709 13:02:37.043031 10714 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:02:37.066653  9398 debug-util.cc:398] Leaking SignalData structure 0x7b08000ddb60 after lost signal to thread 9323
I20260709 13:02:37.066896 10714 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:02:37.068871  9398 debug-util.cc:398] Leaking SignalData structure 0x7b08003634a0 after lost signal to thread 9401
I20260709 13:02:37.069416 10728 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:37.069806  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.028105  9452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36e88678fcd042e78609b17fe3521242"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:34968
W20260709 13:02:37.070436  9398 debug-util.cc:398] Leaking SignalData structure 0x7b080031b800 after lost signal to thread 9476
I20260709 13:02:37.070557  9452 raft_consensus.cc:606] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Received request to transfer leadership to TS 925acbe78db14db3b9e4cfc857717947
W20260709 13:02:37.070875  9398 debug-util.cc:398] Leaking SignalData structure 0x7b080031b6c0 after lost signal to thread 9477
I20260709 13:02:37.071132  9452 raft_consensus.cc:614] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:37.071424  9525 raft_consensus.cc:1240] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
W20260709 13:02:37.072396  9398 debug-util.cc:398] Leaking SignalData structure 0x7b080010cf80 after lost signal to thread 9550
I20260709 13:02:37.019572 10670 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:37.073177  9526 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:37.022461 10717 consensus_queue.cc:260] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:37.074514  9443 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:37.002558 10427 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:37.019088  9444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 1070) took 1285 ms. Trace:
I20260709 13:02:37.075520  9444 rpcz_store.cc:276] 0709 13:02:35.733337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.948661 (+1215324us) service_pool.cc:224] Handling call
0709 13:02:37.019025 (+ 70364us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:37.021443 10615 consensus_queue.cc:237] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.077442 10730 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:37.013830 10724 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.077358  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:37.078908  9517 raft_consensus.cc:2393] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:37.005180 10496 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:37.021366  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:37.080032  9517 raft_consensus.cc:3055] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:37.080616  9517 raft_consensus.cc:740] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:37.081252 10693 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.082047 10693 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:37.066682 10326 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:37.072781  9398 debug-util.cc:398] Leaking SignalData structure 0x7b080025cd20 after lost signal to thread 9551
I20260709 13:02:37.018360 10641 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.077371  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:37.015664 10576 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.074913 10717 raft_consensus.cc:3060] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:37.085507 10727 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:37.080498  9446 raft_consensus.cc:2468] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 1.
I20260709 13:02:37.086711  9520 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.066249  9450 rpcz_store.cc:276] 0709 13:02:35.720751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.041415 (+1320664us) service_pool.cc:224] Handling call
0709 13:02:37.041911 (+   496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.048897 (+  6986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.058115 (+  9218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:37.090874  9452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1066) took 1361 ms. Trace:
I20260709 13:02:37.091311  9452 rpcz_store.cc:276] 0709 13:02:35.725304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.071992 (+1346688us) service_pool.cc:224] Handling call
0709 13:02:37.072419 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.072740 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.072787 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.072849 (+    62us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:37.072885 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.072981 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.086900 (+ 13919us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:37.009716  9518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 988) took 1246 ms. Trace:
I20260709 13:02:37.106518 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:37.108240 10590 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.109658  9521 raft_consensus.cc:2393] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:37.111370 10590 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:37.094234 10724 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:37.094439  9398 debug-util.cc:398] Leaking SignalData structure 0x7b080026f680 after lost signal to thread 10094
I20260709 13:02:37.095319 10718 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.098294 10714 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:37.099627 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:37.097498 10670 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.102327 10025 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
W20260709 13:02:37.103387  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 101438us
I20260709 13:02:37.104061 10575 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3.
I20260709 13:02:37.124794  9444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45366 (request call id 95) took 1340 ms. Trace:
I20260709 13:02:37.010480 10669 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.112686  9369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50568 (request call id 89) took 1334 ms. Trace:
I20260709 13:02:37.093861  9523 raft_consensus.cc:2393] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 4: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:37.116611 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:37.125247  9443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 1056) took 1410 ms. Trace:
I20260709 13:02:37.116494 10555 raft_consensus.cc:697] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:37.126389 10487 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.128857 10693 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:37.130370  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:37.081769  9517 consensus_queue.cc:260] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.118206  9451 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:37.123848  9452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1075) took 1353 ms. Trace:
W20260709 13:02:37.088861  9524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46894 (request call id 976) took 1345 ms (client timeout 1534 ms). Trace:
I20260709 13:02:37.014818  9519 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:37.167225  9375 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 2.
W20260709 13:02:37.116219  9521 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46894 (request call id 983) took 1368 ms (client timeout 1576 ms). Trace:
I20260709 13:02:37.112812  9447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1069) took 1382 ms. Trace:
I20260709 13:02:37.122359 10696 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:37.115903 10632 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:37.139194 10727 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.102357 10658 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:37.140739  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 88169.6us
I20260709 13:02:37.167378  9517 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:37.117897 10731 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.180016  9449 raft_consensus.cc:1240] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:37.182403 10727 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.171243 10672 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.183501 10672 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:37.184597  9449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1077) took 1407 ms. Trace:
I20260709 13:02:37.166126  9452 rpcz_store.cc:276] 0709 13:02:35.769978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.122538 (+1352560us) service_pool.cc:224] Handling call
0709 13:02:37.123065 (+   527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.123336 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.123373 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.123449 (+    76us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:37.123527 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.123602 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.123778 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:37.185062  9449 rpcz_store.cc:276] 0709 13:02:35.776798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.120007 (+1343209us) service_pool.cc:224] Handling call
0709 13:02:37.120591 (+   584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.183178 (+ 62587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.184227 (+  1049us) spinlock_profiling.cc:243] Waited 59.1 ms on lock 0x7b5400015c54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:37.184505 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135923968}
I20260709 13:02:37.186242 10731 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.186851  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:37.186929 10731 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.188050  9452 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:37.189306  9343 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:37.189985 10731 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.190364 10714 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:37.143543 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:37.190948  9447 rpcz_store.cc:276] 0709 13:02:35.730640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.088121 (+1357481us) service_pool.cc:224] Handling call
0709 13:02:37.112218 (+ 24097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.112510 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.112534 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.112590 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:37.112616 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.112663 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.112762 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:37.168938 10669 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:37.192312  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:37.187009  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:37.140794 10590 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:37.105636  9518 rpcz_store.cc:276] 0709 13:02:35.763248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.094084 (+330836us) service_pool.cc:224] Handling call
0709 13:02:36.094375 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.009111 (+914736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.009504 (+   393us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:37.122157 10641 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.147364 10718 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:37.184793 10727 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.118604 10585 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.150058 10065 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:37.200625  9492 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:37.202104  9492 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:37.202278  9342 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:02:37.151307  9369 rpcz_store.cc:276] 0709 13:02:35.778249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.779075 (+   826us) service_pool.cc:224] Handling call
0709 13:02:35.789364 (+ 10289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.051407 (+1262043us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.051487 (+    80us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.051553 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:37.051606 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.112070 (+ 60464us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54000febd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:37.112149 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.112426 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2901204224}
I20260709 13:02:37.203127 10669 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:37.154737 10670 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.203234 10427 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.204974 10590 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:02:37.151154 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 49114.4us
I20260709 13:02:37.152539  9443 rpcz_store.cc:276] 0709 13:02:35.715295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.715423 (+   128us) service_pool.cc:224] Handling call
0709 13:02:37.125026 (+1409603us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b540027f954. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:37.125185 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":301243264}
I20260709 13:02:37.215728  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:37.161161  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:37.216755  9443 raft_consensus.cc:2393] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:37.180719 10299 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.217871  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:37.218767  9443 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 3.
I20260709 13:02:37.220024  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:37.220674 10299 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.169294  9522 raft_consensus.cc:2393] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 2: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:37.220682  9443 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:02:37.226259  9522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46894 (request call id 980) took 1480 ms. Trace:
I20260709 13:02:37.226706  9522 rpcz_store.cc:276] 0709 13:02:35.745707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.746618 (+   911us) service_pool.cc:224] Handling call
0709 13:02:37.225997 (+1479379us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b5400324bd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:37.226177 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515345664}
I20260709 13:02:37.190466 10658 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:37.192991  9447 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:37.166492  9524 rpcz_store.cc:269] 0709 13:02:35.743187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.743331 (+   144us) service_pool.cc:224] Handling call
0709 13:02:37.061039 (+1317708us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:37.229565  9343 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:37.229820  9341 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:37.231295  9341 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:37.141227  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 190221us
I20260709 13:02:37.233855  9418 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:02:37.193322  9521 rpcz_store.cc:269] 0709 13:02:35.748123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.749927 (+  1804us) service_pool.cc:224] Handling call
0709 13:02:37.115999 (+1366072us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b5400325ad4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:37.116166 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578489600}
W20260709 13:02:37.169965  9490 leader_election.cc:336] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.500s (SENT)
I20260709 13:02:37.234984 10299 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:37.088348  9526 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:37.199895  9446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1076) took 1428 ms. Trace:
I20260709 13:02:37.250262  9446 rpcz_store.cc:276] 0709 13:02:35.771628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.096150 (+1324522us) service_pool.cc:224] Handling call
0709 13:02:37.148914 (+ 52764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.166560 (+ 17646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.194363 (+ 27803us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.198703 (+  4340us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:37.199630 (+   927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.199717 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.199839 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:37.252223  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:37.199740 10641 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.155392 10723 raft_consensus.cc:2804] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:37.204339 10027 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:02:37.203759 10669 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.207356 10555 consensus_queue.cc:237] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:37.159046  9450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45366 (request call id 94) took 1404 ms. Trace:
I20260709 13:02:37.204277 10670 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:37.257977  9450 rpcz_store.cc:276] 0709 13:02:35.754202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.090549 (+1336347us) service_pool.cc:224] Handling call
0709 13:02:37.152717 (+ 62168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.158629 (+  5912us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.158665 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.158730 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:37.158763 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.158833 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.158963 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:37.149586  9444 rpcz_store.cc:276] 0709 13:02:35.784280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.123195 (+1338915us) service_pool.cc:224] Handling call
0709 13:02:37.123769 (+   574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.124256 (+   487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.124305 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.124401 (+    96us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:37.124459 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.124556 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.124713 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:37.203680  9492 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:37.207142 10718 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.264436  9343 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:02:37.265293 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 67627.8us
I20260709 13:02:37.220986  9449 raft_consensus.cc:2393] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 2: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:37.263943 10326 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.267100 10717 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:37.267537 10717 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.267403 10326 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:37.258520 10669 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:37.270010 10496 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:37.270712 10496 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:37.270834 10326 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:37.271162 10496 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.167534  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46894 (request call id 977) took 1423 ms. Trace:
I20260709 13:02:37.273227  9519 rpcz_store.cc:276] 0709 13:02:35.744606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.745453 (+   847us) service_pool.cc:224] Handling call
0709 13:02:37.167460 (+1422007us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:37.274057  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:37.232738  9341 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:37.233987 10714 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:37.234071 10672 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:37.274814  9526 raft_consensus.cc:2468] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 1.
W20260709 13:02:37.235145  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 65409.3us
I20260709 13:02:37.276044  9341 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:37.276475  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 72962.4us
I20260709 13:02:37.235446 10585 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:37.235745 10724 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:37.236316 10632 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.144704  9520 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:37.236848 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:37.237074 10067 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:37.197296  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:37.239111 10674 consensus_queue.cc:1059] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:37.241940  9418 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:37.253605  9447 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:37.261909  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:37.233915 10427 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.263434 10575 consensus_queue.cc:1059] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:37.268002 10717 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:37.277469  9492 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:37.221873  9451 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:37.258255 10723 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:37.292400 10723 raft_consensus.cc:3060] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.292873 10641 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.291288 10065 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:37.295804 10575 raft_consensus.cc:3055] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:37.296214 10575 raft_consensus.cc:740] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:37.281427  9446 raft_consensus.cc:2393] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:37.281250 10672 raft_consensus.cc:2764] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:02:37.285558 10632 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.283206 10677 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:37.259066 10670 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:37.301499 10585 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:37.314766 10632 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.314821 10670 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:37.277364 10698 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:37.315546 10698 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:37.316022 10698 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.291046  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:37.291815  9451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 1061) took 1572 ms. Trace:
I20260709 13:02:37.290993  9342 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:02:37.317656  9450 raft_consensus.cc:2410] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:37.298307 10027 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
W20260709 13:02:37.288254  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 46483.6us
I20260709 13:02:37.309455  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:37.313319  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:37.313982  9444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1079) took 1219 ms. Trace:
I20260709 13:02:37.322408  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:37.313665 10575 consensus_queue.cc:260] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.323053  9418 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:37.323524  9449 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:37.323925 10575 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:37.324186  9450 raft_consensus.cc:1240] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:37.314049 10696 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.319120  9451 rpcz_store.cc:276] 0709 13:02:35.719854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.015090 (+1295236us) service_pool.cc:224] Handling call
0709 13:02:37.291748 (+276658us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:37.307440 10724 raft_consensus.cc:3055] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:37.327956  9418 leader_election.cc:400] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:37.334141  9418 leader_election.cc:403] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:02:37.320194  9452 raft_consensus.cc:2468] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 2.
W20260709 13:02:37.322415  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.326053  9449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1081) took 1230 ms. Trace:
I20260709 13:02:37.324873  9450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1080) took 1230 ms. Trace:
I20260709 13:02:37.318476 10718 raft_consensus.cc:2804] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:37.335299  9450 rpcz_store.cc:276] 0709 13:02:36.094381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.323522 (+1229141us) service_pool.cc:224] Handling call
0709 13:02:37.323944 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.324643 (+   699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.324814 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:37.322618 10590 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:37.336732  9449 rpcz_store.cc:276] 0709 13:02:36.096129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.324421 (+1228292us) service_pool.cc:224] Handling call
0709 13:02:37.324734 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.324955 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.324989 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.325750 (+   761us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:37.325816 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.325901 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.326001 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:37.333586 10724 raft_consensus.cc:740] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:37.335716 10585 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:37.367341  9452 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:02:37.368186  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 90897.8us
I20260709 13:02:37.322914 10672 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:37.369333 10672 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.363377  9341 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:37.369793 10724 consensus_queue.cc:260] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.370947 10724 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.371234  9341 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:37.371804 10672 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:37.369261  9447 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:37.373778  9341 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:37.377698 10721 raft_consensus.cc:2804] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:37.382057 10721 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:02:37.386116  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 61283us
I20260709 13:02:37.363399 10632 consensus_queue.cc:1059] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:02:37.335908 10674 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:37.392772  9517 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:02:37.336090 10718 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.338071 10590 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:37.391894 10727 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:37.402241 10677 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:37.365676 10641 consensus_queue.cc:1059] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:02:37.402868 10427 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:37.337868  9369 raft_consensus.cc:2468] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 3.
I20260709 13:02:37.393885  9517 pending_rounds.cc:85] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 1
I20260709 13:02:37.340793 10714 raft_consensus.cc:697] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:37.409957  9341 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:37.338933  9445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1065) took 1613 ms. Trace:
I20260709 13:02:37.392014 10721 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:37.414495  9517 pending_rounds.cc:107] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:02:37.322590  9444 rpcz_store.cc:276] 0709 13:02:36.094100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.301465 (+1207365us) service_pool.cc:224] Handling call
0709 13:02:37.313256 (+ 11791us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.313583 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.313611 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.313657 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:37.313691 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.313786 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.313926 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:37.415329  9451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1082) took 1318 ms. Trace:
I20260709 13:02:37.393555 10674 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:37.405467 10718 raft_consensus.cc:3060] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:37.339437 10696 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.409303 10590 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.420477  9517 raft_consensus.cc:2889] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:37.407811 10672 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:37.422020  9451 rpcz_store.cc:276] 0709 13:02:36.096393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.341547 (+1245154us) service_pool.cc:224] Handling call
0709 13:02:37.401468 (+ 59921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.412829 (+ 11361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.412861 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.414982 (+  2121us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:37.415045 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.415120 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.415254 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:37.421284 10427 raft_consensus.cc:697] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:37.424728 10632 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:02:37.446004  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 168835us
I20260709 13:02:37.424587 10674 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:37.423342 10641 raft_consensus.cc:3055] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:37.424304  9443 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:37.458849 10641 raft_consensus.cc:740] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:37.456475 10632 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.462797  9418 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:37.471572 10641 consensus_queue.cc:260] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:37.472843  9448 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 1058) took 1754 ms (client timeout 1694 ms). Trace:
I20260709 13:02:37.473162 10575 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.473713 10575 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:37.476186 10742 log.cc:927] Time spent T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:02:37.476095 10746 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:37.482123 10746 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:37.473515  9448 rpcz_store.cc:269] 0709 13:02:35.718827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.718971 (+   144us) service_pool.cc:224] Handling call
0709 13:02:37.472475 (+1753504us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b54000195d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:37.472661 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1104974592}
I20260709 13:02:37.476037 10575 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.454962 10672 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:37.465749 10632 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:37.451134 10723 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:37.472913 10641 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.485621 10727 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:37.490196 10658 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:37.501608 10027 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:37.503584  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 52303.2us
I20260709 13:02:37.507455 10326 raft_consensus.cc:2804] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:37.507969 10326 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:37.508385 10741 log.cc:927] Time spent T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:02:37.508402 10326 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:37.491961 10714 consensus_queue.cc:237] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.494145  9446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1083) took 1393 ms. Trace:
I20260709 13:02:37.510115  9446 rpcz_store.cc:276] 0709 13:02:36.096648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.373659 (+1277011us) service_pool.cc:224] Handling call
0709 13:02:37.451257 (+ 77598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.464995 (+ 13738us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.469486 (+  4491us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.469565 (+    79us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:37.471120 (+  1555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.485896 (+ 14776us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.489921 (+  4025us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:37.488169 10496 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.515791 10743 raft_consensus.cc:3055] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:37.516213 10743 raft_consensus.cc:740] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:37.516494 10496 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.516947 10696 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.517154 10743 consensus_queue.cc:260] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.517985  9341 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:37.518464 10743 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.519057  9341 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:37.517175 10496 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:02:37.521121 10615 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:37.521718 10496 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:37.521687 10615 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.491974 10669 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.532629  9418 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:37.417800  9445 rpcz_store.cc:276] 0709 13:02:35.724942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.046102 (+1321160us) service_pool.cc:224] Handling call
0709 13:02:37.046567 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.046972 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:37.146501 (+ 99529us) log.cc:844] Serialized 14 byte log entry
0709 13:02:37.309186 (+162685us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.312910 (+  3724us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:37.312967 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.318982 (+  6015us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.329343 (+ 10361us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":107740,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":16286,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":2250,"thread_start_us":215003,"threads_started":2,"wal-append.queue_time_us":176140}
I20260709 13:02:37.533712 10696 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:37.534314 10696 raft_consensus.cc:697] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:37.535228 10696 consensus_queue.cc:237] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.485396 10745 consensus_queue.cc:1059] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:02:37.539331 10745 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:37.540385 10745 raft_consensus.cc:3055] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:02:37.543980  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 43676.1us
I20260709 13:02:37.498302 10724 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:02:37.512961 10677 raft_consensus.cc:697] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:37.548286 10727 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:37.552974 10727 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.555634 10727 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.556095 10674 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:37.558627 10674 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:37.559842 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:37.567765  9369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:02:37.568485  9369 raft_consensus.cc:606] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:02:37.542922 10496 raft_consensus.cc:697] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:37.569818 10496 consensus_queue.cc:237] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.497571 10427 consensus_queue.cc:237] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.572808 10632 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.513425 10658 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.540932 10745 raft_consensus.cc:740] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:37.583031 10615 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:37.582545 10677 consensus_queue.cc:237] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.588058  9369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:02:37.588804 10658 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:37.589594 10727 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.590058 10632 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.523232 10670 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:02:37.598212  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 48215.2us
W20260709 13:02:37.603826  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.621210  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 102242us
I20260709 13:02:37.612648 10746 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.620587 10669 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:37.657634  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 91417.6us
I20260709 13:02:37.614624 10727 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.626168 10658 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:02:37.663975  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 205796us
I20260709 13:02:37.657178 10615 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:37.667106 10615 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.668576 10065 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:37.669138 10583 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:37.669544  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:37.669729 10583 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.671918 10583 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:37.671718 10590 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.663998 10723 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:37.685684  9418 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:37.686594  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:37.687019  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:37.687383  9445 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:37.689419  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:37.690105  9451 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:37.691412 10670 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:37.692402  9342 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:02:37.693020 10672 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:37.693446  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:37.693917 10615 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:37.694140  9443 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:37.695155  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:37.696487  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:37.697142  9448 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:37.698169  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:37.698830  9446 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:37.698499 10326 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:37.700634 10751 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.650520 10745 consensus_queue.cc:260] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.661903 10698 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.701189 10751 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.705677 10025 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:37.706403 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:37.706499 10723 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:37.707211 10751 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.707468 10727 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.708273  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:37.709108  9444 raft_consensus.cc:2393] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:37.704413 10299 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:37.709736 10299 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.710306  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:37.711792 10299 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.682377 10658 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.713583  9449 raft_consensus.cc:1240] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:37.714263 10698 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.718735  9446 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:37.722646 10696 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:37.700662 10326 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:37.728755 10696 raft_consensus.cc:697] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:37.729439  9492 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:37.729812 10696 consensus_queue.cc:237] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.730340 10583 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:37.724280 10641 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:37.731139 10641 raft_consensus.cc:697] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:37.731981  9492 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:37.732076 10641 consensus_queue.cc:237] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:37.724121  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:37.682533 10718 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:37.733227 10746 consensus_queue.cc:1059] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:37.723664  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:37.734395  9343 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:37.734953 10583 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:37.735956 10590 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:37.736397 10615 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.714283 10658 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:37.737174  9492 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:37.715202 10670 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:37.739113  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:37.748281  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:37.752450  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:37.753335  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:37.753662 10672 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.769627  9492 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:37.769500 10672 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.770594 10590 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:37.686131 10717 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:37.771924 10672 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:37.772190  9492 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:37.773562  9451 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:37.776644 10067 raft_consensus.cc:2368] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4.
I20260709 13:02:37.736737 10721 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:02:37.757936  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 81301.4us
I20260709 13:02:37.779779 10727 consensus_queue.cc:1059] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:37.781088 10727 raft_consensus.cc:3055] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:37.781200  9369 raft_consensus.cc:606] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:02:37.781519 10727 raft_consensus.cc:740] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:37.781736  9369 raft_consensus.cc:614] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:37.730581  9448 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:37.759337  9341 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:37.761163  9449 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:37.762657 10615 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.763595 10670 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:37.787240  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 53151.1us
I20260709 13:02:37.764508 10658 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:37.788121 10670 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.764353 10718 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.765810  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:37.765858 10746 raft_consensus.cc:3055] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:37.789552 10746 raft_consensus.cc:740] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:37.790514 10746 consensus_queue.cc:260] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.791800 10746 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.768833 10065 raft_consensus.cc:1240] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:37.765998  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:37.788810 10670 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:37.793295  9517 raft_consensus.cc:3060] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:02:37.773864 10717 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:37.774492  9375 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:37.762233  9447 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:37.769522  9444 raft_consensus.cc:2393] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:37.776631  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:37.785130  9341 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:37.801599  9341 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:37.756152 10745 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.786130  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:37.802865  9449 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:37.788235 10615 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:37.789577  9450 raft_consensus.cc:3060] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:37.773675 10672 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:37.796099  9343 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:37.712870  9445 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:37.796169  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:37.782526 10727 consensus_queue.cc:260] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.765306  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:37.800208  9342 leader_election.cc:400] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Vote denied by peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623) with higher term. Message: Invalid argument: T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4.
I20260709 13:02:37.787277 10759 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:37.803375  9374 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:37.813110  9342 leader_election.cc:403] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:02:37.813113  9446 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.808326  9341 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:37.815418 10670 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:37.815943 10670 raft_consensus.cc:697] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:37.816874 10670 consensus_queue.cc:237] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.818327  9341 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:37.819178  9517 raft_consensus.cc:2468] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 3.
I20260709 13:02:37.805172 10575 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:37.831189 10027 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:02:37.856982  9274 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43244 (request call id 182) took 7528 ms. Trace:
I20260709 13:02:37.838078  9369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:02:37.857674  9369 raft_consensus.cc:606] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:02:37.858814 10717 raft_consensus.cc:2804] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:37.859552 10717 raft_consensus.cc:697] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 3 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:02:37.859957  9526 raft_consensus.cc:1240] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:37.860513 10717 consensus_queue.cc:237] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:37.829950 10641 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:37.838660  9375 raft_consensus.cc:2468] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 4.
I20260709 13:02:37.838814 10727 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.819408 10724 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:37.819597 10496 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:02:37.871407  9372 raft_consensus.cc:1240] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 3. Current term is 4. Ops: []
W20260709 13:02:37.841810  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 52905.4us
I20260709 13:02:37.842947  9450 raft_consensus.cc:2468] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 3.
I20260709 13:02:37.843323  9517 raft_consensus.cc:1240] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:37.810521 10555 consensus_queue.cc:1059] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:02:37.809907 10677 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:37.849598  9376 raft_consensus.cc:1240] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:37.846781  9374 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 4.
I20260709 13:02:37.832361 10721 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:37.851406 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:37.852854  9371 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:37.853266  9377 raft_consensus.cc:1240] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:37.853638  9492 leader_election.cc:400] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:37.855274  9520 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:37.856592  9447 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:37.819519  9341 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:37.864568  9369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:02:37.813570 10759 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.866272  9446 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:37.866861 10027 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:37.869113  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:37.866741 10724 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:37.872786  9343 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:37.897291  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 77843.9us
I20260709 13:02:37.897832  9492 leader_election.cc:403] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:02:37.900614  9375 raft_consensus.cc:2368] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:37.901862  9341 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:37.879961  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:37.862471 10575 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.904994  9369 raft_consensus.cc:606] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:02:37.905300 10670 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:37.905520  9369 raft_consensus.cc:614] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:37.905920  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.905946 10670 raft_consensus.cc:697] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:37.900785 10718 raft_consensus.cc:2804] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:37.906836  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:37.906948 10718 raft_consensus.cc:697] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 4 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:02:37.907476  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:37.907719  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:37.908010 10718 consensus_queue.cc:237] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:37.908605  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:37.908703  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:37.900780 10724 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:37.909524  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:37.909780  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:37.906988 10670 consensus_queue.cc:237] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.905448 10575 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:37.911121  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:37.912338  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:37.905300 10496 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:37.913022  9369 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:37.913753 10496 raft_consensus.cc:697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:37.914831 10496 consensus_queue.cc:237] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.916710  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:37.901258 10746 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:37.917369 10746 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.909812  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:37.917435  9519 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:37.918555  9372 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:37.917840 10746 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:37.877333 10696 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:37.899675 10750 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623) with higher term. Message: Invalid argument: T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4.
I20260709 13:02:37.904548  9343 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:37.857357  9274 rpcz_store.cc:276] 0709 13:02:30.328942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.337331 (+  8389us) service_pool.cc:224] Handling call
0709 13:02:37.856908 (+7519577us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:37.262960 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:37.263735 (+   775us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:37.263785 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:02:37.263819 (+    34us) tablet.cc:662] Decoding operations
0709 13:02:37.267509 (+  3690us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:37.267606 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:37.267634 (+    28us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:02:37.268245 (+   611us) tablet.cc:701] Row locks acquired
0709 13:02:37.268392 (+   147us) write_op.cc:260] PREPARE: finished
0709 13:02:37.269513 (+  1121us) write_op.cc:270] Start()
0709 13:02:37.290793 (+ 21280us) write_op.cc:276] Timestamp: P: 1783602157269278 usec, L: 0
0709 13:02:37.295713 (+  4920us) op_driver.cc:348] REPLICATION: starting
0709 13:02:37.336414 (+ 40701us) log.cc:844] Serialized 1669 byte log entry
0709 13:02:37.701119 (+364705us) op_driver.cc:464] REPLICATION: finished
0709 13:02:37.725999 (+ 24880us) write_op.cc:301] APPLY: starting
0709 13:02:37.726092 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:37.726232 (+   140us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:37.739314 (+ 13082us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:37.786758 (+ 47444us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:37.810615 (+ 23857us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:02:37.820848 (+ 10233us) write_op.cc:312] APPLY: finished
0709 13:02:37.832855 (+ 12007us) log.cc:844] Serialized 40 byte log entry
0709 13:02:37.833072 (+   217us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:37.833171 (+    99us) write_op.cc:454] Released schema lock
0709 13:02:37.833313 (+   142us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:37.833693 (+   380us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:37.833718 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":23055,"apply.run_cpu_time_us":3634,"apply.run_wall_time_us":107673,"num_ops":4,"prepare.queue_time_us":176541,"prepare.run_cpu_time_us":19278,"prepare.run_wall_time_us":227850,"raft.queue_time_us":70204,"raft.run_cpu_time_us":4581,"raft.run_wall_time_us":24914,"replication_time_us":404958,"thread_start_us":162812,"threads_started":4,"wal-append.queue_time_us":135873}]]}
W20260709 13:02:37.919866  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 66340.2us
I20260709 13:02:37.919934  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:37.897729 10677 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.921213  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:37.921804  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:37.873256 10555 raft_consensus.cc:3055] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:37.923609  9524 raft_consensus.cc:2393] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 3: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:37.901201 10759 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:37.926805 10641 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:37.923981 10672 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:37.927405  9343 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:37.927589  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:37.928179 10714 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:37.933918  9375 raft_consensus.cc:1240] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:37.929929  9341 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:37.936571  9372 raft_consensus.cc:2393] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 2: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:37.937304  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:37.937808  9492 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:37.945335  9341 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:37.936038  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:37.946252 10672 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:37.931105 10555 raft_consensus.cc:740] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:37.950718  9275 catalog_manager.cc:5697] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 1 to 2, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 2 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:37.925266 10677 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:37.953202  9372 raft_consensus.cc:1240] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:37.941919  9526 raft_consensus.cc:2368] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:37.942322 10750 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:37.945371  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:37.953649  9369 raft_consensus.cc:1240] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:37.955344 10027 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:37.972626  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:37.941218  9343 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:37.945104 10696 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:37.933290  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:37.965911  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.972656  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:37.973973  9517 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
W20260709 13:02:37.960276  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.977205  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:37.977761  9374 raft_consensus.cc:1240] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:37.978662  9275 catalog_manager.cc:5697] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 1 to 3, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 3 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:37.979108 10693 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:37.986515  9447 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:37.989717  9341 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:37.994655  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 53519us
W20260709 13:02:37.998070  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.970737 10714 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:37.999346  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:37.993958  9520 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:37.981096 10721 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:38.013865  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:38.014549  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:38.014724 10696 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:37.954331 10555 consensus_queue.cc:260] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:38.016324  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:38.064549  9525 raft_consensus.cc:2393] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 4: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:38.017148  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:38.017851  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:38.018509  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:38.024864  9275 catalog_manager.cc:5697] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:38.027366  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:38.031839 10575 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:38.033099  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:38.070430  9524 raft_consensus.cc:2410] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:38.033649 10427 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:38.037309 10749 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:38.002043 10750 raft_consensus.cc:697] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:38.001978 10590 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.004473 10693 raft_consensus.cc:697] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 4 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:02:37.995369 10745 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:38.061230  9521 raft_consensus.cc:2393] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 4: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
W20260709 13:02:38.062287  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.055558 10714 raft_consensus.cc:697] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:38.074553  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:38.075913  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:38.090037  9520 raft_consensus.cc:2410] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:38.086947  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:38.024899 10746 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:38.072468  9369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:02:38.068841 10721 raft_consensus.cc:697] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:38.117296  9375 raft_consensus.cc:1240] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:38.071672  9518 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:38.087620 10555 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:38.145527  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:38.146572  9520 raft_consensus.cc:2393] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 4: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:38.074635 10749 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:38.065052 10724 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:38.142805  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:38.076354  9519 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:38.149344  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:38.152971  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:38.153591  9526 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:38.149538  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:38.150841  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:38.144847  9369 raft_consensus.cc:606] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:02:38.156893 10575 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:38.157284 10721 consensus_queue.cc:237] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:38.159323 10724 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:38.160207  9377 raft_consensus.cc:2393] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 4: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:38.161367  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:38.162554  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:38.163554  9517 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:38.163966  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:38.164480  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:38.164916  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:02:38.114104 10590 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:38.165251  9517 raft_consensus.cc:2393] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:38.166311  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:38.167214 10590 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:38.167671  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:38.169396  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:38.168433  9524 raft_consensus.cc:1240] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:38.171413  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:38.168385 10065 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:38.177350  9376 raft_consensus.cc:2393] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 5: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:38.161373  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:38.178333  9526 raft_consensus.cc:2393] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 2: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:38.188351  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:38.189147  9520 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:38.190649  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:38.191303  9525 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:38.192509  9375 raft_consensus.cc:2393] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 3: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
W20260709 13:02:38.176170 10760 log.cc:927] Time spent T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:02:38.153198 10749 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.176380  9275 catalog_manager.cc:5697] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:38.207268  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:38.194146  9342 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:38.210316  9375 raft_consensus.cc:2393] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 2: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
W20260709 13:02:38.216311  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.210018 10674 raft_consensus.cc:2804] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:38.112382 10750 consensus_queue.cc:237] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:38.267433  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:38.268229  9375 raft_consensus.cc:2393] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 4: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:38.266111  9275 catalog_manager.cc:5697] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 1 to 2, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 2 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:38.271756  9450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51006
I20260709 13:02:38.272518  9450 raft_consensus.cc:606] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Received request to transfer leadership
I20260709 13:02:38.272902  9450 raft_consensus.cc:614] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:38.280961  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:38.268029 10674 raft_consensus.cc:697] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:38.287415  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:38.282995  9275 catalog_manager.cc:5697] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 1 to 2, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 2 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:38.296577  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:38.267653 10693 consensus_queue.cc:237] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:38.287329  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:02:38.301556 10769 log.cc:927] Time spent T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
W20260709 13:02:38.307163  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.302872 10674 consensus_queue.cc:237] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:38.304157  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:38.304565  9447 raft_consensus.cc:1275] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:38.314074  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:38.316781  9377 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.264973 10714 consensus_queue.cc:237] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:38.333418  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:38.333684  9446 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:38.334362  9444 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:38.338986  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:38.342028  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:38.342593  9518 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:38.334228 10783 consensus_queue.cc:1048] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:02:38.317595 10746 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:38.329936 10718 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.349177 10718 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:38.349999  9444 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:38.351475 10718 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:38.351310 10677 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:38.295884 10759 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:38.336033  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:38.354652  9374 raft_consensus.cc:1240] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:38.362848  9377 raft_consensus.cc:1275] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:38.366953 10745 raft_consensus.cc:697] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:38.367841 10745 consensus_queue.cc:237] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:38.370174  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:02:38.364684 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 46122.6us
W20260709 13:02:38.333714 10772 log.cc:927] Time spent T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:02:38.387676  9373 raft_consensus.cc:2368] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5.
I20260709 13:02:38.389580  9451 raft_consensus.cc:1217] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:02:38.390130  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:38.391057  9444 raft_consensus.cc:1240] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:38.391319  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:38.391461  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:38.392139  9450 raft_consensus.cc:2393] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 3: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:38.390151  9451 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:02:38.392349  9341 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:38.392727  9369 raft_consensus.cc:1240] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:38.393385  9449 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 5. Ops: [3.2-3.2]
I20260709 13:02:38.392153  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:38.395103 10632 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:38.398667  9451 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:38.399113  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:38.399575  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:38.400122  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:38.400569  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:38.400799  9446 raft_consensus.cc:2393] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 3: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:38.401624  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:38.401854  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:38.401628  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:38.402655  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:38.403339  9451 raft_consensus.cc:2393] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 2: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:38.403537  9518 raft_consensus.cc:1275] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:38.403713  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:38.404107  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:38.404122  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:38.404970  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.404934  9521 raft_consensus.cc:2468] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 4.
I20260709 13:02:38.401961  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:38.406102  9452 raft_consensus.cc:2393] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 4: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:38.407653 10027 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:02:38.398563  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:38.409873  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:38.410033  9447 raft_consensus.cc:2368] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:38.411280  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:38.415839  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.417657 10717 raft_consensus.cc:2804] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:38.418133 10717 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.418463 10717 raft_consensus.cc:3060] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:38.417686  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:38.422263  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:38.423732  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:38.424612  9451 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:38.427359  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:38.428359  9447 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:38.402601  9444 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:38.419888 10724 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:38.434165  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:38.429344 10590 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:38.420219 10677 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:38.446437  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:38.446306  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:38.451202  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:38.412405 10718 consensus_queue.cc:1048] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:02:38.445575  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:38.490756 10759 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:38.491415  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:38.492208  9443 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:38.448553 10590 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:38.448027 10724 raft_consensus.cc:697] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:38.479923  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:38.480634  9444 raft_consensus.cc:1240] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:38.498986  9447 raft_consensus.cc:1240] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 4. Ops: []
W20260709 13:02:38.482652  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.501696 10724 consensus_queue.cc:237] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:38.494441 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 86862.7us
I20260709 13:02:38.441649  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:38.512001  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
W20260709 13:02:38.585440  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.567960  9451 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:38.562887  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:38.594652  9341 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:38.597548  9447 raft_consensus.cc:1275] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:38.597573  9446 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:38.598609  9449 raft_consensus.cc:1240] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:38.604684 10674 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:38.590762 10658 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:38.768450  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:38.822968  9373 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:38.605216 10555 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:38.823249 10658 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:38.718618  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:38.616703 10674 raft_consensus.cc:697] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:38.825165 10555 raft_consensus.cc:697] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:38.826541 10658 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:38.495675 10749 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:38.605895  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:38.825479 10674 consensus_queue.cc:237] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:38.825891 10774 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:38.673071  9443 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
W20260709 13:02:38.828454  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 65992.3us
W20260709 13:02:38.713248  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 201309us
W20260709 13:02:38.654350  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.802178  9447 raft_consensus.cc:1275] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:02:38.716434 10789 log.cc:927] Time spent T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.128s	user 0.007s	sys 0.006s
I20260709 13:02:38.605499  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:02:38.676175  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 59598.9us
I20260709 13:02:38.714592  9452 raft_consensus.cc:1275] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:02:38.821956  9377 raft_consensus.cc:1275] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:38.634030  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:38.837930  9374 raft_consensus.cc:2393] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 2: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:38.837988  9376 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:38.841084  9373 raft_consensus.cc:1240] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:38.772820 10746 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:38.843024  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.848038 10746 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:38.845134  9449 raft_consensus.cc:1275] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:38.843421  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:38.850056  9341 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:38.858220  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:38.858772  9372 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
W20260709 13:02:38.860390  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.633806 10590 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:38.834690 10778 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.826820 10555 consensus_queue.cc:237] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:38.865437  9418 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:38.867070  9452 raft_consensus.cc:1275] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:02:38.869177  9452 pending_rounds.cc:85] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 5
I20260709 13:02:38.869514  9452 pending_rounds.cc:107] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:02:38.722601 10717 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:38.869876  9452 raft_consensus.cc:2889] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:38.679136 10759 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.173s
W20260709 13:02:38.872072  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.879492  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:38.880326  9377 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
W20260709 13:02:38.874241  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 178586us
I20260709 13:02:38.867478  9369 raft_consensus.cc:2393] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 3: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:38.884181  9375 raft_consensus.cc:1240] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:38.887161  9519 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:38.887387  9521 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:38.840095 10774 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:38.875459 10750 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:38.888944  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:38.896292  9521 raft_consensus.cc:2393] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 4: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:38.895648  9523 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:38.897286  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:38.897960  9520 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:38.879092 10776 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:38.897210 10800 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:38.899016  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:38.899291  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:38.895272  9522 raft_consensus.cc:3055] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:38.911082  9523 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:38.875743 10575 consensus_queue.cc:1048] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:02:38.889361 10496 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.877725 10743 consensus_queue.cc:1048] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:02:38.912505  9522 raft_consensus.cc:740] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:38.913717 10776 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.894274 10590 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:38.874234 10778 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:38.912283 10747 log.cc:927] Time spent T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:02:38.922536 10590 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:38.919862  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:38.927064  9518 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:38.911065 10750 raft_consensus.cc:697] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:38.948046  9418 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:38.949067  9524 raft_consensus.cc:1275] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:38.898286 10658 consensus_queue.cc:1059] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:02:38.912142  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:38.961544  9520 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:38.932381  9522 consensus_queue.cc:260] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:38.964771  9522 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:38.950714 10784 log.cc:927] Time spent T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.348s	user 0.000s	sys 0.009s
I20260709 13:02:38.971395  9524 raft_consensus.cc:1275] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:02:38.973582 10801 log.cc:927] Time spent T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:02:38.974516 10718 consensus_queue.cc:1048] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:02:38.968230  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 68453.7us
W20260709 13:02:38.986683  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 66436.9us
I20260709 13:02:38.923785 10496 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:38.999862  9368 raft_consensus.cc:1240] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:38.928021 10776 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.009552  9492 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:38.983256 10798 consensus_queue.cc:1059] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:02:39.009662  9518 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:02:39.030754  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.031721  9523 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:39.017298 10746 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:39.037514  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:39.038350  9523 raft_consensus.cc:3060] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:39.032152 10774 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:39.006618 10808 consensus_queue.cc:1059] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:02:39.044238 10812 consensus_queue.cc:1059] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:39.034628 10805 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:39.045272 10805 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:39.045490  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.045681 10805 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:39.047811 10065 raft_consensus.cc:1275] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:02:39.049934 10632 consensus_queue.cc:1048] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:39.050829  9523 raft_consensus.cc:2468] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 5.
I20260709 13:02:39.052192 10027 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:02:39.033089 10750 consensus_queue.cc:237] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.053234 10718 raft_consensus.cc:2804] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:39.044391 10808 raft_consensus.cc:3055] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:02:39.071363  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 56318.6us
I20260709 13:02:39.038084 10717 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:39.075326  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 173581us
I20260709 13:02:39.038419 10806 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:39.076030  9522 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.075547  9492 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:39.074038 10658 consensus_queue.cc:1243] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:02:39.117800  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:39.130069  9452 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:39.132370  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:39.133046  9443 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:39.076529 10677 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.073180 10808 raft_consensus.cc:740] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:39.076262 10718 raft_consensus.cc:697] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 5 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:02:39.143477  9369 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:39.143177 10808 consensus_queue.cc:260] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.145545  9452 raft_consensus.cc:3055] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:39.146083  9452 raft_consensus.cc:740] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:39.147080  9452 consensus_queue.cc:260] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.148293  9452 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.153950  9448 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:39.155627  9445 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:39.158910  9343 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:39.137815 10798 raft_consensus.cc:3055] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:39.184832  9343 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:39.137584 10778 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:39.140637 10590 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:39.133971 10677 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.157456 10808 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:39.194043  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.154052 10788 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:02:39.198787  9343 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:39.167918 10670 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:39.204566 10804 log.cc:927] Time spent T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:02:39.204339 10714 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:39.205230 10746 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:39.205487 10802 log.cc:927] Time spent T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:02:39.206332 10816 consensus_queue.cc:1059] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:02:39.206801 10067 raft_consensus.cc:1240] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:39.211443 10759 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.215797  9370 raft_consensus.cc:1240] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:39.192747 10724 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:39.217314 10776 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:39.218246 10817 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:39.219065 10677 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:39.219481 10718 consensus_queue.cc:237] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:39.185856 10798 raft_consensus.cc:740] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:39.220806 10496 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:39.263209  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.253429  9343 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:39.246735  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 168194us
I20260709 13:02:39.291646  9418 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:39.266013  9452 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.293735  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:39.228453  9448 raft_consensus.cc:3055] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:39.224759 10721 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:39.275820  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 200467us
I20260709 13:02:39.297585  9492 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:39.295275  9448 raft_consensus.cc:740] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:39.298591 10590 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:39.299057 10590 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.299500 10590 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:39.299202  9448 consensus_queue.cc:260] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.300384  9448 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:39.269366 10812 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:39.311264  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 115347us
I20260709 13:02:39.294553  9452 raft_consensus.cc:3060] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:02:39.301376 10788 consensus_queue.cc:1048] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
W20260709 13:02:39.361581  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 108229us
I20260709 13:02:39.335988 10806 raft_consensus.cc:697] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:39.302034 10778 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:39.375289 10811 log.cc:927] Time spent T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:02:39.354125 10813 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.225955 10670 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.284471 10817 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:02:39.353051  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 50016.3us
I20260709 13:02:39.384038  9449 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:39.398473  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.396991  9448 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:39.386178  9526 raft_consensus.cc:3055] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:02:39.365398  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:39.415527  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:39.373591 10796 log.cc:927] Time spent T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.543s	user 0.000s	sys 0.005s
I20260709 13:02:39.223694 10555 consensus_queue.cc:1059] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.130s
I20260709 13:02:39.490687  9526 raft_consensus.cc:740] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:39.354696 10677 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:39.301618 10759 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.406577 10326 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.357800 10674 consensus_queue.cc:1059] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
W20260709 13:02:39.460094  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:39.504873  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.283350  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:39.473228  9452 raft_consensus.cc:2468] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 5.
I20260709 13:02:39.480428  9343 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:39.509970  9343 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:39.500841  9526 consensus_queue.cc:260] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.483608 10778 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.486758 10824 raft_consensus.cc:3055] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:39.486542 10813 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.486857 10823 raft_consensus.cc:2764] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:02:39.502101  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 149449us
I20260709 13:02:39.519013  9418 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:39.472770 10805 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.493706 10817 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.530030  9526 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:39.484432 10496 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:02:39.484305 10714 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:02:39.484086 10721 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:02:39.465281 10812 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:39.512665 10824 raft_consensus.cc:740] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:39.534220 10745 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:39.520138  9445 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:39.506857 10326 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:39.574193 10830 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:39.574625 10658 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.574517 10590 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.575199 10830 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.562076 10677 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:02:39.575390 10658 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.552042 10698 consensus_queue.cc:1048] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:02:39.575700 10830 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.482161 10798 consensus_queue.cc:260] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.588903  9492 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:39.587096  9450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1137) took 1157 ms. Trace:
I20260709 13:02:39.552865 10724 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:02:39.589900  9450 rpcz_store.cc:276] 0709 13:02:38.424439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.431756 (+  7317us) service_pool.cc:224] Handling call
0709 13:02:38.432017 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:38.443386 (+ 11369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:38.443419 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:38.447638 (+  4219us) log.cc:844] Serialized 26 byte log entry
0709 13:02:38.593920 (+146282us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:38.593980 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.594071 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:39.269883 (+675812us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:02:39.571366 (+301483us) raft_consensus.cc:1685] finished
0709 13:02:39.571399 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:39.581748 (+ 10349us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5190,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":4172,"spinlock_wait_cycles":5566720,"thread_start_us":88363,"threads_started":1,"wal-append.queue_time_us":274963}
I20260709 13:02:39.579320 10816 raft_consensus.cc:3055] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:39.551839 10632 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:02:39.600955  9449 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:02:39.604755  9490 leader_election.cc:336] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.735s (SENT)
I20260709 13:02:39.605441  9490 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:39.597718 10816 raft_consensus.cc:740] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:39.624503  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:39.651983 10824 consensus_queue.cc:260] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.609057 10798 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:39.623255 10833 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.651298 10809 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:39.589541 10746 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
W20260709 13:02:39.658393  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.568089 10806 consensus_queue.cc:237] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.659010  9377 raft_consensus.cc:1240] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:02:39.667186  9526 raft_consensus.cc:1275] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:02:39.667657  9526 pending_rounds.cc:85] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 1
I20260709 13:02:39.667881  9526 pending_rounds.cc:107] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:02:39.668100  9526 raft_consensus.cc:2889] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:39.660538  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 55823.5us
I20260709 13:02:39.661242  9375 raft_consensus.cc:2393] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 2: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
W20260709 13:02:39.661906 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 91603.9us
W20260709 13:02:39.668804  9490 leader_election.cc:336] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.745s (SENT)
I20260709 13:02:39.669349  9490 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:39.661391  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 68850.8us
I20260709 13:02:39.672478 10812 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:39.672668  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:39.689900 10832 log.cc:927] Time spent T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:02:39.693936 10816 consensus_queue.cc:260] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.695829 10828 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:39.697151 10835 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 13:02:39.698318 10807 log.cc:927] Time spent T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.729s	user 0.003s	sys 0.000s
I20260709 13:02:39.698829 10838 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:39.699539 10822 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.700094 10822 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.702530 10822 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:39.702692 10830 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:39.703164 10822 consensus_queue.cc:1059] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:39.703716 10590 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:39.704232 10822 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.704439 10590 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:39.705786 10817 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.706977 10590 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:39.707726 10590 raft_consensus.cc:3055] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:39.708194 10590 raft_consensus.cc:740] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:39.710733 10590 consensus_queue.cc:260] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.670540 10833 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.714733 10658 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:39.714920 10590 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.713696 10805 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:39.713788 10778 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:39.708236 10817 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:39.718004 10844 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:39.765064  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:39.765730  9377 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:39.763688  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 94894us
I20260709 13:02:39.765893  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:39.766547  9371 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
W20260709 13:02:39.769894  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 250938us
I20260709 13:02:39.770691  9418 leader_election.cc:400] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:39.770891  9447 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:39.716729 10833 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:39.772254  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:39.773514  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:39.774150  9520 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:39.774675  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:39.775447  9522 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:39.777143  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:39.777530  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.777917  9522 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:39.779031  9521 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:39.758213 10774 raft_consensus.cc:3055] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:39.771011  9418 leader_election.cc:403] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:02:39.780896  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:39.781265  9492 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:39.783313  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:39.784055  9373 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:39.783176  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:39.773334 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:39.792829 10808 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:39.779533 10817 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.773927 10830 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.775008 10823 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:39.793476  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:39.795742  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.796650  9526 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:39.779917 10658 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:39.806855  9418 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:39.781786 10774 raft_consensus.cc:740] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:39.704824 10822 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.814859 10841 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:39.815428 10841 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:39.817410  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:39.799203 10824 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.798424 10808 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.794749  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:39.830466  9377 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:02:39.776054 10828 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:39.832191  9492 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:39.816625  9418 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:39.836177 10853 raft_consensus.cc:2764] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:02:39.837579  9418 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:39.838665 10853 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:39.839056 10853 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:39.839573 10853 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:39.808099 10812 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:39.798403 10813 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:39.839001  9418 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:39.807839 10326 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:39.846604  9525 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:39.815869 10841 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.829877 10806 raft_consensus.cc:2804] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:39.770471 10844 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.843152  9418 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:39.856768 10774 consensus_queue.cc:260] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.857869 10774 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:39.840777 10808 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:39.850069 10812 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:39.860939 10812 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:39.861400 10812 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:39.862257 10846 log.cc:927] Time spent T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:02:39.867252  9343 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:39.867434 10844 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:39.868312  9343 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:39.808280 10830 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.805867 10817 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:39.869932  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.861107 10849 consensus_queue.cc:1059] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.094s
I20260709 13:02:39.821772 10658 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:39.870842 10849 consensus_queue.cc:1243] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:02:39.871358 10849 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:39.815784 10823 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.874091 10751 consensus_queue.cc:1048] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:39.872110 10778 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.871767 10849 raft_consensus.cc:697] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:02:39.883606  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:39.895032  9490 leader_election.cc:336] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.920s (SENT)
I20260709 13:02:39.882990  9343 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:02:39.895282  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 52140.9us
I20260709 13:02:39.895723  9373 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:02:39.896178  9490 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:39.856061 10806 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:39.888309 10724 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:39.903173 10724 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.903302 10836 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:39.903759 10724 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:39.897785 10778 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.904438  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:39.905126  9526 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:39.899662  9343 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:39.902002 10847 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:39.902554 10677 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:39.907825  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:39.903856 10836 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.910338 10836 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:39.910291  9492 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:39.906159  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:39.906471 10849 consensus_queue.cc:237] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.909878 10826 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:39.919664 10860 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:39.919806 10826 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.912712  9526 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:39.920343 10826 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:39.920991  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:39.898470  9371 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:39.912341 10677 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.908222 10847 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.915719 10658 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:02:39.916241  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.917040 10778 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:39.923141  9492 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:02:39.920276 10800 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:02:39.920291 10860 raft_consensus.cc:697] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:39.939510 10860 consensus_queue.cc:237] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:39.918407 10751 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:02:39.927589  9343 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:39.905310 10806 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.950337  9343 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:39.953816 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:39.954715 10721 raft_consensus.cc:993] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:02:39.955183 10721 raft_consensus.cc:1081] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:02:39.922120 10805 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:39.935707  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:39.931267 10677 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:39.948741 10800 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.931529 10847 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:39.956435 10632 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:39.981534  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:39.956513 10658 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:39.981879  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:40.069643  9490 leader_election.cc:336] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 2.116s (SENT)
I20260709 13:02:40.078161  9490 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:40.070161 10632 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.089582 10632 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:40.091150 10805 raft_consensus.cc:2749] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:40.093554 10808 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:40.097136  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.976970 10818 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:40.081534  9526 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:40.075441 10823 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:39.985261 10822 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:40.103646  9491 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
W20260709 13:02:40.110522  9490 leader_election.cc:336] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 2.119s (SENT)
I20260709 13:02:40.111238  9490 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:40.077991 10816 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:40.116425  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.118930  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:40.119560  9524 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:40.058542 10836 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.038425 10724 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.105499 10658 raft_consensus.cc:697] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:40.112914 10818 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:40.128765  9490 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 2.121s (SENT) [suppressed 22 similar messages]
I20260709 13:02:39.983603 10841 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.038504 10826 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.061034 10853 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:40.137913  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.126789 10822 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:40.011433 10800 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.144887  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:40.146000  9377 raft_consensus.cc:2393] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 5: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:40.109328 10806 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.136588 10818 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:40.144819 10776 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:40.146299 10849 raft_consensus.cc:2749] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:40.189438  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:40.134790 10632 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.172494 10833 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.194993  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:40.147256 10812 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.207307  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:40.208194 10808 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:40.210283  9524 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:40.200170 10776 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.212402  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:40.215095  9524 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:40.221313  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.221767  9450 raft_consensus.cc:1240] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:40.222776  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.223043  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.223865  9446 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:40.217257  9369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50568 (request call id 104) took 1004 ms. Trace:
I20260709 13:02:40.231460 10632 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:40.211326 10677 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.193194 10860 consensus_queue.cc:1059] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:02:40.233901 10677 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:40.238546 10632 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:02:40.239243 10864 log.cc:927] Time spent T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:02:40.240761 10841 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:40.243533 10853 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:40.219178 10658 consensus_queue.cc:237] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.226791 10808 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:40.254345  9520 raft_consensus.cc:1240] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:40.210078 10833 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:40.256970  9520 raft_consensus.cc:1240] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:40.258459  9418 leader_election.cc:400] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3.
I20260709 13:02:40.260319  9368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 785) took 1499 ms. Trace:
I20260709 13:02:40.260603  9520 raft_consensus.cc:1240] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:40.260452  9449 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:40.264570  9449 raft_consensus.cc:1275] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:02:40.255239 10862 log.cc:927] Time spent T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.212s	user 0.002s	sys 0.000s
I20260709 13:02:40.267725  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.281374  9448 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:40.269150  9418 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:40.273672  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.261053  9368 rpcz_store.cc:276] 0709 13:02:38.761394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.761565 (+   171us) service_pool.cc:224] Handling call
0709 13:02:38.762020 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:39.000372 (+238352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.259983 (+1259611us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b5400379bd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:40.260239 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":546432384}
I20260709 13:02:40.257026 10776 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:40.278667 10749 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:40.279271  9447 raft_consensus.cc:1275] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:02:40.295617  9418 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:40.296562 10677 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:40.231027  9369 rpcz_store.cc:276] 0709 13:02:39.209935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.212127 (+  2192us) service_pool.cc:224] Handling call
0709 13:02:39.212532 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:39.212907 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:39.212941 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:39.921265 (+708324us) spinlock_profiling.cc:243] Waited 9.24 ms on lock 0x7b2c0001afe8. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb584e63a11 00007fb584e73372 00007fb5865a5a01 00007fb58656a43a 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2
0709 13:02:39.921734 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:02:40.108637 (+186903us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:40.109655 (+  1018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.124464 (+ 14809us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:40.214128 (+ 89664us) raft_consensus.cc:1685] finished
0709 13:02:40.214168 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:40.214407 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1144,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":136,"spinlock_wait_cycles":21247744,"thread_start_us":174637,"threads_started":1,"wal-append.queue_time_us":211930}
I20260709 13:02:40.305763 10590 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.306334 10590 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.306962 10833 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:40.308470 10590 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:40.309929 10800 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:40.314888 10749 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:40.316773 10759 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:40.293952 10841 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:02:40.295763 10826 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:40.324474 10806 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:40.315372 10776 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:40.325695 10812 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:40.288756 10836 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:40.259781 10808 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:40.326476  9517 raft_consensus.cc:3055] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:40.326943  9517 raft_consensus.cc:740] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:40.293231 10859 consensus_queue.cc:1059] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:02:40.342386 10808 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:40.296006  9520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46894
W20260709 13:02:40.344200 10868 log.cc:927] Time spent T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:02:40.344575  9520 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:40.345065  9520 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:40.349551 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:40.315428 10828 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:40.350394 10826 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:40.352023 10826 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.355868 10847 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.364301  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:40.364398 10836 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:40.365274  9372 raft_consensus.cc:1240] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:40.365290  9371 raft_consensus.cc:2393] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 3: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
W20260709 13:02:40.365971 10824 consensus_meta.cc:287] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.000s
I20260709 13:02:40.366155  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:40.366838  9374 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:40.368038  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:40.369652  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:40.371148  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:40.373328  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 77785.4us
I20260709 13:02:40.376310 10670 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:40.352583 10826 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.376027  9418 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:40.373812  9368 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:40.378454  9418 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:40.380962  9418 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:40.382557 10836 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:40.383096 10828 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:40.383389  9418 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:40.384407 10828 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:40.384666  9418 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:40.384830 10828 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:40.369515 10299 raft_consensus.cc:3055] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:40.389139  9449 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:40.391490  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:40.393795 10836 raft_consensus.cc:2804] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:40.394271 10836 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.394665 10836 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:40.396382  9519 raft_consensus.cc:1240] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:40.397750  9519 raft_consensus.cc:1240] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:40.398659 10818 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.387204 10670 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:02:40.401614  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:40.390754 10299 raft_consensus.cc:740] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:40.404474  9526 raft_consensus.cc:1240] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:40.388448 10828 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:40.362398  9520 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.382506 10824 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:40.403612 10836 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.410473 10693 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:40.411087  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:40.410548 10751 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:40.415035 10859 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:40.398671 10826 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:40.426677 10299 consensus_queue.cc:260] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:40.440932  9418 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:40.443185  9418 leader_election.cc:400] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5.
I20260709 13:02:40.480517 10299 raft_consensus.cc:3060] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.491250  9520 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:40.497884  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 54882.7us
I20260709 13:02:40.499109  9418 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:40.501783  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 63995.8us
I20260709 13:02:40.502630  9418 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:40.508930 10833 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:40.509352  9445 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:40.482062  9519 raft_consensus.cc:1240] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:40.486049  9369 raft_consensus.cc:1240] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 3. Ops: []
I20260709 13:02:40.515436  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.516940  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.517592  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.440012 10812 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:40.494850 10774 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:40.433549 10759 consensus_queue.cc:1059] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:02:40.521953  9443 raft_consensus.cc:2368] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:40.522675  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:40.527112  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.527586  9443 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:40.528210  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:40.528901  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.530645  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.531301  9450 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:40.480098 10776 consensus_queue.cc:1059] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:02:40.529601  9341 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:40.502822 10847 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:40.494624 10806 consensus_queue.cc:1059] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:02:40.539409  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:40.436532 10693 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:40.440097 10859 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.543982  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:40.481384 10750 consensus_queue.cc:1175] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d62c9d5a052b42ce8675f8438f846526" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20260709 13:02:40.544620  9449 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:40.543120  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.546655 10818 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:40.512061 10826 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:02:40.505213 10824 consensus_queue.cc:1059] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:02:40.549161  9451 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:40.554090  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.554137  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:40.538941  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.524119 10833 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:02:40.557235 10821 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:40.557708 10821 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.558094 10821 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:40.559532  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.560205  9449 raft_consensus.cc:2393] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 2: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:40.562958  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.550791 10759 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:40.583559  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.538511 10670 consensus_queue.cc:1048] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:02:40.551591 10823 raft_consensus.cc:3055] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:40.584017 10854 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:40.593492 10759 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.612941  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:40.613459  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.606364 10759 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:40.602775 10823 raft_consensus.cc:740] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:40.610188 10808 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.622820 10859 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:40.623724 10882 log.cc:927] Time spent T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:02:40.621716  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:40.625583  9450 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:40.610503 10745 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
W20260709 13:02:40.624432 10880 log.cc:927] Time spent T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:02:40.626679 10884 log.cc:927] Time spent T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:02:40.632716  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:40.628091 10724 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:40.645134  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:40.645514 10693 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:40.646622  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:40.644498  9526 raft_consensus.cc:2393] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 2: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:40.629654  9449 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:02:40.630090  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:40.631681  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:40.642486  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.632352  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:40.601634 10750 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
W20260709 13:02:40.649194  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.649521  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:40.612772 10854 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.621771 10823 consensus_queue.cc:260] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.628176 10836 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:40.698172  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:40.686471  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:40.700438  9452 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:40.652725  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:40.694662  9450 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:40.681594 10069 raft_consensus.cc:1275] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:02:40.684957  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:40.670907  9522 raft_consensus.cc:1275] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:02:40.690279  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.675841  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:40.707367  9521 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.651583  9418 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:40.689219  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.707790  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:40.708719  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:40.709312  9447 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:02:40.709733  9373 raft_consensus.cc:1240] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:40.709865  9520 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:40.710979  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:40.711490  9373 raft_consensus.cc:3055] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:40.711807  9373 raft_consensus.cc:740] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:40.712730  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:40.712976  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:40.713887  9374 raft_consensus.cc:1275] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:40.713908  9443 raft_consensus.cc:2393] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 2: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:40.713707  9377 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:40.715093  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.669693 10853 raft_consensus.cc:3055] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:02:40.715942  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 64444.7us
I20260709 13:02:40.674479 10849 raft_consensus.cc:3055] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:40.720053  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:40.721576  9418 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:40.722381  9375 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:40.689234 10774 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:40.673641 10817 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:40.724835  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:40.644376 10808 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.722750 10751 consensus_queue.cc:1048] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:02:40.740274 10808 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:40.716985  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:40.741091  9526 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 1.
I20260709 13:02:40.742139 10027 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:02:40.742182 10824 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:40.720234 10836 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:40.746006  9448 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:40.737507  9450 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:02:40.663539 10828 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.721158 10853 raft_consensus.cc:740] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:40.723582  9519 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:40.753046  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.743274  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:40.753834  9450 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:40.734795  9418 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:40.744125  9343 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:40.713713 10674 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.705699 10670 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:40.744880  9452 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:40.754984  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:40.736230  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:40.761066  9418 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:40.762137  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.762584  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:40.747170 10823 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.763613  9452 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:40.766462 10721 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:40.767045 10721 raft_consensus.cc:697] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:40.767957 10721 consensus_queue.cc:237] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.751538 10326 raft_consensus.cc:2804] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:40.769223 10326 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:40.769642 10326 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.774137 10853 consensus_queue.cc:260] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.775223 10853 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:40.775934  9517 consensus_queue.cc:260] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.777653  9517 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:40.747328 10849 raft_consensus.cc:740] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:40.781551  9449 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:40.785593  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:40.787189  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.787892  9449 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:40.782974  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:40.800539  9452 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:40.761605 10670 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.802380 10776 consensus_queue.cc:1059] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:02:40.803277 10776 raft_consensus.cc:3055] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:40.803637 10776 raft_consensus.cc:740] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:40.803706  9375 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:40.804111 10670 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:40.783319 10836 raft_consensus.cc:2764] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:02:40.761945 10674 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.782877 10824 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:40.812862  9517 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:40.813612  9517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1045) took 1042 ms. Trace:
I20260709 13:02:40.813867  9517 rpcz_store.cc:276] 0709 13:02:39.771355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.771489 (+   134us) service_pool.cc:224] Handling call
0709 13:02:39.781234 (+  9745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:40.326351 (+545117us) spinlock_profiling.cc:243] Waited 79.6 ms on lock 0x7b540030dca0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5864e1dc0 00007fb58656c1c0 00007fb58656d231 00007fb586569d8f 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c
0709 13:02:40.775616 (+449265us) spinlock_profiling.cc:243] Waited 9.19 ms on lock 0x7b540030dca0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5864e806f 00007fb586560f60 00007fb5865627de 00007fb58656cb49 00007fb58656d416 00007fb586569d8f 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62
0709 13:02:40.813341 (+ 37725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.813569 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204256384}
I20260709 13:02:40.788916 10774 consensus_queue.cc:1059] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:02:40.825291 10830 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:40.827198 10828 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:40.830580 10674 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:40.834597 10759 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.838723 10774 raft_consensus.cc:3055] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:40.839301 10774 raft_consensus.cc:740] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:40.842684 10821 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.843843 10632 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:40.080592  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:40.818087 10813 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:02:40.854948  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:40.855901  9525 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:40.860210  9520 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:40.832746  9519 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:40.869170  9272 catalog_manager.cc:5697] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 1 to 3, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 3 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.870389  9447 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:40.871502  9445 raft_consensus.cc:2368] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:40.872294  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.874171  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.875394  9447 raft_consensus.cc:2410] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:40.877602 10299 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:40.878685  9526 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:02:40.879134  9526 pending_rounds.cc:85] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 2
I20260709 13:02:40.879423  9526 pending_rounds.cc:107] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:02:40.879710  9526 raft_consensus.cc:2889] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:40.876510  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.882311  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:40.882711  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:40.884130  9447 raft_consensus.cc:2368] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 4. Current term is 5.
I20260709 13:02:40.804467 10776 consensus_queue.cc:260] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.883337  9520 raft_consensus.cc:2393] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 3: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:40.816042 10812 consensus_queue.cc:1059] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:02:40.891911  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:40.858933 10816 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:40.840615 10774 consensus_queue.cc:260] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.888550 10854 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:40.894171 10812 consensus_queue.cc:1243] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 6d50f1c263264b21919230bee398022b log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:02:40.902832  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:40.904448  9526 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:40.899973 10776 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:40.908447  9520 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:40.878307 10849 consensus_queue.cc:260] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.913184  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:40.913910  9520 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:02:40.917608  9526 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:40.918437  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:40.918910  9526 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:40.899778 10816 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:40.906348 10759 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:40.928495 10326 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:40.934392 10326 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:40.931103  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.932188  9520 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:40.936619  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.937282  9446 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:02:40.938082  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.938668  9446 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:40.939520  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:40.940198 10677 raft_consensus.cc:3055] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:40.940681 10677 raft_consensus.cc:740] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:40.941226  9521 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:40.941543 10677 consensus_queue.cc:260] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:40.942263  9520 raft_consensus.cc:1240] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:40.942621  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:40.942826 10677 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:40.943149  9521 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:40.944226  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:40.908582 10821 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:40.945521  9490 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:40.919834  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.946287 10805 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:40.946528  9444 raft_consensus.cc:2393] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 5: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:40.947499  9490 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:40.944887  9520 raft_consensus.cc:2368] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3.
I20260709 13:02:40.950016 10849 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.950090  9521 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:40.950496  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:40.951040  9520 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:40.951131  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:40.951694  9521 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:40.952478  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:40.953330  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:40.954174  9526 raft_consensus.cc:2393] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 4: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:40.955082 10805 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:40.956565  9490 leader_election.cc:400] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:40.956859  9490 leader_election.cc:403] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:40.959121  9526 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:40.960793 10805 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:40.962221  9490 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:40.963814  9490 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:40.964457  9341 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:40.969568  9446 raft_consensus.cc:2410] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:40.972853  9490 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:40.972008  9341 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:40.975003  9490 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:40.976900  9520 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:40.975306 10698 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:40.981679  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.982573  9449 raft_consensus.cc:2368] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3.
I20260709 13:02:40.983439  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:40.984007  9449 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:40.986783 10816 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:40.973264 10750 consensus_queue.cc:1048] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:02:40.990432 10817 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:40.990914 10817 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:40.991303 10817 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:40.994388  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:40.995222  9448 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:40.997115 10718 consensus_queue.cc:1048] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:40.999967  9524 raft_consensus.cc:1275] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:40.999991 10027 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:41.002156 10842 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:41.002790 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:41.005476  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:41.009148  9374 raft_consensus.cc:1240] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:41.009245  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:41.009473  9490 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:41.010283 10859 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:41.010694 10859 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:41.010847  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:41.011197 10859 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.011679  9377 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:02:41.009239 10849 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:41.020916 10859 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:41.023211  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 51286.2us
I20260709 13:02:41.023130 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:41.010793  9490 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:41.025331  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:41.027614  9341 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:41.028204  9377 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:41.028705  9341 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:41.024837  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:41.028901  9490 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:41.031993  9341 leader_election.cc:400] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3.
I20260709 13:02:41.041066  9368 raft_consensus.cc:1240] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:41.045163  9341 leader_election.cc:403] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:41.041472  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:40.976388 10808 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.030222  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:41.026932  9417 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:41.050091  9341 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:41.052278  9490 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:41.055437  9490 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:41.007285 10698 raft_consensus.cc:697] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:41.062237  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:41.062417  9490 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:41.029510 10674 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:41.026028 10805 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:41.071535  9490 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:41.041208 10849 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:41.044294 10632 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:41.046397 10745 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:41.072794  9490 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:41.087332  9490 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:41.049401  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:41.048612 10836 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:41.080824  9449 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:41.090198  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:41.061635 10750 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:41.061782 10844 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:41.093909  9341 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:41.122761 10299 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:41.123456 10299 raft_consensus.cc:697] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:41.095064  9451 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:41.057128 10778 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3.
I20260709 13:02:41.057363 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:41.089529  9490 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:41.082064 10822 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.136420 10299 consensus_queue.cc:237] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:41.121093  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.073298 10854 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:41.108489  9373 consensus_queue.cc:260] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:41.086675 10786 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.081418 10800 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:41.089984 10658 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:41.106153 10750 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.140548  9373 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:41.114425 10745 raft_consensus.cc:697] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:41.089867 10326 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:41.095749 10850 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:41.091888 10674 raft_consensus.cc:697] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:41.162563  9443 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
W20260709 13:02:41.151363  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.086297 10841 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:41.153165  9376 raft_consensus.cc:1240] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:02:41.115635  9447 raft_consensus.cc:1240] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:02:41.120958 10632 raft_consensus.cc:697] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:41.094285 10816 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:02:41.161046  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 71606.1us
I20260709 13:02:41.161386  9372 raft_consensus.cc:1240] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 4. Ops: []
I20260709 13:02:41.162437 10698 consensus_queue.cc:237] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:41.145516  9518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1056) took 1351 ms. Trace:
I20260709 13:02:41.164266  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:41.179175  9525 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:41.179450  9343 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:41.181100  9451 raft_consensus.cc:1240] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:41.181878  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:41.186693  9373 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:02:41.158810 10750 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:41.160547 10850 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.146284 10822 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:41.196324 10879 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:41.165660 10326 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:41.202281 10822 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:41.162452 10658 raft_consensus.cc:697] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:41.202159 10065 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
W20260709 13:02:41.214756  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.180342 10859 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:41.153786 10786 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:41.195544 10854 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:41.202742 10326 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:41.228027  9343 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:41.225894 10714 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:41.230790 10854 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.240856 10854 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:41.245226 10641 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:41.245903 10641 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.246389 10641 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:41.252938 10674 consensus_queue.cc:237] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:41.253793  9370 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:41.204811 10850 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:41.190830 10746 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:02:41.195029 10816 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:41.266601  9343 leader_election.cc:400] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3.
I20260709 13:02:41.266301 10751 consensus_queue.cc:1059] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:41.272323  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:41.260145 10714 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:41.276865  9343 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:41.288285  9343 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:41.272006 10806 raft_consensus.cc:3055] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:41.272133 10632 consensus_queue.cc:237] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:41.290799 10749 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:41.291265 10575 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:41.256683 10745 consensus_queue.cc:237] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:41.271976 10818 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:02:41.293653 10806 raft_consensus.cc:740] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:41.324748 10641 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:41.296060 10743 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:02:41.180531  9518 rpcz_store.cc:276] 0709 13:02:39.794155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.798086 (+  3931us) service_pool.cc:224] Handling call
0709 13:02:39.802056 (+  3970us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:40.135204 (+333148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:40.138539 (+  3335us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:40.199789 (+ 61250us) log.cc:844] Serialized 26 byte log entry
0709 13:02:40.501820 (+302031us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:40.510993 (+  9173us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4800061ed8. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58b493aa1 00007fb58b48ab37 00007fb58b48a9ca 00007fb58b58226f 00007fb58b581f37 00007fb58b59655c 00007fb58b596508 00007fb58b596488 00007fb58b596443 00007fb58b5956ec 00007fb58a4bfa96
0709 13:02:40.551339 (+ 40346us) log.cc:844] Serialized 14 byte log entry
0709 13:02:40.565167 (+ 13828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.602243 (+ 37076us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:41.142721 (+540478us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b18003a2400. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58347d3f3 00007fb58347f7c1 00007fb58347f779 00007fb58347f709 00007fb58347f6d1 00007fb58347e9cd 000000000038f354 000000000038f199 00007fb58346083a
0709 13:02:41.145213 (+  2492us) raft_consensus.cc:1685] finished
0709 13:02:41.145252 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.145455 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23233,"prepare.queue_time_us":13937,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":2631,"raft.queue_time_us":60308,"raft.run_cpu_time_us":2887,"raft.run_wall_time_us":655575,"spinlock_wait_cycles":37186816,"thread_start_us":546020,"threads_started":2,"wal-append.queue_time_us":318439}
I20260709 13:02:41.375695  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:41.378502  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:41.293460 10658 consensus_queue.cc:237] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:41.385068  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:41.383327 10069 raft_consensus.cc:1240] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:41.383901 10805 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:41.387753 10805 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:41.386268 10808 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:41.415309  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.417428 10299 consensus_queue.cc:1059] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
W20260709 13:02:41.428254  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.429824  9492 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:41.430281 10299 raft_consensus.cc:3055] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:41.430657 10299 raft_consensus.cc:740] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:41.431412 10299 consensus_queue.cc:260] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:41.432205 10906 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:41.432545 10299 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.388674 10714 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:41.434299  9492 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:41.436072 10027 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:41.405491 10786 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:41.445217 10027 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:41.448809  9492 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:41.380923 10806 consensus_queue.cc:260] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:41.447925 10848 raft_consensus.cc:2749] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:41.465272  9492 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:41.446135 10808 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:41.458906 10816 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:41.464751 10326 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:41.483703 10905 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:41.466818 10822 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:41.438084 10817 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:41.513903 10817 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:41.512844  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 47718.4us
I20260709 13:02:41.519361 10750 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:41.507936  9417 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:41.527222 10750 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:41.528435  9444 raft_consensus.cc:1240] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:41.503643 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:41.478742 10806 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:41.517118 10822 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.517282 10854 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:41.515717 10677 consensus_meta.cc:287] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.001s
I20260709 13:02:41.466504 10859 consensus_queue.cc:1048] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
W20260709 13:02:41.538304 10897 log.cc:927] Time spent T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.357s	user 0.003s	sys 0.000s
I20260709 13:02:41.462138 10800 raft_consensus.cc:697] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:02:41.557713  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:41.595284  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 304815us
W20260709 13:02:41.605898  9520 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.011s	sys 0.026s
W20260709 13:02:41.606418  9520 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.011s	sys 0.026s
I20260709 13:02:41.539713 10822 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:41.622377  9448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1191) took 1003 ms. Trace:
I20260709 13:02:41.554350 10849 raft_consensus.cc:697] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:41.624655 10849 consensus_queue.cc:237] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:41.618088 10852 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:41.635995  9418 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:41.639027  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:41.639904  9372 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:41.646384  9418 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:41.649120  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.650904  9373 raft_consensus.cc:1240] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:41.658605  9374 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:41.655835  9524 raft_consensus.cc:1240] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:41.659961  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:41.660856  9518 raft_consensus.cc:1240] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:41.642409 10816 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:41.561897 10905 raft_consensus.cc:697] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 4 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:41.657153  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:41.668452  9520 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:41.674774  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 281544us
I20260709 13:02:41.651906 10828 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:41.652750 10823 raft_consensus.cc:2804] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:41.671087 10774 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:41.713481  9521 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:41.652441 10826 consensus_queue.cc:1048] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:02:41.682747 10836 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:41.682458 10824 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.718858  9492 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:41.720330 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 275167us
I20260709 13:02:41.728339  9520 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:41.721443  9490 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:41.753206  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.765537  9450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1188) took 1153 ms. Trace:
I20260709 13:02:41.771992  9450 rpcz_store.cc:276] 0709 13:02:40.612162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.806351 (+194189us) service_pool.cc:224] Handling call
0709 13:02:40.817991 (+ 11640us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:40.899488 (+ 81497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:40.899518 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:40.906288 (+  6770us) log.cc:844] Serialized 52 byte log entry
0709 13:02:41.047798 (+141510us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:41.047847 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.047935 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:41.537625 (+489690us) spinlock_profiling.cc:243] Waited 6.44 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:02:41.765108 (+227483us) raft_consensus.cc:1685] finished
0709 13:02:41.765136 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.765457 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":292,"raft.queue_time_us":1773,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":25072,"spinlock_wait_cycles":14805760,"thread_start_us":191756,"threads_started":2,"wal-append.queue_time_us":223526}
W20260709 13:02:41.758198  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:41.775636  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 54363.6us
I20260709 13:02:41.776755  9490 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:41.780573  9490 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:41.720858  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46902 (request call id 921) took 1086 ms. Trace:
I20260709 13:02:41.786513  9449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1193) took 1158 ms. Trace:
I20260709 13:02:41.741168  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:41.789860  9490 leader_election.cc:400] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 4. Current term is 5.
I20260709 13:02:41.788417  9449 rpcz_store.cc:276] 0709 13:02:40.625793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.093408 (+467615us) service_pool.cc:224] Handling call
0709 13:02:41.093696 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:41.093924 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:41.435447 (+341523us) log.cc:844] Serialized 14 byte log entry
0709 13:02:41.783868 (+348421us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:41.783925 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:41.783972 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.784055 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.784204 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":459737,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":53,"thread_start_us":646596,"threads_started":3}
I20260709 13:02:41.754804 10913 raft_consensus.cc:2764] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:02:41.793365  9450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1208) took 1051 ms. Trace:
I20260709 13:02:41.799397  9450 rpcz_store.cc:276] 0709 13:02:40.742121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.782187 (+1040066us) service_pool.cc:224] Handling call
0709 13:02:41.792836 (+ 10649us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:41.792996 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:41.793043 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:41.793084 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:41.793112 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.793167 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.793303 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:41.791914  9490 leader_election.cc:403] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:02:41.735754 10836 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:41.802155  9490 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:41.785310 10844 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:41.788640 10859 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:41.805456  9490 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:41.745245 10850 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:41.808858 10911 log.cc:927] Time spent T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:02:41.809378 10698 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:41.809689 10916 log.cc:927] Time spent T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:02:41.809633 10937 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.714099 10800 consensus_queue.cc:237] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:41.808914 10919 log.cc:927] Time spent T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:02:41.784456 10824 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:41.797884 10828 raft_consensus.cc:697] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:41.784373  9519 rpcz_store.cc:276] 0709 13:02:40.633743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.646283 (+ 12540us) service_pool.cc:224] Handling call
0709 13:02:41.709162 (+1062879us) spinlock_profiling.cc:243] Waited 67.5 ms on lock 0x7b5400314cd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:41.719613 (+ 10451us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155255680}
I20260709 13:02:41.812963 10917 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.946455 10828 consensus_queue.cc:237] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:41.947281 10917 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:41.949599 10917 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:41.950655 10641 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:41.955338  9447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1195) took 1326 ms. Trace:
I20260709 13:02:41.955772  9447 rpcz_store.cc:276] 0709 13:02:40.628811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.169854 (+541043us) service_pool.cc:224] Handling call
0709 13:02:41.170234 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:41.170760 (+   526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:41.170800 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:41.171433 (+   633us) log.cc:844] Serialized 26 byte log entry
0709 13:02:41.470018 (+298585us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:41.470406 (+   388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.470836 (+   430us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:41.955135 (+484299us) raft_consensus.cc:1685] finished
0709 13:02:41.955153 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.955280 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":111,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":12202,"thread_start_us":247453,"threads_started":1,"wal-append.queue_time_us":502493}
I20260709 13:02:41.957522  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:41.957578 10746 consensus_queue.cc:1059] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:41.958331  9447 raft_consensus.cc:2393] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 4: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:41.965523  9445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51016 (request call id 802) took 1449 ms. Trace:
I20260709 13:02:41.965881 10917 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.970625  9376 raft_consensus.cc:1275] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:41.971803  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:41.813043 10817 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:41.973266 10817 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.973733 10817 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:41.974550  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:41.976424  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:41.978364  9443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 1190) took 1360 ms. Trace:
I20260709 13:02:41.978911  9443 rpcz_store.cc:276] 0709 13:02:40.617962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.714848 (+ 96886us) service_pool.cc:224] Handling call
0709 13:02:41.978145 (+1263297us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b5400220954. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:41.978277 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1027560704}
I20260709 13:02:41.967013  9452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1200) took 1269 ms. Trace:
I20260709 13:02:41.791338 10915 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:41.846338 10808 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:41.806203 10905 consensus_queue.cc:237] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:41.919195  9490 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:41.919402  9517 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:41.928367  9525 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:02:41.995630  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 76581.2us
I20260709 13:02:41.997553  9490 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:41.932647 10935 log.cc:927] Time spent T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:02:41.933323 10937 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:41.939291  9372 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:41.944214 10850 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:41.946823 10824 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:41.966521 10917 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:41.917587  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.979979  9452 rpcz_store.cc:276] 0709 13:02:40.697688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.221208 (+523520us) service_pool.cc:224] Handling call
0709 13:02:41.221618 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:41.222114 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:02:41.222173 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:41.222746 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 13:02:41.739790 (+517044us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:41.739833 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.739912 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:41.966775 (+226863us) raft_consensus.cc:1685] finished
0709 13:02:41.966806 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.966953 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2977,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":4562,"thread_start_us":477898,"threads_started":1,"wal-append.queue_time_us":724491}
I20260709 13:02:41.980561  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:42.027145  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.027875  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:41.966142  9445 rpcz_store.cc:276] 0709 13:02:40.516249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.518495 (+  2246us) service_pool.cc:224] Handling call
0709 13:02:41.965255 (+1446760us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54000d1454. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:41.965433 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":651451776}
I20260709 13:02:41.983444  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:02:41.921212 10938 log.cc:927] Time spent T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.111s	user 0.006s	sys 0.004s
I20260709 13:02:42.041483  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:42.042594  9447 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:41.923208 10805 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.001350  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:42.004918  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:42.006430  9368 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:41.996989 10918 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Leader election lost for term 4. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 4. Current term is 5.
I20260709 13:02:42.014456  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:42.016047  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:42.035791  9451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1202) took 1312 ms. Trace:
I20260709 13:02:42.073150  9451 rpcz_store.cc:276] 0709 13:02:40.723184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.293212 (+570028us) service_pool.cc:224] Handling call
0709 13:02:41.298747 (+  5535us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:41.299142 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:41.299202 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:41.302265 (+  3063us) log.cc:844] Serialized 26 byte log entry
0709 13:02:41.683877 (+381612us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:41.683913 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.683982 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:42.035441 (+351459us) raft_consensus.cc:1685] finished
0709 13:02:42.035472 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.035699 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":1313,"thread_start_us":381234,"threads_started":1,"wal-append.queue_time_us":491590}
I20260709 13:02:42.036365  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:42.075857  9452 raft_consensus.cc:2393] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:42.002135 10658 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:42.079548  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:42.093425  9452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 841) took 1186 ms. Trace:
I20260709 13:02:42.094031  9452 rpcz_store.cc:276] 0709 13:02:40.910643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.092392 (+1181749us) service_pool.cc:224] Handling call
0709 13:02:42.092764 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.092984 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.093043 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:42.093101 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:42.093144 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.093218 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.093353 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:42.096447  9452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45366 (request call id 121) took 1159 ms. Trace:
I20260709 13:02:42.008473  9446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1199) took 1357 ms. Trace:
I20260709 13:02:41.992731 10808 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:42.057726 10943 consensus_queue.cc:1059] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:42.059227 10937 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:42.036614 10915 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:41.981395 10822 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.051968 10824 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:42.062547 10854 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:42.064198  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:42.065449 10677 consensus_queue.cc:1059] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:42.113281 10677 raft_consensus.cc:3055] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:42.113768 10677 raft_consensus.cc:740] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:42.114878 10677 consensus_queue.cc:260] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.066015 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:42.116603 10937 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:42.067237  9444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1207) took 1325 ms. Trace:
I20260709 13:02:42.117178 10937 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:42.117268  9444 rpcz_store.cc:276] 0709 13:02:40.741847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.529435 (+787588us) service_pool.cc:224] Handling call
0709 13:02:41.529813 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:41.530224 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:41.530269 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:41.530820 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:02:41.720154 (+189334us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:41.733031 (+ 12877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.733141 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:42.066961 (+333820us) raft_consensus.cc:1685] finished
0709 13:02:42.066989 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.067162 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2495,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":19685,"thread_start_us":177405,"threads_started":1,"wal-append.queue_time_us":254977}
I20260709 13:02:42.119473 10937 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:42.119637  9444 raft_consensus.cc:1275] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:02:42.120208  9444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45366 (request call id 122) took 1182 ms. Trace:
I20260709 13:02:42.039369  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:42.070385 10913 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:02:42.120994 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:42.079552 10778 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.122110 10069 raft_consensus.cc:2393] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 2: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:02:41.917562  9450 raft_consensus.cc:3055] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:02:42.103461 10932 log.cc:927] Time spent T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:02:42.098665  9452 rpcz_store.cc:276] 0709 13:02:40.937273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.095213 (+1157940us) service_pool.cc:224] Handling call
0709 13:02:42.095809 (+   596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.096024 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.096061 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:42.096114 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:42.096156 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.096222 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.096376 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:42.036522 10750 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.104574  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:42.105516  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:41.982405 10698 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:02:42.106990  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 177215us
I20260709 13:02:42.143993  9451 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:42.109602  9447 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:42.112231 10828 raft_consensus.cc:3055] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:42.121378  9445 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:42.053714 10844 consensus_queue.cc:1048] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:02:42.026791 10841 consensus_queue.cc:1059] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 13:02:42.122339 10778 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.084285 10816 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:42.126981 10822 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:42.127694 10824 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:42.081311  9520 raft_consensus.cc:1240] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:02:42.156695  9520 raft_consensus.cc:1240] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:42.102864 10808 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:42.120496  9444 rpcz_store.cc:276] 0709 13:02:40.937690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.118959 (+1181269us) service_pool.cc:224] Handling call
0709 13:02:42.119293 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.119983 (+   690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.120156 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:42.136132  9450 raft_consensus.cc:740] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:42.098835  9446 rpcz_store.cc:276] 0709 13:02:40.650790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.202521 (+551731us) service_pool.cc:224] Handling call
0709 13:02:41.202972 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:41.203169 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:41.608560 (+405391us) log.cc:844] Serialized 14 byte log entry
0709 13:02:41.959092 (+350532us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:02:42.004493 (+ 45401us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:42.004579 (+    86us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:42.004649 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.007722 (+  3073us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.007879 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3079,"prepare.queue_time_us":438721,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":242883,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":132,"spinlock_wait_cycles":11051776,"thread_start_us":765342,"threads_started":3,"wal-append.queue_time_us":251222}
I20260709 13:02:42.150460  9418 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:42.163659  9341 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:42.168319  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:42.143973 10677 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:42.186527 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:42.182910  9374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52548 (request call id 906) took 1158 ms. Trace:
I20260709 13:02:42.186005 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:42.147095 10828 raft_consensus.cc:740] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:42.168988  9341 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:42.172065  9418 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:42.178272 10824 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:42.176455 10943 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:42.182389 10917 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:42.210768 10721 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:42.175019 10947 consensus_queue.cc:1059] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:02:42.204933  9374 rpcz_store.cc:276] 0709 13:02:41.024319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.024474 (+   155us) service_pool.cc:224] Handling call
0709 13:02:42.182700 (+1158226us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b540014cb54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:42.182819 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1238599040}
I20260709 13:02:42.179777 10698 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:42.178368 10641 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:42.214422 10641 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.214870  9525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1099) took 1270 ms. Trace:
I20260709 13:02:42.215304  9525 rpcz_store.cc:276] 0709 13:02:40.944671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.189492 (+244821us) service_pool.cc:224] Handling call
0709 13:02:41.189822 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:41.995422 (+805600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.214625 (+219203us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b540028a5d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:42.214815 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1697642752}
I20260709 13:02:42.216110 10717 consensus_queue.cc:1048] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:42.146886 10750 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.219377 10750 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:42.178503 10937 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:42.188702  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:42.220768  9525 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:42.220942 10069 raft_consensus.cc:2468] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:42.204545  9445 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
W20260709 13:02:42.222249  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 50280.3us
I20260709 13:02:42.165390 10816 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:42.223038  9418 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:42.223520  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:42.202311  9444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1209) took 1236 ms. Trace:
I20260709 13:02:42.222640  9342 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:02:42.227366  9444 rpcz_store.cc:276] 0709 13:02:40.965488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.201248 (+1235760us) service_pool.cc:224] Handling call
0709 13:02:42.201616 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.201870 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.201910 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:42.201970 (+    60us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:42.202015 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.202087 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.202235 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:42.235671  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:42.237641  9341 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:42.176784 10778 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:42.238719  9444 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:42.154282 10836 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:42.214893 10641 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:42.247121  9418 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:02:42.225131 10806 consensus_meta.cc:287] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.685s	user 0.013s	sys 0.010s
I20260709 13:02:42.223124 10721 raft_consensus.cc:697] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:42.252938  9418 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:42.253273  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:42.188856 10817 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.268527  9444 raft_consensus.cc:2410] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:42.276136 10817 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:42.277268 10836 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:42.282588 10806 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:42.283124 10806 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.225107 10943 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:42.285332 10806 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:42.271755  9490 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:42.273734  9449 raft_consensus.cc:1275] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:02:42.262205 10750 raft_consensus.cc:2804] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:42.288542  9449 pending_rounds.cc:85] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 2
I20260709 13:02:42.288643 10750 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.288976  9449 pending_rounds.cc:107] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:02:42.289281 10750 raft_consensus.cc:3060] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:42.289569  9449 raft_consensus.cc:2889] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:42.293567 10822 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:42.293607 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:42.296094  9490 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:42.297632 10828 consensus_queue.cc:260] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.299172 10805 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:42.300554  9519 raft_consensus.cc:1275] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:42.263142 10939 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:42.304831  9517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1102) took 1088 ms. Trace:
I20260709 13:02:42.305308  9517 rpcz_store.cc:276] 0709 13:02:41.216041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.216222 (+   181us) service_pool.cc:224] Handling call
0709 13:02:41.216642 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:41.995829 (+779187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.304583 (+308754us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b5400199bd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:42.304758 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1442287872}
I20260709 13:02:42.307797  9517 raft_consensus.cc:1240] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:42.244843  9445 raft_consensus.cc:2468] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:42.277299  9525 raft_consensus.cc:1240] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:02:42.318069  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:42.318779  9521 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:42.321379 10299 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:02:42.321942 10901 log.cc:927] Time spent T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 1.123s	user 0.001s	sys 0.002s
I20260709 13:02:42.322450 10299 raft_consensus.cc:697] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:42.299232  9490 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:42.330286  9490 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:42.325546  9418 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:42.323953  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 86437.1us
W20260709 13:02:42.322610 10823 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.048s	sys 0.051s
I20260709 13:02:42.336452  9341 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:42.339394 10299 consensus_queue.cc:237] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.337860 10943 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:42.336704 10805 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:02:42.340591 10823 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.048s	sys 0.051s
I20260709 13:02:42.331844 10939 consensus_queue.cc:1059] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:02:42.343113 10698 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:42.345841 10822 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:42.354851  9521 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:42.336095 10808 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.361334  9447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45366 (request call id 125) took 1421 ms. Trace:
I20260709 13:02:42.349653 10817 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:42.346266 10823 raft_consensus.cc:697] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 2 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:42.362056  9447 rpcz_store.cc:276] 0709 13:02:40.938664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.147683 (+1209019us) service_pool.cc:224] Handling call
0709 13:02:42.148075 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.148336 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:42.175259 (+ 26923us) log.cc:844] Serialized 14 byte log entry
0709 13:02:42.359417 (+184158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:42.359562 (+   145us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:42.359622 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.359880 (+   258us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.360032 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4012,"prepare.queue_time_us":28359,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":15200,"thread_start_us":168978,"threads_started":1}
W20260709 13:02:42.365988  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.368139  9452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45366 (request call id 123) took 1430 ms. Trace:
I20260709 13:02:42.371608  9452 rpcz_store.cc:276] 0709 13:02:40.938044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.139194 (+1201150us) service_pool.cc:224] Handling call
0709 13:02:42.139592 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.139867 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:42.158598 (+ 18731us) log.cc:844] Serialized 14 byte log entry
0709 13:02:42.367555 (+208957us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:42.367654 (+    99us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:42.367714 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.367879 (+   165us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.368061 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13357,"prepare.queue_time_us":12025,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":42,"raft.queue_time_us":13578,"thread_start_us":195053,"threads_started":1}
I20260709 13:02:42.374548  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:42.374800  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:42.376641  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:42.366727 10939 consensus_queue.cc:1243] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 6d50f1c263264b21919230bee398022b log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:02:42.362469 10943 raft_consensus.cc:697] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:42.379638 10943 consensus_queue.cc:237] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.362754 10670 raft_consensus.cc:3055] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:42.381108 10670 raft_consensus.cc:740] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:42.361441 10824 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:42.385499  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:42.389246 10942 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.387822  9450 consensus_queue.cc:260] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.357635 10698 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.390669  9450 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:42.391697  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:42.397679  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:42.402794  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:42.403765  9443 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:42.405853  9526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1100) took 1460 ms. Trace:
I20260709 13:02:42.406410  9526 rpcz_store.cc:276] 0709 13:02:40.944921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.190898 (+245977us) service_pool.cc:224] Handling call
0709 13:02:41.191169 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:41.191396 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:41.191412 (+    16us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:41.197400 (+  5988us) log.cc:844] Serialized 26 byte log entry
0709 13:02:42.085669 (+888269us) spinlock_profiling.cc:243] Waited 946 us on lock 0x7b18002f9680. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58345fe07 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b 00007fb586109d23 00007fb58610a0d1 00007fb586525a0f
0709 13:02:42.224655 (+138986us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:42.224693 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.224758 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:42.390799 (+166041us) raft_consensus.cc:1685] finished
0709 13:02:42.390825 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.405761 (+ 14936us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35081,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":1981,"spinlock_wait_cycles":2176896,"thread_start_us":138818,"threads_started":1,"wal-append.queue_time_us":1132970}
I20260709 13:02:42.393967 10698 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:42.427462  9450 raft_consensus.cc:1275] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:02:42.427973  9450 pending_rounds.cc:85] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 2
I20260709 13:02:42.428300  9450 pending_rounds.cc:107] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:02:42.428580  9450 raft_consensus.cc:2889] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:42.429436  9450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 832) took 1562 ms. Trace:
W20260709 13:02:42.413182 10944 log.cc:927] Time spent T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.232s	user 0.000s	sys 0.002s
I20260709 13:02:42.429874  9450 rpcz_store.cc:276] 0709 13:02:40.867214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.801419 (+934205us) service_pool.cc:224] Handling call
0709 13:02:41.815773 (+ 14354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.387423 (+571650us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b5400458920. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5864e806f 00007fb586560f60 00007fb5865627de 00007fb58656cb49 00007fb58656d416 00007fb586569d8f 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62
0709 13:02:42.429162 (+ 41739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.429368 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61799808}
I20260709 13:02:42.355042 10721 consensus_queue.cc:237] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.411320 10950 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.444453  9443 raft_consensus.cc:2410] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:42.425542 10836 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.393657 10942 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:42.436354 10947 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:02:42.445536 10908 raft_consensus.cc:3055] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:02:42.477438 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 87153.6us
I20260709 13:02:42.483971  9444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1211) took 1518 ms. Trace:
I20260709 13:02:42.484508  9444 rpcz_store.cc:276] 0709 13:02:40.965822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.275103 (+1309281us) service_pool.cc:224] Handling call
0709 13:02:42.275604 (+   501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:42.279575 (+  3971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.279629 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:42.280318 (+   689us) log.cc:844] Serialized 26 byte log entry
0709 13:02:42.403552 (+123234us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:42.403593 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.403658 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:42.483700 (+ 80042us) raft_consensus.cc:1685] finished
0709 13:02:42.483726 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.483898 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3517,"raft.queue_time_us":5219,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":148,"thread_start_us":122798,"threads_started":1,"wal-append.queue_time_us":164724}
I20260709 13:02:42.489908  9444 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:42.491782  9444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1217) took 1432 ms. Trace:
I20260709 13:02:42.446307 10817 consensus_queue.cc:1048] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:02:42.492337  9444 rpcz_store.cc:276] 0709 13:02:41.059024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.487370 (+1428346us) service_pool.cc:224] Handling call
0709 13:02:42.489732 (+  2362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.491463 (+  1731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.491711 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:41.623392  9448 rpcz_store.cc:276] 0709 13:02:40.619363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.995962 (+376599us) service_pool.cc:224] Handling call
0709 13:02:41.006676 (+ 10714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:41.006944 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:41.269830 (+262886us) log.cc:844] Serialized 14 byte log entry
0709 13:02:41.621801 (+351971us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:41.621876 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:41.621937 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.622039 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.622234 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":473643,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":12526,"thread_start_us":531627,"threads_started":2}
I20260709 13:02:42.477852 10908 raft_consensus.cc:740] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:42.499126  9448 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:42.453243 10836 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.496606  9445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45366 (request call id 126) took 1502 ms. Trace:
I20260709 13:02:42.474115 10750 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:42.502916  9444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1218) took 1355 ms. Trace:
I20260709 13:02:42.435689 10670 consensus_queue.cc:260] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.505649  9444 rpcz_store.cc:276] 0709 13:02:41.147392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.495916 (+1348524us) service_pool.cc:224] Handling call
0709 13:02:42.498885 (+  2969us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.502616 (+  3731us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.502643 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:42.502684 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:42.502715 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.502771 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.502866 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:42.508002  9444 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:42.502485  9445 rpcz_store.cc:276] 0709 13:02:40.994691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.308865 (+1314174us) service_pool.cc:224] Handling call
0709 13:02:42.309164 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.309344 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:42.309996 (+   652us) log.cc:844] Serialized 14 byte log entry
0709 13:02:42.494026 (+184030us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:42.496256 (+  2230us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:42.496308 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.496437 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.496553 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":269,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":39029,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":4583,"spinlock_wait_cycles":8885632,"thread_start_us":183603,"threads_started":2,"wal-append.queue_time_us":173221}
W20260709 13:02:42.510404  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 65617.4us
I20260709 13:02:42.454622 10950 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.512537 10917 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:42.514252 10967 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:42.515739  9445 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:42.474416 10823 consensus_queue.cc:237] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.522295 10299 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:42.517856 10939 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.527391 10939 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.528836 10836 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:42.529484 10939 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:42.533491  9445 raft_consensus.cc:1275] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:42.532807 10670 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:42.504258 10575 consensus_queue.cc:1059] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:02:42.538486 10575 raft_consensus.cc:3055] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:42.539007 10575 raft_consensus.cc:740] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:42.540016 10575 consensus_queue.cc:260] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.546881 10950 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:42.549073 10937 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:42.549947  9447 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:42.561465 10698 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.562209 10942 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:42.532173 10967 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:42.582597 10946 log.cc:927] Time spent T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.402s	user 0.003s	sys 0.000s
W20260709 13:02:42.591627  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:42.592384  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.592526  9492 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:42.549105 10908 consensus_queue.cc:260] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.594048 10908 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:42.594213  9492 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:42.594895 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:42.595453 10069 raft_consensus.cc:3060] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:42.596236  9523 raft_consensus.cc:1275] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:42.597177 10817 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:42.597901 10817 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:42.593448 10750 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:42.600811 10808 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:42.593391 10828 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:02:42.601192 10816 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:42.602823 10069 raft_consensus.cc:2468] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:42.603741 10816 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:42.605593 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:42.605983 10967 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:42.607477 10641 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.610284  9522 raft_consensus.cc:1275] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:42.575958 10575 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:42.614944  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:42.615299  9449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 831) took 1749 ms. Trace:
I20260709 13:02:42.615666  9449 rpcz_store.cc:276] 0709 13:02:40.866870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.801241 (+934371us) service_pool.cc:224] Handling call
0709 13:02:41.801646 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.291880 (+490234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.615062 (+323182us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b54001cff54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:42.615241 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1084496128}
I20260709 13:02:42.616464  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:42.617189  9522 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:42.617745  9343 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:42.618163  9342 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:02:42.616928  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:42.619968  9449 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:42.626097  9523 raft_consensus.cc:1240] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:42.627020 10750 raft_consensus.cc:2804] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:42.627696 10750 raft_consensus.cc:697] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:42.628149  9526 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:42.627080 10917 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:42.629410 10917 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.629892 10641 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:42.630646  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.626111 10670 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:42.631372  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.631628 10917 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:42.635011  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:42.635838  9377 raft_consensus.cc:2393] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 3: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:42.635978 10698 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:42.637953  9522 raft_consensus.cc:1240] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:42.638129  9446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1210) took 1672 ms. Trace:
I20260709 13:02:42.638566  9446 rpcz_store.cc:276] 0709 13:02:40.965670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.269882 (+1304212us) service_pool.cc:224] Handling call
0709 13:02:42.282622 (+ 12740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.284167 (+  1545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.284218 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:42.284284 (+    66us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:42.284335 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.637907 (+353572us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b540006b8d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:42.637957 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.638073 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2958592}
I20260709 13:02:42.640033  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:42.641549 10743 consensus_queue.cc:1059] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:42.646795  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:42.647904  9374 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:42.648411  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:42.649451  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.649783  9449 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:42.651508  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:42.650919  9418 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:42.652501  9372 raft_consensus.cc:1275] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:42.653972  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:42.655606 10908 consensus_queue.cc:1048] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:42.655969 10632 raft_consensus.cc:3055] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:42.656328 10632 raft_consensus.cc:740] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:42.657171 10967 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:42.657640 10967 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:42.652525  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.658573  9341 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:42.650962  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:42.660976  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:42.663342  9449 raft_consensus.cc:3060] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:02:42.663805  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:42.664261  9371 raft_consensus.cc:2376] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4. Re-sending same reply.
I20260709 13:02:42.669857  9418 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:42.666848 10879 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:02:42.667013 10778 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:02:42.667186 10641 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:42.678220 10641 raft_consensus.cc:697] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:42.679102 10641 consensus_queue.cc:237] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.659552 10967 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:42.679557  9418 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:42.684029 10816 consensus_queue.cc:1048] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:42.685915 10816 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:42.686689 10816 raft_consensus.cc:697] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:42.687974 10940 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.687744 10816 consensus_queue.cc:237] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.688670 10940 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.696661  9449 raft_consensus.cc:2468] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:42.696522  9446 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:42.697629  9443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1216) took 1643 ms. Trace:
I20260709 13:02:42.700538  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:42.701292  9449 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:42.699029  9443 rpcz_store.cc:276] 0709 13:02:41.054765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.451682 (+1396917us) service_pool.cc:224] Handling call
0709 13:02:42.452094 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.452370 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:42.475542 (+ 23172us) log.cc:844] Serialized 14 byte log entry
0709 13:02:42.697330 (+221788us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:42.697383 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:42.697422 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.697484 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.697582 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25025,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":357,"thread_start_us":221104,"threads_started":1}
I20260709 13:02:42.704355  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:42.705099  9452 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:42.705802  9490 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:42.628511 10750 consensus_queue.cc:237] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:42.653321 10824 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:42.698323  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:42.711977  9451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45366 (request call id 124) took 1773 ms. Trace:
I20260709 13:02:42.715189  9451 rpcz_store.cc:276] 0709 13:02:40.938373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.145572 (+1207199us) service_pool.cc:224] Handling call
0709 13:02:42.173058 (+ 27486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.187958 (+ 14900us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.187985 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:42.188023 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:42.188056 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.711718 (+523662us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b5400231254. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:42.711764 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.711915 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33770880}
I20260709 13:02:42.720101  9443 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:42.699393 10823 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:42.722646 10942 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:42.722859 10917 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:42.723367 10917 raft_consensus.cc:697] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:42.723279 10942 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.724423 10917 consensus_queue.cc:237] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.725533 10966 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:42.726099 10966 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.735500  9449 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:42.737066  9341 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:42.743199  9452 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:02:42.728188 10721 consensus_queue.cc:1059] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:02:42.690824  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:42.728776 10824 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.746146 10940 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:42.747383 10824 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:42.751217  9450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1215) took 1697 ms. Trace:
I20260709 13:02:42.714383 10822 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:42.752080 10822 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.752950 10967 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.755875 10967 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:42.756057 10826 consensus_queue.cc:1059] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:42.751637  9450 rpcz_store.cc:276] 0709 13:02:41.053593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.436362 (+1382769us) service_pool.cc:224] Handling call
0709 13:02:42.479021 (+ 42659us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:42.479393 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.479437 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:42.480115 (+   678us) log.cc:844] Serialized 26 byte log entry
0709 13:02:42.666118 (+186003us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:42.666353 (+   235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.666429 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:42.751007 (+ 84578us) raft_consensus.cc:1685] finished
0709 13:02:42.751027 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.751158 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27708,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":4262,"thread_start_us":167049,"threads_started":1,"wal-append.queue_time_us":264038}
I20260709 13:02:42.760861  9490 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:42.764076 10724 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:42.764657 10724 raft_consensus.cc:697] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:42.764791 10745 raft_consensus.cc:3055] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:42.765264 10745 raft_consensus.cc:740] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:42.765552  9444 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:42.765647 10724 consensus_queue.cc:237] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.766155 10745 consensus_queue.cc:260] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.767653 10745 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:42.770447  9343 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:42.759670  9418 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:42.766774 10721 raft_consensus.cc:3055] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:42.772948  9490 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
W20260709 13:02:42.738655 10952 log.cc:927] Time spent T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.365s	user 0.001s	sys 0.001s
I20260709 13:02:42.775946 10872 consensus_queue.cc:1048] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:42.788870  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:42.790452  9522 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:42.774866 10824 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:42.792064  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:02:42.773985 10927 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.012s	sys 0.030s
I20260709 13:02:42.775893  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:42.797961  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.797920  9443 raft_consensus.cc:1240] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 2 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:42.774915 10908 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:42.773996 10721 raft_consensus.cc:740] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:42.801595  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:42.774053 10940 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:42.777086 10967 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:42.781741 10918 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:42.785385 10575 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:42.782846 10749 consensus_queue.cc:1048] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:02:42.820349 10822 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:42.833441  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:42.834764  9375 raft_consensus.cc:2368] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 4.
I20260709 13:02:42.784724 10778 consensus_queue.cc:1059] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:02:42.836084  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:42.837145  9375 raft_consensus.cc:2393] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 4: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:42.837471 10778 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:42.837982  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:42.838959  9443 raft_consensus.cc:1275] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:42.839498 10940 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.839999  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:42.843297 10721 consensus_queue.cc:260] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.798153 10818 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:02:42.837522 10879 raft_consensus.cc:3055] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:42.845526 10879 raft_consensus.cc:740] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:42.846308 10879 consensus_queue.cc:260] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.847745 10879 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:42.801080 10677 consensus_queue.cc:1059] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:02:42.849344 10677 raft_consensus.cc:3055] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:42.849862 10677 raft_consensus.cc:740] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:42.850946 10677 consensus_queue.cc:260] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.852720 10824 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.853456 10824 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.852795 10826 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:02:42.830540 10908 raft_consensus.cc:697] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:42.859678  9447 raft_consensus.cc:1275] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:42.859148 10908 consensus_queue.cc:237] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.856328 10824 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:42.861881  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:42.863308  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:42.863942  9369 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
W20260709 13:02:42.866168  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.869279  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:42.871243  9447 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:42.873351  9447 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:42.876502  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:42.877216  9368 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:42.880491  9418 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:42.842293 10940 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:42.864843  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:42.885962  9450 raft_consensus.cc:1240] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:02:42.890146  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:42.828666 10918 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.829135 10575 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.867229 10670 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:42.874994 10721 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:42.914371  9418 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:42.829628 10942 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:42.879251 10806 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:42.892874 10677 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:42.823205 10927 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.012s	sys 0.031s
I20260709 13:02:42.900261  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:42.971349  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:42.971678  9522 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:42.887588 10947 raft_consensus.cc:2749] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:42.885484 10822 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.973063  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:42.883106 10791 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:42.867031 10967 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:42.985761  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:42.901298 10918 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:42.896651 10575 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:42.962060 10905 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:42.991753  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:42.990180  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:02:42.980154 10923 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:02:42.969826 10806 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:43.005475  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:43.029662  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 252150us
I20260709 13:02:43.030694  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:43.048391  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:43.015988  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 204269us
I20260709 13:02:43.049170  9522 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:43.049312  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:43.049908  9517 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:43.050128  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:43.051143  9368 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:43.055195  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:43.053565  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.057369  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:43.058555  9522 raft_consensus.cc:2393] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 3: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:43.057950 10905 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:43.059808  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:43.061842  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:43.062690  9524 raft_consensus.cc:2376] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4. Re-sending same reply.
I20260709 13:02:43.071422  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:43.076021  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:43.076665  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:42.994001 10822 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:43.050951 10806 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:43.084419  9524 raft_consensus.cc:1275] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:42.996127 10791 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:43.091754  9517 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:02:43.069943 10670 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:43.061033 10905 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:43.081902  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:43.113837  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:43.114861  9524 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:43.127279  9492 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:43.135967  9492 leader_election.cc:400] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 4.
W20260709 13:02:43.144778 10976 log.cc:927] Time spent T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:02:43.146828 10822 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:43.149117  9492 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:43.116793 10933 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.119151 10670 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:43.154901  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:43.155108 10670 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:43.120795 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:43.156025  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:43.156852  9377 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:43.158027  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:43.158793 10966 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:43.159121  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:43.160507  9377 raft_consensus.cc:1240] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:02:43.160622 10632 consensus_queue.cc:260] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:43.161723 10632 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:43.152088 10791 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:43.152369 10967 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:43.121033  9519 raft_consensus.cc:1240] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:43.166886  9373 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:43.168128  9373 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:43.170639 10724 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:43.179891  9444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1225) took 1190 ms. Trace:
I20260709 13:02:43.183800  9451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1235) took 1042 ms. Trace:
I20260709 13:02:43.194108  9370 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:02:43.180436  9444 rpcz_store.cc:276] 0709 13:02:41.989213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.509530 (+520317us) service_pool.cc:224] Handling call
0709 13:02:42.765198 (+255668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.766019 (+   821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.179613 (+413594us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b5400221850. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865698ad 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:43.179816 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":582972672}
I20260709 13:02:43.184340  9451 rpcz_store.cc:276] 0709 13:02:42.141561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.791956 (+650395us) service_pool.cc:224] Handling call
0709 13:02:42.813346 (+ 21390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.047069 (+233723us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:43.047102 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:43.047154 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:43.047183 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.183502 (+136319us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54001581d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:43.183561 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.183726 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":536999680}
I20260709 13:02:43.198729  9373 raft_consensus.cc:1240] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:43.196869  9445 raft_consensus.cc:1240] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:02:43.196872  9444 raft_consensus.cc:1240] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:43.202860  9368 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
W20260709 13:02:43.209743  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 60767.4us
I20260709 13:02:43.210975  9492 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:43.212628  9492 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:43.222522  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:43.204193 10905 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:43.223860  9526 raft_consensus.cc:1240] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:02:43.226428  9526 raft_consensus.cc:3055] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:43.226848  9526 raft_consensus.cc:740] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:43.227691  9526 consensus_queue.cc:260] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:43.228662  9526 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:43.214856 10808 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:43.203927 10778 consensus_queue.cc:1048] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:02:43.184859 10933 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:43.217031 10822 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:43.227414 10917 raft_consensus.cc:2804] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:43.220821 10908 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:02:43.275532  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 54623.8us
I20260709 13:02:43.208079 10918 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:43.227573 10915 consensus_queue.cc:1059] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:02:43.281342  9526 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:02:43.283607  9526 pending_rounds.cc:85] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 2
I20260709 13:02:43.284337  9526 pending_rounds.cc:107] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:02:43.282949  9273 catalog_manager.cc:5697] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 3 to 5, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 5 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:43.284713  9526 raft_consensus.cc:2889] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:43.260474 10917 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:43.289778  9525 raft_consensus.cc:1240] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:02:43.292080  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 70203us
I20260709 13:02:43.292119 10065 raft_consensus.cc:2393] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 2: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:02:43.272939 10908 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:43.290120 10917 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:43.279978 10905 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:02:43.322460 10918 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:43.333428 10995 log.cc:927] Time spent T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:02:43.335440 11000 consensus_queue.cc:1059] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 13:02:43.355659  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 62576.6us
I20260709 13:02:43.366681 10917 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:43.369966 10917 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:43.376317  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:43.377048  9377 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 2.
W20260709 13:02:43.379640 10981 log.cc:927] Time spent T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.256s	user 0.000s	sys 0.002s
I20260709 13:02:43.382712  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:43.388199  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:43.390250  9449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1229) took 1351 ms. Trace:
I20260709 13:02:43.390842  9449 rpcz_store.cc:276] 0709 13:02:42.038818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.736552 (+697734us) service_pool.cc:224] Handling call
0709 13:02:42.736859 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.737080 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:42.774504 (+ 37424us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.389855 (+615351us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:43.389916 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:43.389959 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.390024 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.390165 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":489497,"prepare.queue_time_us":37601,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"thread_start_us":133467,"threads_started":1,"wal-append.queue_time_us":133877}
W20260709 13:02:43.393324  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 478971us
W20260709 13:02:43.396332  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.409281 10933 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:43.410518  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 53834.8us
I20260709 13:02:43.413146  9492 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:43.414345  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:43.415398  9522 raft_consensus.cc:2393] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 4: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:43.420492  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:43.425228  9449 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:43.426052  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:43.428166  9418 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:43.430423 10027 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:02:43.432225  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:43.433249  9526 raft_consensus.cc:2393] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 6: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:43.442492  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:43.444038  9449 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:43.469839 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:43.437806 10915 consensus_queue.cc:1243] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:02:43.473815  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:43.474241  9446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1230) took 1419 ms. Trace:
I20260709 13:02:43.476603  9452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1231) took 1388 ms. Trace:
I20260709 13:02:43.480934  9374 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:43.481416  9452 rpcz_store.cc:276] 0709 13:02:42.088488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.744036 (+655548us) service_pool.cc:224] Handling call
0709 13:02:42.744363 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.744590 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:42.917605 (+173015us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.474875 (+557270us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:43.474943 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:43.475001 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.476273 (+  1272us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.476521 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":422759,"prepare.queue_time_us":89215,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"thread_start_us":283923,"threads_started":2,"wal-append.queue_time_us":226419}
I20260709 13:02:43.420097 11001 raft_consensus.cc:3055] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:43.481254  9342 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:43.480859  9446 rpcz_store.cc:276] 0709 13:02:42.054905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.741375 (+686470us) service_pool.cc:224] Handling call
0709 13:02:42.741745 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.741993 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:42.918002 (+176009us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.473579 (+555577us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.473796 (+   217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:43.473867 (+    71us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:43.473943 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.474023 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.474169 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":448524,"prepare.queue_time_us":73273,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":432692,"thread_start_us":264011,"threads_started":2,"wal-append.queue_time_us":227463}
I20260709 13:02:43.491779  9448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1219) took 1537 ms. Trace:
I20260709 13:02:43.492340  9448 rpcz_store.cc:276] 0709 13:02:41.954759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.499898 (+545139us) service_pool.cc:224] Handling call
0709 13:02:42.500241 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.500471 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:42.508002 (+  7531us) log.cc:844] Serialized 14 byte log entry
0709 13:02:42.627568 (+119566us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b18003fc280. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58345fe07 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b 00007fb586109d23 00007fb58610a23a 00007fb586574a2a
0709 13:02:43.491354 (+863786us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:43.491410 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:43.491465 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.491562 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.491705 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":574808,"prepare.queue_time_us":7359,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":3151,"spinlock_wait_cycles":2539392,"thread_start_us":288724,"threads_started":1,"wal-append.queue_time_us":537552}
I20260709 13:02:43.461520 11000 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.467878 10917 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.469050 10933 raft_consensus.cc:2804] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:02:43.511615  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 83482.9us
I20260709 13:02:43.352866 11003 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.145s
W20260709 13:02:43.523018  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.516791  9418 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:43.479049 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:43.486997 10947 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:43.439195 10822 consensus_queue.cc:1059] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:02:43.486106 11001 raft_consensus.cc:740] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:43.512037 10905 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:02:43.549551 11005 log.cc:927] Time spent T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:02:43.566267 10908 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:43.566264  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 153218us
W20260709 13:02:43.583851  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 123717us
I20260709 13:02:43.562667  9444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:58918 (request call id 2) took 2726 ms. Trace:
I20260709 13:02:43.513278 10933 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:43.564558 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 139803us
I20260709 13:02:43.522430 10632 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.584409  9444 rpcz_store.cc:276] 0709 13:02:40.815344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.488501 (+2673157us) service_pool.cc:224] Handling call
0709 13:02:43.538448 (+ 49947us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:43.502274 10575 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:43.582911  9449 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
W20260709 13:02:43.583184  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 65777.6us
I20260709 13:02:43.513836 11009 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.525727 10942 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:02:43.549942 10993 log.cc:927] Time spent T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:02:43.623548  9418 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:43.627513  9418 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:43.568655 10677 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:43.523428 11000 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:43.588786 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 157407us
W20260709 13:02:43.606752  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.520517 10917 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:43.603350 11011 log.cc:927] Time spent T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:02:43.586146 10822 consensus_queue.cc:1243] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:02:43.589828 10774 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:43.639111  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.590061 10828 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.605660 10632 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:43.667773 10828 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:43.589522 10933 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:43.629205 11008 log.cc:927] Time spent T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:02:43.670372 10828 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:43.672478 10632 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:43.648521  9375 raft_consensus.cc:2393] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 5: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:43.631587 10836 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:43.655028  9418 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:43.594743 11004 consensus_queue.cc:1059] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 13:02:43.641983 10942 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:43.686837  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 45403us
I20260709 13:02:43.645164 10808 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:43.641739 10743 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.674264 10937 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:43.692389 10774 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:43.697608 10743 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:43.698444 10774 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.698973 10774 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:43.700489  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 116239us
W20260709 13:02:43.700884  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:43.702486  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 246250us
I20260709 13:02:43.696871  9418 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:43.680183 10670 consensus_queue.cc:1059] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:02:43.632584 11009 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:43.721256 11000 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:43.704579 10806 consensus_meta.cc:287] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.004s
I20260709 13:02:43.636023 10641 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:02:43.737026 10721 consensus_queue.cc:1048] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:43.745399  9449 raft_consensus.cc:1240] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:43.745640 10069 raft_consensus.cc:1275] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:43.742460  9451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 864) took 1082 ms. Trace:
I20260709 13:02:43.747231  9451 rpcz_store.cc:276] 0709 13:02:42.660115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.215873 (+555758us) service_pool.cc:224] Handling call
0709 13:02:43.235811 (+ 19938us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:43.490277 (+254466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:43.490308 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:43.490749 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:02:43.671296 (+180547us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:43.671353 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.671449 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:43.742021 (+ 70572us) raft_consensus.cc:1685] finished
0709 13:02:43.742044 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.742380 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":286901,"raft.queue_time_us":258597,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":15391,"thread_start_us":180225,"threads_started":1,"wal-append.queue_time_us":247051}
I20260709 13:02:43.750562  9451 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:43.757669 10575 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:43.758615 10632 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:43.760885 10933 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:43.763490 10933 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:43.765448 10641 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.765820 10759 consensus_queue.cc:1048] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:43.765981 10641 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:43.767788 10698 raft_consensus.cc:3055] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:43.768189 10698 raft_consensus.cc:740] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:43.768350 10641 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:43.736436 10950 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:43.769153 10698 consensus_queue.cc:260] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:43.774274  9448 raft_consensus.cc:1275] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:43.702702 10937 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:43.776871 10065 raft_consensus.cc:2368] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
W20260709 13:02:43.795279 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 154937us
I20260709 13:02:43.735574 10806 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:43.794556 10698 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:43.811312  9418 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:43.816542  9418 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:43.821303  9443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1249) took 1296 ms. Trace:
I20260709 13:02:43.821731  9443 rpcz_store.cc:276] 0709 13:02:42.525432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.999923 (+474491us) service_pool.cc:224] Handling call
0709 13:02:43.048674 (+ 48751us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:43.466025 (+417351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:43.466068 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:43.471594 (+  5526us) log.cc:844] Serialized 26 byte log entry
0709 13:02:43.643985 (+172391us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:43.644029 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.644127 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:43.821085 (+176958us) raft_consensus.cc:1685] finished
0709 13:02:43.821103 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.821233 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":455090,"raft.queue_time_us":417710,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":9474,"thread_start_us":171150,"threads_started":1,"wal-append.queue_time_us":315191}
I20260709 13:02:43.802201 10721 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.809796 10670 consensus_queue.cc:1048] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
W20260709 13:02:43.827961 11007 log.cc:927] Time spent T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:02:43.800263 10759 consensus_queue.cc:1059] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:02:43.829139 10759 raft_consensus.cc:3055] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:43.829528 10759 raft_consensus.cc:740] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:43.830235 10937 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:43.830399 10759 consensus_queue.cc:260] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:43.831959 10759 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:43.833292 11023 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:43.833583  9518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1143) took 1039 ms. Trace:
I20260709 13:02:43.810997 10990 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:02:43.835265 10918 raft_consensus.cc:3055] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:43.835667 10918 raft_consensus.cc:740] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:43.834112  9518 rpcz_store.cc:276] 0709 13:02:42.794607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.798760 (+  4153us) service_pool.cc:224] Handling call
0709 13:02:43.409732 (+610972us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b5800188498. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b543fc0 00007fb58b52e929 00007fb58b52e3d2 00007fb584aa5bd4
0709 13:02:43.410052 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.410394 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:43.410839 (+   445us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.804383 (+393544us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.825370 (+ 20987us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:43.830603 (+  5233us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b180039dea0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58347d3f3 00007fb58347f7c1 00007fb58347f779 00007fb58347f709 00007fb58347f6d1 00007fb58347e9cd 000000000038f354 000000000038f199 00007fb58346083a
0709 13:02:43.833120 (+  2517us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:43.833290 (+   170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.833373 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.833519 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12742,"prepare.queue_time_us":9330,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":93,"raft.queue_time_us":16813,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":3445,"spinlock_wait_cycles":17028608,"thread_start_us":372966,"threads_started":1}
I20260709 13:02:43.850042  9418 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:43.852550  9418 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:43.816180 10950 raft_consensus.cc:2749] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:43.861335 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 275856us
I20260709 13:02:43.821336 11009 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:43.867581  9418 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:43.858206 11023 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:43.861857 10937 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:43.887094  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:43.887653  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:43.888484  9377 raft_consensus.cc:1240] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:43.890267  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:43.891291  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:43.886305  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:43.900595  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:43.891889  9376 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:43.841895 10721 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:43.903487  9372 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:43.874689 10942 consensus_queue.cc:1048] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:02:43.836630 10918 consensus_queue.cc:260] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:43.904353  9371 raft_consensus.cc:2393] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 3: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:43.879314  9418 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:43.959342  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 80107.3us
I20260709 13:02:43.910137  9368 raft_consensus.cc:1275] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:43.933902  9377 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:02:43.963320  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:43.964731  9418 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:43.970283  9371 raft_consensus.cc:1240] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:02:43.971560  9418 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:02:43.973963 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 176361us
I20260709 13:02:43.974042  9418 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:43.974753 10027 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:43.975478  9418 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:43.976593  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:43.977380  9526 raft_consensus.cc:2393] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 5: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:43.978155  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:43.978729  9526 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:43.902387 11014 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.910409  9370 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:02:43.993481  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:43.922480 10721 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:43.984092  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:43.981247  9492 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:43.999264  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:43.981959  9376 raft_consensus.cc:1275] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:43.922477 10806 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:43.991925  9377 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:43.904717 11021 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:44.005888  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:44.006778  9368 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:43.988090  9371 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:43.905108 10937 raft_consensus.cc:697] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:43.985409 10823 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:43.990077 10918 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:43.995177  9323 auto_rebalancer.cc:893] Removing replace marker failed: Replica d62c9d5a052b42ce8675f8438f846526 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:43.997040  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:44.091038  9323 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:02:44.009987 11025 log.cc:927] Time spent T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:02:43.999920  9522 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:43.963955 10950 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:44.001874  9492 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:43.990830  9490 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:43.979182 10940 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:43.973616 10828 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:43.986253 10939 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:44.089979  9343 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:44.092224  9526 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:44.000003  9372 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:44.000741 11031 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:43.970135 10774 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:44.109911  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 108094us
I20260709 13:02:43.992615 11000 consensus_queue.cc:1059] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 13:02:44.014098 11004 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:44.003669 10966 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:44.091411  9323 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 13:02:44.101022 10997 log.cc:927] Time spent T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:02:44.101855 10950 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.221022 11013 raft_consensus.cc:2804] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:43.999926 11014 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.014036 10908 raft_consensus.cc:476] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 13:02:44.009344  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:44.012050 10823 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:44.223982 10939 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:44.227559 11028 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:44.228132 11017 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.268152 11017 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.228760 11016 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.273699 11016 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.275959 11016 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.229492 11030 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.093621  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:44.102026 10724 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.277520 10724 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.279673 10724 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:44.220470 10994 log.cc:927] Time spent T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
W20260709 13:02:44.217092  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 226317us
I20260709 13:02:44.280872  9490 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:44.246498 10774 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.254941  9373 raft_consensus.cc:2410] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:44.223062 10808 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:44.282554 10808 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:44.285475 10808 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:44.226372 11004 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.286080 11004 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:44.287051 11001 consensus_queue.cc:260] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.265666 10939 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:44.269134 11028 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:44.293298 11028 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:44.294209  9518 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:44.294762 10774 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.264021 10823 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:44.295560 10774 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.298318 10774 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.272768 11017 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.235092 10966 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.303625 10966 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.309916 10939 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.264607 10908 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:02:44.312467 10939 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.280817 11030 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.254033  9372 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 3.
I20260709 13:02:44.264729 10937 consensus_queue.cc:237] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.314918 11030 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.316068 11028 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.318398 11028 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:44.319226 11004 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.320631 11013 raft_consensus.cc:697] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:44.321288 11004 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:44.251019 10950 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:44.256373 10641 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:44.324113 11034 log.cc:927] Time spent T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:02:44.323904 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:44.326121  9450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 859) took 1712 ms. Trace:
I20260709 13:02:44.326547  9450 rpcz_store.cc:276] 0709 13:02:42.613842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.171441 (+557599us) service_pool.cc:224] Handling call
0709 13:02:43.171750 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:43.478895 (+307145us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:02:43.478926 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:43.485315 (+  6389us) log.cc:844] Serialized 26 byte log entry
0709 13:02:43.869939 (+384624us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:43.869982 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.870063 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:44.325876 (+455813us) raft_consensus.cc:1685] finished
0709 13:02:44.325904 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.326054 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":334009,"raft.queue_time_us":319214,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":15487,"thread_start_us":384264,"threads_started":1,"wal-append.queue_time_us":507480}
I20260709 13:02:44.324762 10641 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.329123 10641 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:44.329460 11013 consensus_queue.cc:237] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:44.338930  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:44.340602  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:44.340863  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 75906.2us
I20260709 13:02:44.307673 11023 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:44.341495  9448 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
W20260709 13:02:44.342197  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.342085  9443 raft_consensus.cc:1275] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:44.343699  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:44.343837  9445 raft_consensus.cc:1275] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:02:44.345026  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 51297.3us
I20260709 13:02:44.352085  9418 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:44.383214  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:44.263007 10940 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:44.388156 11004 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:44.389245 10828 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:44.389334 11004 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.356132 10774 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:44.390491 10774 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.395187  9450 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:02:44.386931 10823 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.332602 10942 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.389797 10828 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.399266 10828 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:44.344877 10806 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.355443 10939 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.392781 10774 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.387069 10950 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.344485 10724 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:44.417812  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:44.390395 11004 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.412464 10774 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:44.380360 11028 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:44.388765 10940 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.403388 10942 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.420598  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:02:44.422209  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 141447us
W20260709 13:02:44.428974  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 339048us
I20260709 13:02:44.429245  9490 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:44.431638  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 212135us
I20260709 13:02:44.430958  9490 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:44.434480  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:02:44.422559 10759 consensus_meta.cc:287] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.587s	user 0.005s	sys 0.007s
I20260709 13:02:44.404533 11023 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:02:44.412864 11044 consensus_queue.cc:1048] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:02:44.419412 10966 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:44.407514 10806 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.411171 10939 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.417865 10724 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:44.464308 11042 log.cc:927] Time spent T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:02:44.465785 10942 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.470418  9524 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:02:44.470822  9524 pending_rounds.cc:85] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 1
I20260709 13:02:44.471064  9524 pending_rounds.cc:107] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:02:44.471269  9524 raft_consensus.cc:2889] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:44.464365 10641 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.475283  9372 raft_consensus.cc:2393] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 5: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:44.476580 10641 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.477499 11004 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:44.478202 10940 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.473280 10950 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.454715  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:44.436764 11028 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:44.546784 10774 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.547547 10774 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:44.478457 11014 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:44.520706  9368 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:02:44.488803 11004 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:44.454308 10966 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
W20260709 13:02:44.624074  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 191520us
I20260709 13:02:44.617036 10774 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:02:44.642704  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 253546us
I20260709 13:02:44.651921  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:44.629205 10823 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:44.663882  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 232982us
I20260709 13:02:44.641070 11049 consensus_queue.cc:1059] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:02:44.667057 10942 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.679327  9343 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:44.663973 11052 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:44.681051 10966 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.666965 10774 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:44.677893 11049 consensus_queue.cc:1243] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:02:44.670011 10872 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:44.676529 11013 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:44.683068 11028 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:44.686434 11047 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:44.690171 11047 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.689908 10872 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.690578 11047 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:44.690361 11013 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.690112 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:44.691547  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:44.676987 10743 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.686636 10724 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.688951  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:44.696663 11013 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:44.686667 10828 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.670514 11046 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:02:44.701543 10966 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:44.702117 10966 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.702672 10828 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.707101 10966 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.697639 10939 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.684949 10774 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.711452  9521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1159) took 1183 ms. Trace:
I20260709 13:02:44.711843  9521 rpcz_store.cc:276] 0709 13:02:43.528486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.530073 (+  1587us) service_pool.cc:224] Handling call
0709 13:02:43.580991 (+ 50918us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:43.604687 (+ 23696us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:43.635027 (+ 30340us) log.cc:844] Serialized 14 byte log entry
0709 13:02:44.413562 (+778535us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b18002d2320. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58345fe07 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b 00007fb586109d23 00007fb58610a23a 00007fb586574a2a
0709 13:02:44.545800 (+132238us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:44.546330 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:02:44.546456 (+   126us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:44.546486 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.546560 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:44.711120 (+164560us) raft_consensus.cc:1685] finished
0709 13:02:44.711226 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.711366 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49932,"prepare.queue_time_us":30262,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":16228,"raft.queue_time_us":194004,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":28600,"spinlock_wait_cycles":4987136,"thread_start_us":92530,"threads_started":1,"wal-append.queue_time_us":1035023}
I20260709 13:02:44.694710 10872 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.716866  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:44.712260 10774 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.709067 11013 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.719432 10872 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:44.719728 11013 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.720062 10872 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:44.721560  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:44.688481 10942 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.728667 10872 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:44.727128 11047 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.730501 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:44.732329 11047 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:44.733191  9375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52548 (request call id 935) took 1973 ms (client timeout 1818 ms). Trace:
W20260709 13:02:44.733691  9375 rpcz_store.cc:269] 0709 13:02:42.759609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.839780 (+ 80171us) service_pool.cc:224] Handling call
0709 13:02:44.732931 (+1893151us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b54001b0154. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:44.733109 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1857025792}
I20260709 13:02:44.736223 11013 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:44.738873 10942 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.741590  9273 catalog_manager.cc:5697] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 2 to 3, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 3 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.745102  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:44.732069  9275 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43252 (request call id 166) took 9446 ms. Trace:
I20260709 13:02:44.749310  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:44.749650  9273 catalog_manager.cc:5697] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 1 to 3, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 3 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.756073  9449 raft_consensus.cc:1240] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:02:44.766660  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:44.757326 10967 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:44.767414  9376 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:44.767951 10967 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.770215 10967 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.758208  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:44.758625  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:44.758879 11054 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:44.772565 11054 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.773368 10818 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:44.774101 10818 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.776311 10818 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.776356 11054 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.779165 10917 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:44.784441  9376 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:44.789149  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:44.795287  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:44.795794  9450 raft_consensus.cc:1240] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:02:44.808893 11047 consensus_queue.cc:1059] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:44.759017  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:44.759267  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:44.759660 10939 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.815948 10939 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:44.818024 11041 log.cc:927] Time spent T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.540s	user 0.010s	sys 0.019s
I20260709 13:02:44.818222  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:44.818413 10939 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.761129  9446 raft_consensus.cc:1240] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:02:44.818935  9448 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:44.820060  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:44.820992  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:44.821201  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:44.762483  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:44.821851  9375 raft_consensus.cc:2393] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 4: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:44.822244  9452 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:44.822777 10806 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.822964  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:44.823218  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:44.824214  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:44.762560  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:44.825734  9370 raft_consensus.cc:2410] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:44.763963  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:44.826402  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:44.827567  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:44.828657  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:44.829543 10947 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:44.830031 10947 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:44.832204 11010 log.cc:927] Time spent T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 1.128s	user 0.007s	sys 0.009s
I20260709 13:02:44.832912 10806 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.833586 10806 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.834281  9447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45366 (request call id 129) took 2355 ms. Trace:
I20260709 13:02:44.749557  9445 raft_consensus.cc:1275] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:44.835608  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:44.835824 10806 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:44.834728  9447 rpcz_store.cc:276] 0709 13:02:42.479003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.884604 (+405601us) service_pool.cc:224] Handling call
0709 13:02:42.894438 (+  9834us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:43.362749 (+468311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:43.362795 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:43.363478 (+   683us) log.cc:844] Serialized 26 byte log entry
0709 13:02:43.575651 (+212173us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:43.598871 (+ 23220us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.599156 (+   285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.599255 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:44.820312 (+1221057us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:02:44.833906 (+ 13594us) raft_consensus.cc:1685] finished
0709 13:02:44.834042 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.834210 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":467813,"prepare.queue_time_us":27066,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":474131,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":248,"spinlock_wait_cycles":6124800,"thread_start_us":211685,"threads_started":1,"wal-append.queue_time_us":271336}
I20260709 13:02:44.836241  9445 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:44.836915  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:44.839378  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:44.839857  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:44.841188  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:44.736819 11013 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:44.841931 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 44261.3us
I20260709 13:02:44.821847  9446 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:44.843327  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:44.841361  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:44.844278  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:44.843374 10027 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
W20260709 13:02:44.845781 10065 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45690 (request call id 89) took 1432 ms (client timeout 1812 ms). Trace:
I20260709 13:02:44.770707 11001 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:44.846231 10065 rpcz_store.cc:269] 0709 13:02:43.413441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.422986 (+  9545us) service_pool.cc:224] Handling call
0709 13:02:44.844004 (+1421018us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b540017d254. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:44.845690 (+  1686us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":559188736}
I20260709 13:02:44.847429 11013 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.849735  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:44.824694  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:44.837872 10806 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:02:44.851631  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.845188  9418 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:44.850557  9445 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:44.830010  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:44.859570  9418 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:44.864171  9452 raft_consensus.cc:2393] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 4: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:44.864646  9448 raft_consensus.cc:2393] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 4: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:44.868319  9447 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:44.877399  9452 raft_consensus.cc:1275] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:44.877231  9418 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:44.881493  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:44.882486  9523 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:44.891157  9341 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:44.866463 10942 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:44.898689  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:44.869987 11015 raft_consensus.cc:2804] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:44.888876  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:44.915216  9341 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:44.899515  9370 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:02:44.923975  9520 raft_consensus.cc:2410] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:44.924789  9418 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:44.926312  9521 raft_consensus.cc:1240] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:44.748878  9275 rpcz_store.cc:276] 0709 13:02:35.286111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.286242 (+   131us) service_pool.cc:224] Handling call
0709 13:02:44.731995 (+9445753us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:38.742317 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:38.743088 (+   771us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:38.743139 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:02:38.749132 (+  5993us) tablet.cc:662] Decoding operations
0709 13:02:38.825456 (+ 76324us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:38.825514 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:38.825541 (+    27us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:02:38.826292 (+   751us) tablet.cc:701] Row locks acquired
0709 13:02:38.826317 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:02:38.826468 (+   151us) write_op.cc:270] Start()
0709 13:02:38.826592 (+   124us) write_op.cc:276] Timestamp: P: 1783602158826424 usec, L: 0
0709 13:02:38.826615 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:02:38.846380 (+ 19765us) log.cc:844] Serialized 2427 byte log entry
0709 13:02:39.125780 (+279400us) op_driver.cc:464] REPLICATION: finished
0709 13:02:39.577072 (+451292us) write_op.cc:301] APPLY: starting
0709 13:02:39.577157 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:39.577356 (+   199us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:39.577491 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:39.654186 (+ 76695us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:39.676090 (+ 21904us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:02:39.693113 (+ 17023us) write_op.cc:312] APPLY: finished
0709 13:02:39.693456 (+   343us) log.cc:844] Serialized 52 byte log entry
0709 13:02:39.770838 (+ 77382us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:39.780339 (+  9501us) write_op.cc:454] Released schema lock
0709 13:02:39.782741 (+  2402us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:39.813593 (+ 30852us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:39.817395 (+  3802us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6080,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":451009,"apply.run_cpu_time_us":6921,"apply.run_wall_time_us":223167,"num_ops":6,"prepare.queue_time_us":300727,"prepare.run_cpu_time_us":4704,"prepare.run_wall_time_us":120261,"raft.queue_time_us":126298,"raft.run_cpu_time_us":29593,"raft.run_wall_time_us":230233,"replication_time_us":299002,"thread_start_us":427993,"threads_started":3,"wal-append.queue_time_us":3140,"wal-append.run_cpu_time_us":21417,"wal-append.run_wall_time_us":1965498}]]}
I20260709 13:02:44.917428 10824 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:44.931468 10745 consensus_queue.cc:1048] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:02:44.934878 11019 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:44.935348 11019 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.935101 10824 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.935743 11019 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:44.889869 11046 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:44.937109  9341 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:44.942900  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:44.889046 10939 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:44.947402  9520 raft_consensus.cc:1275] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:44.951231  9377 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:44.953763  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:44.954913  9377 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:44.913093 10990 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:44.955796  9418 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:44.937438 11054 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:44.959554  9418 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:44.893352 10759 consensus_queue.cc:1059] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:02:44.942787  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:44.939565 11015 raft_consensus.cc:697] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 3 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:02:44.940851 11047 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:44.884025 11052 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:02:44.968950  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:44.969887 10818 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.985491 10818 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:44.961947 10872 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:44.973606 10816 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:44.944854 10942 raft_consensus.cc:697] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:44.975348  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:44.978793  9445 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:44.979921 10299 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:44.982946  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:44.955406 11046 raft_consensus.cc:697] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:44.984047 11047 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.984270 10698 consensus_queue.cc:1048] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:02:44.964476 10939 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:44.966307 11054 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.982326 10774 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:44.998867  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:45.009423  9517 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:02:45.013078  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:45.021247  9526 raft_consensus.cc:2393] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 4: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:45.013680  9524 raft_consensus.cc:2393] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 4: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:45.014469  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:45.012254  9523 raft_consensus.cc:2410] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:45.019641 11054 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:44.983932  9518 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:45.033636  9521 raft_consensus.cc:2393] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 6: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
W20260709 13:02:45.019901 11057 log.cc:927] Time spent T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:02:45.005088 10872 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.037526  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:45.019817 10939 raft_consensus.cc:697] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:45.011170 10943 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.007519 11013 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:45.018216 11047 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:45.040588  9526 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:45.004797 10816 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:45.041447 10872 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:45.043426 10816 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:44.963697 10990 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:45.049043 10990 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:45.049214 10824 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:45.049477 10939 consensus_queue.cc:237] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.050431 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:45.052408  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:45.055749  9526 raft_consensus.cc:2410] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:45.059064 10942 consensus_queue.cc:237] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.062011  9377 raft_consensus.cc:1240] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:45.075407  9452 raft_consensus.cc:1240] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:02:45.080181  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:45.081095  9341 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:45.037109 10774 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.055436 11046 consensus_queue.cc:237] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.094910  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:45.095577  9526 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:02:45.045445 10943 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:45.102136  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:45.087617 10698 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:44.996992 11019 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.105576  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:45.107227  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:45.107986  9523 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:45.083823 10806 consensus_queue.cc:1059] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:02:45.083300 11015 consensus_queue.cc:237] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:45.118455  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:45.119305  9523 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 1.
I20260709 13:02:45.122619  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:45.123473  9524 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:45.122016  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:45.127000 10966 raft_consensus.cc:3055] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:45.127434 10966 raft_consensus.cc:740] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:45.128278 10966 consensus_queue.cc:260] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.125440  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:45.130419  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:45.113431 10698 raft_consensus.cc:697] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:45.145364  9491 leader_election.cc:400] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Vote denied by peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623) with higher term. Message: Invalid argument: T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3.
I20260709 13:02:45.147023  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:45.152668  9418 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:45.154410  9418 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:02:45.164283  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 81615.7us
I20260709 13:02:45.174618  9418 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:45.141983 10818 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:45.136567 11054 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.156363 10966 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:45.201534  9492 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.003s	sys 0.018s
I20260709 13:02:45.153909 10824 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:45.197245  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:45.154928 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:45.195683  9526 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:45.211568  9418 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:02:45.213588  9492 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.003s	sys 0.019s
W20260709 13:02:45.214030  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 577735us
I20260709 13:02:45.163095  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:45.186399 10823 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:45.198477 11014 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.000s	sys 0.020s
I20260709 13:02:45.235067  9341 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:45.238962  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:45.239638  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:45.240826  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:45.241990  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:45.242264 10299 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:45.242955  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:45.245253  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:45.245986  9375 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:45.246621  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:45.261998  9490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.018s	sys 0.014s
I20260709 13:02:45.262961  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:45.266638  9490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.018s	sys 0.015s
I20260709 13:02:45.266985  9448 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:45.274765  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:45.199976 11044 consensus_queue.cc:1059] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:02:45.188689 11017 consensus_queue.cc:1059] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
W20260709 13:02:45.230072 11004 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.029s	sys 0.057s
W20260709 13:02:45.257277 11014 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.000s	sys 0.021s
W20260709 13:02:45.230494 11016 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.009s	sys 0.021s
I20260709 13:02:45.206875 11055 consensus_queue.cc:1048] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
W20260709 13:02:45.293413 11004 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.029s	sys 0.058s
I20260709 13:02:45.269515 10848 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:02:45.311800 11016 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.009s	sys 0.022s
W20260709 13:02:45.296300 10641 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.011s	sys 0.014s
I20260709 13:02:45.281148 11026 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:45.316542  9273 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.018s	sys 0.005s
I20260709 13:02:45.297142 10823 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:45.333220 11004 raft_consensus.cc:697] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:45.232173 10698 consensus_queue.cc:237] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.344363 10848 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:45.347934 11049 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.304898 11044 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:45.353511  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:45.355693  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:45.348629  9273 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.019s	sys 0.005s
I20260709 13:02:45.350412 11026 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.351109 10823 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:45.358701 11004 consensus_queue.cc:237] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.359668 11065 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.360936  9523 raft_consensus.cc:1275] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:45.371353  9492 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
W20260709 13:02:45.426705  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 55463.6us
I20260709 13:02:45.428102  9492 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:45.354897 11013 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:45.429229 10915 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:45.429596 11013 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.430239 10915 raft_consensus.cc:2804] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:45.430809 10915 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.431330 10915 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:45.368927 11059 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:45.375450 11064 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.407153  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:45.443042  9524 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:45.407527  9522 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:45.414467 11026 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:45.407984 10823 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:45.345938 10905 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:45.371121 11019 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:45.408908 11049 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.374687 11062 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:45.348795 10774 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:45.348120 10641 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.012s	sys 0.014s
I20260709 13:02:45.435456 11054 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:45.436627  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:45.392088 10947 consensus_meta.cc:287] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.562s	user 0.008s	sys 0.001s
W20260709 13:02:45.384754 11001 consensus_meta.cc:287] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.538s	user 0.011s	sys 0.000s
I20260709 13:02:45.432662 11013 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:45.477555  9523 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:45.371769 11014 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:45.448390  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:45.434293 11047 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.453466 11051 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.408749 11055 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.485963  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:45.406018 11044 raft_consensus.cc:3055] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:45.487037  9526 raft_consensus.cc:2393] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 4: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
W20260709 13:02:45.484831 11021 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.270s	user 0.013s	sys 0.011s
W20260709 13:02:45.461042  9449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.016s	sys 0.014s
W20260709 13:02:45.467079 10677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.023s	sys 0.046s
I20260709 13:02:45.480535  9522 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:45.437515 11059 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:45.467130 10749 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.015s	sys 0.006s
I20260709 13:02:45.462479 10905 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:45.497960  9449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.016s	sys 0.014s
I20260709 13:02:45.498581  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:45.459836  9524 raft_consensus.cc:1240] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
W20260709 13:02:45.506258  9450 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.000s	sys 0.021s
I20260709 13:02:45.507117  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:45.507658  9450 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.000s	sys 0.022s
I20260709 13:02:45.498837  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:45.509146  9522 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:45.490367 11044 raft_consensus.cc:740] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:02:45.499886 11000 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.238s	user 0.015s	sys 0.027s
I20260709 13:02:45.474717 10947 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:45.497613 11021 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.286s	user 0.014s	sys 0.012s
W20260709 13:02:45.500128  9451 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.016s	sys 0.025s
W20260709 13:02:45.525101  9451 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.017s	sys 0.025s
W20260709 13:02:45.502959 10749 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.015s	sys 0.006s
W20260709 13:02:45.502774 10677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.024s	sys 0.046s
W20260709 13:02:45.523855  9446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.012s	sys 0.039s
W20260709 13:02:45.542706  9446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.012s	sys 0.039s
W20260709 13:02:45.518810  9525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.014s	sys 0.036s
W20260709 13:02:45.559158  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:45.601465  9525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.024s	sys 0.056s
W20260709 13:02:45.519506 11000 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.264s	user 0.016s	sys 0.028s
I20260709 13:02:45.535516 10915 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.499457 10918 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.438364 11065 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.489773 11051 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.540107 10759 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:45.541107  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:45.483031 11014 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.489939 10872 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.536775 11021 raft_consensus.cc:697] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:45.513537 10641 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:45.601073  9372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.000s	sys 0.020s
I20260709 13:02:45.499845  9519 raft_consensus.cc:1275] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:02:45.455168 11064 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.464908 11062 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.537066 10828 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:02:45.632108  9372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.000s	sys 0.020s
I20260709 13:02:45.492134 11055 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.622252 11066 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:45.661512  9526 raft_consensus.cc:1240] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
W20260709 13:02:45.639319  9374 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.015s	sys 0.041s
I20260709 13:02:45.640555  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:02:45.662129  9374 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.016s	sys 0.041s
I20260709 13:02:45.660777  9375 raft_consensus.cc:2393] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 3: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:45.671222  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:45.668339  9522 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:45.672435  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:45.674948  9520 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.053s	sys 0.073s
W20260709 13:02:45.675316  9520 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.053s	sys 0.073s
W20260709 13:02:45.675406  9373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.012s	sys 0.046s
W20260709 13:02:45.676066  9373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.012s	sys 0.046s
I20260709 13:02:45.628258 10918 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:45.709087 10069 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.013s	sys 0.049s
W20260709 13:02:45.709470 10069 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.013s	sys 0.049s
I20260709 13:02:45.634969 10759 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.518023 10816 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:45.637178 11053 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.006s	sys 0.024s
I20260709 13:02:45.632805  9519 pending_rounds.cc:85] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 1
W20260709 13:02:45.737682  9447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.002s	sys 0.033s
W20260709 13:02:45.738181  9447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.002s	sys 0.033s
I20260709 13:02:45.639114 10641 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:02:45.711126 10025 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.005s	sys 0.033s
I20260709 13:02:45.717123 10069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 176) took 1251 ms. Trace:
W20260709 13:02:45.717631 10942 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.010s	sys 0.027s
I20260709 13:02:45.752336 10069 rpcz_store.cc:276] 0709 13:02:44.458488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.458768 (+   280us) service_pool.cc:224] Handling call
0709 13:02:44.459244 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.459543 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:44.857115 (+397572us) log.cc:844] Serialized 14 byte log entry
0709 13:02:45.709753 (+852638us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:45.709826 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:45.709883 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.709973 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.710119 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30777,"prepare.queue_time_us":1016740,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":3770,"raft.queue_time_us":70946,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":9755,"thread_start_us":1180122,"threads_started":2}
W20260709 13:02:45.758858 10025 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.005s	sys 0.033s
W20260709 13:02:45.718043  9368 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.997s	user 0.000s	sys 0.049s
W20260709 13:02:45.608227 10937 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.292s	user 0.012s	sys 0.016s
W20260709 13:02:45.737497 11053 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.007s	sys 0.025s
I20260709 13:02:45.745399  9519 pending_rounds.cc:107] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 2.2
W20260709 13:02:45.774290  9443 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.010s	sys 0.014s
W20260709 13:02:45.805732  9443 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.010s	sys 0.014s
W20260709 13:02:45.636998 10836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.320s	user 0.014s	sys 0.028s
I20260709 13:02:45.713024 10848 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:45.759606  9368 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.000s	sys 0.050s
I20260709 13:02:45.665782 11066 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.818596  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:45.801378  9418 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.013s	sys 0.013s
W20260709 13:02:45.801314 10027 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.917s	user 0.012s	sys 0.009s
I20260709 13:02:45.823256  9368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 955) took 1123 ms. Trace:
I20260709 13:02:45.647253 11044 consensus_queue.cc:260] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.755725 11047 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:45.738196 11021 consensus_queue.cc:237] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:46.004103  9372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 970) took 1106 ms. Trace:
I20260709 13:02:45.987903  9449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1276) took 1230 ms. Trace:
I20260709 13:02:46.175028  9449 rpcz_store.cc:276] 0709 13:02:44.757771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.765806 (+  8035us) service_pool.cc:224] Handling call
0709 13:02:44.766100 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.766463 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.766494 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:44.766951 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:02:45.504035 (+737084us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:45.504091 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.504185 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:45.987686 (+483501us) raft_consensus.cc:1685] finished
0709 13:02:45.987707 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.987843 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4280,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":736668,"threads_started":1,"wal-append.queue_time_us":1100364}
W20260709 13:02:46.161391  9418 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.018s	sys 0.016s
W20260709 13:02:46.183823  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 972224us
I20260709 13:02:46.161720  9448 raft_consensus.cc:2393] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 in current term 4: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:46.185124  9418 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:46.102909  9373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 972) took 1202 ms. Trace:
W20260709 13:02:45.784690 10937 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.445s	user 0.013s	sys 0.016s
W20260709 13:02:46.171358 10027 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.287s	user 0.018s	sys 0.010s
I20260709 13:02:45.993237  9451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1265) took 1245 ms. Trace:
I20260709 13:02:46.169926  9368 rpcz_store.cc:276] 0709 13:02:44.700122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.700404 (+   282us) service_pool.cc:224] Handling call
0709 13:02:44.700792 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.701047 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:44.718358 (+ 17311us) log.cc:844] Serialized 14 byte log entry
0709 13:02:45.822767 (+1104409us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:45.822842 (+    75us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:45.822910 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.823023 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.823179 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":294,"prepare.queue_time_us":17463,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":102290,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":12348,"thread_start_us":1103790,"threads_started":1}
W20260709 13:02:46.213626 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 1.34708e+06us
W20260709 13:02:45.821540 10939 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.011s	sys 0.007s
W20260709 13:02:45.970791 11069 log.cc:927] Time spent T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 13:02:46.023698 10641 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:46.219720 11048 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.233747 11048 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:46.236629  9446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1277) took 1478 ms. Trace:
W20260709 13:02:46.032169  9377 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.007s	sys 0.024s
W20260709 13:02:45.872014  9452 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.002s	sys 0.026s
I20260709 13:02:46.198848  9418 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:46.162288  9372 rpcz_store.cc:276] 0709 13:02:44.897952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.898102 (+   150us) service_pool.cc:224] Handling call
0709 13:02:44.898544 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.917761 (+ 19217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.917792 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:44.918337 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:02:45.646727 (+728390us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:45.646764 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.646834 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.003882 (+357048us) raft_consensus.cc:1685] finished
0709 13:02:46.003904 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.004037 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28424,"raft.queue_time_us":20538,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":11545,"thread_start_us":699066,"threads_started":1,"wal-append.queue_time_us":1062101}
W20260709 13:02:45.785071 10942 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.010s	sys 0.027s
I20260709 13:02:46.239377  9418 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
W20260709 13:02:45.903148  9445 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.036s	sys 0.076s
W20260709 13:02:45.971020 11070 log.cc:927] Time spent T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 13:02:46.008816 11072 log.cc:927] Time spent T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:46.170706 10915 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:46.220335  9451 rpcz_store.cc:276] 0709 13:02:44.748104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.749827 (+  1723us) service_pool.cc:224] Handling call
0709 13:02:44.750117 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.750440 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.750467 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:44.750889 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:02:45.525771 (+774882us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:45.525822 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.525922 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:45.992974 (+467052us) raft_consensus.cc:1685] finished
0709 13:02:45.992998 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.993174 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6682,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":774474,"threads_started":1,"wal-append.queue_time_us":1213516}
W20260709 13:02:46.228963 10939 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.129s	user 0.012s	sys 0.011s
I20260709 13:02:45.923007 11065 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:46.002715 10823 consensus_meta.cc:287] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.001s
I20260709 13:02:45.796343  9519 raft_consensus.cc:2889] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:46.252039 11077 log.cc:927] Time spent T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:02:45.794227 11049 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:45.905546 10986 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.951s	user 0.012s	sys 0.024s
I20260709 13:02:46.229537  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:46.323381  9521 raft_consensus.cc:2393] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 4: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:46.227653  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:46.324007  9375 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 4.
I20260709 13:02:46.219794 10917 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:46.231607 10759 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:46.006016 10824 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:46.102820 10872 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:46.011201 10808 raft_consensus.cc:3055] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:45.778199 11051 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:46.237270  9446 rpcz_store.cc:276] 0709 13:02:44.758034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.844625 (+ 86591us) service_pool.cc:224] Handling call
0709 13:02:44.844912 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.849946 (+  5034us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.850004 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:44.850584 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 13:02:45.595526 (+744942us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:45.595580 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.595665 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.236401 (+640736us) raft_consensus.cc:1685] finished
0709 13:02:46.236421 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.236570 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6197,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":12677,"thread_start_us":653441,"threads_started":1,"wal-append.queue_time_us":1094886}
W20260709 13:02:46.238487  9452 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.126s	user 0.002s	sys 0.053s
I20260709 13:02:46.317548 10823 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:45.956054 10947 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:46.191246  9373 rpcz_store.cc:276] 0709 13:02:44.900358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.900515 (+   157us) service_pool.cc:224] Handling call
0709 13:02:44.900918 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.918975 (+ 18057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.919019 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:44.932019 (+ 13000us) log.cc:844] Serialized 26 byte log entry
0709 13:02:44.994967 (+ 62948us) spinlock_profiling.cc:243] Waited 9.1 ms on lock 0x7b4800003fd8. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58b493aa1 00007fb58b48ab37 00007fb58b48a9ca 00007fb58b58226f 00007fb58b581f37 00007fb58b59655c 00007fb58b596508 00007fb58b596488 00007fb58b596443 00007fb58b5956ec 00007fb58a4bfa96
0709 13:02:45.676469 (+681502us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:45.676527 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.676619 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.102346 (+425727us) raft_consensus.cc:1685] finished
0709 13:02:46.102387 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.102774 (+   387us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17573,"raft.queue_time_us":18181,"raft.run_cpu_time_us":1942,"raft.run_wall_time_us":69852,"spinlock_wait_cycles":20924160,"thread_start_us":719656,"threads_started":1,"wal-append.queue_time_us":1152660}
W20260709 13:02:46.238418  9377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.018s	sys 0.024s
W20260709 13:02:46.240648  9445 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.130s	user 0.047s	sys 0.080s
W20260709 13:02:46.322949 10986 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.462s	user 0.012s	sys 0.029s
I20260709 13:02:45.993624 11084 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:45.997874 11014 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:46.141701 11015 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.019s	sys 0.021s
I20260709 13:02:46.027971 10918 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:45.855862 11054 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:02:46.100759 11091 log.cc:927] Time spent T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:02:45.946877 10905 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:46.249964  9523 raft_consensus.cc:3055] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:46.006947 10816 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:46.241274  9418 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:46.214349 10828 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:02:46.018604 10966 consensus_meta.cc:287] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.804s	user 0.007s	sys 0.004s
W20260709 13:02:46.141264 10698 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.023s	sys 0.016s
I20260709 13:02:46.334898 10943 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:45.994138 11064 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:46.356766 10698 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.026s	sys 0.017s
I20260709 13:02:45.897998 11059 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:46.335602 11052 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.285285  9520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 967) took 1300 ms. Trace:
W20260709 13:02:46.294474  9450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.005s	sys 0.038s
W20260709 13:02:46.357882  9450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.005s	sys 0.038s
I20260709 13:02:46.352486 10806 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:46.358793  9450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1289) took 1568 ms. Trace:
I20260709 13:02:46.336385 10824 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:46.214771 11028 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:45.995328 11055 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:45.822427 10836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.501s	user 0.015s	sys 0.028s
I20260709 13:02:46.251168 11078 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:46.254534 11044 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:46.336825 10808 raft_consensus.cc:740] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:46.343639 10823 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:46.389446 11059 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:46.359247  9450 rpcz_store.cc:276] 0709 13:02:44.790050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.859156 (+ 69106us) service_pool.cc:224] Handling call
0709 13:02:44.859424 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.859849 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:45.523514 (+663665us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.358425 (+834911us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:46.358497 (+    72us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:46.358547 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.358622 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.358743 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1049276,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":1621,"thread_start_us":1479581,"threads_started":2}
I20260709 13:02:46.249719 10937 raft_consensus.cc:2764] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:02:46.283514 11046 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.885s	user 0.022s	sys 0.022s
I20260709 13:02:46.326656  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:46.394157  9521 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:46.394435  9343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.038s	sys 0.040s
W20260709 13:02:46.394836  9343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.038s	sys 0.040s
I20260709 13:02:46.346822 11062 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:46.336218 10917 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:46.194924 11067 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:02:46.386128 11095 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:02:46.355096  9523 raft_consensus.cc:740] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:02:46.335903 10908 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.014s	sys 0.010s
I20260709 13:02:46.357501  9520 rpcz_store.cc:276] 0709 13:02:44.984834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.985040 (+   206us) service_pool.cc:224] Handling call
0709 13:02:44.985333 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.985660 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.985685 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:44.986120 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:02:45.675749 (+689629us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:45.675792 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.675862 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.284901 (+609039us) raft_consensus.cc:1685] finished
0709 13:02:46.284936 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.285191 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1214,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":8933,"thread_start_us":689299,"threads_started":1,"wal-append.queue_time_us":1157807}
I20260709 13:02:46.345505 11066 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:46.352898 11015 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.019s	sys 0.023s
I20260709 13:02:46.387018  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:46.363392  9490 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
W20260709 13:02:46.328436  9524 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.000s	sys 0.022s
W20260709 13:02:46.398762  9343 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.4.67:35929 timed out after 1.558s (SENT) [suppressed 6 similar messages]
I20260709 13:02:46.393095 11078 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:02:46.403075  9341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.013s	sys 0.013s
W20260709 13:02:46.406342 10749 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.008s	sys 0.018s
W20260709 13:02:46.423457  9341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.013s	sys 0.013s
I20260709 13:02:46.390297 11059 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:46.342068  9375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:02:46.356009 10816 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:02:46.397107 11046 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.022s	sys 0.023s
W20260709 13:02:46.298847  9525 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.011s	sys 0.010s
W20260709 13:02:46.437271  9525 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.011s	sys 0.011s
W20260709 13:02:46.418967 10908 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.014s	sys 0.011s
W20260709 13:02:46.392590 10677 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.016s	sys 0.069s
W20260709 13:02:46.416528  9416 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.007s	sys 0.014s
I20260709 13:02:46.357513 11052 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:46.421168  9524 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.000s	sys 0.022s
I20260709 13:02:46.421772  9521 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
W20260709 13:02:46.440673  9443 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.009s	sys 0.017s
W20260709 13:02:46.422542  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 59299us
W20260709 13:02:46.441087  9443 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.010s	sys 0.018s
W20260709 13:02:46.355849  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 114661us
I20260709 13:02:46.426714  9375 raft_consensus.cc:606] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:02:46.441589  9375 raft_consensus.cc:614] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:46.441838  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:46.429765  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:46.353384 11054 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:46.347242 11048 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:46.425778 11078 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:46.438513  9416 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.008s	sys 0.014s
I20260709 13:02:46.390235 10808 consensus_queue.cc:260] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:46.414974  9523 consensus_queue.cc:260] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:46.441993  9490 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:46.416236 11067 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:46.443678  9446 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:46.463452  9490 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:46.390354 11028 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:46.444670  9525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 956) took 1558 ms. Trace:
W20260709 13:02:46.426075 10749 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.008s	sys 0.018s
W20260709 13:02:46.439692 10677 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.016s	sys 0.069s
I20260709 13:02:46.447712  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:46.471215  9449 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:02:46.437887  9272 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 63) took 8498 ms. Trace:
I20260709 13:02:46.436305  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:02:46.455214  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.460043 10069 raft_consensus.cc:1240] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 3 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:46.352370 11084 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:46.440382 10745 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.439093 11066 raft_consensus.cc:2764] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:02:46.462226  9523 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:46.443305  9418 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:46.458950 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:46.444550 11062 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:02:46.470618 11064 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:46.471287 10808 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:46.467517  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:46.498035  9446 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:02:46.498874  9449 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:02:46.500202  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:46.501291  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:46.474661 10986 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:46.446529 10836 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:46.469220  9341 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:46.469458  9451 raft_consensus.cc:1240] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:02:46.519345  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:46.520018  9451 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
W20260709 13:02:46.469662  9417 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.006s	sys 0.018s
I20260709 13:02:46.473721  9490 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:46.521299  9417 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.006s	sys 0.018s
W20260709 13:02:46.521970  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 48377.9us
W20260709 13:02:46.522581  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.523160  9490 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:46.475627  9447 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.000s	sys 0.031s
W20260709 13:02:46.524139  9447 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.000s	sys 0.031s
I20260709 13:02:46.459865 11048 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.459981 11046 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:02:46.488747  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 45519.4us
I20260709 13:02:46.526543  9418 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:46.470213 10641 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:46.490970 10299 raft_consensus.cc:3055] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:46.493618  9450 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:46.464972  9525 rpcz_store.cc:276] 0709 13:02:44.886144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.886261 (+   117us) service_pool.cc:224] Handling call
0709 13:02:44.886558 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.886877 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.886904 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:44.887303 (+   399us) log.cc:844] Serialized 26 byte log entry
0709 13:02:44.974364 (+ 87061us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b18000411a0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58345fe07 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b 00007fb586109d23 00007fb58610a0d1 00007fb586525a0f
0709 13:02:45.602041 (+627677us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:46.443953 (+841912us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.444235 (+   282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.444318 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.444367 (+    49us) raft_consensus.cc:1685] finished
0709 13:02:46.444463 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.444603 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":863674,"raft.queue_time_us":3462,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":52128,"spinlock_wait_cycles":5260544,"thread_start_us":1443130,"threads_started":2,"wal-append.queue_time_us":1028327}
I20260709 13:02:46.532183 10299 raft_consensus.cc:740] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:02:46.466892  9522 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.012s	sys 0.017s
W20260709 13:02:46.532821  9522 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.012s	sys 0.017s
I20260709 13:02:46.489085 10816 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:46.484988 11014 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:46.505347 10065 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
W20260709 13:02:46.508759 11099 log.cc:927] Time spent T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:02:46.490356 10745 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:46.555253  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 86105.4us
I20260709 13:02:46.496672 11055 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.555408  9445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1300) took 1484 ms. Trace:
W20260709 13:02:46.515650 11104 log.cc:927] Time spent T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:02:46.558527 11098 log.cc:927] Time spent T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:02:46.558616 10818 raft_consensus.cc:2804] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:46.559121 10818 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.559463 10818 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:46.560631 11103 log.cc:927] Time spent T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:46.520855  9451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:02:46.561244  9451 raft_consensus.cc:606] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Received request to transfer leadership to TS 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:46.561606  9451 raft_consensus.cc:614] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:46.564646 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:46.565367 10065 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:46.566470  9342 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:02:46.567247 11059 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:46.567962  9452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1305) took 1491 ms. Trace:
I20260709 13:02:46.530103  9490 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:46.487978 10943 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:46.487783 10937 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:46.533165 10299 consensus_queue.cc:260] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:46.568431  9452 rpcz_store.cc:276] 0709 13:02:45.076572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.077023 (+   451us) service_pool.cc:224] Handling call
0709 13:02:45.077354 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:45.084593 (+  7239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:45.084639 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:45.095002 (+ 10363us) log.cc:844] Serialized 26 byte log entry
0709 13:02:46.337943 (+1242941us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:46.338337 (+   394us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.338558 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.338655 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.567721 (+229066us) raft_consensus.cc:1685] finished
0709 13:02:46.567759 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.567902 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6806,"prepare.queue_time_us":1109,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":10759,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":5204,"thread_start_us":1225779,"threads_started":1,"wal-append.queue_time_us":1322412}
I20260709 13:02:46.570152 10299 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:46.466531  9443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1290) took 1676 ms. Trace:
I20260709 13:02:46.535271  9418 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:46.484566 10905 consensus_queue.cc:1059] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:02:46.498243 10806 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:46.506697 10749 raft_consensus.cc:3055] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:46.557170  9445 rpcz_store.cc:276] 0709 13:02:45.070728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.070931 (+   203us) service_pool.cc:224] Handling call
0709 13:02:45.071340 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:45.071754 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:45.071804 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:45.088637 (+ 16833us) log.cc:844] Serialized 26 byte log entry
0709 13:02:46.351904 (+1263267us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:46.351947 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.352025 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.555174 (+203149us) raft_consensus.cc:1685] finished
0709 13:02:46.555199 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.555349 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1180,"raft.queue_time_us":11321,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":2855,"thread_start_us":1241497,"threads_started":1,"wal-append.queue_time_us":1344501}
I20260709 13:02:46.528070  9447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1308) took 1447 ms. Trace:
I20260709 13:02:46.571384  9443 rpcz_store.cc:276] 0709 13:02:44.790325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.860668 (+ 70343us) service_pool.cc:224] Handling call
0709 13:02:44.860986 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.861244 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:45.806122 (+944878us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.466194 (+660072us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:46.466246 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:46.466289 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.466349 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.466477 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35482,"prepare.queue_time_us":1072628,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":18715,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":5621,"thread_start_us":1568609,"threads_started":2}
I20260709 13:02:46.582643  9443 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:46.505353  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1165) took 2516 ms. Trace:
W20260709 13:02:46.531734 11004 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.016s	sys 0.026s
I20260709 13:02:46.578054  9377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 872) took 1304 ms. Trace:
W20260709 13:02:46.580148  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 44925us
I20260709 13:02:46.597364  9418 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:46.572291  9452 raft_consensus.cc:1240] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:02:46.581620  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 51552.1us
I20260709 13:02:46.599014  9490 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:46.584714  9417 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:46.581616  9447 rpcz_store.cc:276] 0709 13:02:45.080594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.083095 (+  2501us) service_pool.cc:224] Handling call
0709 13:02:45.083498 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:45.083931 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:45.083968 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:45.084534 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:02:45.738696 (+654162us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:46.525574 (+786878us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.527653 (+  2079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.527758 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.527815 (+    57us) raft_consensus.cc:1685] finished
0709 13:02:46.527834 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.528003 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9399,"prepare.queue_time_us":195389,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":965,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":5756,"thread_start_us":1285163,"threads_started":2,"wal-append.queue_time_us":1129698}
I20260709 13:02:46.582224  9446 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
W20260709 13:02:46.588013 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 286091us
I20260709 13:02:46.596757  9377 rpcz_store.cc:276] 0709 13:02:45.273228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.273416 (+   188us) service_pool.cc:224] Handling call
0709 13:02:45.273991 (+   575us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:45.281734 (+  7743us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:45.281781 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:45.290199 (+  8418us) log.cc:844] Serialized 26 byte log entry
0709 13:02:46.351904 (+1061705us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:46.351947 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.352019 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.577703 (+225684us) raft_consensus.cc:1685] finished
0709 13:02:46.577733 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.577962 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7781,"raft.queue_time_us":7379,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":11760,"thread_start_us":1006383,"threads_started":1,"wal-append.queue_time_us":1126246}
I20260709 13:02:46.533243 11021 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:46.531875 11066 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:46.625059  9450 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:46.614742  9341 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:46.482438  9272 rpcz_store.cc:276] 0709 13:02:37.939118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.939284 (+   166us) service_pool.cc:224] Handling call
0709 13:02:46.437813 (+8498529us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:43.308878 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:43.405440 (+ 96562us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:43.405495 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:02:43.405528 (+    33us) tablet.cc:662] Decoding operations
0709 13:02:43.405992 (+   464us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:43.406096 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:43.406152 (+    56us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:43.406596 (+   444us) tablet.cc:701] Row locks acquired
0709 13:02:43.406624 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:02:43.406830 (+   206us) write_op.cc:270] Start()
0709 13:02:43.406998 (+   168us) write_op.cc:276] Timestamp: P: 1783602163406764 usec, L: 0
0709 13:02:43.407032 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:02:43.408138 (+  1106us) log.cc:844] Serialized 526 byte log entry
0709 13:02:44.110710 (+702572us) op_driver.cc:464] REPLICATION: finished
0709 13:02:44.892754 (+782044us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b1800126040. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58347d3f3 00007fb58347f7c1 00007fb58347f779 00007fb58347f709 00007fb58347f6d1 00007fb58347e9cd 000000000038f354 000000000038f199 00007fb58346083a
0709 13:02:44.923105 (+ 30351us) write_op.cc:301] APPLY: starting
0709 13:02:44.934018 (+ 10913us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:44.946728 (+ 12710us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:44.949593 (+  2865us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:44.983262 (+ 33669us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:45.013340 (+ 30078us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:02:45.013419 (+    79us) write_op.cc:312] APPLY: finished
0709 13:02:45.017911 (+  4492us) log.cc:844] Serialized 22 byte log entry
0709 13:02:45.836619 (+818708us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:45.872830 (+ 36211us) write_op.cc:454] Released schema lock
0709 13:02:45.890845 (+ 18015us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:45.956396 (+ 65551us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:45.956427 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3192096,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":327698,"apply.run_cpu_time_us":38179,"apply.run_wall_time_us":1033680,"num_ops":1,"prepare.queue_time_us":78578,"prepare.run_cpu_time_us":36072,"prepare.run_wall_time_us":345076,"raft.queue_time_us":286287,"raft.run_cpu_time_us":28888,"raft.run_wall_time_us":556803,"replication_time_us":602113,"spinlock_wait_cycles":6746880,"thread_start_us":1447144,"threads_started":6,"wal-append.queue_time_us":1190301,"wal-append.run_cpu_time_us":17888,"wal-append.run_wall_time_us":1239490}]]}
I20260709 13:02:46.617358 10027 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:46.556551 11055 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:46.636234  9418 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:46.566506 11054 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:46.546469 10774 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:46.572273 10824 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:46.534356 11064 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:46.539220 11046 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:46.528995 10986 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:46.596488 11004 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.016s	sys 0.027s
I20260709 13:02:46.591343 10823 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:46.587998 10749 raft_consensus.cc:740] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:46.595299 11062 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:02:46.648407  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.641491  9418 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:46.625597 11059 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:46.535187 11048 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:46.546793 10816 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:46.539640 10641 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:46.634466 11096 log.cc:927] Time spent T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:02:46.631774 11014 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.700212  9444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 1272) took 1943 ms. Trace:
I20260709 13:02:46.732175  9444 rpcz_store.cc:276] 0709 13:02:44.756655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.758411 (+  1756us) service_pool.cc:224] Handling call
0709 13:02:46.695317 (+1936906us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b5400113d54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:46.700134 (+  4817us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3960665984}
I20260709 13:02:46.699847 10823 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:46.702808  9377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7a866663507456b9442af6c42748c5f"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:02:46.697575 11018 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:46.705947  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:02:46.704311  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.735440  9525 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:46.706807  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:46.709847  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 311073us
I20260709 13:02:46.736498  9521 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:02:46.739590  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:46.633790 10677 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:46.677923 11017 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:46.686365 11113 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:46.740605 10677 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.639433 10905 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:46.741397  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:46.713785  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:46.613656 10943 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:46.642920 10836 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:46.646211 10745 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:46.645458 10774 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:46.670496 11066 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:46.731745 10966 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:46.613023 10937 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:46.729530  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:02:46.690909  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 106338us
I20260709 13:02:46.706892 11054 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:46.687569 11118 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:46.733412  9368 raft_consensus.cc:1275] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:46.632390 11021 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:46.702275  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 87644.4us
I20260709 13:02:46.715736 11047 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:46.735080  9377 raft_consensus.cc:606] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:02:46.645289 11039 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:46.740219  9369 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:46.635675 10917 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:46.742259  9374 raft_consensus.cc:2410] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:46.742746  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:46.750730 11067 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:46.752398  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:46.821916  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:46.802613 11113 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:46.785746 11047 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.823354 11113 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:46.823954 11047 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:46.824431  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:46.825500 11113 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:46.816211 11039 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:46.826284 11039 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:46.826419  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:46.827891  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:46.740792  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:46.829020  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:46.829425  9372 raft_consensus.cc:2393] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 4: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:46.830240  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:46.735092 11014 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:46.749064  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:46.588208  9519 rpcz_store.cc:276] 0709 13:02:43.972720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.973442 (+   722us) service_pool.cc:224] Handling call
0709 13:02:43.985148 (+ 11706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.324853 (+2339705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.474622 (+149769us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54000a41d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:46.489106 (+ 14484us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3433959680}
I20260709 13:02:46.752620  9375 raft_consensus.cc:1240] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:02:46.725554  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 84177.2us
I20260709 13:02:46.758617  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:46.758853  9523 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:46.842554  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:46.741875 10823 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.760979  9449 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:46.764974  9525 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:46.752861 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:46.740804 11017 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:46.767755 11062 raft_consensus.cc:3055] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:02:46.768739 11105 log.cc:927] Time spent T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
I20260709 13:02:46.759647 11118 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:46.759755 11054 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.770242  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:46.773602  9341 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:46.869868  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 96342.2us
I20260709 13:02:46.773751 11055 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:46.753108 10774 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:46.776134 10937 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:46.747347 10677 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:46.786471  9524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1189) took 1321 ms. Trace:
I20260709 13:02:46.868856 11118 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:46.742776 11084 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:46.802486  9377 raft_consensus.cc:614] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:46.810572  9521 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:46.811318  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:46.813494  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:46.823530 11121 log.cc:927] Time spent T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:02:46.831441  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:46.999753  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:47.000613  9372 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:02:46.742813  9522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1193) took 1242 ms. Trace:
I20260709 13:02:46.760104 11028 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:46.843436  9371 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
W20260709 13:02:46.815939 11102 log.cc:927] Time spent T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
I20260709 13:02:46.847330  9343 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:46.847693 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 72633.3us
I20260709 13:02:46.848344  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:46.750325 11018 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:46.750016 10905 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:46.752619 10836 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:46.867326 10917 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:46.880751  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:46.756349 11066 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:46.894582  9368 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:46.890516 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:46.893642  9524 rpcz_store.cc:276] 0709 13:02:45.465113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.518178 (+ 53065us) service_pool.cc:224] Handling call
0709 13:02:45.518594 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.669501 (+150907us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:46.440120 (+770619us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.730542 (+290422us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:46.730595 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:46.730646 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.786156 (+ 55510us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54000479d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:46.786221 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.786401 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17696,"prepare.queue_time_us":819829,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":22178,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":8528,"spinlock_wait_cycles":355554432,"thread_start_us":1006353,"threads_started":2,"wal-append.queue_time_us":310833}
I20260709 13:02:47.060925  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:46.984041  9523 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:02:46.822199 10698 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:02:46.755686 10749 consensus_queue.cc:260] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:46.745119  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.062182  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:46.858923 11062 raft_consensus.cc:740] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:47.073902 11062 consensus_queue.cc:260] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:47.074750 11047 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:47.075074  9526 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:47.011201 11015 consensus_queue.cc:1048] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:02:46.882068 11054 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:46.850418 10759 consensus_queue.cc:1048] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.131s
I20260709 13:02:47.017300  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:47.081182  9377 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:47.081598 11021 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:47.082576 10749 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:46.891578 11108 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:47.084555 11108 raft_consensus.cc:697] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:46.885324 11067 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:47.085398 11067 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:47.085577 11108 consensus_queue.cc:237] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:47.053243 10986 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:47.087963 11067 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:47.015678  9522 rpcz_store.cc:276] 0709 13:02:45.500821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.672739 (+171918us) service_pool.cc:224] Handling call
0709 13:02:45.673281 (+   542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.762914 (+ 89633us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:46.533207 (+770293us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.742271 (+209064us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:46.742489 (+   218us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:46.742530 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.742614 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.742749 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11341,"prepare.queue_time_us":716831,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":16387,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":3988,"thread_start_us":850028,"threads_started":2,"wal-append.queue_time_us":232956}
I20260709 13:02:47.026265  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:47.037798  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:47.090312  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:47.091859  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:47.011618  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:47.059734 11107 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:47.042559 11017 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:47.044997  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:47.045742 10641 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:47.046548 10943 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:47.050417  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.107470  9452 raft_consensus.cc:2468] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 3.
I20260709 13:02:47.050349 11028 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:02:47.051575 11125 log.cc:927] Time spent T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
W20260709 13:02:47.052253 11117 log.cc:927] Time spent T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.319s	user 0.001s	sys 0.000s
I20260709 13:02:47.063443  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:47.065107  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:47.067277 10816 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:47.067816 11048 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:47.069857 11066 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:47.071390 11014 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:47.050264 10808 consensus_meta.cc:287] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.532s	user 0.005s	sys 0.005s
I20260709 13:02:47.075187 11062 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:47.098002  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:47.099898  9524 pending_rounds.cc:85] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 4
I20260709 13:02:47.147398  9524 pending_rounds.cc:107] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:02:47.147831  9524 raft_consensus.cc:2889] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:47.105568  9521 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:47.121152 10025 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:47.130746  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:47.131081  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:47.152128  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:47.132189  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:47.153951  9443 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:47.117835 10806 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:47.155230  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:47.132851  9444 raft_consensus.cc:1240] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:47.064141 11052 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:47.133191  9446 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:02:47.138640  9447 raft_consensus.cc:1240] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:02:47.159579  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:47.160758  9444 raft_consensus.cc:2393] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 3: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:47.144938  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:47.108778 10908 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:47.162264  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:47.097519 10917 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:47.166028  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:47.167073  9446 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:47.168694  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:47.170439  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:47.171451  9447 raft_consensus.cc:2393] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 4: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:47.176913  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:47.179127  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:47.133592 11046 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:47.138608 10943 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:47.139011 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:47.133653 11028 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:47.154415 10816 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:47.194895  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:47.187762 11078 consensus_meta.cc:287] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.724s	user 0.008s	sys 0.005s
W20260709 13:02:47.207525  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.135581 10774 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:47.175859 11092 raft_consensus.cc:2804] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:47.181183 10808 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:47.222741 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:47.176254 10908 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:47.203650 10943 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:47.215746 11092 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:47.224670 11047 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:47.214702 11078 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:47.238444 11092 raft_consensus.cc:3060] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:47.243847 10943 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:47.094277 11109 consensus_queue.cc:1175] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d62c9d5a052b42ce8675f8438f846526" responder_term: 4 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: [3.2-3.2]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:47.233199 11054 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:47.252002 11054 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:02:47.253551 11129 log.cc:927] Time spent T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.150s	user 0.003s	sys 0.000s
I20260709 13:02:47.264108 11118 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:47.265333 11092 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:02:47.037961  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 190731us
I20260709 13:02:47.401530  9343 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:47.402464 11092 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:47.403908  9343 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:47.097155  9375 raft_consensus.cc:1240] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 4. Ops: []
W20260709 13:02:47.301745  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 404159us
I20260709 13:02:47.102694  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:47.407447  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:47.408252  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:47.222985 10808 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:47.413960  9341 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:47.113317  9377 raft_consensus.cc:2410] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:47.311208  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:47.414968 10808 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:47.415117 11107 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:47.417887 11109 consensus_queue.cc:1059] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:47.419219 11052 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:47.419550 11017 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:47.311414  9448 raft_consensus.cc:1240] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:47.311233  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:47.315086  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:47.317222  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:47.318383  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:47.266785 11118 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:47.323089  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:47.326548  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.350857 10774 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:47.353838 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:47.355279  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:47.237434 10818 consensus_meta.cc:287] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.678s	user 0.013s	sys 0.002s
I20260709 13:02:47.362273 11014 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:47.363917 10917 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:47.247154 11018 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:47.364512 10908 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:46.474095 10918 consensus_queue.cc:1175] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d62c9d5a052b42ce8675f8438f846526" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:47.365077 11059 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:47.366824 11028 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:47.214965 10816 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:47.391284 10905 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:47.397732 11044 consensus_meta.cc:287] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 1.004s	user 0.013s	sys 0.007s
I20260709 13:02:47.303791  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:47.410513 11048 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:47.306440  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:47.321895  9451 raft_consensus.cc:1240] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:47.420290 11052 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:47.434605  9446 raft_consensus.cc:2410] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:02:47.653694  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 249955us
W20260709 13:02:47.657701  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:47.639917  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 190381us
W20260709 13:02:47.530761  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 89484us
I20260709 13:02:47.434868  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:47.436878  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:47.670284  9448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1314) took 1241 ms. Trace:
I20260709 13:02:47.766587  9448 rpcz_store.cc:276] 0709 13:02:46.428407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.432687 (+  4280us) service_pool.cc:224] Handling call
0709 13:02:46.432988 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:47.433704 (+1000716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.669976 (+236272us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b540024f4d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:47.670201 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2018099072}
I20260709 13:02:47.770367  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:47.771315  9448 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
W20260709 13:02:47.651310  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:47.758767 10749 consensus_meta.cc:287] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.676s	user 0.007s	sys 0.011s
I20260709 13:02:47.753717  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:47.668421 11091 log.cc:927] Time spent T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e: Append to log took a long time: real 0.419s	user 0.002s	sys 0.000s
W20260709 13:02:47.780973  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.437069  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:47.654373 11078 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:47.785676  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:47.785946  9447 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:47.785768 10818 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:47.787142  9343 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:47.788053  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:47.791921  9517 raft_consensus.cc:2410] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:47.792682 11028 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:02:47.794694  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.793540  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:47.799564 10641 raft_consensus.cc:3055] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:47.800364 11055 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.687143  9371 consensus_queue.cc:237] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:47.644512 11113 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:47.423470 11017 raft_consensus.cc:697] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:47.808615  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:47.649608 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:47.815646  9375 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:02:47.676048 10836 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:47.806705 10641 raft_consensus.cc:740] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:47.828541  9369 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:47.833216 10818 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:47.835703  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:47.838464  9452 raft_consensus.cc:1240] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:02:47.829833  9370 raft_consensus.cc:2393] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 4: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:47.840579  9452 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:02:47.823973  9418 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:47.824412 11028 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:47.844265 11039 consensus_meta.cc:287] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9: Time spent flushing consensus metadata: real 1.017s	user 0.004s	sys 0.015s
I20260709 13:02:47.848829  9376 raft_consensus.cc:2393] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 4: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:47.827955  9373 raft_consensus.cc:2468] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 3.
W20260709 13:02:47.853475  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 64707.4us
I20260709 13:02:47.854995  9446 raft_consensus.cc:3060] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:47.860145  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 55336.2us
I20260709 13:02:47.863880  9450 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 1.
I20260709 13:02:47.852900 11048 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:47.820160  9444 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f322b7281d554c459bb8109ed249047b"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:02:47.856652 11039 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:47.819712 11055 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:47.868266  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 81290.1us
I20260709 13:02:47.825735 10917 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:47.807672 11014 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:47.883358 10067 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:47.853233 11059 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:47.895318 11062 consensus_meta.cc:287] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.732s	user 0.014s	sys 0.001s
I20260709 13:02:47.896351 11014 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:47.897816  9445 raft_consensus.cc:2410] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:47.898983 11017 consensus_queue.cc:237] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:47.886145  9444 raft_consensus.cc:606] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Received request to transfer leadership to TS 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:47.901304  9444 raft_consensus.cc:614] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:47.903298  9517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46894 (request call id 1216) took 1093 ms. Trace:
I20260709 13:02:47.903764  9517 rpcz_store.cc:276] 0709 13:02:46.809736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.811111 (+  1375us) service_pool.cc:224] Handling call
0709 13:02:47.791104 (+979993us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b540037c420. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5864e1dc0 00007fb58656de18 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:47.903020 (+111916us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54001b67d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:47.903188 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1789556992}
I20260709 13:02:47.909806  9341 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:47.911096  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.911609  9341 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:47.913259 11039 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:47.916414 10677 consensus_meta.cc:287] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.914s	user 0.007s	sys 0.012s
I20260709 13:02:47.916649  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:47.962579 10836 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:47.919032  9418 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:47.962977 10677 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:47.921283  9374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:02:47.963339 10641 consensus_queue.cc:260] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:47.963567 10836 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:02:47.927157 10823 consensus_meta.cc:287] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 1.035s	user 0.007s	sys 0.011s
I20260709 13:02:47.858676 11113 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:47.935009 11028 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:47.935253 11059 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:47.942811 10816 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:47.945892 11108 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:47.946103  9341 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:47.947971  9451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1323) took 1482 ms. Trace:
W20260709 13:02:47.951671  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 64507.4us
W20260709 13:02:47.960183 11145 log.cc:927] Time spent T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:02:47.963366  9452 raft_consensus.cc:2368] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 for earlier term 4. Current term is 5.
I20260709 13:02:47.922489 10299 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:47.965742  9374 raft_consensus.cc:606] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:02:47.971865  9374 raft_consensus.cc:614] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:47.944736  9447 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:47.970676 10067 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:02:47.970898  9451 rpcz_store.cc:276] 0709 13:02:46.465617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.563229 (+ 97612us) service_pool.cc:224] Handling call
0709 13:02:46.563492 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:47.808095 (+1244603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.947651 (+139556us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b5400016654. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:47.947907 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1742666624}
I20260709 13:02:47.975765  9446 raft_consensus.cc:2468] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 4.
I20260709 13:02:47.981129 10299 raft_consensus.cc:697] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:47.982272  9443 raft_consensus.cc:2410] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:47.986496  9372 raft_consensus.cc:2393] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 5: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:47.986672 10806 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:47.987881 10641 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:47.994845 11113 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:48.001314  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 82468.3us
I20260709 13:02:47.994838  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:47.973781 10917 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:48.002812 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 71788.9us
W20260709 13:02:48.000133  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 171742us
I20260709 13:02:47.972687 10823 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.000942 11078 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:48.007019 10818 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:48.021318 10025 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:48.009421 11059 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:48.017776 10299 consensus_queue.cc:237] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.017498 10818 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
W20260709 13:02:48.031669 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 54218.2us
I20260709 13:02:48.030701  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:48.025918 10749 consensus_queue.cc:1059] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:02:48.041739 10025 leader_election.cc:400] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 for earlier term 4. Current term is 5.
I20260709 13:02:48.042202 10025 leader_election.cc:403] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:02:48.034250 10818 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:48.045883 11139 consensus_queue.cc:1059] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:02:48.047246 11120 raft_consensus.cc:2804] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:48.048010 11108 raft_consensus.cc:3055] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:48.048079 11055 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:48.048516 11108 raft_consensus.cc:740] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:48.049643 11108 consensus_queue.cc:260] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:48.050472  9369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52562 (request call id 887) took 1284 ms. Trace:
I20260709 13:02:48.051345 11108 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:48.050311 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:48.057482 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:48.058864 10759 raft_consensus.cc:3055] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:48.066125 10759 raft_consensus.cc:740] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:48.066232 10917 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:48.067090 10759 consensus_queue.cc:260] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.068142  9418 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:48.051043  9369 rpcz_store.cc:276] 0709 13:02:46.766316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.826157 (+ 59841us) service_pool.cc:224] Handling call
0709 13:02:48.050217 (+1224060us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b54000fe6d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:48.050368 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2241074432}
I20260709 13:02:48.051752 10848 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 for earlier term 4. Current term is 5.
I20260709 13:02:48.068517  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:48.061271  9370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52562 (request call id 885) took 1305 ms. Trace:
I20260709 13:02:48.069581  9370 rpcz_store.cc:276] 0709 13:02:46.765110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.828782 (+ 63672us) service_pool.cc:224] Handling call
0709 13:02:48.055673 (+1226891us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b5400188654. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:48.061182 (+  5509us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2274155904}
I20260709 13:02:48.045029 11059 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.072744 11118 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:48.073236 11118 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.073596 11118 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:48.073238 10774 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:48.074393 10774 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.076951 10774 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:48.055003 11052 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:48.055465 11120 raft_consensus.cc:697] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 4 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:02:48.080821 11120 consensus_queue.cc:237] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:48.084602  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:48.068493 10759 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:48.085479  9372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52548 (request call id 978) took 1208 ms. Trace:
I20260709 13:02:48.085839  9372 rpcz_store.cc:276] 0709 13:02:46.877310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.025988 (+148678us) service_pool.cc:224] Handling call
0709 13:02:48.085242 (+1059254us) spinlock_profiling.cc:243] Waited 876 ms on lock 0x7b54000febd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:48.085415 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2014549248}
I20260709 13:02:48.087327 11113 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:48.088035 11113 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:48.072005  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.056514 10027 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:48.065640 10823 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:48.090286 11087 raft_consensus.cc:2804] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:48.090765 11087 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:48.090263 11059 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:48.091229 11087 raft_consensus.cc:3060] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:48.054271 10836 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:48.090263 11113 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:48.106238  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:48.112857  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:48.113286  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.118394  9443 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:48.128368  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.148371 11078 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:48.149066 11078 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:48.157611  9445 raft_consensus.cc:1240] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:48.163291 11059 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.164117 11059 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.166807 10818 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.171494  9524 raft_consensus.cc:1275] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:02:48.178404  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 50710.4us
I20260709 13:02:48.181420  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.182345  9372 raft_consensus.cc:2393] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 6: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:48.181550  9343 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:48.183934 10759 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:48.184444 10759 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:48.184911 10759 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:48.192327 11155 log.cc:927] Time spent T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:02:48.197328 10065 raft_consensus.cc:1240] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 4 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:48.194501 11113 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:48.202277 11113 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:48.204249  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.204564 11113 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:48.205427 10818 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:48.213547  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:48.216532 11059 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:48.224457 11109 consensus_queue.cc:1048] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:48.226110 11109 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:48.208317 11118 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.230541  9343 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:48.230985  9490 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:48.233706  9517 raft_consensus.cc:1275] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:48.233816  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:48.235849  9519 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:48.235978  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.237026 11059 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:48.237118  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:48.238185  9525 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:02:48.239032 11078 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.243139 11087 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:48.244361 11109 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:48.244594 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:48.244786 10677 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:48.254104 11018 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:48.259199 11018 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:48.258323 11109 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:48.261762 11109 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:48.266045  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.257229 10299 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:48.266913 10299 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.269325  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:48.270144  9448 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:48.266064  9273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43240 (request call id 177) took 10579 ms. Trace:
W20260709 13:02:48.256822  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.272775 11087 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:48.270370 10299 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:48.273761  9443 raft_consensus.cc:1240] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:48.257103 11078 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:48.254908 10759 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.244853 11118 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:48.275487  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:48.277489 10025 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:48.278980 10791 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:48.279779  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:48.280411  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:02:48.268177  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.282408 10759 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:48.285629  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:48.282882 10299 consensus_queue.cc:1059] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:02:48.292789 10299 consensus_queue.cc:1243] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer b0812463215649c3b011d36e2f0400c9 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:02:48.293381 10299 raft_consensus.cc:3055] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:48.293768  9371 raft_consensus.cc:3060] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:48.286435  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:48.294219 10299 raft_consensus.cc:740] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:48.284288  9417 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:48.278992  9341 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:48.294768 11059 consensus_queue.cc:1059] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:02:48.297609  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:48.301190 11018 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:48.302536  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:48.305128  9452 raft_consensus.cc:2393] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 6: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:48.302243  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:48.306757  9517 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 4.
I20260709 13:02:48.310580  9524 raft_consensus.cc:2376] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4. Re-sending same reply.
W20260709 13:02:48.322415  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 43649.1us
I20260709 13:02:48.310221 10759 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:48.311256 11118 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:48.332921  9490 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:48.328619 10759 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.341666 11048 consensus_queue.cc:1059] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:48.340847  9492 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:48.345891 11048 raft_consensus.cc:3055] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:48.343003  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:48.352651  9452 raft_consensus.cc:2393] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 4: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:48.330793 10917 consensus_queue.cc:1059] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:02:48.336203 11118 raft_consensus.cc:697] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:48.341204 10759 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:48.353541 10299 consensus_queue.cc:260] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:48.359366 10677 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.343899 11028 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:48.360035 10299 raft_consensus.cc:3060] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:48.352937 11048 raft_consensus.cc:740] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:02:48.362851  9342 consensus_peers.cc:597] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 45a4f94c156249adab9c2b1ffb00ac46. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:48.364590 10917 consensus_queue.cc:1243] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer d62c9d5a052b42ce8675f8438f846526 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:02:48.360041 10677 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.371083 10677 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:48.371620  9274 catalog_manager.cc:5697] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 3 to 4, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 4 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.373545 11048 consensus_queue.cc:260] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.374840 11048 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:48.379719 11014 raft_consensus.cc:3055] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:48.380182 11014 raft_consensus.cc:740] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:48.380375  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.380373  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:48.381640  9524 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:48.381470  9274 catalog_manager.cc:5697] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 3 to 5, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 5 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:48.382308  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:48.380743  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.383095  9373 raft_consensus.cc:2393] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 5: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:48.362092 11028 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.385037  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:48.386529  9274 catalog_manager.cc:5697] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:48.387185  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:48.397528  9524 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:48.387614 11014 consensus_queue.cc:260] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.367456 11059 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:48.389133 11052 raft_consensus.cc:3055] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:48.400923  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:48.392198  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:48.392952  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:48.272962  9273 rpcz_store.cc:276] 0709 13:02:37.686786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.687170 (+   384us) service_pool.cc:224] Handling call
0709 13:02:48.265543 (+10578373us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:45.836275 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:45.956645 (+120370us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:45.956715 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:02:45.956742 (+    27us) tablet.cc:662] Decoding operations
0709 13:02:45.974154 (+ 17412us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:45.988548 (+ 14394us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:46.028356 (+ 39808us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:02:46.028892 (+   536us) tablet.cc:701] Row locks acquired
0709 13:02:46.028925 (+    33us) write_op.cc:260] PREPARE: finished
0709 13:02:46.029190 (+   265us) write_op.cc:270] Start()
0709 13:02:46.029350 (+   160us) write_op.cc:276] Timestamp: P: 1783602166029126 usec, L: 0
0709 13:02:46.029384 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:02:46.030265 (+   881us) log.cc:844] Serialized 1289 byte log entry
0709 13:02:46.831536 (+801271us) op_driver.cc:464] REPLICATION: finished
0709 13:02:47.221196 (+389660us) write_op.cc:301] APPLY: starting
0709 13:02:47.224681 (+  3485us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:47.235754 (+ 11073us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:47.244004 (+  8250us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:47.244527 (+   523us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:47.244712 (+   185us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:02:47.244798 (+    86us) write_op.cc:312] APPLY: finished
0709 13:02:47.245140 (+   342us) log.cc:844] Serialized 34 byte log entry
0709 13:02:47.245331 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:47.245431 (+   100us) write_op.cc:454] Released schema lock
0709 13:02:47.245479 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:47.245916 (+   437us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:47.245944 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2057484,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":360110,"apply.run_cpu_time_us":2440,"apply.run_wall_time_us":32857,"num_ops":3,"prepare.queue_time_us":974546,"prepare.run_cpu_time_us":4538,"prepare.run_wall_time_us":251923,"replication_time_us":773128,"thread_start_us":866566,"threads_started":2}]]}
I20260709 13:02:48.399166  9371 raft_consensus.cc:2468] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 4.
I20260709 13:02:48.403470  9517 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:48.403574  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:48.400882 11052 raft_consensus.cc:740] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:48.406733 11052 consensus_queue.cc:260] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.408121 11052 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:48.397653 11028 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:48.406131  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:48.413343 11161 log.cc:927] Time spent T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:02:48.417472 11109 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.418571 11014 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:48.399094 11059 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.418754 11118 consensus_queue.cc:237] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:48.419792  9452 raft_consensus.cc:1275] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:48.420568  9374 raft_consensus.cc:1240] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:48.421540 10759 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.428428  9517 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:48.433661  9519 raft_consensus.cc:2410] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:48.465150  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:48.434320  9370 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:48.426788  9525 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:48.436535  9372 raft_consensus.cc:2468] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:48.438463 10917 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.438501  9443 raft_consensus.cc:1240] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:48.440759 11078 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.441505  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.443723  9274 catalog_manager.cc:5697] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 1 to 5, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 5 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:48.445788  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:48.440766  9418 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:48.469420  9524 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:48.453691 11059 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:48.474522  9373 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:48.454088 11048 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.475616  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:48.473639  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:48.484061  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:48.486259  9368 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:48.486822  9524 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:48.487305 10027 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:48.489290  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.489804  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:48.491112  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 50477.6us
W20260709 13:02:48.492755  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 124835us
I20260709 13:02:48.493739  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.476188  9274 catalog_manager.cc:5697] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 3 to 4, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 4 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:48.492815  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:48.495352  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.495570  9519 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.496153  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.491256 11113 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:48.471889 10917 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.488584  9518 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:48.499517  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:48.501505  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:48.502127  9523 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:48.502442 10917 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:48.475000 11078 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.504433 11078 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:48.507319  9418 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:48.501765  9274 catalog_manager.cc:5697] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:48.509001  9375 raft_consensus.cc:1275] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:48.509706  9274 catalog_manager.cc:5697] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:48.510767 11152 consensus_queue.cc:1048] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:48.511603  9274 catalog_manager.cc:5697] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:48.513350 11078 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:48.513439  9274 catalog_manager.cc:5697] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 3 to 4, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 4 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:48.515269  9418 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:48.516646 11078 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:48.516492  9274 catalog_manager.cc:5697] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 2 to 3, leader changed from b0812463215649c3b011d36e2f0400c9 (127.8.4.68) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 3 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:48.518285  9274 catalog_manager.cc:5697] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 3 to 4, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 4 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:48.519891  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:48.500625  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:48.537377  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:48.541574  9492 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:48.548949  9449 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:02:48.528842  9525 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:48.551016 11014 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:48.528146 10848 raft_consensus.cc:2804] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:48.551555 11014 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.551996 10848 raft_consensus.cc:697] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 4 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:02:48.541219  9372 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:48.544063  9418 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:48.548410  9369 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:48.553121 10848 consensus_queue.cc:237] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:48.546645 11059 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.556118  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:48.492424 11048 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.521162  9517 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:48.553213 11078 raft_consensus.cc:2749] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:48.528846 10759 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:48.553390  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:48.529433  9452 raft_consensus.cc:2393] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 5: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
W20260709 13:02:48.531432  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.563220  9523 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:48.557133 10937 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:48.568511  9377 raft_consensus.cc:2410] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:48.562597 11014 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:48.556967 11059 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:48.561136  9274 catalog_manager.cc:5697] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 2 to 5, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 5 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:48.575951  9519 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:48.581506  9418 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:48.582741 11078 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:48.583318  9418 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:48.584510 11078 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:48.573624 10917 consensus_queue.cc:1059] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:02:48.591909  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:02:48.592422  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.592729  9445 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:48.596586 11078 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:02:48.609418  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.615235 11048 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:48.548106 11109 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:48.617262 11078 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:48.619108  9274 catalog_manager.cc:5697] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 1 to 3, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 3 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:48.624313  9490 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:48.621685  9274 catalog_manager.cc:5697] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 3 to 5, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 5 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:48.637805  9418 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:48.640563  9274 catalog_manager.cc:5697] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 1 to 2, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 2 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:48.660562  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:48.664063  9452 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:48.666215  9448 raft_consensus.cc:1275] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:48.669395 11176 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.673171 11176 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:48.685433  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 111077us
W20260709 13:02:48.687639  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 59534.5us
I20260709 13:02:48.689786  9490 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:48.692724  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:48.676687 11176 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:48.665392 11118 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:48.695798  9448 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:48.685663 11052 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:48.702323  9418 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:48.706288  9445 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:48.703394  9341 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:48.708721  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.711445  9369 raft_consensus.cc:1240] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:48.711551 10774 raft_consensus.cc:2749] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:02:48.711460  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:48.717921 11171 log.cc:927] Time spent T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:02:48.693687 10917 consensus_queue.cc:1243] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:02:48.718465  9448 raft_consensus.cc:1275] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:48.716496 11014 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.724020  9490 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:48.724813  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.708216 11176 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:48.709059 11017 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:48.728166  9368 raft_consensus.cc:1240] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:48.699966 11028 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.732942  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.734028  9418 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:48.734148  9368 raft_consensus.cc:2393] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 4: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:48.736485  9368 raft_consensus.cc:1240] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:48.728703 11152 consensus_queue.cc:1048] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:02:48.738284 11174 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:48.726024 10641 consensus_queue.cc:1059] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:02:48.728964 11017 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:48.739557 11017 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:48.737191  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.741991  9369 raft_consensus.cc:2393] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 5: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:48.729143 11078 consensus_queue.cc:1048] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:02:48.744616 11118 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:48.746822  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.749246 11118 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:48.749423  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.749817 11118 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:48.750252  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.750561  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.751372  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.751632  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.752084  9371 raft_consensus.cc:2393] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 5: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:48.752240  9370 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:48.746909  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.747184  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.745754 11017 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.747618  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.748364  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.748452  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.748749  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.754104 11059 raft_consensus.cc:3055] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:48.755609  9372 raft_consensus.cc:2393] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 5: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:48.755643 11059 raft_consensus.cc:740] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:48.757241  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.756911 11059 consensus_queue.cc:260] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.757838  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:48.758388 11059 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:48.758599  9374 raft_consensus.cc:2393] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 4: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:48.759371  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.759641  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.760565  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:48.760774 10641 raft_consensus.cc:3055] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:48.758404  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.761471  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:48.762228  9375 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:48.762705  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.761191 10641 raft_consensus.cc:740] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:48.753942  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.764307  9370 raft_consensus.cc:2393] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 5: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:48.764153 10641 consensus_queue.cc:260] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.756680  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.765332 11028 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:48.765702 10641 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.766187  9373 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:02:48.766461 11014 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:48.753674  9418 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:48.767503 11078 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:48.767918 11078 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:48.768301 11078 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:48.752854  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.761703  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.773149 10774 consensus_queue.cc:1048] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:48.773375  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:48.774245  9368 raft_consensus.cc:2393] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 4: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:48.770649  9418 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:48.775965  9418 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:48.776685 10774 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:48.777136 10774 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:48.777603 10774 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:48.778460 10937 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:48.777927  9418 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:48.779206 10937 raft_consensus.cc:697] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:48.779868 11044 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:48.780185  9418 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:48.780344 11044 raft_consensus.cc:697] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:48.781342 11113 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:48.781809 11113 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:48.782222 11113 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:48.783133 10937 consensus_queue.cc:237] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:48.783797 11107 consensus_queue.cc:1048] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:48.781550 11044 consensus_queue.cc:237] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.786338  9341 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:48.777112  9375 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:02:48.791777  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:48.775066  9490 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:48.799180  9368 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:48.808693  9418 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:48.798619  9341 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:48.789857 11107 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:48.803261  9374 raft_consensus.cc:2410] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:48.810527 11014 consensus_queue.cc:1059] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:02:48.813089 10677 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:48.813556 10677 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.813889 10677 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:48.814260 11014 raft_consensus.cc:3055] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:48.815083 11014 raft_consensus.cc:740] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:48.814985 10774 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.817576 11113 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.818085 11017 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:48.818713 11028 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:48.819631 11113 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:48.829706  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 54751.8us
I20260709 13:02:48.820573 11078 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.836687  9341 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:48.816509 11014 consensus_queue.cc:260] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.838088  9341 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:48.839265 11109 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:48.839793 10774 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:48.840912  9490 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:48.834458 11044 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:48.867044  9446 raft_consensus.cc:1240] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:48.869387  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:02:48.877619  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 69011.7us
I20260709 13:02:48.861204 11017 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:48.860077 11109 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.880648  9447 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:48.835691 10759 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:02:48.881946  9418 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:48.873050 11044 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.921058 11044 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:48.884809 11017 raft_consensus.cc:697] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:48.921710  9418 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:48.922781 10937 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:48.922560 11017 consensus_queue.cc:237] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.923050  9418 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:48.923460 11179 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:48.923887 11179 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:48.924235 11179 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:48.878072 11176 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:48.925500 10774 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:48.885070 11109 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:48.926074 10774 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:48.926501 10774 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:48.929801  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.931964 10937 raft_consensus.cc:697] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:48.924394  9418 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:48.871390 11028 consensus_queue.cc:1175] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d62c9d5a052b42ce8675f8438f846526" responder_term: 5 status { last_received { term: 5 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 5 index: 3 } }
I20260709 13:02:48.883749  9490 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:48.920027  9368 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:02:48.838323 11174 consensus_queue.cc:1059] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:02:48.933374 11175 consensus_queue.cc:1059] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:48.937206 11176 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.942277 10937 consensus_queue.cc:237] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.937199  9492 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:48.838682 10749 consensus_queue.cc:1048] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:02:48.952749  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:48.961539  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:48.962843  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:48.964510  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:48.969504  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 85842.4us
I20260709 13:02:48.970705  9490 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:48.974393  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:48.885108 11118 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.931780 11179 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.976970 10917 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:48.987391  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:48.988204  9445 raft_consensus.cc:2368] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6.
I20260709 13:02:48.990195 10774 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:48.992928  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:48.995628  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:48.964668 11184 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:49.005273  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:49.005177  9445 raft_consensus.cc:2393] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 6: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:49.009460  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:49.010967 11184 raft_consensus.cc:697] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 2 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:49.012141 11179 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:49.006695 11109 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.014688  9448 raft_consensus.cc:1240] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:49.016450 11109 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:49.023034  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 85876.7us
I20260709 13:02:49.017596 11078 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:49.008922  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:48.996557 11175 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:48.992475 10917 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:49.018281 11118 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:49.021106 10759 consensus_queue.cc:1059] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:49.021813 11052 raft_consensus.cc:3055] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:48.966964 11176 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.017401  9447 raft_consensus.cc:1240] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:49.012063 11184 consensus_queue.cc:237] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.034783  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:49.026453  9492 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:49.035938  9444 raft_consensus.cc:2393] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 5: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:49.006304 10774 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:49.043970  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:49.043960  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 73358.2us
I20260709 13:02:49.033222 10917 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:49.064111 11108 raft_consensus.cc:3055] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:49.064599 11108 raft_consensus.cc:740] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:49.065326 11017 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:49.065542 11108 consensus_queue.cc:260] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.065871 11017 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.066334  9368 raft_consensus.cc:1275] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:49.066824 11108 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:49.067993 11017 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:49.068092 11120 consensus_queue.cc:1048] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:49.033988 11052 raft_consensus.cc:740] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:49.071568 11052 consensus_queue.cc:260] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.072921 11052 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:49.073623 11028 raft_consensus.cc:3055] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:49.074096 11028 raft_consensus.cc:740] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:49.074956 11028 consensus_queue.cc:260] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:49.076427 11028 raft_consensus.cc:3060] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:49.050779  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:49.055078 10065 raft_consensus.cc:1275] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:49.056980  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:49.086299  9446 raft_consensus.cc:2376] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4. Re-sending same reply.
I20260709 13:02:49.088147 11118 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:49.093452 10774 consensus_queue.cc:1059] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:49.095309 10774 raft_consensus.cc:3055] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:49.095784 10774 raft_consensus.cc:740] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:02:49.097707  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 71752.8us
I20260709 13:02:49.057265 10677 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.059514 11014 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:49.059883 11176 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:49.060192 11174 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:49.007364 11044 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.098047 11179 consensus_queue.cc:1048] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:02:49.102945 11044 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:49.103740  9443 raft_consensus.cc:2368] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 4. Current term is 5.
I20260709 13:02:49.100972  9492 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:49.106761 11174 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:49.088210  9418 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
W20260709 13:02:49.108261  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 79506.3us
I20260709 13:02:49.107447  9492 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:49.136899  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 48767.3us
I20260709 13:02:49.150492  9418 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:49.153051  9341 leader_election.cc:400] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 4. Current term is 5.
I20260709 13:02:49.153474  9341 leader_election.cc:403] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:02:49.117432 10677 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:49.134858 11044 raft_consensus.cc:2764] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:02:49.154928  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 47549.2us
I20260709 13:02:49.158806  9418 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:49.159487 10937 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:49.165853  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.166594  9445 raft_consensus.cc:1240] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:49.112287 11191 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:49.173425  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:49.174099  9445 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:49.174450  9490 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:49.173710  9492 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:49.176465  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.178081  9449 raft_consensus.cc:1240] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:49.177258  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:49.179527  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:49.143249 10641 consensus_queue.cc:1059] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:02:49.170926 11017 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:49.184262  9447 raft_consensus.cc:2393] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:49.178352 11190 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:49.187522  9490 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:49.161919 11078 consensus_queue.cc:1059] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:02:49.190100 11078 raft_consensus.cc:3055] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:49.136858 10774 consensus_queue.cc:260] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.190469 11078 raft_consensus.cc:740] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:49.191252 10774 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:49.191591 11078 consensus_queue.cc:260] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.192487 11078 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:49.161592 10749 consensus_queue.cc:1059] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:02:49.189345 11174 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:49.178411 11113 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:49.198029  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:49.193128 11028 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:49.198119 11107 raft_consensus.cc:2955] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:49.199853  9443 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:49.201864 10917 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.203116 11118 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:49.204471 10917 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:49.206156 11192 ts_tablet_manager.cc:933] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
I20260709 13:02:49.147140 11186 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:02:49.180656 11048 consensus_queue.cc:1059] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:02:49.214337  9492 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:49.228253  9449 raft_consensus.cc:1240] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:49.216656 10677 consensus_queue.cc:1059] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
W20260709 13:02:49.236370  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.237660  9492 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:49.204489 10749 raft_consensus.cc:3055] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:49.218012 11014 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:49.246335  9492 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:49.223960  9445 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:02:49.247993  9492 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:02:49.253993  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 79753.4us
I20260709 13:02:49.239552 10917 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:49.245126 11174 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:49.244727 10749 raft_consensus.cc:740] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:49.256129 11190 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:49.253768 11028 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:49.250612 11048 raft_consensus.cc:3055] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:49.268916  9490 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:49.245537 10641 raft_consensus.cc:3055] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:02:49.282148  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.260456 11014 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:49.267082 11174 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:49.278239 10641 raft_consensus.cc:740] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:49.276938 11048 raft_consensus.cc:740] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:49.296221 11192 tablet_copy_client.cc:323] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.65:37547
W20260709 13:02:49.313917  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 141806us
I20260709 13:02:49.318979  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:49.320844  9375 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:02:49.296849 11174 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:49.325901 10749 consensus_queue.cc:260] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.341259 11174 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.294643 11190 raft_consensus.cc:697] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:49.315958 11059 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:49.297264 11014 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.342829 11190 consensus_queue.cc:237] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.345077 11014 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:49.346285 10641 consensus_queue.cc:260] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.347734 10641 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:49.320215 10299 raft_consensus.cc:3055] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:49.323417  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:49.328866  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:49.327405  9492 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:49.304345 11028 raft_consensus.cc:697] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:49.341673 11017 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 4. Current term is 5.
I20260709 13:02:49.363620  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:49.349315  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:49.349490 10299 raft_consensus.cc:740] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:49.375144  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:02:49.378840  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 51511.7us
I20260709 13:02:49.377661  9373 raft_consensus.cc:1240] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:49.355275  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:49.381587  9376 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:49.355857  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:49.376209  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:49.372278  9490 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:49.385357  9519 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:02:49.381424  9523 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:02:49.385555  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:49.387248  9372 raft_consensus.cc:2410] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:02:49.380270 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 88497.9us
I20260709 13:02:49.390072  9519 raft_consensus.cc:1275] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:49.365422  9443 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:49.341343 10749 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:49.394503  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:49.397478  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:49.397836 10299 consensus_queue.cc:260] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.400555  9526 raft_consensus.cc:1240] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:49.422951 10299 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:49.425891  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 102464us
W20260709 13:02:49.429173  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.431229 11174 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:49.386091 11175 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:49.446166  9490 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:49.446583  9371 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:49.431943 11014 raft_consensus.cc:2804] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:49.349396 11048 consensus_queue.cc:260] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.435218 11175 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:49.463388 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 52831.7us
I20260709 13:02:49.455304  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:49.465507  9526 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:49.466207  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:49.467018  9519 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:49.454308 11190 raft_consensus.cc:2804] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:49.471491 11190 raft_consensus.cc:697] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 4 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:02:49.471763 11197 log.cc:927] Time spent T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:02:49.472442 11190 consensus_queue.cc:237] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.451782 11014 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:49.481678 11014 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:49.485152 11028 consensus_queue.cc:237] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.495743 11210 consensus_queue.cc:1048] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 13:02:49.503772  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.507979  9445 raft_consensus.cc:1240] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
W20260709 13:02:49.511152  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.460141 11175 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:49.524748  9376 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:02:49.524145  9523 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:02:49.526961  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:49.527901  9523 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:49.519080 11014 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.532642 11014 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:49.541057  9519 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:49.537848  9341 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:49.542351  9341 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:49.537138 11048 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:49.550305  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:49.551163  9519 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:49.553088  9490 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:49.554661  9490 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:49.542412 10641 consensus_queue.cc:1059] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:02:49.555946 11014 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:49.556670 10641 raft_consensus.cc:3055] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:49.557149 10641 raft_consensus.cc:740] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:49.546736 11207 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:49.558161 10641 consensus_queue.cc:260] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.547609 11108 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:49.559327 11108 raft_consensus.cc:697] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:49.559541 10641 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:49.558667 11207 raft_consensus.cc:697] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:49.562234 11207 consensus_queue.cc:237] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.568858  9490 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:49.573575  9523 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:02:49.576151  9526 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
W20260709 13:02:49.577958 11212 log.cc:927] Time spent T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:02:49.560324 11108 consensus_queue.cc:237] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.579983  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:49.580188  9418 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:49.581727  9490 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:49.582631  9523 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:49.585266  9418 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:49.586050  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.588542  9490 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:49.588809  9519 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:02:49.584379 11191 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:02:49.592651  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.593904  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:49.594548  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:49.595259  9526 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:49.578804 11014 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:49.596432  9371 raft_consensus.cc:1275] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:49.599911  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:49.600070  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:49.600168  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:49.601078  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:49.601293 11201 consensus_queue.cc:1059] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:02:49.598356 11190 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:49.598114 11174 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:49.603943  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.598582 11218 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:49.604521 11218 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:49.607326  9520 raft_consensus.cc:1240] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:02:49.598851 10774 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:49.613555 10774 raft_consensus.cc:697] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:49.614488 10774 consensus_queue.cc:237] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.595904  9418 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:49.619308  9377 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:49.619464  9418 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:49.620754  9418 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:49.621093  9490 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:49.622033  9418 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:49.622601  9371 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:02:49.623994  9371 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:49.627060  9523 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:49.604915 11218 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:49.625201 11044 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:49.625334 11113 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:49.645931  9526 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:02:49.646616  9490 leader_election.cc:400] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6.
I20260709 13:02:49.647082  9490 leader_election.cc:403] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:49.650667  9490 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:49.652812  9520 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:49.654749 11107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:60188 (request call id 7) took 2321 ms. Trace:
I20260709 13:02:49.628207 11078 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:49.659341  9490 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:49.662914  9490 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:49.645783 10917 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:49.671830  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.680445  9490 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:49.686792  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 140042us
I20260709 13:02:49.681931 10774 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:49.684407 11190 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:49.694792  9522 raft_consensus.cc:1275] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:49.661231 11059 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6.
I20260709 13:02:49.672331 11028 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:49.701126  9521 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:49.701535  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:49.702168  9517 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:49.709797  9376 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:02:49.670632 11052 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:49.714864  9387 tablet_copy_service.cc:140] P 925acbe78db14db3b9e4cfc857717947: Received BeginTabletCopySession request for tablet 45a4f94c156249adab9c2b1ffb00ac46 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:50568)
I20260709 13:02:49.715510  9387 tablet_copy_service.cc:161] P 925acbe78db14db3b9e4cfc857717947: Beginning new tablet copy session on tablet 45a4f94c156249adab9c2b1ffb00ac46 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:50568: session id = b0812463215649c3b011d36e2f0400c9-45a4f94c156249adab9c2b1ffb00ac46
I20260709 13:02:49.717217 10774 raft_consensus.cc:697] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:49.670814 11191 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:49.728534  9370 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:02:49.733657  9517 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:49.738730  9372 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:02:49.704974 11176 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:49.742210  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:49.656486 11175 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.700755  9369 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:49.744514  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:49.747459  9521 raft_consensus.cc:2376] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3. Re-sending same reply.
I20260709 13:02:49.742410 11014 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.755633  9525 raft_consensus.cc:2393] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 7: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:49.757198  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:49.759509  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:49.760301  9517 raft_consensus.cc:2376] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6. Re-sending same reply.
I20260709 13:02:49.761144 11044 raft_consensus.cc:697] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:49.762600  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:49.762965 11044 consensus_queue.cc:237] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.764278  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:49.766366  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:49.767416  9517 raft_consensus.cc:2368] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 4. Current term is 5.
W20260709 13:02:49.767436  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 145459us
I20260709 13:02:49.770392  9517 raft_consensus.cc:1275] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:49.781122  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:49.745849 11218 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.766084 11014 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.792263  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:49.801036  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.810995  9521 raft_consensus.cc:1240] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:49.755331 10774 consensus_queue.cc:237] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.789911 11113 raft_consensus.cc:697] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:49.794447 11218 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:49.828924 11113 consensus_queue.cc:237] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:49.832760  9517 raft_consensus.cc:1240] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:02:49.840596  9517 raft_consensus.cc:1240] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:02:49.871068  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:49.869361 11175 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:49.872030  9519 raft_consensus.cc:2410] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:49.655349 11107 rpcz_store.cc:276] 0709 13:02:47.333731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.418845 (+ 85114us) service_pool.cc:224] Handling call
0709 13:02:47.978906 (+560061us) log.cc:844] Serialized 485 byte log entry
0709 13:02:48.156579 (+177673us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b540026c620. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5864e3142 00007fb5864c3eaa 00007fb5864cad53 00007fb5864cacd9 00007fb5864cac69 00007fb5864cac31 00007fb5864c9dfd 000000000038f354 000000000038f199 00007fb58347d475
0709 13:02:48.286587 (+130008us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b540026c620. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5864e3142 00007fb5864c3eaa 00007fb5864cad53 00007fb5864cacd9 00007fb5864cac69 00007fb5864cac31 00007fb5864c9dfd 000000000038f354 000000000038f199 00007fb58347d475
0709 13:02:48.326280 (+ 39693us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b2c0001afe8. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb584e63a11 00007fb584e72a0a 00007fb584e72693 00007fb584e72631 00007fb5865a6b52 00007fb5865a6cf5 00007fb5864e3691 00007fb5864c3eaa 00007fb5864cad53 00007fb5864cacd9 00007fb5864cac69
0709 13:02:48.385573 (+ 59293us) spinlock_profiling.cc:243] Waited 41.1 ms on lock 0x7b180023c520. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865a6d01 00007fb5864e3691 00007fb5864c3eaa 00007fb5864cad53 00007fb5864cacd9 00007fb5864cac69 00007fb5864cac31 00007fb5864c9dfd 000000000038f354 000000000038f199
0709 13:02:49.654646 (+1269073us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55931,"raft.queue_time_us":57372,"raft.run_cpu_time_us":17430,"raft.run_wall_time_us":548933,"spinlock_wait_cycles":121043968,"thread_start_us":55832,"threads_started":1,"wal-append.queue_time_us":167619,"wal-append.run_cpu_time_us":2098,"wal-append.run_wall_time_us":1008490}
I20260709 13:02:49.877892 11014 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:49.904325 11052 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:49.904827  9517 raft_consensus.cc:1240] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:49.907110  9521 raft_consensus.cc:1240] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:49.907552  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:02:49.907948  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:49.908550  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.916033  9446 raft_consensus.cc:1275] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:49.919924  9369 consensus_queue.cc:237] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:49.920953 11078 raft_consensus.cc:697] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:49.924861  9521 raft_consensus.cc:1240] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:49.925206  9524 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:49.925230  9519 raft_consensus.cc:1240] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:49.926519  9521 raft_consensus.cc:1240] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:49.929237  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:49.938541  9521 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:02:49.939627  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:49.940346  9522 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:49.941202  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:49.942710  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:49.945020  9522 raft_consensus.cc:1240] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:49.948908  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:49.950735  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:49.951984  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:49.953377  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:49.953509  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:49.954741  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:49.955403  9445 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:02:49.956279  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:49.958791  9447 raft_consensus.cc:2393] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 5: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:49.959649  9446 raft_consensus.cc:1240] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:49.960213  9418 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:49.965842  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:49.969959  9448 raft_consensus.cc:2393] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 6: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:49.972589  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:49.970804  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:49.971652  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:49.972005  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:49.974799  9373 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:02:49.974014  9418 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:49.976210  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:49.977079  9525 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:02:49.970561  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:49.978245  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:49.980475  9418 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:49.982667 11237 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:49.987819  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:49.988112 11237 raft_consensus.cc:697] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:49.968680 11184 raft_consensus.cc:3055] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:49.968869 10774 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:49.992993  9443 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:49.994947  9418 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:50.012944  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.995746  9521 raft_consensus.cc:1275] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:49.998672  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:50.018087  9525 raft_consensus.cc:2410] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:49.997289 11239 consensus_queue.cc:1048] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:02:50.022399 11245 consensus_queue.cc:1059] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:02:50.023536 11245 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:50.024869  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:50.024976 11245 raft_consensus.cc:697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:50.025547  9521 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:50.026005 11245 consensus_queue.cc:237] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:50.026547  9526 raft_consensus.cc:1240] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:50.027459  9343 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:50.029663  9518 raft_consensus.cc:1240] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:50.030040  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:50.024427 11230 raft_consensus.cc:3055] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:50.030722 11230 raft_consensus.cc:740] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:49.995229 11044 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:49.995096 11184 raft_consensus.cc:740] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:50.031708 11230 consensus_queue.cc:260] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:50.080338  9373 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:02:50.030862  9520 raft_consensus.cc:2368] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 4. Current term is 5.
W20260709 13:02:50.035810 11246 log.cc:927] Time spent T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:02:50.041074 11078 consensus_queue.cc:237] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:50.086828  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 102854us
I20260709 13:02:50.043521  9272 catalog_manager.cc:5697] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.056879  9519 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
W20260709 13:02:50.057714  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.088550  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.059725  9376 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:02:50.083943  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:50.091333  9521 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:50.091867  9443 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:02:50.097489  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:50.098224  9525 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:50.084616  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:50.099074  9526 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:50.099511  9525 raft_consensus.cc:1275] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:02:50.102762  9521 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:02:50.097586  9523 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:50.099843  9525 pending_rounds.cc:85] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 2
I20260709 13:02:50.079855 11044 raft_consensus.cc:697] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:49.995793 11218 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
I20260709 13:02:50.106145  9525 pending_rounds.cc:107] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:02:50.114022  9525 raft_consensus.cc:2889] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:50.091164 11048 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:02:50.125777  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.135341 11044 consensus_queue.cc:237] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:50.136337  9526 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
W20260709 13:02:50.141255  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 113871us
W20260709 13:02:50.142040  9342 consensus_peers.cc:597] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 807906edc34d41589d9b860b72f70e16. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:50.142831  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 61061us
I20260709 13:02:50.112234 10759 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:50.143517  9492 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:50.149061  9492 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:50.148922  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:50.149236  9526 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:02:50.170037  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:50.170395  9376 raft_consensus.cc:1275] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:50.168942  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:50.172312  9374 raft_consensus.cc:1275] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:50.134403 11048 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:50.161190  9387 tablet_copy_source_session.cc:215] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:50.186713  9373 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:50.119431 11239 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:02:50.244073  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:50.188182  9526 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:50.246559  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:50.247581  9526 raft_consensus.cc:1240] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:50.247717  9450 raft_consensus.cc:2393] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 5: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:50.161942 11176 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:50.135030 11232 consensus_queue.cc:1059] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:02:50.249250 11232 consensus_queue.cc:1243] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Peer 6d50f1c263264b21919230bee398022b log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:02:50.251935  9444 raft_consensus.cc:1275] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:50.253376  9445 raft_consensus.cc:1275] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:50.238366 10759 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.147759 11179 consensus_queue.cc:1048] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:02:50.163703 11184 consensus_queue.cc:260] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:50.166298 11118 consensus_queue.cc:1048] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:02:49.992065 11237 consensus_queue.cc:237] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:50.171265 11174 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:50.241727 11228 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:50.275436  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 132594us
I20260709 13:02:50.258353 11230 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:50.259969 11240 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:50.185211 11245 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:50.272872  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 46234.8us
I20260709 13:02:50.281059  9490 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:50.284374  9490 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:50.267616 11176 raft_consensus.cc:697] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:50.289036  9452 raft_consensus.cc:1275] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:02:50.280880  9343 leader_election.cc:336] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Timed out: RequestConsensusVote RPC to 127.8.4.67:35929 timed out after 1.763s (SENT)
I20260709 13:02:50.289917  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:50.294935  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.294914  9490 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:50.295845  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.298234 10641 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:50.301318 11048 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:50.301090 11253 consensus_queue.cc:1175] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6d50f1c263264b21919230bee398022b" responder_term: 5 status { last_received { term: 3 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: [4.3-4.3]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:50.283490 11174 raft_consensus.cc:697] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:50.304275 11174 consensus_queue.cc:237] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:50.297719  9444 raft_consensus.cc:2955] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:50.309346  9490 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:50.279026 11028 consensus_queue.cc:1059] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:02:50.270601 10759 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:50.316597  9490 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:50.278098 11239 consensus_queue.cc:1048] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:02:50.288872 11191 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:50.314626  9445 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:02:50.296823 10917 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:50.291507 11186 consensus_queue.cc:1048] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:02:50.314774 11052 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:50.280000 11228 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:50.342833  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 61962.2us
I20260709 13:02:50.320791 11175 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:50.349539 11176 consensus_queue.cc:237] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:50.360204 10759 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:50.366174  9343 leader_election.cc:336] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Timed out: RequestConsensusVote RPC to 127.8.4.67:35929 timed out after 1.804s (SENT)
I20260709 13:02:50.367699  9343 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:50.341405  9518 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:50.369807 11052 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:50.376338 11109 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:02:50.391168  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 74679.1us
I20260709 13:02:50.392424  9490 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:50.403357  9490 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:50.495147  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 91886.8us
W20260709 13:02:50.510742  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.512919 11263 consensus_queue.cc:1048] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:50.509337 11240 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.515202 11240 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:50.516956 11228 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:50.530369  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 186064us
I20260709 13:02:50.537638  9375 raft_consensus.cc:1275] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:50.494216 10917 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:50.539657  9371 raft_consensus.cc:1275] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:50.540482  9375 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:50.547358  9373 raft_consensus.cc:1275] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:02:50.509719 11233 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.549110  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:50.549975  9370 raft_consensus.cc:2410] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:50.511615 11175 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:50.556926 11260 log.cc:927] Time spent T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:02:50.521432 11052 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:02:50.569119  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:50.569964  9370 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
W20260709 13:02:50.563215 11257 log.cc:927] Time spent T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 13:02:50.568234 11254 log.cc:927] Time spent T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:02:50.572160  9343 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:50.577330  9272 catalog_manager.cc:5697] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 1 to 4, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 4 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.554198 11233 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:50.577857 11186 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:50.581717 11233 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:50.585093 11240 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:50.585872  9450 raft_consensus.cc:1275] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:02:50.586287  9450 pending_rounds.cc:85] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 2
I20260709 13:02:50.586508  9450 pending_rounds.cc:107] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:02:50.586757  9450 raft_consensus.cc:2889] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:50.587044  9450 pending_rounds.cc:107] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:02:50.587257  9450 raft_consensus.cc:2889] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:50.577318  9343 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:50.597182  9343 leader_election.cc:400] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 4. Current term is 5.
I20260709 13:02:50.593950 11186 raft_consensus.cc:2749] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:50.596122 11052 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:50.593051 11250 log.cc:927] Time spent T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.353s	user 0.000s	sys 0.010s
I20260709 13:02:50.604550 11052 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:50.608068 11052 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:50.609938 11245 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:50.610723 11245 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:50.611083  9343 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:50.612057 10299 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:50.613982 11186 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:50.617811  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:50.618745  9343 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:50.618745  9523 raft_consensus.cc:2410] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:50.619660 11186 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:50.620085 11186 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:50.620472 11186 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:50.622320  9343 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:50.623800 10299 consensus_queue.cc:1059] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:50.626186 10299 raft_consensus.cc:3055] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:50.626511 10299 raft_consensus.cc:740] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:50.626679  9443 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:02:50.627202 10299 consensus_queue.cc:260] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:50.629724 10299 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:50.633832 11199 consensus_queue.cc:1048] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:50.628083 11107 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:50.639516 11184 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:50.661160 11191 raft_consensus.cc:3055] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:50.671173  9343 leader_election.cc:400] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 4. Current term is 5.
I20260709 13:02:50.671945  9343 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:50.674343 10641 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:50.674669  9343 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:50.675051 10641 raft_consensus.cc:697] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:50.668807 11191 raft_consensus.cc:740] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:50.682830 11191 consensus_queue.cc:260] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:50.684058 11191 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:50.685392 11186 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:50.687801 11186 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:50.690542 10641 consensus_queue.cc:237] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:50.691715  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:50.692225 11251 log.cc:927] Time spent T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.454s	user 0.002s	sys 0.003s
I20260709 13:02:50.689168  9447 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:50.692652  9448 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:50.669770 10759 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:50.707149 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 45677.9us
I20260709 13:02:50.704960 11248 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:50.707343 11048 consensus_queue.cc:1059] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:02:50.707726 10759 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:50.726986  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:50.727777  9519 raft_consensus.cc:2376] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6. Re-sending same reply.
I20260709 13:02:50.715317 11248 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:50.730487  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:50.732009  9519 raft_consensus.cc:2410] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:50.712498 11199 consensus_queue.cc:1048] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:02:50.743556  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:50.744568  9521 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:50.746457  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:50.747076  9522 raft_consensus.cc:2393] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 5: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:50.749509  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:50.733469 11248 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:50.755985  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:50.757989  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:50.715576 11186 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:02:50.768787  9525 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
W20260709 13:02:50.744593 11268 log.cc:927] Time spent T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:02:50.721168 11109 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
W20260709 13:02:50.776250  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.764192 11052 consensus_queue.cc:1048] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
W20260709 13:02:50.778962 11272 log.cc:927] Time spent T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:02:50.763388 11014 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:02:50.769850 11174 consensus_queue.cc:1048] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:02:50.788096 11186 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:50.798796 11271 log.cc:927] Time spent T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:02:50.821499  9418 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:50.796767 11278 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:50.845518  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.846148  9418 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:50.849498  9418 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:50.805948 11186 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:50.816357 10759 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:50.838896 11113 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:50.870985 11109 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:02:50.871567 11274 log.cc:927] Time spent T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.136s	user 0.002s	sys 0.000s
I20260709 13:02:50.874228 11280 ts_tablet_manager.cc:933] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
W20260709 13:02:50.876255 11276 log.cc:927] Time spent T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:02:50.857558 10774 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:50.877199 10774 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.877667 10774 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:50.878762 11275 log.cc:927] Time spent T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:02:50.855975 11239 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:50.886140 11192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a4f94c156249adab9c2b1ffb00ac46. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:50.886387 11261 log.cc:927] Time spent T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.365s	user 0.001s	sys 0.001s
I20260709 13:02:50.889405  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:50.890092  9369 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:02:50.888357  9521 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:50.843016 11184 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:02:50.842759 11234 consensus_queue.cc:1048] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:02:50.850627 11278 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:50.893697  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:50.899312 11278 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:50.900192  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:50.900844  9520 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:02:50.900931 11279 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.902530  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:50.903167  9369 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:50.910347  9343 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:50.850823 10937 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:02:50.914904  9492 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:50.917697  9343 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:50.933737  9377 raft_consensus.cc:1275] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:02:50.934546 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 79347.2us
I20260709 13:02:50.939240  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:50.943763  9373 raft_consensus.cc:1275] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:50.946170  9370 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:50.948915 11176 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:50.949406 11176 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.949774 11176 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:50.951140 11239 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:50.953251 11239 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:50.953342 11191 consensus_queue.cc:1048] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:50.956475 11107 raft_consensus.cc:3055] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:50.956924 11107 raft_consensus.cc:740] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:50.901451 11279 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:50.938549 11278 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:50.961447 11201 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:50.923496 11179 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.957846 11107 consensus_queue.cc:260] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:50.989823 10299 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:50.997692  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:02:50.989483  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 71873.6us
I20260709 13:02:51.118917  9448 raft_consensus.cc:2393] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 5: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:51.119127  9343 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:51.093377 11186 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:51.026619  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:51.040282  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:51.039881  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:50.971998 11014 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:51.128319  9343 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:51.012828  9445 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:51.134023  9448 raft_consensus.cc:1275] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:50.976919 11280 tablet_copy_client.cc:323] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.65:37547
I20260709 13:02:51.139711  9521 raft_consensus.cc:1275] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:51.142149  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:51.149441 11184 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:51.150331 11184 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:51.153940 11184 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:51.039520 11278 raft_consensus.cc:697] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:51.063300 11118 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.989233 11201 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.180984  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:51.158572 11265 log.cc:927] Time spent T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.579s	user 0.003s	sys 0.001s
W20260709 13:02:51.157279 11286 log.cc:927] Time spent T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:02:50.987377 11237 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.181s
W20260709 13:02:51.156734 11290 log.cc:927] Time spent T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:02:51.018829 11113 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.162s
I20260709 13:02:51.190016  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:51.180584 11201 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:51.206813  9517 raft_consensus.cc:1275] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:51.171494 11186 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:51.156029 11282 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:51.100103 11248 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:51.180409 11107 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:51.251240  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:51.139322 11179 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:51.254849  9447 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:02:51.255689  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:51.162040 11014 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:51.182204 11118 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:51.243399 11233 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:51.268802  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:51.244688 11279 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:51.279475  9373 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:51.282266  9524 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:51.286441 10299 consensus_queue.cc:1048] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:51.258791 11176 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:51.285344  9525 raft_consensus.cc:1275] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:02:51.301622 11285 log.cc:927] Time spent T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
W20260709 13:02:51.310145 11267 log.cc:927] Time spent T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:02:51.327649  9517 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:02:51.336095 11295 log.cc:927] Time spent T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.254s	user 0.002s	sys 0.000s
I20260709 13:02:51.338706 11118 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:51.342602  9341 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:51.344600 10641 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:51.345335 10641 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:51.345852 10641 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:51.275493 11233 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:51.353762 11293 log.cc:927] Time spent T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.118s	user 0.001s	sys 0.001s
W20260709 13:02:51.354444 11297 log.cc:927] Time spent T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:02:51.292169 11109 consensus_queue.cc:1059] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:02:51.356555 11109 raft_consensus.cc:3055] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:51.356789 11014 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:51.356976 11109 raft_consensus.cc:740] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:51.357075  9274 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43244 (request call id 183) took 6531 ms. Trace:
I20260709 13:02:51.358186 11179 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:50.098958  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:51.357863 11109 consensus_queue.cc:260] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:51.353821 11294 log.cc:927] Time spent T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 13:02:51.365491  9272 catalog_manager.cc:5697] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 1 to 3, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 3 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:51.275651 11278 consensus_queue.cc:237] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:51.351249 10774 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:51.369364  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:51.375823  9376 raft_consensus.cc:2393] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 7: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:51.377485 10641 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:51.384838  9519 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:02:51.393497  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.398789  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:51.399327 10641 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:51.402180  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:51.403303  9519 raft_consensus.cc:2393] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 5: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:51.408645  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:51.409799  9519 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:02:51.412395 11305 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:51.414098 11305 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:51.415561  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:51.357539  9274 rpcz_store.cc:276] 0709 13:02:44.825470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.827428 (+  1958us) service_pool.cc:224] Handling call
0709 13:02:51.356970 (+6529542us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:48.877633 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:48.937708 (+ 60075us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:48.937798 (+    90us) write_op.cc:435] Acquired schema lock
0709 13:02:48.937822 (+    24us) tablet.cc:662] Decoding operations
0709 13:02:48.939520 (+  1698us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:48.939641 (+   121us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:48.939670 (+    29us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:02:48.945764 (+  6094us) tablet.cc:701] Row locks acquired
0709 13:02:48.949325 (+  3561us) write_op.cc:260] PREPARE: finished
0709 13:02:48.977178 (+ 27853us) write_op.cc:270] Start()
0709 13:02:49.002763 (+ 25585us) write_op.cc:276] Timestamp: P: 1783602168965572 usec, L: 0
0709 13:02:49.005029 (+  2266us) op_driver.cc:348] REPLICATION: starting
0709 13:02:49.005863 (+   834us) log.cc:844] Serialized 5878 byte log entry
0709 13:02:49.279398 (+273535us) op_driver.cc:464] REPLICATION: finished
0709 13:02:49.400384 (+120986us) write_op.cc:301] APPLY: starting
0709 13:02:49.400521 (+   137us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:49.454008 (+ 53487us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:49.458419 (+  4411us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:49.559570 (+101151us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:49.560004 (+   434us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:02:49.560082 (+    78us) write_op.cc:312] APPLY: finished
0709 13:02:49.560550 (+   468us) log.cc:844] Serialized 106 byte log entry
0709 13:02:49.560776 (+   226us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:49.560941 (+   165us) write_op.cc:454] Released schema lock
0709 13:02:49.561053 (+   112us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:49.561527 (+   474us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:49.561564 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":102863,"apply.run_cpu_time_us":6193,"apply.run_wall_time_us":163378,"num_ops":15,"prepare.queue_time_us":51785,"prepare.run_cpu_time_us":77701,"prepare.run_wall_time_us":338217,"raft.queue_time_us":68748,"raft.run_cpu_time_us":5105,"raft.run_wall_time_us":37334,"replication_time_us":274131,"thread_start_us":248902,"threads_started":4,"wal-append.queue_time_us":158416,"wal-append.run_cpu_time_us":39068,"wal-append.run_wall_time_us":1399632}]]}
I20260709 13:02:51.380489 10774 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:51.420210  9517 raft_consensus.cc:1275] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:51.401749 11048 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.424120 11048 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:51.422624  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:51.426174  9523 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:51.421525  9519 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:51.405880 11109 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:51.429549  9418 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:51.431206  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 86963.4us
I20260709 13:02:51.431743  9418 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:51.433172  9341 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:51.412907 11118 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:02:51.452214  9523 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:02:51.438205  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:02:51.458309 11307 log.cc:927] Time spent T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:02:51.465557 11048 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:51.471235 11298 log.cc:927] Time spent T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:02:51.436816 11245 consensus_queue.cc:1048] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:02:51.436671 11113 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:51.477280 11175 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.436952 11078 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:51.484308  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:51.496786 11176 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:51.501780  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 67139.8us
I20260709 13:02:51.505123  9370 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:51.506386  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:51.508852  9418 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:51.574631  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 65895.5us
I20260709 13:02:51.456869 11248 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:51.435037 11234 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:02:51.576874  9451 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:51.576818  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:51.577664  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:51.578761  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:51.590468  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:51.562199 11265 log.cc:927] Time spent T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:02:51.551669 11113 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:51.636135  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 62772.1us
I20260709 13:02:51.638312  9368 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:51.561934 11078 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.650869  9526 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:51.654738  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:51.641597  9370 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:02:51.497059 11201 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:51.594655 11305 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:51.656179 11078 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:51.612807 11107 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.643949 11113 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:51.668553  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:51.572367 11175 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:51.657469  9492 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:51.613173 11278 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:51.654951 11052 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.018s	sys 0.038s
I20260709 13:02:51.639632 11233 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:51.662364  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:02:51.662993 11297 log.cc:927] Time spent T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:02:51.674379  9374 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:02:51.685462  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:51.678877 11305 raft_consensus.cc:697] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:51.684629 11206 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:51.685601 11278 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:51.686051 11052 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.018s	sys 0.038s
I20260709 13:02:51.701989  9343 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:51.707006 11281 raft_consensus.cc:2955] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
W20260709 13:02:51.709228 11311 log.cc:927] Time spent T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:02:51.716727  9371 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:51.752832  9452 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:51.671147 11107 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:51.759320  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:51.763281  9368 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:51.769977  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:51.770825  9452 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:51.720048 11264 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.709511 11304 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:02:51.783660  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 81797.9us
I20260709 13:02:51.718580 11186 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:51.714293 11278 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:51.711656 11201 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:51.784444  9343 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:51.719885  9387 tablet_copy_service.cc:140] P 925acbe78db14db3b9e4cfc857717947: Received BeginTabletCopySession request for tablet 807906edc34d41589d9b860b72f70e16 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:50568)
I20260709 13:02:51.916383  9387 tablet_copy_service.cc:161] P 925acbe78db14db3b9e4cfc857717947: Beginning new tablet copy session on tablet 807906edc34d41589d9b860b72f70e16 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:50568: session id = b0812463215649c3b011d36e2f0400c9-807906edc34d41589d9b860b72f70e16
I20260709 13:02:51.917785 11175 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:51.925388  9521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1284) took 1016 ms. Trace:
I20260709 13:02:51.926263 11278 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:51.926927 11278 raft_consensus.cc:697] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:51.925868  9521 rpcz_store.cc:276] 0709 13:02:50.908798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.154945 (+246147us) service_pool.cc:224] Handling call
0709 13:02:51.161336 (+  6391us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:51.161772 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:51.161797 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:51.184167 (+ 22370us) log.cc:844] Serialized 52 byte log entry
0709 13:02:51.275191 (+ 91024us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:51.331223 (+ 56032us) log.cc:844] Serialized 14 byte log entry
0709 13:02:51.363965 (+ 32742us) log.cc:844] Serialized 14 byte log entry
0709 13:02:51.366591 (+  2626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:51.366661 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:51.467501 (+100840us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b1800377c80. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb5833f7c0a 00007fb58cb37219 00007fb58a43e58f 00007fb58347d571 00007fb58347f7c1 00007fb58347f779 00007fb58347f709 00007fb58347f6d1 00007fb58347e9cd
0709 13:02:51.925081 (+457580us) raft_consensus.cc:1685] finished
0709 13:02:51.925113 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:51.925309 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47094,"prepare.queue_time_us":92295,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":67,"raft.queue_time_us":38857,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":13470,"spinlock_wait_cycles":16772224,"thread_start_us":23465,"threads_started":1,"wal-append.queue_time_us":186608}
I20260709 13:02:51.927904 11278 consensus_queue.cc:237] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:51.925726  9448 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:51.768407 11332 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:51.933436 11332 raft_consensus.cc:697] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:51.934435 11332 consensus_queue.cc:237] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:51.791050 11264 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:51.939644 11264 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:51.710572 11305 consensus_queue.cc:237] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:51.790868 11304 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:51.951352 11304 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:51.894224  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:51.766566 11282 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.772708 11320 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:51.901786  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:02:51.821620  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:51.909672  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 125297us
I20260709 13:02:52.029578  9343 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:51.911365 11313 log.cc:927] Time spent T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 13:02:51.915500 11107 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:51.971793  9368 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:52.024494  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:52.033187  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 54995.7us
I20260709 13:02:52.036055  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:52.040004  9448 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:52.040201 10299 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:52.031378  9343 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:52.049953  9448 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:02:52.059293 10299 consensus_queue.cc:1059] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:51.908542 11186 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:52.070637  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:52.025746 11264 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.080547  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:52.086916  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 55595us
I20260709 13:02:52.059183 11175 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:52.061406 11192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44540 (request call id 189) took 3050 ms. Trace:
I20260709 13:02:52.165437  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:52.176601  9368 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:02:52.179570  9418 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:52.060264 10759 consensus_queue.cc:1048] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:02:52.132270 11315 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
W20260709 13:02:52.196673  9447 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.021s	sys 0.021s
I20260709 13:02:52.206358  9522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1288) took 1296 ms. Trace:
I20260709 13:02:52.040786 11282 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:52.089059 11264 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:52.376739  9525 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:02:52.282608  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 243032us
I20260709 13:02:52.268769  9370 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:02:52.269881 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 215370us
W20260709 13:02:52.383862  9444 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.006s	sys 0.012s
W20260709 13:02:52.382967  9492 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.001s	sys 0.017s
W20260709 13:02:52.385704  9447 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.021s	sys 0.021s
W20260709 13:02:52.390305  9492 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.001s	sys 0.017s
W20260709 13:02:52.413496  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 736765us
I20260709 13:02:52.203089 11245 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.212s
I20260709 13:02:52.342084 11052 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:52.418071 11351 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:02:52.232064 11109 consensus_meta.cc:287] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.793s	user 0.010s	sys 0.000s
I20260709 13:02:52.418694 11351 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:52.418454 11052 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:52.319628 11078 consensus_meta.cc:287] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.642s	user 0.008s	sys 0.001s
I20260709 13:02:52.320161 11348 consensus_queue.cc:1059] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.102s
I20260709 13:02:52.421265 11078 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:52.210140  9522 rpcz_store.cc:276] 0709 13:02:50.909862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.186262 (+276400us) service_pool.cc:224] Handling call
0709 13:02:51.186984 (+   722us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:51.192661 (+  5677us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:51.192687 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:51.249892 (+ 57205us) log.cc:844] Serialized 485 byte log entry
0709 13:02:51.407396 (+157504us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:51.407439 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:51.410908 (+  3469us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:52.206124 (+795216us) raft_consensus.cc:1685] finished
0709 13:02:52.206148 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:52.206296 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":132583,"threads_started":1,"wal-append.queue_time_us":288370}
I20260709 13:02:52.241258 11304 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.423724 11304 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:52.393623  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 304355us
W20260709 13:02:52.425751 11340 log.cc:927] Time spent T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:02:52.425911  9446 raft_consensus.cc:2368] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8.
I20260709 13:02:52.426378  9343 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:52.426555 11353 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:52.429167 11304 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:52.429893 11304 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:02:52.430254 11281 consensus_meta.cc:287] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.000s
I20260709 13:02:52.389204  9370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:02:52.431823  9370 raft_consensus.cc:606] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:02:52.432337  9370 raft_consensus.cc:614] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:52.433537  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:52.389681  9444 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.007s	sys 0.012s
I20260709 13:02:52.434736  9444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1422) took 1447 ms. Trace:
I20260709 13:02:52.211515 11315 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:52.341449 11337 log.cc:927] Time spent T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:02:52.206787 11240 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:52.339365 11299 log.cc:927] Time spent T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.840s	user 0.004s	sys 0.000s
I20260709 13:02:52.479679  9343 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:52.435154  9444 rpcz_store.cc:276] 0709 13:02:50.987049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.987640 (+   591us) service_pool.cc:224] Handling call
0709 13:02:50.987997 (+   357us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:51.091737 (+103740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:51.091768 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:51.475342 (+383574us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b4800380058. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58b493aa1 00007fb58b48ab37 00007fb58b48a9ca 00007fb58b58226f 00007fb58b581f37 00007fb58b59655c 00007fb58b596508 00007fb58b596488 00007fb58b596443 00007fb58b5956ec 00007fb58a4bfa96
0709 13:02:51.696763 (+221421us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b2c00010c48. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb584e63a11 00007fb584e73372 00007fb5865a5a01 00007fb58656a43a 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2
0709 13:02:51.737627 (+ 40864us) log.cc:844] Serialized 52 byte log entry
0709 13:02:52.434293 (+696666us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:52.434348 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.434437 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:52.434494 (+    57us) raft_consensus.cc:1685] finished
0709 13:02:52.434510 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:52.434677 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124495,"raft.queue_time_us":114362,"raft.run_cpu_time_us":1858,"raft.run_wall_time_us":372781,"spinlock_wait_cycles":39783552,"thread_start_us":696203,"threads_started":1,"wal-append.queue_time_us":677373}
W20260709 13:02:52.499356  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 49380.5us
I20260709 13:02:52.500018 10641 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
W20260709 13:02:52.312777 11334 log.cc:927] Time spent T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:02:52.207795 11336 raft_consensus.cc:3055] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:52.193773 11175 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:52.524024 10641 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:52.294034 11333 log.cc:927] Time spent T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:02:52.430510 11304 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:52.506615 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 69272.6us
I20260709 13:02:52.517927 11048 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:52.387650 11345 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.518447  9343 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:52.518700 11315 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:52.518494 11109 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:52.249462 11335 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:52.522437 11264 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:52.516163 11324 log.cc:927] Time spent T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.945s	user 0.006s	sys 0.000s
I20260709 13:02:52.311635 11346 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.198s
W20260709 13:02:52.263765 11113 consensus_meta.cc:287] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.001s
I20260709 13:02:52.583667 11113 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:52.212723 11199 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:52.387539 11234 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:02:52.546911  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 352964us
I20260709 13:02:52.479447 10937 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:02:52.550457  9376 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.014s	sys 0.014s
W20260709 13:02:52.596369  9376 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.014s	sys 0.014s
I20260709 13:02:52.506578 11253 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:52.522483 11287 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:52.586086  9445 raft_consensus.cc:2368] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4.
I20260709 13:02:52.526037 11336 raft_consensus.cc:740] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:52.501677 11186 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:52.588507  9418 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:52.550871 11317 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:52.626302 11332 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:52.630229  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:52.602042 10641 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:52.594409 11176 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:02:52.621757 11337 log.cc:927] Time spent T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:02:52.643396  9375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1055) took 1682 ms. Trace:
I20260709 13:02:52.576858 11109 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:52.643994  9375 rpcz_store.cc:276] 0709 13:02:50.957966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.959483 (+  1517us) service_pool.cc:224] Handling call
0709 13:02:50.959923 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:50.976375 (+ 16452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:50.976409 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:50.976943 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:02:51.248181 (+271238us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:51.248225 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:51.248296 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:52.338761 (+1090465us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:02:52.602109 (+263348us) raft_consensus.cc:1685] finished
0709 13:02:52.602141 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:52.639974 (+ 37833us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37289,"raft.queue_time_us":18004,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":9333,"spinlock_wait_cycles":23981440,"thread_start_us":225449,"threads_started":1,"wal-append.queue_time_us":437301}
I20260709 13:02:52.646893  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:52.586738 11335 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:52.652881  9444 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:02:52.633893 11239 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:52.550433 11345 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:52.164494 11192 rpcz_store.cc:276] 0709 13:02:48.990523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.990670 (+   147us) service_pool.cc:224] Handling call
0709 13:02:49.206529 (+215859us) ts_tablet_manager.cc:934] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
0709 13:02:50.843312 (+1636783us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:02:51.664114 (+820802us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:51.673520 (+  9406us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:02:51.923985 (+250465us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:02:51.924354 (+   369us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:52.025446 (+101092us) ts_tablet_manager.cc:989] Replica registered.
0709 13:02:52.040408 (+ 14962us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":368,"tablet-copy.queue_time_us":162745,"thread_start_us":167353,"threads_started":2}
I20260709 13:02:52.674777  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:52.665863  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 133136us
I20260709 13:02:52.675696  9444 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:52.656046  9447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1444) took 1327 ms. Trace:
I20260709 13:02:52.664837  9375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:02:52.679337  9375 raft_consensus.cc:606] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:02:52.603576 11199 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:52.681951 11369 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:52.682789 11335 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:52.689864 11199 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:52.643714 11317 raft_consensus.cc:697] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:52.686386 11348 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:52.685593  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:52.691570 11317 consensus_queue.cc:237] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:52.691895 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:52.687350  9368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1065) took 1028 ms. Trace:
I20260709 13:02:52.693109  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:02:52.693961 11358 log.cc:927] Time spent T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:02:52.691385 11348 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:52.693253  9368 rpcz_store.cc:276] 0709 13:02:51.658993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.206465 (+547472us) service_pool.cc:224] Handling call
0709 13:02:52.208968 (+  2503us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:52.229830 (+ 20862us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:52.229885 (+    55us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:52.235641 (+  5756us) log.cc:844] Serialized 52 byte log entry
0709 13:02:52.524756 (+289115us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:52.524811 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.524918 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:52.687095 (+162177us) raft_consensus.cc:1685] finished
0709 13:02:52.687118 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:52.687276 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1177,"raft.queue_time_us":61474,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":5563,"thread_start_us":248400,"threads_started":1,"wal-append.queue_time_us":368903}
I20260709 13:02:52.696336  9376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1057) took 1075 ms. Trace:
I20260709 13:02:52.696913  9375 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:52.696753  9376 rpcz_store.cc:276] 0709 13:02:51.620943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.625200 (+  4257us) service_pool.cc:224] Handling call
0709 13:02:51.625633 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:51.788650 (+163017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:51.788683 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:51.789190 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:02:52.596803 (+807613us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:52.596860 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.596971 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:52.695974 (+ 99003us) raft_consensus.cc:1685] finished
0709 13:02:52.696133 (+   159us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:52.696277 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":54598,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5839,"thread_start_us":969800,"threads_started":2,"wal-append.queue_time_us":884982}
I20260709 13:02:52.643990 11176 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:52.700474 11176 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:52.645695 11352 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:52.702749 11345 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:52.704186 11345 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:52.706755  9523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1071) took 1197 ms. Trace:
I20260709 13:02:52.707170  9523 rpcz_store.cc:276] 0709 13:02:51.508937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.581254 (+ 72317us) service_pool.cc:224] Handling call
0709 13:02:51.581627 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:51.652035 (+ 70408us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:51.652258 (+   223us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:51.653121 (+   863us) log.cc:844] Serialized 26 byte log entry
0709 13:02:52.705769 (+1052648us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b180015db40. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb5861124bc 00007fb58346048b 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b 00007fb586109d23 00007fb58610a0d1
0709 13:02:52.706003 (+   234us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:52.706054 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.706274 (+   220us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:52.706352 (+    78us) raft_consensus.cc:1685] finished
0709 13:02:52.706371 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:52.706668 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":72577,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":6525,"spinlock_wait_cycles":4575616,"thread_start_us":80280,"threads_started":2,"wal-append.queue_time_us":410188}
I20260709 13:02:52.708433 11109 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:52.608616 11234 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:52.676616  9447 rpcz_store.cc:276] 0709 13:02:51.328622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.329000 (+   378us) service_pool.cc:224] Handling call
0709 13:02:51.329366 (+   366us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:51.329735 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:51.329763 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:51.347832 (+ 18069us) log.cc:844] Serialized 52 byte log entry
0709 13:02:51.570253 (+222421us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:52.390915 (+820662us) log.cc:844] Serialized 14 byte log entry
0709 13:02:52.515647 (+124732us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b24000f5768. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833039c4 00007fb583301acb 00007fb5834bcdc9 00007fb5834bca55 00007fb5834bc09d 00007fb5860ee10e 00007fb58610588c 00007fb586104bb6 00007fb5861047d8 00007fb58610e221
0709 13:02:52.647186 (+131539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.647304 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:52.647371 (+    67us) raft_consensus.cc:1685] finished
0709 13:02:52.655811 (+  8440us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:52.655970 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112636,"prepare.queue_time_us":106546,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":1782,"raft.queue_time_us":128059,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":219,"spinlock_wait_cycles":40299776,"thread_start_us":1152228,"threads_started":3,"wal-append.queue_time_us":204616}
I20260709 13:02:52.710714 11234 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:52.700989 11348 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:52.701197 11192 tablet_copy_client.cc:806] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:52.681885 11239 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:02:52.627794 11253 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:52.625274 10937 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:02:52.713208 11334 log.cc:927] Time spent T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:02:52.641690 11332 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:52.660305 11052 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:52.723016  9373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 947) took 1555 ms. Trace:
I20260709 13:02:52.731966  9373 rpcz_store.cc:276] 0709 13:02:51.167485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.167628 (+   143us) service_pool.cc:224] Handling call
0709 13:02:51.183727 (+ 16099us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:51.280083 (+ 96356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.722770 (+1442687us) spinlock_profiling.cc:243] Waited 95.3 ms on lock 0x7b540021c854. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:52.722954 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219153664}
I20260709 13:02:52.717331 11109 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.712142 11192 tablet_copy_client.cc:670] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:52.715415 11245 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.716900 11113 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:52.704804 11345 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:52.625334 11287 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:52.756742  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1066) took 1327 ms. Trace:
I20260709 13:02:52.755244  9373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:02:52.757649  9523 raft_consensus.cc:1275] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:52.685034 11209 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 13:02:52.751988 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:52.758754  9519 rpcz_store.cc:276] 0709 13:02:51.429305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.446995 (+ 17690us) service_pool.cc:224] Handling call
0709 13:02:51.447527 (+   532us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:51.550361 (+102834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:51.550389 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:51.572065 (+ 21676us) log.cc:844] Serialized 52 byte log entry
0709 13:02:51.752372 (+180307us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:51.752832 (+   460us) log.cc:844] Serialized 14 byte log entry
0709 13:02:52.196340 (+443508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.196520 (+   180us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:52.756524 (+560004us) raft_consensus.cc:1685] finished
0709 13:02:52.756546 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:52.756685 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110600,"prepare.queue_time_us":208,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":45,"raft.queue_time_us":269284,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":14154,"thread_start_us":513777,"threads_started":2,"wal-append.queue_time_us":409358}
I20260709 13:02:52.748741 11052 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:52.753575 11174 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:52.755311 11356 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:52.777963 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:52.783681  9524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1074) took 1029 ms. Trace:
I20260709 13:02:52.762949 11304 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:52.756160 11371 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:52.762398 11332 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:52.762408 11175 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:52.797045  9375 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:02:52.784696  9524 rpcz_store.cc:276] 0709 13:02:51.754128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.754337 (+   209us) service_pool.cc:224] Handling call
0709 13:02:51.754665 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:51.754985 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:51.755023 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:51.759608 (+  4585us) log.cc:844] Serialized 26 byte log entry
0709 13:02:52.224868 (+465260us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:52.599308 (+374440us) log.cc:844] Serialized 14 byte log entry
0709 13:02:52.782607 (+183299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.783010 (+   403us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:52.783135 (+   125us) raft_consensus.cc:1685] finished
0709 13:02:52.783182 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:52.783543 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45727,"prepare.queue_time_us":25653,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":266794,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":203,"thread_start_us":824712,"threads_started":3,"wal-append.queue_time_us":509697}
I20260709 13:02:52.843653 11287 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:52.790899 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 237639us
I20260709 13:02:52.772289 10917 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:52.871662 11345 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:52.872066 10917 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:52.753955 11109 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:52.876372  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:52.877249 11109 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:52.803638 11329 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:52.878190 11329 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:52.879479  9373 raft_consensus.cc:606] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:02:52.880002  9373 raft_consensus.cc:614] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:52.757510 11245 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:52.762840 11186 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:52.961489  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 93874us
W20260709 13:02:52.838471 11361 log.cc:927] Time spent T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:02:52.964777  9490 leader_election.cc:400] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8.
I20260709 13:02:52.972922  9490 leader_election.cc:403] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:52.785174 11052 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:52.845413 11048 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.874744 10917 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:52.977958 11367 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:52.727492 11336 consensus_queue.cc:260] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:52.787711 11174 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:52.837167 11356 raft_consensus.cc:697] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:52.974479  9490 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:52.963888 11332 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:52.975253 11209 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:52.993454 11113 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.996927 11253 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:52.818565 11371 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:52.991743 11048 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
W20260709 13:02:53.044697 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 170754us
W20260709 13:02:53.042397  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 376965us
I20260709 13:02:53.013867 11175 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:53.025435 11365 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.049038  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:53.009930 11332 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:53.052403 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:53.052887  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:53.056067  9444 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 4.
W20260709 13:02:53.051005  9492 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.019s	sys 0.017s
I20260709 13:02:53.053531  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:53.062641  9519 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:53.054143  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:53.054589  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:53.063439  9492 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.020s	sys 0.017s
I20260709 13:02:53.063534  9374 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:02:53.064105  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:53.064761  9375 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:02:53.065652  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:53.028138 11113 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:53.109815  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:53.123973  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:53.014743 11209 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:53.111357  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:53.125181  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:53.125732  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:53.126237  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:53.126717  9374 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:02:53.047453 10917 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:53.042927 11234 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:53.139322  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:53.054754 11348 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.150130  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:53.047247 11264 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:53.131799  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:53.134328  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:53.134742  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:53.042512 11253 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.055047 11304 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:02:53.120419 11281 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.020s	sys 0.047s
I20260709 13:02:53.057426 11176 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:53.163079  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:53.111886 11239 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:53.196826  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:53.166316  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:53.167564  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:53.111560 10937 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:53.206995  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:53.165205 11368 log.cc:927] Time spent T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.360s	user 0.001s	sys 0.001s
W20260709 13:02:53.192262  9372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.033s	sys 0.084s
W20260709 13:02:53.209455  9372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.033s	sys 0.084s
I20260709 13:02:53.194931  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:53.211071  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:53.211993  9375 raft_consensus.cc:2410] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:53.206637  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:53.190624 11281 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.021s	sys 0.047s
I20260709 13:02:53.163184 10759 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:53.058527 11175 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:53.162650 10917 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:53.169271 11348 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:53.174484 11264 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:53.067602 11365 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:53.165458 11253 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:53.168130 11234 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:53.191152 11356 consensus_queue.cc:237] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:53.415370  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:53.276309  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:53.308135  9519 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:53.410888  9524 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 4.
W20260709 13:02:53.339213  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.398316  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:53.442803 11393 log.cc:927] Time spent T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:02:53.442866  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:53.443413 11201 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:53.287252 11380 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:53.444015 11201 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:53.444351 11380 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:53.446460 11380 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:53.447105 11201 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:53.324553 11048 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:53.324741 11376 log.cc:927] Time spent T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:02:53.448490  9371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50568 (request call id 180) took 1728 ms. Trace:
I20260709 13:02:53.448586 11253 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:53.449131  9370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1073) took 1723 ms. Trace:
I20260709 13:02:53.286861 11379 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:53.450024  9517 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:02:53.434634 11371 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:53.449611  9370 rpcz_store.cc:276] 0709 13:02:51.725596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.503878 (+778282us) service_pool.cc:224] Handling call
0709 13:02:52.504306 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:52.504709 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:52.504749 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:52.505465 (+   716us) log.cc:844] Serialized 26 byte log entry
0709 13:02:52.995870 (+490405us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:52.995914 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.996017 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:53.448926 (+452909us) raft_consensus.cc:1685] finished
0709 13:02:53.448944 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:53.449080 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1557,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":88,"thread_start_us":420261,"threads_started":1,"wal-append.queue_time_us":583720}
I20260709 13:02:53.450789 11379 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.451239 11379 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:53.451648  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:53.452296  9370 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:53.426105  9343 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:53.442513  9447 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:02:53.416368  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:53.416841  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:53.406652  9518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1072) took 1691 ms. Trace:
I20260709 13:02:53.416075  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:53.441407  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:53.439994  9452 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:53.460559  9519 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:53.391283 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:53.457232  9448 raft_consensus.cc:2393] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 6: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:53.190476 11304 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:53.286703 11354 log.cc:927] Time spent T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 13:02:53.349351 11346 raft_consensus.cc:3055] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:53.472600  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:53.231581 11192 tablet_copy_client.cc:538] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:53.448945  9371 rpcz_store.cc:276] 0709 13:02:51.719959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.346436 (+626477us) service_pool.cc:224] Handling call
0709 13:02:52.346777 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:52.712512 (+365735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:52.712571 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:52.712624 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:52.712666 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.448232 (+735566us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b540014da54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:53.448289 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:53.448426 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":840624896}
I20260709 13:02:53.470613  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:53.516409  9452 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:53.304281 11052 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:53.287396 11378 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:53.471306  9449 raft_consensus.cc:2410] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:53.439352  9490 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:53.396811 11377 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:02:53.346861 11385 log.cc:927] Time spent T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:02:53.513439  9448 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:02:53.435067 11367 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8.
I20260709 13:02:53.508320 11281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:60188 (request call id 8) took 3586 ms. Trace:
I20260709 13:02:53.326669 11209 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:53.517529  9522 raft_consensus.cc:1275] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:53.512811 11346 raft_consensus.cc:740] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:53.326311 11384 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.240981 11372 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:53.349231 11113 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:53.473811 11388 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:53.521879  9371 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 13:02:53.522271  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 82992.8us
I20260709 13:02:53.539891  9371 pending_rounds.cc:85] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947: Aborting all ops after (but not including) 1
I20260709 13:02:53.540174  9371 pending_rounds.cc:107] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:02:53.540411  9371 raft_consensus.cc:2889] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:53.457646  9518 rpcz_store.cc:276] 0709 13:02:51.715442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.746030 (+ 30588us) service_pool.cc:224] Handling call
0709 13:02:51.746528 (+   498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:51.969895 (+223367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:51.969969 (+    74us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:52.424596 (+454627us) spinlock_profiling.cc:243] Waited 79.2 ms on lock 0x7b2c0001cab8. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb584e63a11 00007fb584e73372 00007fb5865a5a01 00007fb58656a43a 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2
0709 13:02:52.425089 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:02:52.655768 (+230679us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:52.655807 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.655869 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:53.327046 (+671177us) raft_consensus.cc:1685] finished
0709 13:02:53.327069 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:53.406490 (+ 79421us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8337,"raft.queue_time_us":171621,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"spinlock_wait_cycles":182130048,"thread_start_us":421911,"threads_started":2,"wal-append.queue_time_us":309922}
I20260709 13:02:53.208813 11239 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:53.494262  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:53.536067 11367 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:53.527014 11332 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:53.553962  9371 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:53.514997  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:53.431821 11175 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:53.241366 11389 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:53.217645 10937 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:53.213671 11176 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:53.222852 11387 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:53.535205 10917 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:53.535778 11391 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:53.329941 11282 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:53.463897 10759 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:53.522329  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:53.569727  9447 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:53.544009  9343 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:02:53.326108 11382 log.cc:927] Time spent T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:02:53.557083  9451 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:02:53.571789  9372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1056) took 1952 ms. Trace:
I20260709 13:02:53.571723 11284 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:53.574599 10917 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:53.547472 11372 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:53.581882 11372 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:53.583719 11387 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:53.579424 10917 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:53.576699  9372 rpcz_store.cc:276] 0709 13:02:51.619484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.619604 (+   120us) service_pool.cc:224] Handling call
0709 13:02:51.619888 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:51.620184 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:51.620207 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:51.620633 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:02:52.687157 (+1066524us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b18001768c0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58345fe07 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b 00007fb586109d23 00007fb58610a0d1 00007fb586525a0f
0709 13:02:53.210001 (+522844us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:53.562792 (+352791us) log.cc:844] Serialized 14 byte log entry
0709 13:02:53.570273 (+  7481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.571470 (+  1197us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:53.571516 (+    46us) raft_consensus.cc:1685] finished
0709 13:02:53.571600 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:53.571735 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6522,"raft.queue_time_us":51045,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":13312,"spinlock_wait_cycles":4571392,"thread_start_us":854450,"threads_started":2,"wal-append.queue_time_us":1681212}
I20260709 13:02:53.567651 11332 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:53.594941 11234 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:53.591460 11389 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:53.532559 11378 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:53.587962 11282 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:53.588985 11014 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:53.563529 11367 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:53.570052 10937 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:53.588254 11052 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:53.595651 11332 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.560045 11384 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:53.616690 11375 raft_consensus.cc:993] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:02:53.552884 11377 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:53.784765 11179 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.575584 11346 consensus_queue.cc:260] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:53.720216  9492 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.009s	sys 0.017s
I20260709 13:02:53.708016 11348 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:53.711226 11304 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:53.711532 11264 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:02:53.745151  9521 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.016s	sys 0.038s
W20260709 13:02:53.790077 11328 log.cc:927] Time spent T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 1.579s	user 0.010s	sys 0.003s
I20260709 13:02:53.526235 11281 rpcz_store.cc:276] 0709 13:02:49.905328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.918106 (+ 12778us) service_pool.cc:224] Handling call
0709 13:02:50.051671 (+133565us) log.cc:844] Serialized 485 byte log entry
0709 13:02:53.491546 (+3439875us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8367,"raft.queue_time_us":9520,"raft.run_cpu_time_us":1541,"raft.run_wall_time_us":1538,"thread_start_us":77016,"threads_started":1,"wal-append.queue_time_us":121183,"wal-append.run_cpu_time_us":2068,"wal-append.run_wall_time_us":1076797}
I20260709 13:02:53.798203 11279 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.809237  9418 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
W20260709 13:02:53.815351 10027 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.005s	sys 0.020s
W20260709 13:02:53.866679 10027 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.005s	sys 0.020s
W20260709 13:02:53.867043 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 661302us
I20260709 13:02:53.821493 11282 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:53.845865  9492 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.011s	sys 0.019s
I20260709 13:02:53.852903  9450 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
W20260709 13:02:53.859310  9521 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.016s	sys 0.038s
W20260709 13:02:53.819778 11345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.011s	sys 0.018s
I20260709 13:02:53.826558 11332 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:53.874245  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 65143.8us
I20260709 13:02:53.875638  9418 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:53.828991 11353 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:53.900758  9492 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:53.911513 11355 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:02:53.871986 11345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.011s	sys 0.019s
I20260709 13:02:53.863812 11388 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:53.869961 11078 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:53.894888 11282 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:53.876626 10759 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:53.852385 11052 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:53.949970  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 49332.6us
I20260709 13:02:53.896534 11209 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:53.895040 11389 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:53.963259  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 52999.6us
I20260709 13:02:53.967492  9492 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:53.906431 11348 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.907449 11372 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:53.970377  9492 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:53.826891 11176 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:53.982998  9523 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.025s	sys 0.014s
W20260709 13:02:53.983983  9523 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.025s	sys 0.014s
I20260709 13:02:53.894770 11279 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:53.991974  9418 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:54.001765  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:54.007514  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:53.862162 11179 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:54.016803  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:53.828861 11014 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:53.977105 11353 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:54.020032 11014 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:54.020712  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:54.021135  9517 raft_consensus.cc:2955] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:54.020337 11353 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:54.025035  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:54.025297 11353 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:54.012115  9492 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:54.025846  9449 raft_consensus.cc:2393] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 6: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:53.997131  9451 raft_consensus.cc:2955] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:54.033958  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:53.976272 10759 raft_consensus.cc:1081] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:02:54.043414  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:53.962546 11388 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:53.997112 11381 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.024s	sys 0.048s
I20260709 13:02:54.106278  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:53.984549 11397 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:54.069552  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:54.014354 11078 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:54.072600  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:54.014636 11372 raft_consensus.cc:697] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:54.034042 11176 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:53.983315 11348 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:54.081243  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:54.034623 11253 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:54.066133 11355 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:54.066313 11209 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:54.128042 10641 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:54.107153  9449 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
W20260709 13:02:54.111725  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 77850.5us
I20260709 13:02:54.129545  9418 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:54.094188 11367 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:54.139468  9418 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
W20260709 13:02:54.122505  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:54.106709 11381 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.024s	sys 0.048s
W20260709 13:02:54.130203  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 118179us
I20260709 13:02:54.148240  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.132822  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:54.158787  9447 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:54.113194 11397 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:54.140121  9341 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:54.168783  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.122191 11389 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:54.177556  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.183954  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.128562 10641 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:54.165337 11379 consensus_meta.cc:287] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.714s	user 0.010s	sys 0.006s
W20260709 13:02:54.184756  9341 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.647s (SENT) [suppressed 20 similar messages]
I20260709 13:02:54.162803 11113 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:54.193724  9374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 963) took 1081 ms. Trace:
I20260709 13:02:54.162598 11404 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:54.120187 11078 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:54.164070 11264 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:54.111590 11353 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:02:54.179832 11391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.003s	sys 0.015s
I20260709 13:02:54.197543  9523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1307) took 1063 ms. Trace:
I20260709 13:02:54.172626 11397 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:54.191365 11378 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:54.170377 10937 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:54.197319  9447 raft_consensus.cc:1275] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:54.202791  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.136222 11253 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:54.193495 11206 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:54.164532 11403 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:54.205884  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:54.254915 11403 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:54.212935  9444 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:54.255383 11403 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:54.165951 11209 raft_consensus.cc:697] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:02:54.212486 11391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.003s	sys 0.016s
I20260709 13:02:54.199156 11384 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:54.188098 11367 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:54.228960  9369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 962) took 1158 ms. Trace:
I20260709 13:02:54.197525 11179 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:54.238281  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 53551us
I20260709 13:02:54.238518 11176 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:54.248538 11206 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:54.249778 11078 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:54.198519 11379 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:54.196552 11401 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:54.198920  9374 rpcz_store.cc:276] 0709 13:02:53.111848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.527391 (+415543us) service_pool.cc:224] Handling call
0709 13:02:53.542841 (+ 15450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.543160 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:53.984977 (+441817us) log.cc:844] Serialized 14 byte log entry
0709 13:02:54.193226 (+208249us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:54.193293 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:54.193348 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.193515 (+   167us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.193660 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":244868,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"thread_start_us":633367,"threads_started":2}
I20260709 13:02:54.273026 11209 consensus_queue.cc:237] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:54.283237 11414 log.cc:927] Time spent T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:02:54.240221 11417 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:02:54.284646 11413 log.cc:927] Time spent T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:02:54.287528  9369 rpcz_store.cc:276] 0709 13:02:53.071001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.520015 (+449014us) service_pool.cc:224] Handling call
0709 13:02:53.520277 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.520463 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:54.008235 (+487772us) log.cc:844] Serialized 14 byte log entry
0709 13:02:54.228613 (+220378us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:54.228668 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:54.228708 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.228770 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.228893 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20503,"prepare.queue_time_us":224779,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"thread_start_us":683300,"threads_started":2}
I20260709 13:02:54.327880  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.286253 11052 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:54.313321  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.301055  9449 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:54.222833 11264 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:54.343154  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:54.315546 11279 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:54.353158  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.353343  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:54.353894  9369 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:54.354938  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.226857 11372 consensus_queue.cc:237] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:54.369125  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.311102 11367 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:54.348567  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:54.349097  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 185354us
I20260709 13:02:54.379616  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:54.381107  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:54.381882  9449 raft_consensus.cc:2468] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:54.317405 11176 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:54.384657  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.387017  9372 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:54.381301  9341 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:54.389753  9371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1084) took 1276 ms. Trace:
I20260709 13:02:54.390460  9520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1305) took 1256 ms. Trace:
I20260709 13:02:54.390398  9371 rpcz_store.cc:276] 0709 13:02:53.113691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.555007 (+441316us) service_pool.cc:224] Handling call
0709 13:02:53.555439 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:53.555922 (+   483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:53.555967 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:53.556590 (+   623us) log.cc:844] Serialized 26 byte log entry
0709 13:02:53.985459 (+428869us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:53.985498 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.985580 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:54.389443 (+403863us) raft_consensus.cc:1685] finished
0709 13:02:54.389475 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.389670 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2755,"raft.queue_time_us":1825,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6189,"thread_start_us":397927,"threads_started":1,"wal-append.queue_time_us":546210}
I20260709 13:02:54.402000  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.391178  9520 rpcz_store.cc:276] 0709 13:02:53.133578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.214105 (+ 80527us) service_pool.cc:224] Handling call
0709 13:02:53.236782 (+ 22677us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:53.637916 (+401134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:53.637967 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:53.638611 (+   644us) log.cc:844] Serialized 26 byte log entry
0709 13:02:54.063285 (+424674us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:54.063326 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.063411 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:54.390261 (+326850us) raft_consensus.cc:1685] finished
0709 13:02:54.390281 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.390403 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":298777,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":62,"thread_start_us":759571,"threads_started":2,"wal-append.queue_time_us":514712}
I20260709 13:02:54.413396  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.413717  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.414297  9374 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:54.414983  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.419773  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.429626  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:54.410125 11409 log.cc:927] Time spent T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 13:02:54.432278  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.433252  9374 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:54.331584 11401 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:54.413066 11192 tablet_bootstrap.cc:492] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:02:54.405968 11348 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:54.444778  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 54471.1us
I20260709 13:02:54.423444 11230 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:54.445765  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.449913  9374 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:02:54.449832 11230 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:54.450917  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.451992 11230 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:54.434296 11388 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:54.441812 11433 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:54.452955 11433 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:54.434564 11353 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:54.456471  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.462349 11401 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:54.465430 11245 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:54.473182  9374 raft_consensus.cc:1240] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:54.480474  9370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1081) took 1419 ms. Trace:
I20260709 13:02:54.480866  9370 rpcz_store.cc:276] 0709 13:02:53.060584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.453796 (+393212us) service_pool.cc:224] Handling call
0709 13:02:53.454073 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:53.454769 (+   696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:53.454843 (+    74us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:53.455265 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:02:53.858021 (+402756us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:53.858078 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.858168 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:54.480312 (+622144us) raft_consensus.cc:1685] finished
0709 13:02:54.480332 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.480430 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1497,"raft.queue_time_us":960,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":11125,"thread_start_us":342973,"threads_started":1,"wal-append.queue_time_us":614698}
I20260709 13:02:54.482707  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:54.483290  9370 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:02:54.463167 11253 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:54.468904 11427 log.cc:927] Time spent T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:02:54.471273 11417 raft_consensus.cc:697] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:54.469324 11353 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:54.493629 11426 log.cc:927] Time spent T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:54.494674  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:02:54.491952 11424 log.cc:927] Time spent T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:02:54.495608  9374 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:54.506863 11264 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:54.508000 11176 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:54.511668 11425 log.cc:927] Time spent T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:02:54.513832 11433 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:54.519621 11367 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:54.514307 11379 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:54.522190 11430 log.cc:927] Time spent T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:02:54.524353  9521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1083) took 1477 ms. Trace:
I20260709 13:02:54.524964  9450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51016 (request call id 960) took 1109 ms. Trace:
I20260709 13:02:54.525298  9525 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:54.550623  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:54.548486  9450 rpcz_store.cc:276] 0709 13:02:53.415308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.415442 (+   134us) service_pool.cc:224] Handling call
0709 13:02:54.524723 (+1109281us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b5400113354. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:54.524870 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":941183872}
I20260709 13:02:54.553889  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.524739  9521 rpcz_store.cc:276] 0709 13:02:53.047347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.047511 (+   164us) service_pool.cc:224] Handling call
0709 13:02:53.071257 (+ 23746us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:53.868599 (+797342us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:54.180334 (+311735us) log.cc:844] Serialized 14 byte log entry
0709 13:02:54.238972 (+ 58638us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:54.249080 (+ 10108us) log.cc:844] Serialized 26 byte log entry
0709 13:02:54.249224 (+   144us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:54.249262 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.249338 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:54.524106 (+274768us) raft_consensus.cc:1685] finished
0709 13:02:54.524131 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.524294 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53454,"prepare.queue_time_us":334193,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":3905,"raft.queue_time_us":411180,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":237,"thread_start_us":993788,"threads_started":3,"wal-append.queue_time_us":165576}
I20260709 13:02:54.573814  9526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1304) took 1440 ms. Trace:
I20260709 13:02:54.581555  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:54.585028  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.606681  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:54.606850  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.607966  9520 raft_consensus.cc:2393] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 2: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:54.574199 11417 consensus_queue.cc:237] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:54.611694 11379 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:54.612447 11379 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:54.574420  9526 rpcz_store.cc:276] 0709 13:02:53.133336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.213018 (+ 79682us) service_pool.cc:224] Handling call
0709 13:02:53.232035 (+ 19017us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:53.682941 (+450906us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:54.107804 (+424863us) log.cc:844] Serialized 14 byte log entry
0709 13:02:54.236814 (+129010us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:54.275672 (+ 38858us) log.cc:844] Serialized 26 byte log entry
0709 13:02:54.276100 (+   428us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:54.276230 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.276452 (+   222us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:54.573517 (+297065us) raft_consensus.cc:1685] finished
0709 13:02:54.573540 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.573718 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":503650,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":303543,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":11980,"thread_start_us":913306,"threads_started":3,"wal-append.queue_time_us":208118}
I20260709 13:02:54.634615  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:54.634759  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.631981 11206 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:54.645089  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.648341 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:54.648159  9370 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:02:54.648977 10067 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:54.646346  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:54.649986  9519 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:02:54.645820  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:54.653188  9520 raft_consensus.cc:2410] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:54.650811  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.654726 11239 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:54.655433  9370 raft_consensus.cc:2393] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 3: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:54.655833  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.656694  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.647361  9373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:52636 (request call id 10) took 1887 ms. Trace:
I20260709 13:02:54.655990 11365 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:54.658264 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:54.659971  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.659771  9373 rpcz_store.cc:276] 0709 13:02:52.754288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.755078 (+   790us) service_pool.cc:224] Handling call
0709 13:02:54.641514 (+1886436us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b5400188b54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb586564853 00007fb58b53260a 00007fb584ab87d4 00007fb584ab8762 00007fb584ab8691 00007fb584ab860c 00007fb584ab78c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:54.641663 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274996096}
I20260709 13:02:54.661273  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:54.661747  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.662577  9373 raft_consensus.cc:2410] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:54.664582  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:54.665176  9373 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:02:54.675309 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:54.676389 10677 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.676884 10677 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:54.681869  9377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1058) took 3040 ms. Trace:
I20260709 13:02:54.682283  9377 rpcz_store.cc:276] 0709 13:02:51.637281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.637580 (+   299us) service_pool.cc:224] Handling call
0709 13:02:51.637848 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:51.787980 (+150132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:51.788029 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:51.788612 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:02:52.209544 (+420932us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:52.384002 (+174458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.673262 (+2289260us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54001ffed4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:54.673303 (+    41us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:54.673336 (+    33us) raft_consensus.cc:1685] finished
0709 13:02:54.673343 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.677454 (+  4111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13089,"raft.queue_time_us":1812,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":109983,"spinlock_wait_cycles":344057600,"thread_start_us":415614,"threads_started":1,"wal-append.queue_time_us":515445,"wal-append.run_cpu_time_us":1857,"wal-append.run_wall_time_us":1010064}
I20260709 13:02:54.685884 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:54.681296 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:54.688548 10677 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:54.689576 11330 consensus_queue.cc:1059] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:54.685906 11191 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:02:54.691169  9492 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:54.693804  9492 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:54.693928 11191 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:54.696103 11191 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:54.694727 11387 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:54.694787 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:54.697768  9492 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:54.696522 11341 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:54.705571 11341 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:54.705992 11341 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:54.706187 11403 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:54.709398  9521 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
W20260709 13:02:54.710124 11441 log.cc:927] Time spent T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:02:54.712095 11330 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:54.712502 11330 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:54.712869 11330 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:54.679266 11317 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.696559 11191 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:54.702350 11379 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:54.727348  9492 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:54.719866 11403 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:54.721037 11329 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:54.747272  9492 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:54.753054  9492 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:02:54.756039  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 310156us
I20260709 13:02:54.757227  9341 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:54.758515 10677 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:54.758944  9341 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:54.749420 11379 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:54.752352 11282 consensus_meta.cc:287] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.776s	user 0.009s	sys 0.017s
W20260709 13:02:54.755666 11332 consensus_meta.cc:287] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.848s	user 0.021s	sys 0.015s
I20260709 13:02:54.763839  9341 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:54.767355 11284 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:54.767980  9341 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:54.769095 11284 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:54.771188  9341 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:54.772163 11284 raft_consensus.cc:2804] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:54.772545 11284 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.729103 11317 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:54.764413 11435 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:54.758131 11403 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:54.772861 11284 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:54.761864 11365 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:54.763702 11379 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:54.758167 11397 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:54.796182  9341 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:54.782720 11365 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:54.774278 11282 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:54.774755 11332 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:54.788648 11379 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:54.806061  9341 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:02:54.789965 11403 raft_consensus.cc:697] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:54.811266  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:54.811925  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:54.802521 11365 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:54.814954  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:54.815284  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:54.818212  9341 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:54.819626  9449 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:54.821035  9341 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:54.809332 11417 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:54.799423 11435 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:02:54.824815  9446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45366 (request call id 203) took 2088 ms. Trace:
I20260709 13:02:54.814602 10759 raft_consensus.cc:2804] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:54.832121  9446 rpcz_store.cc:276] 0709 13:02:52.736534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.737577 (+  1043us) service_pool.cc:224] Handling call
0709 13:02:52.737928 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:52.752271 (+ 14343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:52.752304 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:52.752351 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:52.752380 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.824497 (+2072117us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b5400270954. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:54.824565 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.824741 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32538368}
I20260709 13:02:54.823760 11439 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:54.835642 11435 consensus_queue.cc:1243] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer d62c9d5a052b42ce8675f8438f846526 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:02:54.831110 11419 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:54.839525 10759 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:02:54.881748 11447 log.cc:927] Time spent T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:02:54.849728 11403 consensus_queue.cc:237] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:54.897517  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:54.899201 11454 log.cc:927] Time spent T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:02:54.875671 11419 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.888159 10759 raft_consensus.cc:3060] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:54.905175 11332 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:54.928994  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:54.929874  9446 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:02:54.930240 11174 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:54.936319 10759 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:54.907769 11341 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:54.938982 11282 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:54.912154 11419 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:54.958026  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:54.932693 11317 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:54.968118 10759 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:54.941109 11397 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:55.009621  9446 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:54.970649 11353 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:55.018625  9341 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:55.022989 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 105059us
I20260709 13:02:55.022334 11353 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:55.028702 11191 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:55.030723  9451 pending_rounds.cc:85] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 1
I20260709 13:02:55.007328 11330 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:55.031051  9451 pending_rounds.cc:107] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:02:55.031308  9451 raft_consensus.cc:2889] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:55.032364 11431 log.cc:927] Time spent T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e: Append to log took a long time: real 0.593s	user 0.001s	sys 0.000s
I20260709 13:02:55.032699 11330 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:55.038750 11351 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:55.041162  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:55.042582  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:55.043139  9520 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:02:55.043901  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:55.050802 11452 log.cc:927] Time spent T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:02:55.052731  9525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1300) took 1920 ms. Trace:
I20260709 13:02:55.055311  9341 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:55.053237  9525 rpcz_store.cc:276] 0709 13:02:53.132286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.132465 (+   179us) service_pool.cc:224] Handling call
0709 13:02:54.525112 (+1392647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:54.549161 (+ 24049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.052508 (+503347us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400314cd0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865698ad 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:55.052664 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3201719168}
I20260709 13:02:55.057211  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:55.034399 11191 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:55.056598  9445 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 1448) took 3450 ms (client timeout 2287 ms). Trace:
I20260709 13:02:55.019448 11341 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:55.021438 11282 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:02:55.060263  9445 rpcz_store.cc:269] 0709 13:02:51.575490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.577387 (+  1897us) service_pool.cc:224] Handling call
0709 13:02:55.025821 (+3448434us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b5400220454. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:55.025970 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2291477760}
I20260709 13:02:55.023715 11335 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:55.020682 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:55.060871 11320 raft_consensus.cc:2804] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:55.079530  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:55.080452  9520 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:55.078086 11335 raft_consensus.cc:697] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:55.066576 11282 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:55.081594 11320 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:55.087952  9342 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:55.097070  9449 raft_consensus.cc:1240] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:55.100173  9387 tablet_copy_source_session.cc:215] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:55.102770 11284 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:55.107038  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:55.105794 11320 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:55.122236  9522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1303) took 1989 ms. Trace:
I20260709 13:02:55.124992  9522 rpcz_store.cc:276] 0709 13:02:53.133095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.208101 (+ 75006us) service_pool.cc:224] Handling call
0709 13:02:53.208454 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.526949 (+318495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.121973 (+1595024us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b540042b154. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:55.122170 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":699760512}
I20260709 13:02:55.126494  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:55.123485  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:55.111466 11436 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:55.128194  9526 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:02:55.091563 11365 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:55.130643  9387 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:50568 (request call id 179) took 3411 ms. Trace:
I20260709 13:02:55.131081  9387 rpcz_store.cc:276] 0709 13:02:51.719516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.719699 (+   183us) service_pool.cc:224] Handling call
0709 13:02:55.099780 (+3380081us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b540008aa54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865743f7 00007fb58b50a036 00007fb58b513a3e 00007fb582dd727b 00007fb58b5139ba 00007fb58b50eacc 00007fb58b509c7b 00007fb58b4fe8d1 00007fb58a5b24b4 00007fb58a5b2442
0709 13:02:55.130557 (+ 30777us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3835166976}
I20260709 13:02:55.132231 11365 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:55.113795 10759 consensus_queue.cc:1059] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:02:55.135870 10759 consensus_queue.cc:1243] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer d62c9d5a052b42ce8675f8438f846526 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:02:55.136067  9448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1459) took 1122 ms. Trace:
I20260709 13:02:55.136466 10759 raft_consensus.cc:3055] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:55.103304 11419 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:55.136983 10759 raft_consensus.cc:740] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:55.136519  9448 rpcz_store.cc:276] 0709 13:02:54.013747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.014454 (+   707us) service_pool.cc:224] Handling call
0709 13:02:54.525460 (+511006us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:54.525697 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:54.525734 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:54.525788 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:54.525830 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.525901 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.135933 (+610032us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b5400113350. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865698ad 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:55.136017 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1174421888}
I20260709 13:02:55.138072 10759 consensus_queue.cc:260] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:55.139242 10759 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:55.140091 11335 consensus_queue.cc:237] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:55.141630 10641 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:55.105556 11379 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:55.149276 11365 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:55.149958 11379 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:55.150583  9517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1319) took 1803 ms. Trace:
I20260709 13:02:55.150947  9517 rpcz_store.cc:276] 0709 13:02:53.346744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.796238 (+449494us) service_pool.cc:224] Handling call
0709 13:02:53.796490 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:54.020952 (+224462us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:54.104611 (+ 83659us) log.cc:844] Serialized 14 byte log entry
0709 13:02:54.227508 (+122897us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:54.227590 (+    82us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:54.227646 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.150342 (+922696us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54001a0754. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:55.150385 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.150513 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5,"raft.queue_time_us":681,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":515507968,"thread_start_us":120570,"threads_started":1,"wal-append.queue_time_us":268179}
I20260709 13:02:55.150256 11365 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:55.153321 11282 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:55.141785  9522 raft_consensus.cc:1240] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:55.157639  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:55.146107  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:02:55.167575 11442 log.cc:927] Time spent T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.592s	user 0.000s	sys 0.003s
I20260709 13:02:55.171512 11365 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:55.171810  9376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1075) took 2505 ms. Trace:
I20260709 13:02:55.172282  9376 rpcz_store.cc:276] 0709 13:02:52.666575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.699384 (+ 32809us) service_pool.cc:224] Handling call
0709 13:02:52.699649 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:52.700002 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:02:52.700029 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:54.835296 (+2135267us) spinlock_profiling.cc:243] Waited 4.99 ms on lock 0x7b2c0001afe8. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb584e63a11 00007fb584e73372 00007fb5865a5a01 00007fb58656a43a 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2
0709 13:02:54.838503 (+  3207us) log.cc:844] Serialized 26 byte log entry
0709 13:02:54.969868 (+131365us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:54.969917 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.970024 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.171520 (+201496us) raft_consensus.cc:1685] finished
0709 13:02:55.171541 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.171753 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":531,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"spinlock_wait_cycles":11469696,"thread_start_us":92512,"threads_started":1,"wal-append.queue_time_us":238342}
I20260709 13:02:55.141323 11320 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:55.172803  9522 raft_consensus.cc:1240] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:55.177471 10027 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:55.185532 11373 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:55.186184  9520 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:02:55.186123 11373 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:55.178527  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:55.187952  9449 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:55.173311 11460 log.cc:927] Time spent T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:02:55.190207  9522 raft_consensus.cc:1240] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:55.200361 11346 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:55.203276  9522 raft_consensus.cc:1240] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:55.193797 11269 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:55.204639  9522 raft_consensus.cc:1240] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:55.177098 11206 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:55.205183 11369 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:55.205760 11369 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:55.175968  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:55.207261  9444 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:55.208153  9449 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:02:55.208787  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:55.209371  9448 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.209648  9341 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:55.193890  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:55.211254  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:55.211308  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:55.237646  9448 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:55.238894  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:55.238976  9341 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:55.217262 11355 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:55.239939 10759 raft_consensus.cc:2804] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:55.240475 10759 raft_consensus.cc:697] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:55.240099 11355 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:55.172220 11284 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:55.215793 11373 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:55.241362 10759 consensus_queue.cc:237] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:54.206604  9523 rpcz_store.cc:276] 0709 13:02:53.134045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.215458 (+ 81413us) service_pool.cc:224] Handling call
0709 13:02:53.215777 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.215992 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:53.984490 (+768498us) log.cc:844] Serialized 14 byte log entry
0709 13:02:54.197064 (+212574us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:54.197132 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:54.197188 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.197272 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.197489 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":909376,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2805,"raft.queue_time_us":2056,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":3967,"thread_start_us":791100,"threads_started":2}
I20260709 13:02:55.327538  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:55.243407  9444 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:02:55.423085  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:55.423448  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:55.424249  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:55.424892  9443 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:55.425356  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:55.215582 11206 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:55.425985  9523 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:02:55.245527  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:55.248622  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:55.439499  9522 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:55.440783  9448 raft_consensus.cc:1240] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:55.443449  9523 raft_consensus.cc:1240] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:55.448253  9341 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:55.299770 11374 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:55.398797 11369 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:55.420022 11330 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.452565 11330 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:55.299525 11378 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.253831 11320 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:55.261518 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:55.259011 11355 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:55.315726 11419 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:55.466620  9451 raft_consensus.cc:1275] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:02:55.468431  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.454700 11373 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:55.454087 11378 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:55.475756 11378 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:55.457083 11206 raft_consensus.cc:697] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:55.456377 11374 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:55.494091  9443 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:55.480280 11373 raft_consensus.cc:697] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:55.514953 11206 consensus_queue.cc:237] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:55.518965 11374 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:55.520465 11373 consensus_queue.cc:237] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:55.562336 11465 log.cc:927] Time spent T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.393s	user 0.001s	sys 0.003s
I20260709 13:02:55.563884  9447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1473) took 1392 ms. Trace:
I20260709 13:02:55.564318  9447 rpcz_store.cc:276] 0709 13:02:54.171094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.178197 (+  7103us) service_pool.cc:224] Handling call
0709 13:02:54.178574 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:54.224400 (+ 45826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.563661 (+1339261us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b54001cff54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:55.563832 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42228480}
W20260709 13:02:55.572114  9524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52502 (request call id 202) took 2522 ms (client timeout 2044 ms). Trace:
W20260709 13:02:55.572780  9524 rpcz_store.cc:269] 0709 13:02:53.048487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.048605 (+   118us) service_pool.cc:224] Handling call
0709 13:02:55.570218 (+2521613us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b54003241d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:55.570375 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":823685376}
I20260709 13:02:55.581813 10917 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:55.588059 11192 tablet_bootstrap.cc:492] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:55.593907  9369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52562 (request call id 985) took 1252 ms. Trace:
I20260709 13:02:55.598532  9371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 980) took 1441 ms. Trace:
I20260709 13:02:55.601518  9369 rpcz_store.cc:276] 0709 13:02:54.341881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.354686 (+ 12805us) service_pool.cc:224] Handling call
0709 13:02:55.593678 (+1238992us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b540014d554. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:55.593847 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1021247872}
I20260709 13:02:55.601570  9371 rpcz_store.cc:276] 0709 13:02:54.157108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.434893 (+277785us) service_pool.cc:224] Handling call
0709 13:02:54.435274 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:54.435691 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:54.435729 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:54.438516 (+  2787us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.166864 (+728348us) spinlock_profiling.cc:243] Waited 5.44 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:02:55.597892 (+431028us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b18003513a0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb5861124bc 00007fb58346048b 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b 00007fb586109d23 00007fb58610a0d1
0709 13:02:55.598079 (+   187us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:55.598124 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.598211 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.598271 (+    60us) raft_consensus.cc:1685] finished
0709 13:02:55.598286 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.598463 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8979,"raft.queue_time_us":38936,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":2049,"spinlock_wait_cycles":19886208,"thread_start_us":27317,"threads_started":1,"wal-append.queue_time_us":128657}
I20260709 13:02:55.617830 11192 tablet_bootstrap.cc:492] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:02:55.619406 11192 ts_tablet_manager.cc:1403] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 1.256s	user 0.046s	sys 0.031s
W20260709 13:02:55.683653 11468 log.cc:927] Time spent T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.514s	user 0.003s	sys 0.000s
I20260709 13:02:55.719455 11377 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:55.720350 11330 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:55.724512 11192 raft_consensus.cc:359] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:55.725463 11192 raft_consensus.cc:740] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:02:55.726758 11192 consensus_queue.cc:260] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:55.737301 11192 ts_tablet_manager.cc:1434] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.117s	user 0.007s	sys 0.001s
I20260709 13:02:55.753772 11353 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:55.794103 11336 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:55.802911 10299 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.803442 10299 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:55.818424 11470 log.cc:927] Time spent T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.651s	user 0.003s	sys 0.002s
W20260709 13:02:55.876427 11445 log.cc:927] Time spent T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 1.119s	user 0.000s	sys 0.005s
W20260709 13:02:55.898974  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.899658 11432 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:55.900141 11432 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:55.902244 11432 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:55.902395  9368 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:02:55.902796  9368 pending_rounds.cc:85] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947: Aborting all ops after (but not including) 3
I20260709 13:02:55.903033  9368 pending_rounds.cc:107] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:02:55.903251  9368 raft_consensus.cc:2889] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:55.903836  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:55.904124  9375 raft_consensus.cc:1240] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:55.938258  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:55.938988  9373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50568 (request call id 190) took 1281 ms. Trace:
I20260709 13:02:55.939432  9373 rpcz_store.cc:276] 0709 13:02:54.657375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.765854 (+108479us) service_pool.cc:224] Handling call
0709 13:02:54.766591 (+   737us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:54.784438 (+ 17847us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:54.784470 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:54.784515 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:54.784545 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.938760 (+1154215us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b540014da54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:55.938807 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.938930 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40538496}
I20260709 13:02:55.951254  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:55.952082  9372 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:02:55.994589  9418 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:55.998016  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:55.999503  9418 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:56.000366  9418 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:56.000921 11377 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:56.001509 11377 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:56.001991 11377 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:56.003528 11379 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:56.004101 11379 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:56.005412  9323 auto_rebalancer.cc:629] Failed to schedule move for tablet a3b5c7847cbc42538f7f07cceeb9c125: Illegal state: Replica 6d50f1c263264b21919230bee398022b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:56.006289 11379 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:56.024581  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1101) took 1375 ms. Trace:
W20260709 13:02:56.028270  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.029563 11377 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:56.034795  9374 raft_consensus.cc:1240] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:02:56.035914  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:56.050225 11078 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:56.050912 11078 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:56.051415 11078 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:56.055387  9449 raft_consensus.cc:1275] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:56.056617  9372 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:02:56.058501  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:56.059911 11377 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:56.067060 11377 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:56.067570 11377 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.067996 11377 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:56.078500 11482 consensus_queue.cc:1059] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:56.080061 11482 consensus_queue.cc:1059] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:56.081700  9443 raft_consensus.cc:1240] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:56.062819 11184 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:56.084688  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:56.084843  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:56.085498  9372 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:56.085963  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:56.040349  9519 rpcz_store.cc:276] 0709 13:02:54.648995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.173850 (+524855us) service_pool.cc:224] Handling call
0709 13:02:55.174183 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.174373 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:55.363888 (+189515us) log.cc:844] Serialized 14 byte log entry
0709 13:02:56.023769 (+659881us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b1800275bc0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb5861124bc 00007fb58346048b 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b 00007fb586109d23 00007fb58610a23a
0709 13:02:56.024080 (+   311us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:56.024158 (+    78us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:56.024221 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.024319 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.024500 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":296692,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":4495,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125,"spinlock_wait_cycles":6114688,"thread_start_us":307622,"threads_started":2,"wal-append.queue_time_us":176276}
I20260709 13:02:56.095117  9449 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:56.101471  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:56.106307  9521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46902 (request call id 1090) took 1581 ms. Trace:
I20260709 13:02:56.106720  9521 rpcz_store.cc:276] 0709 13:02:54.531211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.556758 (+ 25547us) service_pool.cc:224] Handling call
0709 13:02:56.106135 (+1549377us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b540028a5d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:56.106247 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291074304}
I20260709 13:02:56.115922  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:56.172339  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:56.173286  9370 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:56.172034  9374 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:56.172822  9369 raft_consensus.cc:1240] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:56.176257  9375 raft_consensus.cc:1240] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:56.177392  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:56.177641  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:56.178951  9375 raft_consensus.cc:1275] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:56.180555  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:56.178548  9368 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:02:56.093493 11184 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:56.186594  9492 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:56.181514  9371 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:02:56.191985 11184 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:56.188372 11048 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.209417  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:56.209673 11048 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:56.211408  9387 tablet_copy_service.cc:342] P 925acbe78db14db3b9e4cfc857717947: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-45a4f94c156249adab9c2b1ffb00ac46 received from {username='slave'} at 127.0.0.1:50568
I20260709 13:02:56.212276  9387 tablet_copy_service.cc:434] P 925acbe78db14db3b9e4cfc857717947: ending tablet copy session b0812463215649c3b011d36e2f0400c9-45a4f94c156249adab9c2b1ffb00ac46 on tablet 45a4f94c156249adab9c2b1ffb00ac46 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:02:56.216365 11350 consensus_queue.cc:1059] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:56.217217 11335 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:56.217914 11335 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:56.225334 11078 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:56.226869  9451 raft_consensus.cc:1240] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:56.227794 11184 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:56.228327 11078 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:56.229110  9449 raft_consensus.cc:1240] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:56.229677 11208 raft_consensus.cc:3055] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:56.230257 11208 raft_consensus.cc:740] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:02:56.231449 11208 consensus_queue.cc:260] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:56.232971 11208 raft_consensus.cc:3060] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:56.232146 11184 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:56.234042 10759 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:56.238008  9370 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
W20260709 13:02:56.240504  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 208918us
I20260709 13:02:56.236058 10759 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:56.241529  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:56.098207 11482 consensus_queue.cc:1059] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.137s
W20260709 13:02:56.405668  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 164345us
I20260709 13:02:56.407840  9418 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:56.410183 10026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.438530  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.171037 11377 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:56.459489 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 234493us
I20260709 13:02:56.471728  9418 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:56.471784  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 252778us
I20260709 13:02:56.507395  9492 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:56.342231 11078 raft_consensus.cc:3055] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:02:56.510264  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 101258us
I20260709 13:02:56.592905  9418 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:56.342586 11184 raft_consensus.cc:3055] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:56.596135 10759 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:56.610114  9418 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:56.616039 10759 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:56.616776 10759 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:56.591219 11482 raft_consensus.cc:3055] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:02:56.656155  9372 consensus_meta.cc:287] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.001s
I20260709 13:02:56.656553  9372 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:02:56.590899 11078 raft_consensus.cc:740] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:56.596508 11486 consensus_queue.cc:1059] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:02:56.596143 11184 raft_consensus.cc:740] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:56.672427 11184 consensus_queue.cc:260] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:56.675360 11184 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:56.676931  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:56.679498  9518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1309) took 3544 ms. Trace:
I20260709 13:02:56.679919  9518 rpcz_store.cc:276] 0709 13:02:53.134549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.547631 (+413082us) service_pool.cc:224] Handling call
0709 13:02:55.570532 (+2022901us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.570804 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.570845 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.570903 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:55.570955 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.571039 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.679279 (+1108240us) spinlock_profiling.cc:243] Waited 2.02 s on lock 0x7b54003241d0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865698ad 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:02:56.679411 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4651320704}
W20260709 13:02:56.681442  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 344597us
I20260709 13:02:56.661635 11483 consensus_queue.cc:1059] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:02:56.654768 11482 raft_consensus.cc:740] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:56.683382 10759 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:02:56.686661  9343 leader_election.cc:336] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Timed out: RequestConsensusVote RPC to 127.8.4.67:35929 timed out after 1.824s (SENT)
I20260709 13:02:56.687704  9343 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:56.691506 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:56.694396  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:56.697258 11078 consensus_queue.cc:260] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:56.713635 11379 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:56.714277 11379 raft_consensus.cc:697] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:56.716533 11377 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:56.716950  9452 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:56.718760 11355 consensus_queue.cc:1059] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:56.720153 10067 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 1 LEARNER]: Advancing to term 3
W20260709 13:02:56.682917  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 175673us
I20260709 13:02:56.717705 10759 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:56.727310 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 131526us
I20260709 13:02:56.729621  9341 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:56.731683 11489 consensus_queue.cc:1059] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:02:56.732471 10027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.732658 11489 consensus_queue.cc:1243] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:56.733083 11432 consensus_queue.cc:1048] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:56.733385 11373 raft_consensus.cc:2804] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:56.718083 11369 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:56.734200 11369 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:56.734586 11369 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:56.735884 11432 consensus_queue.cc:1048] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:56.739563 11233 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:56.740029 11233 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:56.740157 11492 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:56.740456 11233 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:56.740595 11492 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:56.741092 11492 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:56.744598  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 134496us
I20260709 13:02:56.745321  9418 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:56.745616 11369 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:56.746022 10299 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:56.746387  9418 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:56.743846 11486 consensus_queue.cc:1243] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 6.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:02:56.747677 11491 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:56.748808 11369 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:56.768374  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.769749  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:56.771577  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:56.771879 11233 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:56.773355  9444 raft_consensus.cc:1275] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:56.774513 11378 raft_consensus.cc:2764] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:02:56.776212  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:56.732043  9377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:02:56.777386 11078 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:56.776993  9377 raft_consensus.cc:606] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:02:56.749249 11373 raft_consensus.cc:697] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:56.753068 10067 raft_consensus.cc:1275] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 3 LEARNER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:56.757162 11335 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:56.781865 11335 consensus_queue.cc:1048] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:56.782850 10641 consensus_queue.cc:1048] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:56.759145  9492 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:56.715323 11379 consensus_queue.cc:237] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:56.763758  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.784718  9492 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:56.763625 11365 consensus_queue.cc:1048] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:02:56.789649 11208 consensus_meta.cc:287] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.000s
I20260709 13:02:56.789258 11482 consensus_queue.cc:260] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:56.790505  9374 consensus_meta.cc:287] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.616s	user 0.005s	sys 0.005s
I20260709 13:02:56.790892  9374 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:02:56.791019 11482 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:56.791396 11353 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.791844 11353 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:56.717199 11377 consensus_queue.cc:1059] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:02:56.794981 11377 raft_consensus.cc:3055] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:56.795078 11365 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:56.795429 11377 raft_consensus.cc:740] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:56.795723 11365 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:56.796388 11365 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:56.771759 11209 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:56.799823 10917 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:56.800423 10917 raft_consensus.cc:697] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:56.801419 10917 consensus_queue.cc:237] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:56.802727 11486 raft_consensus.cc:3055] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:56.803258 11486 raft_consensus.cc:740] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:56.804275 11048 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:56.805096  9449 raft_consensus.cc:1240] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:02:56.807117  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:56.804291 11486 consensus_queue.cc:260] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:56.808609  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:56.808679 11486 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:56.766775 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:56.814512  9444 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 2. (index mismatch)
I20260709 13:02:56.776361 11233 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:56.754112 11493 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:56.833534  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 50867.4us
I20260709 13:02:56.850988  9417 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:56.767484 11494 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:56.858508  9273 catalog_manager.cc:5697] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 2 to 4, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 4 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:56.868902  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 122581us
I20260709 13:02:56.860594 10025 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:56.870111  9418 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:56.871390  9418 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:56.871815 11491 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:56.863236 11494 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:56.873112 11491 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:56.873533 11491 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.873883 11491 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:56.874825 11494 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:56.876660 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:56.879424 11487 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:56.881780 11280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 807906edc34d41589d9b860b72f70e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:56.851943 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:02:56.884020  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.796550 11377 consensus_queue.cc:260] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:56.881680 11492 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:56.859604 11233 raft_consensus.cc:2749] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:56.892799  9418 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:56.893738 10641 consensus_queue.cc:1059] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:02:56.892131  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 107485us
I20260709 13:02:56.881737 11491 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:56.894677  9492 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:56.895867  9492 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:56.904489  9418 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:56.907351 11379 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:56.892443 11482 consensus_queue.cc:1059] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:02:56.915269  9341 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:56.906111 11184 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:56.915951 10641 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:56.916534 11498 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:56.917385 11492 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:56.913093 11377 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:56.953357  9376 raft_consensus.cc:1240] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:02:56.954525  9370 raft_consensus.cc:1240] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:56.917968 11107 raft_consensus.cc:3055] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:56.957937 10299 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:56.958489 10299 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:56.958920 10299 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:56.953372  9490 connection.cc:256] RPC call timeout handler was delayed by -2.3809476820000555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
I20260709 13:02:56.951630 11233 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:56.965754  9490 connection.cc:256] RPC call timeout handler was delayed by -2.3431476820000512s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
W20260709 13:02:56.968289  9490 connection.cc:256] RPC call timeout handler was delayed by -2.3377476820000425s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
W20260709 13:02:56.969069  9490 connection.cc:256] RPC call timeout handler was delayed by -2.2819476820000091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
W20260709 13:02:56.969512  9490 connection.cc:256] RPC call timeout handler was delayed by -2.2153476820000151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18510000000000001s for a response
W20260709 13:02:56.969934  9490 connection.cc:256] RPC call timeout handler was delayed by -2.1793745630000103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
W20260709 13:02:56.970340  9490 connection.cc:256] RPC call timeout handler was delayed by -2.1775476820000108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
W20260709 13:02:56.970767  9490 connection.cc:256] RPC call timeout handler was delayed by -2.0551476820000403s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2029s for a response
W20260709 13:02:56.971175  9490 connection.cc:256] RPC call timeout handler was delayed by -1.91325426100002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
W20260709 13:02:56.971585  9490 connection.cc:256] RPC call timeout handler was delayed by -1.8031476820000307s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23090000000000002s for a response
W20260709 13:02:56.972002  9490 connection.cc:256] RPC call timeout handler was delayed by -1.7665542610000102s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260709 13:02:56.972340  9490 connection.cc:256] RPC call timeout handler was delayed by -1.5361542610000356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
W20260709 13:02:56.972779  9490 connection.cc:256] RPC call timeout handler was delayed by -1.4848542610000095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
W20260709 13:02:56.973222  9490 connection.cc:256] RPC call timeout handler was delayed by -1.3234476820000509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2842s for a response
W20260709 13:02:56.973646  9490 connection.cc:256] RPC call timeout handler was delayed by -1.2942819080000163s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2223s for a response
I20260709 13:02:56.973508  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:56.974722  9372 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:56.956497 11492 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.978605  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:56.943017 11284 consensus_queue.cc:1048] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:02:56.961170 11107 raft_consensus.cc:740] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:56.982672 11491 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:56.977108  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:56.982999 10759 raft_consensus.cc:993] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:02:56.982280 11336 consensus_queue.cc:1059] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:56.988293  9517 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:56.983929  9518 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:56.979743  9524 raft_consensus.cc:2410] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:56.913410 11373 consensus_queue.cc:237] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:56.991639  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:56.992535  9524 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:56.986200 11492 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:56.989339 11355 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:57.001448 11048 raft_consensus.cc:1081] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:02:57.001183 11355 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.003247  9341 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:57.003463 11315 consensus_queue.cc:1059] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:56.999305 10299 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.005201  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:57.013151 11379 raft_consensus.cc:697] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:57.013871  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:57.014799  9524 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:57.014353 11379 consensus_queue.cc:237] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.015725  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:57.006394  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:57.016942  9518 raft_consensus.cc:2393] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 7: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:57.017976  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:57.018942  9518 raft_consensus.cc:2393] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 7: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:57.003775 11206 consensus_queue.cc:1048] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:02:57.019726  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:57.020395  9518 raft_consensus.cc:2393] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 7: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:57.007766  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:57.021531 11335 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:57.022324 11335 consensus_queue.cc:1059] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:57.023188 11432 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:57.023501 11355 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:57.025359  9524 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:02:57.025710  9418 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:57.010563  9372 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:02:57.011164  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:56.986083 11504 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:57.026459  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:57.032188  9518 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:57.009120  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:57.027330  9522 raft_consensus.cc:2393] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 5: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:57.027334  9418 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:57.028541  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:57.033986  9374 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:02:57.034174 10299 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:57.036635  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:57.037370  9524 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:02:57.035938  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:57.088708  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:57.074826  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.033393  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:57.104908  9525 raft_consensus.cc:2410] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:57.105243  9490 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
W20260709 13:02:57.101156  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 73902.1us
I20260709 13:02:57.106302  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:57.107103  9524 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:57.106283  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:57.108217  9523 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:02:57.046773  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:57.110339  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:57.113296  9520 raft_consensus.cc:2410] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:57.113452  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:57.117389  9375 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:02:57.117944  9375 pending_rounds.cc:85] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947: Aborting all ops after (but not including) 2
I20260709 13:02:57.118158  9375 pending_rounds.cc:107] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:02:57.118383  9375 raft_consensus.cc:2889] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:57.120332  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:57.117350  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:57.105492  9518 raft_consensus.cc:2410] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:57.123687 10299 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.124234 10299 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.124698  9490 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:57.128845  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:57.129522  9524 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 1.
I20260709 13:02:57.129822  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:57.130363  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:57.131035  9524 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:57.131606  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:57.132019  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:57.133046  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:57.133576  9518 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:57.134027  9445 raft_consensus.cc:1240] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:57.134658  9490 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:57.137797  9490 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:57.141455  9490 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:57.083475 11500 log.cc:927] Time spent T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:02:57.098150 11502 log.cc:927] Time spent T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:02:57.156129  9490 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:57.046921 11491 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:57.143702 11507 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:57.147857 11379 raft_consensus.cc:2804] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:57.149376  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:57.038007 11498 raft_consensus.cc:697] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:57.161955  9377 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:02:57.132756  9523 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:57.163479  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:57.141474 11355 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:57.173241 11355 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:57.173674 11355 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:57.176057  9272 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 64) took 8879 ms. Trace:
I20260709 13:02:57.150569  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:57.182145 11419 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.195919  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:57.043742 11494 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.119s
I20260709 13:02:57.141609 11496 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:57.209496 11496 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:57.160528 11491 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:57.213488 11491 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:57.154233  9518 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:02:57.157467  9490 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:57.217418 11503 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:02:57.217819  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 60434.6us
I20260709 13:02:57.218640  9490 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:57.219836  9490 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:57.042213  9526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46894
I20260709 13:02:57.158486 10299 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:57.087442 11206 raft_consensus.cc:3055] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:57.159291 11369 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:57.171782 10917 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:57.172451 11379 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:57.172641  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:57.043207 11504 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.183013 11355 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.183575  9273 catalog_manager.cc:5697] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:57.155977 11506 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:57.185467 11492 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:57.186487  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.229846 11492 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:57.230204 11492 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:57.227924 11379 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:57.230533  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.231511  9447 raft_consensus.cc:2410] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:02:57.231801 11495 raft_consensus.cc:3055] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:57.232273  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.232411 11495 raft_consensus.cc:740] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:57.187192  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.224000 11206 raft_consensus.cc:740] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:57.233839  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.234679  9445 raft_consensus.cc:2393] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 6: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:57.234364 11206 consensus_queue.cc:260] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.235428  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.228354 11486 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:57.233727 11495 consensus_queue.cc:260] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.228197 11369 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.236220  9445 raft_consensus.cc:2393] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 6: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:57.240499  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:57.240893 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:02:57.241648 10065 raft_consensus.cc:2468] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:02:57.235749 10759 raft_consensus.cc:3055] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:57.242755 10759 raft_consensus.cc:740] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:57.187466 11209 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:57.220626  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:57.222975  9524 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:02:57.212752 11496 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:57.225479 10917 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:57.227871 11506 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:57.239796 11507 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:57.170204 11432 consensus_queue.cc:1059] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:02:57.033377 11335 raft_consensus.cc:3055] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:57.242753  9273 catalog_manager.cc:5697] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 1 to 4, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 4 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:57.239030  9526 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:57.243206  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.244189  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.302500  9526 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:57.244226  9417 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:57.302747  9445 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
W20260709 13:02:57.303193  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 59055.5us
I20260709 13:02:57.248749  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:57.303709  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.224107  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:57.304700  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:57.304970  9520 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:57.250033  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.250988 10759 consensus_queue.cc:260] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.046635 11107 consensus_queue.cc:260] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.235638 11206 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:57.308034  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:57.308279  9523 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:02:57.309744  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:57.252718  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:57.304700  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.310974  9518 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:57.252321 11209 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.311401  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:57.255847 10917 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:57.349800  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.351022 10759 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:57.230561 11492 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:57.294821  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.224699 11419 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.357856  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.305358  9524 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:02:57.308621  9447 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:57.238644 11369 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:57.236522 11486 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:57.371008 11486 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:57.238955 11355 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:57.313153  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:57.374892  9523 raft_consensus.cc:1240] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:57.375512 11113 raft_consensus.cc:3055] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:57.376080 11113 raft_consensus.cc:740] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:57.376231 11209 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:57.356276  9451 raft_consensus.cc:2393] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 4: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:57.377345 11113 consensus_queue.cc:260] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.359935  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:57.176649  9272 rpcz_store.cc:276] 0709 13:02:48.296825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.297082 (+   257us) service_pool.cc:224] Handling call
0709 13:02:57.175966 (+8878884us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:51.593482 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:51.633915 (+ 40433us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:51.633968 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:02:51.633994 (+    26us) tablet.cc:662] Decoding operations
0709 13:02:51.634807 (+   813us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:51.634911 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:51.634950 (+    39us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:02:51.635390 (+   440us) tablet.cc:701] Row locks acquired
0709 13:02:51.635414 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:02:52.415460 (+780046us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b2c000264b8. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb584e63a11 00007fb584e72a0a 00007fb584e72693 00007fb584e72631 00007fb5865a5902 00007fb5865a56dd 00007fb589fa0243 00007fb589f9fd58 00007fb589fa49f1 00007fb589fa49a9 00007fb589fa4939
0709 13:02:52.415534 (+    74us) write_op.cc:270] Start()
0709 13:02:52.415816 (+   282us) write_op.cc:276] Timestamp: P: 1783602171639785 usec, L: 0
0709 13:02:52.415874 (+    58us) op_driver.cc:348] REPLICATION: starting
0709 13:02:52.416556 (+   682us) log.cc:844] Serialized 1274 byte log entry
0709 13:02:53.349618 (+933062us) op_driver.cc:464] REPLICATION: finished
0709 13:02:54.127593 (+777975us) write_op.cc:301] APPLY: starting
0709 13:02:54.138336 (+ 10743us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:54.187183 (+ 48847us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:54.190962 (+  3779us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:54.249350 (+ 58388us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:54.249604 (+   254us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:02:54.249680 (+    76us) write_op.cc:312] APPLY: finished
0709 13:02:54.249987 (+   307us) log.cc:844] Serialized 34 byte log entry
0709 13:02:54.318677 (+ 68690us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:54.326395 (+  7718us) write_op.cc:454] Released schema lock
0709 13:02:54.335962 (+  9567us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:54.373787 (+ 37825us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:54.383095 (+  9308us) write_op.cc:454] Released schema lock
0709 13:02:55.031752 (+648657us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
Metrics: {"mutex_wait_us":1706638,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":758679,"apply.run_cpu_time_us":22897,"apply.run_wall_time_us":244117,"num_ops":3,"prepare.queue_time_us":193132,"prepare.run_cpu_time_us":34307,"prepare.run_wall_time_us":1056389,"raft.queue_time_us":606585,"raft.run_cpu_time_us":73440,"raft.run_wall_time_us":832373,"replication_time_us":933553,"spinlock_wait_cycles":13284864,"thread_start_us":1558916,"threads_started":5,"wal-append.queue_time_us":416797,"wal-append.run_cpu_time_us":41280,"wal-append.run_wall_time_us":2948011}]]}
I20260709 13:02:57.378043  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.363108  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.292452 11507 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:57.383944  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.314527  9273 catalog_manager.cc:5697] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 1 to 2, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 2 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:57.350208 11496 raft_consensus.cc:2804] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:57.381945  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.401970 11355 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.292989 11506 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:57.402356 11496 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:02:57.402921 11496 raft_consensus.cc:3060] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:57.376233  9523 raft_consensus.cc:1240] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:57.302961 11495 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:57.302158 11335 raft_consensus.cc:740] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:57.414814  9520 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:02:57.385995  9375 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:57.415941  9524 raft_consensus.cc:1240] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:57.388993 11353 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:57.389252 11517 log.cc:927] Time spent T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:02:57.417863  9452 raft_consensus.cc:1240] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:57.414438  9492 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:57.414502  9526 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.412838  9273 catalog_manager.cc:5697] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 3 to 4, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 4 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:57.422266  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:57.423476  9444 raft_consensus.cc:2368] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 6. Current term is 7.
I20260709 13:02:57.422365  9273 catalog_manager.cc:5697] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:57.425195  9523 raft_consensus.cc:1275] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:57.426069  9492 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:02:57.399089  9447 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:02:57.399803  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:57.405691 11355 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.406136 11315 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:57.350035 11184 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:57.408275 11113 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:57.386229 11507 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:57.365212 11365 consensus_meta.cc:287] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.568s	user 0.011s	sys 0.000s
I20260709 13:02:57.412411  9518 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:57.301426 11498 consensus_queue.cc:237] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:57.381328  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 161546us
I20260709 13:02:57.452147  9449 raft_consensus.cc:1240] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:57.452776  9490 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:57.427800  9375 raft_consensus.cc:1275] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:57.427902  9517 raft_consensus.cc:2376] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3. Re-sending same reply.
I20260709 13:02:57.429081  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:57.421228 11503 consensus_queue.cc:1059] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:02:57.429658  9520 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:57.438186  9273 catalog_manager.cc:5697] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 2 to 5, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 5 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:57.466248  9273 catalog_manager.cc:5697] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:57.450037  9518 raft_consensus.cc:1275] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:57.431092 11516 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:57.474838  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:57.459318  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:57.469786  9518 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:02:57.476302  9518 pending_rounds.cc:85] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 3
I20260709 13:02:57.476580  9518 pending_rounds.cc:107] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:02:57.476686  9376 raft_consensus.cc:1240] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:57.471540  9273 catalog_manager.cc:5697] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 3 to 5, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 5 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:57.476858  9518 raft_consensus.cc:2889] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:57.478611  9273 catalog_manager.cc:5697] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:57.483289  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:02:57.483870  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.478708 11503 consensus_queue.cc:1243] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 6.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:02:57.484645 11503 raft_consensus.cc:2804] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:57.485075 11503 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:57.485486 11503 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:57.488188  9519 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:02:57.488176  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.489267  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:57.490188  9523 raft_consensus.cc:3055] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:57.490744  9523 raft_consensus.cc:740] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:57.492594  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.493276  9446 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:02:57.490265  9519 raft_consensus.cc:1240] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:57.495942  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:57.491623  9523 consensus_queue.cc:260] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.497941  9523 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:57.430280 11486 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.510932  9523 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 2. (term mismatch)
I20260709 13:02:57.511358  9523 pending_rounds.cc:85] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 1
I20260709 13:02:57.511571  9523 pending_rounds.cc:107] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:02:57.511794  9523 raft_consensus.cc:2889] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:57.512171  9523 pending_rounds.cc:107] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:02:57.512506  9523 raft_consensus.cc:2889] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:57.526057  9519 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:57.527829  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:57.528599  9371 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:57.528784  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 76121.7us
I20260709 13:02:57.530205  9490 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:57.528857  9447 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
W20260709 13:02:57.537048 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 44795us
I20260709 13:02:57.443287 11315 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:57.543972  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:57.499881 11516 raft_consensus.cc:697] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:57.451443 11365 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.552177  9371 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:02:57.552922  9447 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
W20260709 13:02:57.548389  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 112280us
I20260709 13:02:57.489297 10917 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.554767  9492 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:02:57.555357 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 71728.1us
I20260709 13:02:57.557384  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:02:57.559224 11489 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:02:57.560184 11507 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.560988 11491 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.562400 11507 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:57.563445  9450 raft_consensus.cc:2393] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 6: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:02:57.544276 11351 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.549643 11419 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:57.479041 11335 consensus_queue.cc:260] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.566015  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:57.480973  9273 catalog_manager.cc:5697] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 1 to 4, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 4 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:57.827251  9273 catalog_manager.cc:5697] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:57.842083  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.566289  9520 raft_consensus.cc:1240] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:57.845783  9451 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:02:57.847573  9452 raft_consensus.cc:1240] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:57.819161  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.851683  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.841980  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:57.854722  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.860105  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:57.861310  9273 catalog_manager.cc:5697] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:57.865339 10091 debug-util.cc:398] Leaking SignalData structure 0x7b08002fdfc0 after lost signal to thread 8212
I20260709 13:02:57.857216  9444 raft_consensus.cc:1275] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:57.866012 10067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 205) took 1081 ms. Trace:
W20260709 13:02:57.866971 10091 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe6a0 after lost signal to thread 9309
I20260709 13:02:57.869073 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:02:57.872578 10091 debug-util.cc:398] Leaking SignalData structure 0x7b08002c83a0 after lost signal to thread 9401
W20260709 13:02:57.872990 10091 debug-util.cc:398] Leaking SignalData structure 0x7b080035fca0 after lost signal to thread 9402
I20260709 13:02:57.866547 10067 rpcz_store.cc:276] 0709 13:02:56.784085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.827672 (+ 43587us) service_pool.cc:224] Handling call
0709 13:02:56.828099 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:56.831213 (+  3114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:56.831267 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:56.831926 (+   659us) log.cc:844] Serialized 26 byte log entry
0709 13:02:57.593210 (+761284us) spinlock_profiling.cc:243] Waited 6.81 ms on lock 0x7b18001ea240. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58345fe07 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b 00007fb586109d23 00007fb58610a0d1 00007fb586525a0f
0709 13:02:57.865124 (+271914us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:57.865234 (+   110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.865368 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:57.865444 (+    76us) raft_consensus.cc:1685] finished
0709 13:02:57.865454 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.865778 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2560,"raft.queue_time_us":2685,"raft.run_cpu_time_us":4387,"raft.run_wall_time_us":13472,"spinlock_wait_cycles":15656320,"thread_start_us":271386,"threads_started":1,"wal-append.queue_time_us":894190}
W20260709 13:02:57.889441 10091 debug-util.cc:398] Leaking SignalData structure 0x7b08003a9980 after lost signal to thread 9476
W20260709 13:02:57.892338 10091 debug-util.cc:398] Leaking SignalData structure 0x7b0800374540 after lost signal to thread 9550
I20260709 13:02:57.602490 11355 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:57.568154 11377 consensus_meta.cc:287] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.606s	user 0.015s	sys 0.002s
I20260709 13:02:57.894063 10641 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:57.895474 10641 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.591120 10917 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:57.601981 11486 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:57.571244 11351 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:57.647873 11107 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:57.582017 11507 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:57.900872  9445 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:02:57.590179 11315 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:57.637188 11373 raft_consensus.cc:3055] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:57.589169 11330 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:57.902191 11373 raft_consensus.cc:740] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:57.902590 11330 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.903103 11330 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:57.648845 11491 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:57.728011 11379 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.642123 11497 raft_consensus.cc:3055] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:02:57.911605  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.912058 11497 raft_consensus.cc:740] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:02:57.912297  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:57.892879 10091 debug-util.cc:398] Leaking SignalData structure 0x7b0800055e40 after lost signal to thread 9551
I20260709 13:02:57.594899 11496 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:57.595695 11365 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:57.589946 11492 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.946681 11335 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:57.556226 11504 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:57.725522 11503 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.578773 11521 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:57.953446  9521 raft_consensus.cc:1240] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
W20260709 13:02:57.570250 11515 log.cc:927] Time spent T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:02:57.912441 11379 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:57.960659  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.961858  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.904151 11373 consensus_queue.cc:260] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.888307  9273 catalog_manager.cc:5697] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 1 to 3, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 3 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:57.974213 10641 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:57.975174  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.975692 11351 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:57.978711 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:02:57.979514  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.981431 10759 raft_consensus.cc:1064] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:02:57.982059  9526 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:57.594269 11506 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.979514 10067 raft_consensus.cc:2468] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:57.984766  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:57.981451 11503 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:57.984160 10759 consensus_queue.cc:237] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:57.985605  9342 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
W20260709 13:02:57.734447 11485 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.005s	sys 0.014s
W20260709 13:02:57.990502  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.990929 11491 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:57.588886 11516 consensus_queue.cc:237] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:57.978649 11377 consensus_queue.cc:1059] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:02:57.995424 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:57.992072  9374 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:02:57.996176 11492 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:58.000553  9376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:02:58.003536 11497 consensus_queue.cc:260] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:58.006053 11330 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:58.009274 10091 debug-util.cc:398] Leaking SignalData structure 0x7b08001dea80 after lost signal to thread 10094
I20260709 13:02:58.009656  9368 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:02:58.009975  9449 raft_consensus.cc:1240] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:58.008764  9446 raft_consensus.cc:1275] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:58.009294  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:58.011466 11373 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:57.986136 11506 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:58.019075  9376 raft_consensus.cc:606] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.026880 11330 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:58.025195 11491 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:58.029771 11491 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:58.024048 11485 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.283s	user 0.005s	sys 0.020s
I20260709 13:02:58.030860 11280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44540 (request call id 192) took 7288 ms. Trace:
I20260709 13:02:57.992395 11496 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:58.025789 11494 raft_consensus.cc:3055] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:58.033037 11494 raft_consensus.cc:740] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:02:58.033339  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 47807.9us
I20260709 13:02:58.034571 11494 consensus_queue.cc:260] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:58.036373 11494 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:58.037587 11534 raft_consensus.cc:2804] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:58.038152 11534 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.038601 11534 raft_consensus.cc:3060] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:58.041177  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.041962  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.042384  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.043219  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.047042 11497 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:58.049077 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 498453us
I20260709 13:02:58.058626  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:58.060127  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:58.063692  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:02:58.066761  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.071306  9446 raft_consensus.cc:1240] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:58.078491  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.079918  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 525049us
W20260709 13:02:58.084396  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 554038us
I20260709 13:02:58.084192 11492 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
W20260709 13:02:58.087046  9517 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.008s	sys 0.012s
W20260709 13:02:58.087632  9517 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.008s	sys 0.012s
I20260709 13:02:58.089551 11541 consensus_queue.cc:1048] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:02:58.090124  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 88158.4us
I20260709 13:02:58.031494 11280 rpcz_store.cc:276] 0709 13:02:50.741769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.744697 (+  2928us) service_pool.cc:224] Handling call
0709 13:02:50.874601 (+129904us) ts_tablet_manager.cc:934] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
0709 13:02:56.806661 (+5932060us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:02:57.490221 (+683560us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:57.502805 (+ 12584us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:02:58.028795 (+525990us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:02:58.029817 (+  1022us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:58.030323 (+   506us) ts_tablet_manager.cc:989] Replica registered.
0709 13:02:58.030468 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":8439,"tablet-copy.queue_time_us":62487,"thread_start_us":124960,"threads_started":2}
I20260709 13:02:58.095818  9490 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.092842  9418 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:58.097116 10067 raft_consensus.cc:2468] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:02:58.106901 11496 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:58.111341 10070 raft_consensus.cc:1275] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 3 LEARNER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:58.111845  9417 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:58.111321  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:58.100454  9273 catalog_manager.cc:5697] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 1 to 2, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 2 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:58.119632 11535 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:58.121655  9490 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.107574 11496 raft_consensus.cc:697] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:58.116951  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:58.123715  9448 raft_consensus.cc:2468] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:58.134905 11535 raft_consensus.cc:2749] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:58.137511 11491 raft_consensus.cc:2804] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:58.138214 11491 raft_consensus.cc:697] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:58.138257 11496 consensus_queue.cc:237] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:58.139539 11491 consensus_queue.cc:237] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:58.122967  9273 catalog_manager.cc:5697] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 1 to 5, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 5 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.113886 11280 tablet_copy_client.cc:806] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
W20260709 13:02:58.161348  9447 consensus_meta.cc:287] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.555s	user 0.012s	sys 0.003s
W20260709 13:02:58.164212  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 49441.8us
I20260709 13:02:58.169260  9447 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:02:58.172263 10641 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:58.176599  9446 raft_consensus.cc:2393] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 5: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:58.179280 10641 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:58.180040  9370 raft_consensus.cc:2410] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:58.179281  9518 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:58.189352  9518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1126) took 1076 ms. Trace:
I20260709 13:02:58.190121  9518 rpcz_store.cc:276] 0709 13:02:57.112610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.480012 (+367402us) service_pool.cc:224] Handling call
0709 13:02:57.480856 (+   844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:58.187888 (+707032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.188910 (+  1022us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b5400314cd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:02:58.189256 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1602689280}
I20260709 13:02:58.202013 10641 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:58.205446  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.207635  9273 catalog_manager.cc:5697] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 1 to 3, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 3 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:58.209612  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.176012 11432 consensus_queue.cc:1048] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:02:58.182319 11280 tablet_copy_client.cc:670] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:58.229375  9418 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:02:58.209242  9273 catalog_manager.cc:5697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 1 to 2, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 2 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:58.251022 11335 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:58.257601  9343 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:02:58.260797  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.263990 11494 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:58.281900 11280 tablet_copy_client.cc:538] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:58.276476 11373 consensus_queue.cc:1059] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:02:58.284713 11432 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:58.284873 10299 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:58.285807 11335 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.286401 11335 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:58.288645 11335 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:58.290174  9341 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.291193 11335 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:58.296450  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 80168.3us
I20260709 13:02:58.296651 11373 raft_consensus.cc:3055] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:58.297178 11373 raft_consensus.cc:740] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:58.297906  9418 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:58.298246 11373 consensus_queue.cc:260] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:58.299804 11373 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:58.301278  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.306828 11432 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:58.308106  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 50778.1us
I20260709 13:02:58.309072  9343 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.309230 11534 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:58.309855 10299 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:58.310563  9343 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.311407 10299 raft_consensus.cc:2804] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:58.311910 10299 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:58.312132  9343 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.312427 10299 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:58.313930 11494 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:58.314730 11494 raft_consensus.cc:697] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:58.313946 11335 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:58.315238 11335 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:58.315745 11335 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:58.315879 11494 consensus_queue.cc:237] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:58.317914 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:58.318579 10069 raft_consensus.cc:3060] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:58.320032  9447 raft_consensus.cc:1275] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:58.325479  9418 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:58.329623 11491 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:58.330286 11491 raft_consensus.cc:697] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:58.331396 11491 consensus_queue.cc:237] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:58.337910 11209 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:58.338752 11497 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:58.331779 10641 consensus_queue.cc:1048] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:58.341293  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:58.342012  9447 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:58.342989 11284 raft_consensus.cc:993] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:02:58.343775 11336 raft_consensus.cc:1081] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:02:58.344846  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:58.345638  9451 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:02:58.345937 11534 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:58.347899 10299 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:58.352874  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:58.332391 11335 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:58.353745 10069 raft_consensus.cc:2468] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:02:58.344964  9343 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.361552  9342 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:02:58.348840 11280 tablet_bootstrap.cc:492] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:02:58.365373  9343 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.363938 10299 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:58.366443 10299 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:58.366865 10299 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:58.367275 10299 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:58.368144 11335 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:58.369062 11284 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:58.369207  9341 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:58.369546 11284 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:58.370019 11284 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:58.370472  9343 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.371332 10759 raft_consensus.cc:2804] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:58.371835 11336 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:58.371802 10759 raft_consensus.cc:697] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:58.372259 11336 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:58.372668 11336 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:58.372951 10759 consensus_queue.cc:237] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:58.376539  9341 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:58.368795  9445 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51012
I20260709 13:02:58.386413  9445 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:58.387049  9445 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:58.388715 11432 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:58.389950  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:58.389724 11432 raft_consensus.cc:2955] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:58.396916  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:58.385304 11335 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:58.399606 11335 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.399986 11335 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:58.411893 11336 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:02:58.414484 11284 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:58.418651  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 48333.8us
I20260709 13:02:58.422340 10299 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:58.428917 10299 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:58.433441  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:58.429656 11491 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:02:58.439775  9343 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.420430  9446 raft_consensus.cc:2955] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:58.448894  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:58.442291 11284 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:58.453253 11336 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:58.451383 10299 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:02:58.454784  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.455824  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.456216  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:58.464363  9445 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:58.467645  9445 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:58.476392  9343 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.458134 11491 consensus_queue.cc:1059] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:02:58.481516 11048 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:58.481791 11491 raft_consensus.cc:3055] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:58.482142 11048 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:58.482411 11491 raft_consensus.cc:740] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:58.482760 11048 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.483697 11491 consensus_queue.cc:260] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:58.485561  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.477945  9343 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.495596  9451 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:58.499722  9341 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:58.502264  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.507607 11377 consensus_queue.cc:1059] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:58.508445 11377 consensus_queue.cc:1243] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 6d50f1c263264b21919230bee398022b log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:58.508927 11497 raft_consensus.cc:3055] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:58.511098 11497 raft_consensus.cc:740] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:58.512121 11497 consensus_queue.cc:260] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:58.498679 11336 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:58.504534 11284 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:58.519804  9376 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:58.517503  9368 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:58.525472 11284 raft_consensus.cc:697] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:58.526101 11335 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:58.526809 11284 consensus_queue.cc:237] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
W20260709 13:02:58.533245  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 55406.7us
I20260709 13:02:58.534850  9343 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.517442  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:58.535944  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:58.505092 11491 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:58.537573 10759 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:58.539695  9343 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.535041  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:58.518105  9526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46894
I20260709 13:02:58.519505 11497 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:58.541528  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:58.545924  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:58.545974 10069 raft_consensus.cc:2955] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:58.589200  9526 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:58.589636  9526 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:58.547449  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:58.547698 11335 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:58.549782  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:58.551064  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:58.552346  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:58.553297  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:58.555678  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:58.557360  9369 raft_consensus.cc:1240] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:58.595290  9518 raft_consensus.cc:2393] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 5: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:58.565272 11048 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:58.515413 11336 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:58.573670  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:02:58.602078  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 62505.6us
I20260709 13:02:58.602381  9451 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:58.603839  9520 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
W20260709 13:02:58.577222  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.606168  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.596519 10759 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:58.607941 10759 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:58.608428 10759 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:58.605366  9524 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
W20260709 13:02:58.612058  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.612717  9522 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:02:58.617313  9521 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:02:58.617990  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:58.618275 11048 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:58.618865  9522 raft_consensus.cc:2393] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 5: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:58.618770  9521 raft_consensus.cc:1240] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:58.602092 11336 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:58.626590  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:58.627894  9523 raft_consensus.cc:2368] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 7. Current term is 8.
I20260709 13:02:58.629914  9451 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:02:58.632607  9526 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:58.636353  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:02:58.636935  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.613441  9519 raft_consensus.cc:2376] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3. Re-sending same reply.
I20260709 13:02:58.635797  9521 raft_consensus.cc:1240] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:58.642328  9370 raft_consensus.cc:1240] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:58.643102  9522 raft_consensus.cc:1240] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:58.644124  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:02:58.644258  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:58.645901  9524 raft_consensus.cc:2393] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 5: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:58.649636  9341 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:58.660681  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:58.658767  9520 raft_consensus.cc:2376] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7. Re-sending same reply.
I20260709 13:02:58.664342  9522 raft_consensus.cc:1275] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:58.704752  9519 raft_consensus.cc:1240] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:58.656522 11048 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:58.680763  9518 raft_consensus.cc:2393] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 5: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:02:58.709764  9371 raft_consensus.cc:1240] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:58.709880 10067 raft_consensus.cc:1240] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:58.713279 11377 consensus_queue.cc:1059] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:58.715158 10759 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:58.717344  9523 raft_consensus.cc:1240] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:58.721223  9526 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:02:58.725837  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:58.726501 11107 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:58.726940  9370 raft_consensus.cc:2393] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 6: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:02:58.727283 11107 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:58.729070  9376 raft_consensus.cc:1240] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:58.729272  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:58.710914 11492 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.733572 11373 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:58.733565 11492 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:58.734592 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:02:58.735388 10070 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:58.736833  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:02:58.739971  9323 auto_rebalancer.cc:629] Failed to schedule move for tablet 3ad4133883414768941dffb952ca7caf: Illegal state: Replica d62c9d5a052b42ce8675f8438f846526 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:58.740989  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:02:58.742292  9523 raft_consensus.cc:2393] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 6: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
W20260709 13:02:58.743490  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.714673 11494 raft_consensus.cc:3055] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:58.744576 11494 raft_consensus.cc:740] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:58.745908 11494 consensus_queue.cc:260] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:02:58.747725 11494 raft_consensus.cc:3060] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:58.754027 10759 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:58.712749 11048 raft_consensus.cc:697] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:58.765714  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:58.764916  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:02:58.771732 10759 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:58.781767 11107 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:58.765102 11373 consensus_queue.cc:1048] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:02:58.785995 10070 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
W20260709 13:02:58.787525  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.763481 11492 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:58.794737  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:58.795629  9451 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:02:58.798831  9490 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.802124  9525 raft_consensus.cc:1240] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:58.817564  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:02:58.817366 11048 consensus_queue.cc:237] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:58.818132  9374 raft_consensus.cc:3055] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:58.818434  9374 raft_consensus.cc:740] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:58.819180  9374 consensus_queue.cc:260] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:58.820207  9374 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:58.823326  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:02:58.828935  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.836097  9374 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:02:58.832209  9341 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:02:58.842059  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 44051.1us
I20260709 13:02:58.842226 10641 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:58.842689 10641 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:02:58.843113 10641 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:58.861233 11492 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:58.875837  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:02:58.878806  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.865727 11336 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:58.893380  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:58.894577  9343 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.895391 11351 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:58.909333 11494 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:58.915861 10070 raft_consensus.cc:1275] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:58.890856 11336 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:58.919647  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 57202us
W20260709 13:02:58.921061  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.921548 10641 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:58.928723 11351 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.933781 11351 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:58.935940 11351 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:58.933033  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 159465us
I20260709 13:02:58.939443  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:58.940158  9452 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:02:58.941361  9341 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:58.941919  9490 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.942968 11573 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:58.943650  9490 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.944671 11494 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:58.945732 11516 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:58.948240 11336 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:58.948732  9490 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.951349 11573 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:58.953761  9490 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.957476 11573 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:58.958436  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 61412.1us
I20260709 13:02:58.927037 11048 consensus_queue.cc:1048] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:02:58.963202  9418 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:58.948987 11336 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.970300 10641 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:58.973354  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:58.971135 11336 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:58.982856  9490 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.985247  9490 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.986783  9490 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.986852 11336 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:58.988698 11516 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:58.988099  9490 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:58.989418 11280 tablet_bootstrap.cc:492] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:58.989585 11516 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:58.990365 11492 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:58.991173 11492 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:58.975677 11494 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:59.004141  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.017235 11573 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:59.017654 11280 tablet_bootstrap.cc:492] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:02:59.018847 11280 ts_tablet_manager.cc:1403] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.670s	user 0.041s	sys 0.019s
I20260709 13:02:59.026233  9490 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:59.026401 11280 raft_consensus.cc:359] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:59.027303 11280 raft_consensus.cc:740] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:02:59.027776  9490 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:59.028041 11280 consensus_queue.cc:260] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:59.029281 11573 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:59.028694 11492 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:59.032055 11280 ts_tablet_manager.cc:1434] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:02:59.032495 11516 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:59.029222  9490 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:59.092973 11516 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:59.093375 11492 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:59.093485 11336 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:02:59.094286  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 65219.5us
I20260709 13:02:59.095510  9490 leader_election.cc:400] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 6. Current term is 7.
I20260709 13:02:59.100564  9490 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:59.102757 11492 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:59.145689  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:59.151661  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 54701.9us
I20260709 13:02:59.156474  9490 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:59.172981 11516 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.173748 11516 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.177325 11516 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:59.193027 11516 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:02:59.201511  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.346313  9490 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:59.403066 11492 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:59.403909 11492 raft_consensus.cc:697] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:59.310674 11516 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:02:59.412607  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 66413.2us
I20260709 13:02:59.418366 11516 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:59.429641 11492 consensus_queue.cc:237] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.430351  9490 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:59.431245 11573 raft_consensus.cc:2749] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:59.432519  9490 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:59.433276 11573 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:59.443275 11516 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.447579  9490 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:59.448552 11492 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:59.449820  9490 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:59.451225  9490 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:59.454138 11492 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:59.454993 11492 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:59.455771 11492 consensus_queue.cc:1059] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:59.457055 11516 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:59.457244 11569 raft_consensus.cc:3055] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:59.457775 11569 raft_consensus.cc:740] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:02:59.458704 11569 consensus_queue.cc:260] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.459965 11569 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:59.462641  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.465127 11573 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:59.481333 10759 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.456881 11492 consensus_queue.cc:1048] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:02:59.486500 10759 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.491587 10759 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:59.494299 11573 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.497822 11573 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:59.492312 11516 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:59.499419 11516 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.503062 10641 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.503628 10641 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.504555 10070 raft_consensus.cc:1217] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:02:59.505998 10641 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:59.508246 11516 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:59.522518 11336 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:59.523383 11336 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:59.524462  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.524959  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.525771  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.532862  9272 catalog_manager.cc:5697] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index -1 to 2, term changed from 1 to 3, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 3 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:02:59.536630  9272 catalog_manager.cc:5697] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 3 to 5, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 5 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:59.540182  9387 tablet_copy_service.cc:342] P 925acbe78db14db3b9e4cfc857717947: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-807906edc34d41589d9b860b72f70e16 received from {username='slave'} at 127.0.0.1:50568
I20260709 13:02:59.540743  9387 tablet_copy_service.cc:434] P 925acbe78db14db3b9e4cfc857717947: ending tablet copy session b0812463215649c3b011d36e2f0400c9-807906edc34d41589d9b860b72f70e16 on tablet 807906edc34d41589d9b860b72f70e16 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:02:59.538714  9272 catalog_manager.cc:5697] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 3 to 4, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 4 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:59.566115  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 593087us
I20260709 13:02:59.566993  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:59.567672  9452 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:59.567927  9418 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:02:59.570084 11209 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:59.570915 11209 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:59.572983  9418 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:59.525662 11336 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:59.600356  9452 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:02:59.612988  9447 raft_consensus.cc:1275] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:02:59.702248  9447 pending_rounds.cc:85] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 6
I20260709 13:02:59.702564  9447 pending_rounds.cc:107] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:02:59.702862  9447 raft_consensus.cc:2889] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:59.628866  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:59.627962  9275 catalog_manager.cc:5697] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.637244  9449 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:59.641984  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:59.665408  9444 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:59.666666  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:59.676838  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:59.706928  9446 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:59.707216  9445 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
W20260709 13:02:59.708930  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.706928  9451 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:02:59.710955 11336 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.711540 11336 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.714119 11336 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:59.714903 11209 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.724052 11209 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.724409  9341 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:59.715373 11497 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:59.725585  9341 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:59.725946 11497 raft_consensus.cc:697] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:59.726393 11581 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:59.726802 11581 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.727236 11581 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:59.717866 11582 consensus_queue.cc:1048] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:59.718783 10641 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:59.719799 11580 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:59.726963 11497 consensus_queue.cc:237] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.730520 11336 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:59.731112 11336 raft_consensus.cc:697] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:59.728364 11587 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.732686 11587 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.733948 11209 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:59.730036 11586 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:02:59.736479 11586 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:02:59.736999  9446 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:02:59.739029 11586 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:59.735605 11587 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:59.741531 11336 consensus_queue.cc:237] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:59.722560  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 149650us
I20260709 13:02:59.744916 11569 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.749280  9418 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:02:59.749557 11569 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.752151 11569 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:02:59.753088 11494 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:59.753712 11494 raft_consensus.cc:697] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:02:59.755435  9492 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.658s (SENT) [suppressed 16 similar messages]
I20260709 13:02:59.755043 11494 consensus_queue.cc:237] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.763679  9341 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:59.764600 11580 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:59.764991 11580 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:59.765424 11580 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:59.774286  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:59.775655  9275 catalog_manager.cc:5697] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.777451  9275 catalog_manager.cc:5697] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 3 to 4, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 4 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:59.780555 11580 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.781774  9272 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 65) took 1588 ms. Trace:
I20260709 13:02:59.782167  9343 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:59.783077 11582 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:59.783457 11582 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.783866 11582 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:59.783733 11580 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:59.780303  9275 catalog_manager.cc:5697] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 1 to 3, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 3 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
W20260709 13:02:59.791689  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.782187  9272 rpcz_store.cc:276] 0709 13:02:58.193801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.194311 (+   510us) service_pool.cc:224] Handling call
0709 13:02:59.781660 (+1587349us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:59.553064 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:59.553737 (+   673us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:59.553777 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:02:59.553800 (+    23us) tablet.cc:662] Decoding operations
0709 13:02:59.554468 (+   668us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:59.554558 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:59.554593 (+    35us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:02:59.555552 (+   959us) tablet.cc:701] Row locks acquired
0709 13:02:59.555578 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:02:59.555736 (+   158us) write_op.cc:270] Start()
0709 13:02:59.555875 (+   139us) write_op.cc:276] Timestamp: P: 1783602179555686 usec, L: 0
0709 13:02:59.555899 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:02:59.556687 (+   788us) log.cc:844] Serialized 1334 byte log entry
0709 13:02:59.560251 (+  3564us) op_driver.cc:464] REPLICATION: finished
0709 13:02:59.571082 (+ 10831us) write_op.cc:301] APPLY: starting
0709 13:02:59.571174 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:59.571326 (+   152us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:59.571474 (+   148us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:59.572047 (+   573us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:59.572260 (+   213us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:02:59.572308 (+    48us) write_op.cc:312] APPLY: finished
0709 13:02:59.572533 (+   225us) log.cc:844] Serialized 34 byte log entry
0709 13:02:59.572696 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:59.572801 (+   105us) write_op.cc:454] Released schema lock
0709 13:02:59.572845 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:59.575605 (+  2760us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:59.575644 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23493,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":7321,"apply.run_cpu_time_us":2176,"apply.run_wall_time_us":4476,"num_ops":3,"prepare.queue_time_us":7135,"prepare.run_cpu_time_us":3492,"prepare.run_wall_time_us":3978,"replication_time_us":4180,"thread_start_us":18583,"threads_started":2}]]}
I20260709 13:02:59.798089 11587 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:02:59.801442  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 838311us
I20260709 13:02:59.802331  9343 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:59.803627  9343 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:59.804613 11336 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:59.805028 11336 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:02:59.805485 11336 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:59.805660 11587 consensus_queue.cc:1059] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:59.806910 11586 raft_consensus.cc:3055] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:59.807319 11586 raft_consensus.cc:740] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:59.808205 11586 consensus_queue.cc:260] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.810894  9273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43240 (request call id 178) took 10646 ms. Trace:
I20260709 13:02:59.791275  9275 catalog_manager.cc:5697] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 3 to 5, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 5 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:02:59.813225 11586 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:59.814028 10641 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:59.814395 10759 consensus_queue.cc:1059] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:59.820998 11336 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:59.822420  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 67009.8us
I20260709 13:02:59.823397 11336 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:59.827310  9343 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:02:59.833513 10759 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:59.834385 10759 consensus_queue.cc:1059] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:59.760274 11581 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.837546 11581 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:59.838181 11581 raft_consensus.cc:3055] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:59.838546 11581 raft_consensus.cc:740] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:59.839452 11587 consensus_queue.cc:1059] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:59.839390 11581 consensus_queue.cc:260] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.840854 11209 raft_consensus.cc:3055] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:59.842540  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:59.842896 11594 raft_consensus.cc:3055] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:59.870460 11594 raft_consensus.cc:740] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:59.871497 11594 consensus_queue.cc:260] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.843501  9341 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:59.873102 11599 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.873363  9418 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:02:59.873708 11599 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.845022  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:59.845196 11586 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.880744 11586 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.884820 11586 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:59.886524 11586 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:59.887179 11586 raft_consensus.cc:697] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:59.890470 11569 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.891103 11569 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.895045 11569 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:02:59.895576  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 52171.3us
I20260709 13:02:59.896734  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:59.898476  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:59.900403  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:59.901530  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:59.845816  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:59.840854 10641 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:59.903095  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:59.903882  9449 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:59.907553  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:59.909204  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:59.910737  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:59.911448  9447 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:59.913532  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:59.915890  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:59.879870 11599 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:59.901592  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:59.875967 11594 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:59.919075  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:59.919884  9450 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:59.920521  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:59.903307 11601 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:59.812140  9273 rpcz_store.cc:276] 0709 13:02:49.164401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.164595 (+   194us) service_pool.cc:224] Handling call
0709 13:02:59.810775 (+10646180us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:58.379457 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:58.380121 (+   664us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:58.380179 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:02:58.380227 (+    48us) tablet.cc:662] Decoding operations
0709 13:02:58.382143 (+  1916us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:58.382253 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:58.382287 (+    34us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:02:58.383766 (+  1479us) tablet.cc:701] Row locks acquired
0709 13:02:58.383829 (+    63us) write_op.cc:260] PREPARE: finished
0709 13:02:58.384034 (+   205us) write_op.cc:270] Start()
0709 13:02:58.384220 (+   186us) write_op.cc:276] Timestamp: P: 1783602178383965 usec, L: 0
0709 13:02:58.384258 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:02:58.385118 (+   860us) log.cc:844] Serialized 6971 byte log entry
0709 13:02:58.742772 (+357654us) op_driver.cc:464] REPLICATION: finished
0709 13:02:58.849424 (+106652us) write_op.cc:301] APPLY: starting
0709 13:02:58.849517 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:58.849903 (+   386us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:58.850050 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:58.852284 (+  2234us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:58.852640 (+   356us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:02:58.852692 (+    52us) write_op.cc:312] APPLY: finished
0709 13:02:58.868790 (+ 16098us) log.cc:844] Serialized 124 byte log entry
0709 13:02:58.875510 (+  6720us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:58.886866 (+ 11356us) write_op.cc:454] Released schema lock
0709 13:02:58.886963 (+    97us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:58.887412 (+   449us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:58.887648 (+   236us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1227613,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":102988,"apply.run_cpu_time_us":4952,"apply.run_wall_time_us":37977,"num_ops":18,"prepare.queue_time_us":63257,"prepare.run_cpu_time_us":27734,"prepare.run_wall_time_us":73217,"raft.queue_time_us":166148,"raft.run_cpu_time_us":34677,"raft.run_wall_time_us":163696,"replication_time_us":296138,"thread_start_us":265578,"threads_started":5,"wal-append.queue_time_us":77921}]]}
I20260709 13:02:59.800836 11582 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.935627 11209 raft_consensus.cc:740] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:02:59.954703 11601 raft_consensus.cc:697] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:02:59.955856 11601 consensus_queue.cc:237] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:02:59.937059  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:59.967329  9451 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:02:59.956789 11582 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:02:59.955803 11209 consensus_queue.cc:260] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:02:59.961341  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.923583  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:02:59.985428  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:02:59.986521  9443 raft_consensus.cc:2393] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 3: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
W20260709 13:03:00.002279  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 173499us
I20260709 13:03:00.003973  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:00.017459  9343 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:00.021713 10759 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:00.022778  9444 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:03:00.025271  9452 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:00.025637  9451 raft_consensus.cc:1240] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:59.988034  9271 catalog_manager.cc:5697] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 2 to 4, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:02:59.888454 11586 consensus_queue.cc:237] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.032696  9447 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:03:00.036921  9341 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:00.043293  9341 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:00.046886 10641 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:00.047288 10641 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.047607 10641 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:00.048628  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:00.049595  9447 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:00.053143  9443 raft_consensus.cc:1240] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:00.039932 11209 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:00.060374 10641 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.062040  9451 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:00.063133  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:00.064318  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:00.065315  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:00.065924  9444 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:00.067317  9447 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:03:00.071112  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:00.072602  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:00.075063  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:00.076581  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:00.078008  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:00.079293  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:00.081570  9448 raft_consensus.cc:1240] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:03:00.084687  9450 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:03:00.085268 10759 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:00.086320  9449 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:00.091095  9444 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
W20260709 13:03:00.096905  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.104624  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:00.106612  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:00.107101  9452 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:00.107545  9449 raft_consensus.cc:2376] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8. Re-sending same reply.
I20260709 13:03:00.116225  9443 raft_consensus.cc:1275] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:03:00.134194  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:00.136847  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 98608.7us
I20260709 13:03:00.139134  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:00.141307 10641 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:00.104321 11604 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:00.179847 10759 consensus_queue.cc:1048] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:00.180336  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:00.184446  9443 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:00.187580  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:00.188436  9445 raft_consensus.cc:2376] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7. Re-sending same reply.
I20260709 13:03:00.191617 10759 consensus_queue.cc:1059] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:00.201412  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:00.191838  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:00.202487  9445 raft_consensus.cc:2368] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8.
I20260709 13:03:00.179127 11604 raft_consensus.cc:697] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:00.204875  9523 raft_consensus.cc:1275] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:00.206519  9369 raft_consensus.cc:1240] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:00.207803  9368 raft_consensus.cc:1240] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:00.207999  9376 raft_consensus.cc:1275] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:00.209079  9374 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:00.210470  9371 raft_consensus.cc:1240] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:00.211294  9526 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:00.209022  9517 raft_consensus.cc:1240] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:00.214147 11569 consensus_queue.cc:1059] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:00.222743  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:00.223429  9526 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:03:00.221069  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:00.225701 11581 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:00.227994  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:00.228724  9521 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:00.227813  9271 catalog_manager.cc:5697] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 4 to 6, leader changed from b0812463215649c3b011d36e2f0400c9 (127.8.4.68) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 6 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:00.230005  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:00.232196 10641 consensus_queue.cc:1059] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:03:00.231727  9517 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:03:00.236092  9275 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43252 (request call id 167) took 10475 ms. Trace:
I20260709 13:03:00.235105  9271 catalog_manager.cc:5697] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index -1 to 3, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 2 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:03:00.236482  9275 rpcz_store.cc:276] 0709 13:02:49.760485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.762413 (+  1928us) service_pool.cc:224] Handling call
0709 13:03:00.236031 (+10473618us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:59.842858 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:59.843620 (+   762us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:59.843648 (+    28us) write_op.cc:435] Acquired schema lock
0709 13:02:59.843660 (+    12us) tablet.cc:662] Decoding operations
0709 13:02:59.844483 (+   823us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:59.844553 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:59.844599 (+    46us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:02:59.845377 (+   778us) tablet.cc:701] Row locks acquired
0709 13:02:59.845399 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:02:59.845587 (+   188us) write_op.cc:270] Start()
0709 13:02:59.845725 (+   138us) write_op.cc:276] Timestamp: P: 1783602179845533 usec, L: 0
0709 13:02:59.845753 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:02:59.846569 (+   816us) log.cc:844] Serialized 2048 byte log entry
0709 13:02:59.926509 (+ 79940us) op_driver.cc:464] REPLICATION: finished
0709 13:02:59.927003 (+   494us) write_op.cc:301] APPLY: starting
0709 13:02:59.927086 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:59.927258 (+   172us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:59.927352 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:59.928118 (+   766us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:59.928312 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:02:59.928359 (+    47us) write_op.cc:312] APPLY: finished
0709 13:02:59.928596 (+   237us) log.cc:844] Serialized 46 byte log entry
0709 13:02:59.928775 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:59.928888 (+   113us) write_op.cc:454] Released schema lock
0709 13:02:59.928933 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:59.929394 (+   461us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:59.929420 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":327037,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":257,"apply.run_cpu_time_us":2345,"apply.run_wall_time_us":2344,"num_ops":5,"prepare.queue_time_us":582,"prepare.run_cpu_time_us":4069,"prepare.run_wall_time_us":7723,"replication_time_us":80523}]]}
I20260709 13:03:00.239226  9371 raft_consensus.cc:1240] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:00.226187 11604 consensus_queue.cc:237] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.260268  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:00.261088  9371 raft_consensus.cc:2393] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 4: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
W20260709 13:03:00.269613  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 47895.3us
I20260709 13:03:00.310786  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:00.311790  9374 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:03:00.316246  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:00.316984  9445 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:00.325340  9418 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:00.328572 10759 raft_consensus.cc:3055] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:00.329141 10759 raft_consensus.cc:740] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:00.329881  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 50983.5us
I20260709 13:03:00.330926  9341 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:00.327623  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:00.340016  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 106461us
I20260709 13:03:00.279448 11586 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:00.346364  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 46977.8us
I20260709 13:03:00.350878  9418 leader_election.cc:400] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 7. Current term is 8.
I20260709 13:03:00.351357  9418 leader_election.cc:403] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:00.312887 11497 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:00.355945  9418 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:00.360205  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:00.361047  9376 raft_consensus.cc:2393] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 8: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:00.298804 11599 consensus_queue.cc:1059] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:03:00.364218  9371 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:00.342563 11598 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:00.371635 10759 consensus_queue.cc:260] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.354692 11601 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:00.366865  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:00.368781 11209 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:00.394448  9274 catalog_manager.cc:5697] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 3 to 4, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 4 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:00.397569 11610 raft_consensus.cc:3055] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:00.398664  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:00.398102  9274 catalog_manager.cc:5697] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 2 to 4, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 4 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:00.399435  9368 raft_consensus.cc:2393] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 6: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:00.401232  9376 raft_consensus.cc:1240] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:00.381120  9418 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:00.384100  9445 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
W20260709 13:03:00.381798  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.403221  9274 catalog_manager.cc:5697] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:00.377964  9369 raft_consensus.cc:1240] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:00.361408 11494 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 7. Current term is 8.
I20260709 13:03:00.415604  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:00.414639  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:00.368772 11569 raft_consensus.cc:3055] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:00.354797 11586 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.459354  9274 catalog_manager.cc:5697] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:00.465242  9274 catalog_manager.cc:5697] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 4 to 5, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 5 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:00.411653 11209 consensus_queue.cc:1059] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:03:00.374511 11587 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.363467 11497 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.398073 11610 raft_consensus.cc:740] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:00.370383 11598 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:00.412846 11596 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:00.482419  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:00.414485 11601 raft_consensus.cc:697] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:00.469270 11569 raft_consensus.cc:740] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:00.474975 11614 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.506763  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:03:00.508087  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 152784us
I20260709 13:03:00.498965 11599 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.512125 11619 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.512832 11619 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.501824 11374 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.498823 11598 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:00.497285 11613 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:00.519774  9274 catalog_manager.cc:5697] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:00.497560 11587 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.515857 11619 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:00.527698  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:00.539253 10759 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:00.547180  9274 catalog_manager.cc:5697] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 5 to 6, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 6 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:00.549383  9274 catalog_manager.cc:5697] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 3 to 4, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 4 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:00.550953  9341 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:00.552758 11336 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:00.552371 11569 consensus_queue.cc:260] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.553277 11336 raft_consensus.cc:697] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:00.553680 11569 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:00.554257 11336 consensus_queue.cc:237] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.556809  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:00.557507  9369 raft_consensus.cc:3055] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:00.559078  9444 raft_consensus.cc:1275] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:00.557824  9369 raft_consensus.cc:740] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:00.577625  9376 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:03:00.580598 11594 consensus_queue.cc:1048] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:00.585561 11601 consensus_queue.cc:237] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.587829 11587 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:00.588379 11610 consensus_queue.cc:260] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:00.508930 11614 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.589401  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:00.532337 11611 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:00.625126 11611 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.528744 11613 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.627411 11611 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:00.629335 11613 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:00.590147  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:00.590839  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:00.591215 11497 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:00.525111 11374 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:00.592550 11586 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:00.644464  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:00.523414 11599 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.593874  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:00.653533  9375 raft_consensus.cc:2393] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 3: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:00.654469  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:00.654645 11599 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:00.655645  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:00.576810 11621 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:03:00.542960 11619 consensus_queue.cc:1059] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:03:00.599715  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:00.604166  9369 consensus_queue.cc:260] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.571679 11581 raft_consensus.cc:3055] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:00.673236  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:00.674242  9444 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:00.551033  9274 catalog_manager.cc:5697] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 5 to 7, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 7 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
W20260709 13:03:00.612974  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:00.613930  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 159267us
I20260709 13:03:00.619802  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:00.622547  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 109045us
I20260709 13:03:00.623333 11614 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:00.635341  9371 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:03:00.648036 11374 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:00.650527  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:00.692543  9445 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 5.
I20260709 13:03:00.661432  9377 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:03:00.664143  9373 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:03:00.665133  9370 raft_consensus.cc:1240] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:00.665766  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:00.677207  9341 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:00.679251  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:00.684355  9274 catalog_manager.cc:5697] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:00.685475  9369 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:03:00.657317  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:00.696518  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.699491  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:00.700074  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:00.701036  9373 raft_consensus.cc:2393] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 6: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:00.671336 11581 raft_consensus.cc:740] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:00.728166  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 51137.4us
I20260709 13:03:00.729672  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:00.729849  9418 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:00.730751  9371 raft_consensus.cc:2393] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 3: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:00.731105  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:00.731331  9490 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:00.731407  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:03:00.690834  9473 debug-util.cc:398] Leaking SignalData structure 0x7b080018df60 after lost signal to thread 8212
I20260709 13:03:00.731760  9376 raft_consensus.cc:2376] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5. Re-sending same reply.
I20260709 13:03:00.732658  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:00.733461  9376 raft_consensus.cc:2393] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 7: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:00.733697  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:00.734231  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:00.735109  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:00.735730  9374 raft_consensus.cc:2376] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6. Re-sending same reply.
I20260709 13:03:00.727977  9274 catalog_manager.cc:5697] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 2 to 5, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 5 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
W20260709 13:03:00.737776  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.698567 11614 raft_consensus.cc:3055] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:00.751287 11614 raft_consensus.cc:740] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:00.752197 11614 consensus_queue.cc:260] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.753108 11620 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.753481 11614 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:00.743549 11603 raft_consensus.cc:3055] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:00.753621 11620 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.754416 11603 raft_consensus.cc:740] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:00.744328  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:00.733264 11494 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:03:00.743466 11599 raft_consensus.cc:1064] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:03:00.745234 11628 consensus_queue.cc:1059] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:00.704057 11582 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:00.746452  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:00.761507  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:00.762132  9372 raft_consensus.cc:2393] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 4: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:00.747165  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:00.762234  9517 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 5.
I20260709 13:03:00.747356 11586 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:00.747906  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:00.749368 11598 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.777990 11598 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:00.750641  9473 debug-util.cc:398] Leaking SignalData structure 0x7b08001d2e20 after lost signal to thread 9309
I20260709 13:03:00.752636 11594 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:00.745836  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.756731  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:00.783485  9373 raft_consensus.cc:2393] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 5: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:00.757130  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:00.784461  9377 raft_consensus.cc:2376] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3. Re-sending same reply.
W20260709 13:03:00.758458  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.760906  9369 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:00.762778  9374 raft_consensus.cc:2376] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6. Re-sending same reply.
I20260709 13:03:00.788043  9374 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 6. Current term is 8. Ops: [6.4-6.4]
I20260709 13:03:00.764731  9375 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:03:00.790336  9375 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:00.790032 11581 consensus_queue.cc:260] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.791929  9375 raft_consensus.cc:1240] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:00.792129  9490 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:00.775372  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:00.779273  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:00.793732  9490 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:00.779495  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:00.794700  9371 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:03:00.794792 11611 consensus_queue.cc:1059] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:00.788043  9369 raft_consensus.cc:1240] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:03:00.797065 11569 raft_consensus.cc:2804] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:00.796779  9374 raft_consensus.cc:1275] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:00.703465 11497 consensus_queue.cc:1048] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:03:00.779978  9274 catalog_manager.cc:5697] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 3 to 4, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 4 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:00.799722  9375 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:00.800804  9274 catalog_manager.cc:5697] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:00.803331  9274 catalog_manager.cc:5697] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 1 to 5, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 5 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:00.805608 11627 consensus_queue.cc:1059] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:00.809070 11613 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:00.796830 11629 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:00.811242 11629 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:00.816004  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.817139  9444 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:00.818805 11629 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:00.761633 11582 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.779994 11619 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:00.775588 11586 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:00.781999 11621 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:00.843096  9492 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:00.844270  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:00.843917  9375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ad4133883414768941dffb952ca7caf"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:00.833171 11610 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:00.863713  9375 raft_consensus.cc:606] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:00.863698  9372 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:03:00.847553 11582 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:00.888741 11618 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.889298 11618 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.889475 11603 consensus_queue.cc:260] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.858729 11586 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:00.829375 11594 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.892598  9372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:00.912619 11598 raft_consensus.cc:3055] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:00.913273 11598 raft_consensus.cc:740] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:00.916766  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:00.902390  9274 catalog_manager.cc:5697] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 4 to 5, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 5 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:00.869794 11619 raft_consensus.cc:697] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:03:00.920922  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 191107us
I20260709 13:03:00.891698 11603 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:00.922020  9418 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:00.926514  9418 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:00.919905 11627 consensus_queue.cc:1243] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer d62c9d5a052b42ce8675f8438f846526 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:03:00.949339  9526 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:00.948232  9274 catalog_manager.cc:5697] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 5 to 8, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 8 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:00.950385  9369 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:00.869561 11621 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:00.973639  9517 raft_consensus.cc:1275] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:00.982285  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:00.926939 11569 raft_consensus.cc:697] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:00.977075  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:00.980438  9520 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:00.982944  9449 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:03:00.986531  9375 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
W20260709 13:03:00.939627  9473 debug-util.cc:398] Leaking SignalData structure 0x7b080037e880 after lost signal to thread 9401
W20260709 13:03:00.974267  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 166309us
I20260709 13:03:00.984982  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:00.991875  9377 raft_consensus.cc:1275] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
W20260709 13:03:00.996567 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 238996us
I20260709 13:03:00.988607  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:00.990314  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:00.993606  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:00.994305  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:00.998353  9523 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:00.949416 11629 raft_consensus.cc:3055] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:00.999997  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:00.991501  9526 raft_consensus.cc:3055] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:01.005523  9526 raft_consensus.cc:740] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:01.003917  9524 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:01.001000  9371 raft_consensus.cc:1275] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:01.001827  9274 catalog_manager.cc:5697] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 5 to 7, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 7 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:00.946278 11494 raft_consensus.cc:2764] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:03:00.996949  9377 pending_rounds.cc:85] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947: Aborting all ops after (but not including) 3
I20260709 13:03:01.007269  9377 pending_rounds.cc:107] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:03:01.007661  9377 raft_consensus.cc:2889] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:00.973296 11613 raft_consensus.cc:697] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 8 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:01.015707  9341 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:01.000655  9473 debug-util.cc:398] Leaking SignalData structure 0x7b08003b5fc0 after lost signal to thread 9402
I20260709 13:03:01.018496  9526 consensus_queue.cc:260] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:01.021855  9274 catalog_manager.cc:5697] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:00.946682 11634 raft_consensus.cc:2764] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:03:01.019532 10027 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:00.950845 11604 consensus_queue.cc:1059] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:03:01.050385  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:01.057583  9522 raft_consensus.cc:2393] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 4: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:00.996373 11611 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:01.055079  9526 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:01.004886 11629 raft_consensus.cc:740] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:03:01.067468 11596 consensus_meta.cc:287] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.567s	user 0.004s	sys 0.008s
W20260709 13:03:01.068163  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 54095.3us
I20260709 13:03:01.070940 10759 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:01.072439 10759 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.068957  9490 leader_election.cc:400] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8.
I20260709 13:03:01.073407  9490 leader_election.cc:403] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:03:01.072829 10759 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:00.995282 11627 consensus_queue.cc:1048] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:03:01.058818  9274 catalog_manager.cc:5697] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 3 to 4, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 4 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:01.076213 11620 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:01.079313  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 63692.1us
I20260709 13:03:00.974500 11598 consensus_queue.cc:260] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:01.082408  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:01.075928  9274 catalog_manager.cc:5697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 2 to 3, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 3 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:01.046833 11618 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:01.094321  9443 raft_consensus.cc:1275] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:01.079352 11596 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:01.020228 11587 consensus_queue.cc:1059] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:03:01.099040  9274 catalog_manager.cc:5697] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 4 to 5, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 5 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:01.117985  9274 catalog_manager.cc:5697] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 1 to 2, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 2 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:01.100523  9473 debug-util.cc:398] Leaking SignalData structure 0x7b08002b69a0 after lost signal to thread 9476
I20260709 13:03:01.128949  9526 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:03:01.136035  9452 raft_consensus.cc:1240] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:01.072980 11611 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:01.155539 11581 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:01.156436 11613 consensus_queue.cc:237] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:01.157572 11594 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:01.079704 11209 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:03:01.139312 11643 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:01.141176 11602 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
W20260709 13:03:01.142736 11636 log.cc:927] Time spent T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:03:01.143543 11642 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:01.144074 11637 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:03:01.123780 11599 consensus_queue.cc:237] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:01.151396 11540 raft_consensus.cc:2804] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:01.155706 11611 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:01.124810 10759 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:01.139179 11587 raft_consensus.cc:3055] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:01.056557 11619 consensus_queue.cc:237] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:01.135829  9526 pending_rounds.cc:85] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 3
W20260709 13:03:01.166455  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.099398 11569 consensus_queue.cc:237] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:01.223373  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.169891 11621 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:01.160597 11627 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:01.177697  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 156510us
I20260709 13:03:01.243739  9418 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
W20260709 13:03:01.134130  9473 debug-util.cc:398] Leaking SignalData structure 0x7b08003657a0 after lost signal to thread 9477
I20260709 13:03:01.068774 11640 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
W20260709 13:03:01.202364  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.208137 11540 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.214469  9526 pending_rounds.cc:107] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:03:01.245178  9526 raft_consensus.cc:2889] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:01.245368  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:01.245932  9451 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:01.216988  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:01.218803  9443 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:03:01.208949 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 189469us
I20260709 13:03:01.227085  9448 raft_consensus.cc:1275] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:03:01.234648  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.235631  9447 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:01.249812 10759 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:01.250628  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:01.209232 11587 raft_consensus.cc:740] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:01.272490  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:01.274852  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.278473 10759 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:01.279891 10641 consensus_queue.cc:1048] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:01.283576 11626 consensus_queue.cc:1059] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:03:01.284858 11626 consensus_queue.cc:1059] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:01.286015 11626 raft_consensus.cc:3055] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:01.286394 11626 raft_consensus.cc:740] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:01.287415 11626 consensus_queue.cc:260] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:01.289479 11648 consensus_queue.cc:1048] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:03:01.290503 11646 consensus_queue.cc:1059] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:03:01.291494 11646 raft_consensus.cc:3055] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:01.291873 11646 raft_consensus.cc:740] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:03:01.294574  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.298280  9521 raft_consensus.cc:1275] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:01.255085  9518 raft_consensus.cc:2393] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 3: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:01.254565  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:01.242218 11621 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:01.315527  9520 raft_consensus.cc:1275] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:01.309880  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:01.292817 11635 log.cc:927] Time spent T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.404s	user 0.003s	sys 0.000s
I20260709 13:03:01.249310 11540 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:01.321732  9518 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:01.323215  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:01.288862 11626 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:01.281890 11596 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:01.209467 11629 consensus_queue.cc:260] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:01.289523 11653 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.346920  9451 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:03:01.207487 11642 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:01.329701 11621 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:01.292898 11646 consensus_queue.cc:260] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:01.359753 11642 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:01.277753 11634 consensus_queue.cc:1059] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 13:03:01.361334 11629 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:01.362079 11634 raft_consensus.cc:3055] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:01.362457 11634 raft_consensus.cc:740] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:01.363308 11634 consensus_queue.cc:260] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:01.364472 11634 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:01.339397 11596 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.365620  9526 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:01.352262 11638 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:03:01.350445  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:01.313524 11604 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:03:01.365820 11596 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:01.369244  9521 raft_consensus.cc:2393] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 5: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:01.356729  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:01.341240  9473 debug-util.cc:398] Leaking SignalData structure 0x7b080035e680 after lost signal to thread 9550
I20260709 13:03:01.384438 11586 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:03:01.296195 11582 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:01.316663 11602 consensus_queue.cc:1059] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:03:01.409739  9373 raft_consensus.cc:1240] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 7. Ops: []
W20260709 13:03:01.398499  9492 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.009s	sys 0.002s
I20260709 13:03:01.249869 11627 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:01.406752 11586 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:01.407313  9446 raft_consensus.cc:1240] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:01.411316  9492 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.010s	sys 0.002s
W20260709 13:03:01.419378  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 576367us
I20260709 13:03:01.420979  9518 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
W20260709 13:03:01.398837  9473 debug-util.cc:398] Leaking SignalData structure 0x7b08001e7e80 after lost signal to thread 9551
I20260709 13:03:01.427999  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:01.429368  9518 raft_consensus.cc:2410] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:03:01.424361  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 145752us
I20260709 13:03:01.393106 11621 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:01.433070  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:01.413743  9526 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 2.
I20260709 13:03:01.438128  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:01.432598  9492 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.442484  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:01.443017  9341 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:01.460893  9448 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:01.465693  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:01.466437  9443 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:01.498569  9518 raft_consensus.cc:2393] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 6: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:01.418020 11582 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:01.508774  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.516003  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:01.516892  9518 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:01.519147 11621 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:03:01.519351  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 86842us
I20260709 13:03:01.355607 11587 consensus_queue.cc:260] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:01.521345  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:01.525493  9492 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.430821 11209 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:01.526046  9521 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:03:01.369737 11653 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:01.538754  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:01.538228  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:01.541421  9492 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.542344  9518 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
W20260709 13:03:01.530741 11610 consensus_meta.cc:287] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.651s	user 0.012s	sys 0.000s
I20260709 13:03:01.544222  9492 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:01.565881  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:01.566563  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 252431us
I20260709 13:03:01.567235  9518 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:01.535122  9473 debug-util.cc:398] Leaking SignalData structure 0x7b080029bda0 after lost signal to thread 10094
W20260709 13:03:01.538193 11603 consensus_meta.cc:287] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.599s	user 0.011s	sys 0.000s
I20260709 13:03:01.568871  9418 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:01.568893  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:01.574576  9521 raft_consensus.cc:2393] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 6: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:01.542363 11587 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:01.577203 11655 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.577739 11655 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:01.578593  9372 raft_consensus.cc:606] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:01.579059 11639 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 8 LEADER]: Leader election lost for term 7. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8.
W20260709 13:03:01.580273 11656 log.cc:927] Time spent T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:03:01.581280 11638 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:01.581815 11336 raft_consensus.cc:3055] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:01.582240 11336 raft_consensus.cc:740] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:01.582473  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.583142 11336 consensus_queue.cc:260] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:01.584152 10641 consensus_queue.cc:1059] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:01.585702 11497 raft_consensus.cc:3055] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:01.586181 11497 raft_consensus.cc:740] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:01.587159 11497 consensus_queue.cc:260] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:01.588425 11614 consensus_meta.cc:287] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.834s	user 0.013s	sys 0.000s
I20260709 13:03:01.591514  9523 raft_consensus.cc:2410] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:03:01.533257 11209 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:01.593621 11666 consensus_queue.cc:1048] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:01.594527 11209 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:01.566010 11642 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:01.578845 11661 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:03:01.601343  9473 debug-util.cc:398] Leaking SignalData structure 0x7b08000d6080 after lost signal to thread 11546
I20260709 13:03:01.579053  9372 raft_consensus.cc:614] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:01.588339 11497 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:01.606797  9368 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 5.
I20260709 13:03:01.583390 11649 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:01.581828 11638 raft_consensus.cc:697] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:01.622313 11653 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:01.622146 11638 consensus_queue.cc:237] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:01.625775  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:01.609972  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:01.627146  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:01.627285  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:01.627830  9522 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:01.610916 11627 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:01.629271  9521 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:01.630330  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:01.632792  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:01.611524 11586 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:03:01.586618 11336 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:01.642894  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:01.643527  9519 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:01.603309 11602 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:01.646965 11602 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.647323 11602 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:01.647768 11649 raft_consensus.cc:697] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:01.650794  9343 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.652487  9343 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.653388 11665 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:01.654763 11630 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:01.658715  9343 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.660357  9343 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.615685  9492 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.660941  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:01.663570  9343 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.663808  9521 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:01.662328  9443 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
W20260709 13:03:01.668089  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 91969.3us
I20260709 13:03:01.667896  9520 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:01.671787  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:01.672678  9523 raft_consensus.cc:2410] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:03:01.673159  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 57576.5us
I20260709 13:03:01.675638  9492 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.682781  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:01.683629  9450 raft_consensus.cc:2393] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 3: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:01.684408  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:01.685599  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:01.686321  9450 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:03:01.687139  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:01.687703  9450 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:03:01.688481  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:01.689541  9369 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:01.689621  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:01.691433  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:01.691987  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:01.699415  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.700879  9490 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.703866  9490 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:01.705231 11639 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:01.669659 11581 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:01.708235 11651 consensus_queue.cc:1048] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:03:01.711223  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:01.661587 11594 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:01.722361  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:01.725031  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:01.726157  9446 raft_consensus.cc:2376] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5. Re-sending same reply.
I20260709 13:03:01.727383  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:01.725020  9343 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.729744  9492 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.730587  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:01.730803  9343 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.733496  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:01.734400  9523 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:01.736531  9518 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:01.738293  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:01.739955  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:01.740890  9518 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:01.741448 11596 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:01.744436  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:01.744967  9370 raft_consensus.cc:1240] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:01.745415  9418 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:01.745586  9443 raft_consensus.cc:2393] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 7: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:01.749184  9518 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:01.749492  9522 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:03:01.751674  9418 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:01.752229  9492 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.754098  9492 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.755084  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:01.755332  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:01.754098  9343 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.710525 11629 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:01.760504  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:01.759227  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:01.761044  9522 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:01.761768  9518 raft_consensus.cc:2410] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:03:01.781435  9522 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:03:01.765677  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:01.833524  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:01.805778  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 51714.9us
I20260709 13:03:01.733861 11603 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:01.834803  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 80762.9us
I20260709 13:03:01.728740 11640 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:01.836496  9343 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.829133 11580 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:01.846125  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:01.852505  9492 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.744237 11627 raft_consensus.cc:2764] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:03:01.847162  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.765508 11581 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:01.842042  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:01.831246 11209 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:01.746248 11586 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.102s
W20260709 13:03:01.845283  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 86648us
I20260709 13:03:01.845423  9343 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.765753 11651 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:01.847752 11603 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:01.765887 11666 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:01.869000  9492 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:01.871349  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.844388 11613 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:03:01.887009  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.852304 11619 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:01.841410 11639 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:01.661808 11649 consensus_queue.cc:237] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:01.745676 11634 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.110s
I20260709 13:03:01.899505  9523 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:03:01.873795  9343 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.852548 11630 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:01.903913  9492 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.906827 11209 consensus_queue.cc:1048] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:01.882169 11651 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:01.913527  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:01.917685  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 44015.1us
I20260709 13:03:01.858536 11629 raft_consensus.cc:697] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:03:01.931288  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.878846 11661 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:01.744412 11540 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:01.900971 11666 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:01.969367 11666 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:01.879897 11581 raft_consensus.cc:697] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:01.971791 11581 consensus_queue.cc:237] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:01.949906  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 46095.6us
I20260709 13:03:01.879393 11621 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:03:01.957640  9343 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.975762  9343 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:03:01.981190  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 69898.1us
I20260709 13:03:01.982547  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:01.940598 11619 raft_consensus.cc:697] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:01.945891 11617 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:01.954131 11651 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:02.000315  9492 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:01.964341 11638 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:01.999171 11594 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:01.954327 11597 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:03:01.963752 11626 consensus_meta.cc:287] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.621s	user 0.011s	sys 0.000s
I20260709 13:03:02.022904 11638 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:01.998639  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.034641  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:02.063544  9376 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:02.035691  9522 raft_consensus.cc:1240] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:02.001585 11644 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:02.039332 11679 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.182s
W20260709 13:03:02.083706  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:02.042099 11673 log.cc:927] Time spent T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:03:02.007265 11580 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:02.007054 11667 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:02.064630  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 82160.4us
W20260709 13:03:02.067423  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 67231.5us
I20260709 13:03:02.067703  9443 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:03:02.025610 11622 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:02.025806 11617 raft_consensus.cc:697] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:02.100780  9519 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
W20260709 13:03:02.102977  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.067152 11638 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:02.109736  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.062951 11628 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:02.006901 11613 consensus_queue.cc:1048] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:03:02.114775  9376 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:02.007514 11643 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 13:03:02.070055 11594 raft_consensus.cc:697] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:02.084503 11642 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:02.107355 11644 raft_consensus.cc:697] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:02.122385 11587 consensus_meta.cc:287] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.545s	user 0.004s	sys 0.005s
I20260709 13:03:02.108345 11665 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:03:02.144260  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.156070  9450 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:03:02.122103 11653 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.170137  9451 raft_consensus.cc:1240] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:03:02.176653  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.144085 11642 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:02.162299 11621 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:02.162801 11646 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:02.196375 11692 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.197140 11683 consensus_queue.cc:1059] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.096s
I20260709 13:03:02.117867 11629 consensus_queue.cc:237] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.210857 11594 consensus_queue.cc:237] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.212132 11644 consensus_queue.cc:237] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.114985 11667 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.170192 11653 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.160874 11619 consensus_queue.cc:237] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.183642 11603 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:02.231921  9490 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:02.203238  9372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:52636 (request call id 14) took 1310 ms. Trace:
I20260709 13:03:02.248749  9490 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:02.193833 11642 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:02.253075  9371 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.030s	sys 0.032s
I20260709 13:03:02.254412  9490 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:02.255927  9371 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.031s	sys 0.032s
I20260709 13:03:02.247601  9372 rpcz_store.cc:276] 0709 13:03:00.892289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.892471 (+   182us) service_pool.cc:224] Handling call
0709 13:03:02.202942 (+1310471us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b5400186d54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb586564853 00007fb58b53260a 00007fb584ab87d4 00007fb584ab8762 00007fb584ab8691 00007fb584ab860c 00007fb584ab78c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:02.203086 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1575977216}
I20260709 13:03:02.195407 11621 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.265283  9490 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:02.253273 11643 raft_consensus.cc:2764] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 13:03:02.279662  9490 leader_election.cc:336] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.948s (SENT)
I20260709 13:03:02.282174  9490 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:02.287846  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.262521 11603 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:02.285706 11682 log.cc:927] Time spent T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.077s	user 0.003s	sys 0.000s
I20260709 13:03:02.272888 11661 raft_consensus.cc:697] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:02.272716 11697 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:02.313602 11678 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.314263 11678 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:02.299300 11336 consensus_meta.cc:287] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.658s	user 0.012s	sys 0.000s
W20260709 13:03:02.297698 11602 consensus_meta.cc:287] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.650s	user 0.010s	sys 0.002s
W20260709 13:03:02.305748 11497 consensus_meta.cc:287] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.667s	user 0.013s	sys 0.000s
I20260709 13:03:02.300665 11693 raft_consensus.cc:3055] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:02.237457 11692 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.338708 11653 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:02.306326 11643 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:02.289917 11666 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.253847 11617 consensus_queue.cc:237] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.300563 11603 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:02.366894  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.346801 11693 raft_consensus.cc:740] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:02.347988 11540 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:02.347651 11700 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:02.327975 11602 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.392475 11691 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:02.410303 11696 log.cc:927] Time spent T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:03:02.412874 11666 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:02.414294 11693 consensus_queue.cc:260] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.400002 11661 consensus_queue.cc:237] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.420657 11603 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:02.423283 11686 log.cc:927] Time spent T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:03:02.423161 11602 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:02.423895  9446 raft_consensus.cc:1240] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:03:02.424327  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:02.439152 11698 log.cc:927] Time spent T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:03:02.440142  9374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:52546 (request call id 69) took 1611 ms. Trace:
I20260709 13:03:02.440802  9374 rpcz_store.cc:276] 0709 13:03:00.834992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.849944 (+ 14952us) service_pool.cc:224] Handling call
0709 13:03:02.439827 (+1589883us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b5400186d54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb586570735 00007fb5865689fa 00007fb58b5304c9 00007fb584aacc54 00007fb584aacbe2 00007fb584aacb11 00007fb584aaca8c 00007fb584aabd42 00007fb5848a548c 00007fb5848a48c6
0709 13:03:02.440040 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1499200384}
I20260709 13:03:02.444896 11678 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:02.480074 11702 log.cc:927] Time spent T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:03:02.482424  9525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1170) took 1480 ms. Trace:
W20260709 13:03:02.482898 11705 log.cc:927] Time spent T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:02.478618 11646 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.483047  9525 rpcz_store.cc:276] 0709 13:03:01.001506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.014476 (+ 12970us) service_pool.cc:224] Handling call
0709 13:03:01.052709 (+ 38233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.052888 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:01.185768 (+132880us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.481036 (+1295268us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b180025f240. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb5833f7c0a 00007fb58cb37219 00007fb58347fa40 00007fb58347a4e4 00007fb58347a455 00007fb589f623c7 00007fb5865749a7 00007fb5865840bf 00007fb586584038
0709 13:03:02.481376 (+   340us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.481619 (+   243us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:02.481681 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:02.481748 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.481858 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.482202 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21396,"prepare.queue_time_us":213083,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":14675,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":27939,"spinlock_wait_cycles":8476544,"thread_start_us":444786,"threads_started":2,"wal-append.queue_time_us":445007}
I20260709 13:03:02.490494 11614 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:02.484122 11646 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.549088  9525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52502 (request call id 270) took 1215 ms. Trace:
I20260709 13:03:02.549583  9525 rpcz_store.cc:276] 0709 13:03:01.333776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.500485 (+1166709us) service_pool.cc:224] Handling call
0709 13:03:02.548185 (+ 47700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.548418 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.548445 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:02.548489 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:02.548530 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.548596 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.548994 (+   398us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:02.500859 11621 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:02.548324 11639 consensus_meta.cc:287] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.626s	user 0.009s	sys 0.003s
I20260709 13:03:02.513185 11667 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:02.565514 11646 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:02.568363 11704 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:02.551003 11630 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:02.576048  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1402) took 1246 ms. Trace:
W20260709 13:03:02.601305 11709 log.cc:927] Time spent T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 13:03:02.603322 11706 log.cc:927] Time spent T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:03:02.562610 11639 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:02.578168  9519 rpcz_store.cc:276] 0709 13:03:01.329392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.122907 (+793515us) service_pool.cc:224] Handling call
0709 13:03:02.123427 (+   520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:02.123868 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.123918 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:02.124516 (+   598us) log.cc:844] Serialized 26 byte log entry
0709 13:03:02.245040 (+120524us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:02.570928 (+325888us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.575588 (+  4660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.575720 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.575780 (+    60us) raft_consensus.cc:1685] finished
0709 13:03:02.575799 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.575977 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":250314,"prepare.queue_time_us":269585,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":79161,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129,"thread_start_us":190591,"threads_started":2,"wal-append.queue_time_us":175048}
I20260709 13:03:02.572535 11638 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.574873 11704 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:02.637527 11677 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.022s	sys 0.042s
I20260709 13:03:02.586041 11630 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:02.643307  9525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1403) took 1298 ms. Trace:
I20260709 13:03:02.632386 11639 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:02.644335  9525 rpcz_store.cc:276] 0709 13:03:01.345381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.566098 (+1220717us) service_pool.cc:224] Handling call
0709 13:03:02.566663 (+   565us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:02.567046 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.567078 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:02.567542 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:03:02.630770 (+ 63228us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:02.639826 (+  9056us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.640353 (+   527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.640405 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.643097 (+  2692us) raft_consensus.cc:1685] finished
0709 13:03:02.643115 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.643246 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5583,"thread_start_us":62707,"threads_started":1,"wal-append.queue_time_us":66771}
I20260709 13:03:02.649612  9521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1399) took 1370 ms. Trace:
I20260709 13:03:02.650528  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1408) took 1237 ms. Trace:
I20260709 13:03:02.650924  9519 rpcz_store.cc:276] 0709 13:03:01.412845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.633825 (+1220980us) service_pool.cc:224] Handling call
0709 13:03:02.650006 (+ 16181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.650219 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.650251 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:02.650294 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:02.650332 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.650382 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.650481 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:02.650651  9521 rpcz_store.cc:276] 0709 13:03:01.279656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.941425 (+661769us) service_pool.cc:224] Handling call
0709 13:03:01.954338 (+ 12913us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:01.965180 (+ 10842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.965231 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:02.003701 (+ 38470us) log.cc:844] Serialized 26 byte log entry
0709 13:03:02.388797 (+385096us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:02.570731 (+181934us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.571143 (+   412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.571258 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.649414 (+ 78156us) raft_consensus.cc:1685] finished
0709 13:03:02.649435 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.649553 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125945,"prepare.queue_time_us":158885,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":12566,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":41786,"thread_start_us":386369,"threads_started":2,"wal-append.queue_time_us":473853}
I20260709 13:03:02.656431 11622 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:02.657111 11622 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:02.658661 11630 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:03:02.639457 11677 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.022s	sys 0.042s
I20260709 13:03:02.659979  9525 raft_consensus.cc:1240] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:02.661262 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:02.662724 11704 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:02.665408  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:02.672837  9525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1410) took 1246 ms. Trace:
I20260709 13:03:02.666831 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:02.668289 11622 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.669147 11639 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:02.679316 11639 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:02.679594 11598 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:02.684990  9341 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:02.688058  9526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46894 (request call id 1397) took 1435 ms (client timeout 1531 ms). Trace:
I20260709 13:03:02.687837 11642 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.671175 11638 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:02.689922  9519 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:03:02.690325  9519 pending_rounds.cc:85] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 4
I20260709 13:03:02.690551  9519 pending_rounds.cc:107] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:03:02.690780  9519 raft_consensus.cc:2889] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:02.691442  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1412) took 1264 ms. Trace:
I20260709 13:03:02.691757  9519 rpcz_store.cc:276] 0709 13:03:01.427118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.688693 (+1261575us) service_pool.cc:224] Handling call
0709 13:03:02.689554 (+   861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.691220 (+  1666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.691392 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:02.692292 11651 consensus_meta.cc:287] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.665s	user 0.008s	sys 0.002s
W20260709 13:03:02.692831  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:02.688556  9526 rpcz_store.cc:269] 0709 13:03:01.252274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.254323 (+  2049us) service_pool.cc:224] Handling call
0709 13:03:02.687774 (+1433451us) spinlock_profiling.cc:243] Waited 53.8 ms on lock 0x7b54000a5354. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:02.687929 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123680128}
W20260709 13:03:02.693511  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.693708 11604 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.701296 11604 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.701534 11642 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:02.702294  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:02.695617  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.692950  9519 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:02.704072  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1420) took 1168 ms. Trace:
I20260709 13:03:02.704375  9519 rpcz_store.cc:276] 0709 13:03:01.535775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.692472 (+1156697us) service_pool.cc:224] Handling call
0709 13:03:02.692783 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.703838 (+ 11055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.704025 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:02.696559  9373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 1033) took 2125 ms. Trace:
I20260709 13:03:02.698647  9518 raft_consensus.cc:1240] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 8 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 8. Ops: []
I20260709 13:03:02.706759  9518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1398) took 1454 ms. Trace:
I20260709 13:03:02.707049  9518 rpcz_store.cc:276] 0709 13:03:01.252579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.698111 (+1445532us) service_pool.cc:224] Handling call
0709 13:03:02.698452 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.706528 (+  8076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.706706 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:02.673264  9525 rpcz_store.cc:276] 0709 13:03:01.426533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.650625 (+1224092us) service_pool.cc:224] Handling call
0709 13:03:02.659760 (+  9135us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.672534 (+ 12774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.672778 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31616}
I20260709 13:03:02.705538  9373 rpcz_store.cc:276] 0709 13:03:00.571212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.825375 (+254163us) service_pool.cc:224] Handling call
0709 13:03:00.825714 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.410340 (+584626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.696291 (+1285951us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b54000fe6d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:02.696463 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342537984}
I20260709 13:03:02.708482 11494 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:02.714507  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:02.714975 10759 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:03:02.700145 11658 log.cc:927] Time spent T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 1.360s	user 0.011s	sys 0.000s
I20260709 13:03:02.716197  9526 raft_consensus.cc:872] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }.
  Pending config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }: 
  New config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:02.716684  9526 raft_consensus.cc:1579] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Could not prepare op 'term: 3 index: 4' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }.
  Pending config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }: 
  New config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:02.717706  9517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1172) took 1632 ms. Trace:
I20260709 13:03:02.693919 11651 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.718147  9517 rpcz_store.cc:276] 0709 13:03:01.085569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.086247 (+   678us) service_pool.cc:224] Handling call
0709 13:03:01.098071 (+ 11824us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:01.098465 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.098508 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:01.125953 (+ 27445us) log.cc:844] Serialized 52 byte log entry
0709 13:03:01.220188 (+ 94235us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:01.426369 (+206181us) log.cc:844] Serialized 14 byte log entry
0709 13:03:01.431415 (+  5046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.431492 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.699412 (+1267920us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:02.717345 (+ 17933us) raft_consensus.cc:1685] finished
0709 13:03:02.717471 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.717633 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25540,"prepare.queue_time_us":81318,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":5549,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":32185,"spinlock_wait_cycles":24274176,"thread_start_us":225865,"threads_started":2,"wal-append.queue_time_us":103675}
I20260709 13:03:02.720033 11651 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:02.720969  9517 raft_consensus.cc:1275] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:03:02.721508  9517 pending_rounds.cc:85] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 3
I20260709 13:03:02.721764  9517 pending_rounds.cc:107] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:03:02.722013  9517 raft_consensus.cc:2889] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:02.722304  9518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52502 (request call id 271) took 1122 ms. Trace:
I20260709 13:03:02.722689  9517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1426) took 1105 ms. Trace:
I20260709 13:03:02.722887  9518 rpcz_store.cc:276] 0709 13:03:01.599672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.707693 (+1108021us) service_pool.cc:224] Handling call
0709 13:03:02.721633 (+ 13940us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.721884 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.721924 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:02.721982 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:02.722032 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.722102 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.722234 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:02.693743 11617 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:02.723147  9517 rpcz_store.cc:276] 0709 13:03:01.617071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.720283 (+1103212us) service_pool.cc:224] Handling call
0709 13:03:02.720593 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.722444 (+  1851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.722629 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:02.729447 10759 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:02.729441  9518 raft_consensus.cc:1240] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:02.731940  9518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1428) took 1114 ms. Trace:
I20260709 13:03:02.732446  9518 rpcz_store.cc:276] 0709 13:03:01.617648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.724686 (+1107038us) service_pool.cc:224] Handling call
0709 13:03:02.729230 (+  4544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.731642 (+  2412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.731869 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:02.734413 10641 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.734918 10641 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.737162  9519 raft_consensus.cc:1275] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:02.740002  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1424) took 1147 ms. Trace:
I20260709 13:03:02.740238  9517 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:02.740379  9519 rpcz_store.cc:276] 0709 13:03:01.605774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.705101 (+1099327us) service_pool.cc:224] Handling call
0709 13:03:02.736825 (+ 31724us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.737495 (+   670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.739949 (+  2454us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:02.741490  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:02.713948 11704 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:02.742354  9446 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:03:02.744987  9517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1429) took 1127 ms. Trace:
I20260709 13:03:02.745817  9517 rpcz_store.cc:276] 0709 13:03:01.617871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.727843 (+1109972us) service_pool.cc:224] Handling call
0709 13:03:02.739928 (+ 12085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.740679 (+   751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.744923 (+  4244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:02.747663  9517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52502 (request call id 272) took 1110 ms. Trace:
I20260709 13:03:02.747982  9517 rpcz_store.cc:276] 0709 13:03:01.636941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.746796 (+1109855us) service_pool.cc:224] Handling call
0709 13:03:02.747196 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.747369 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.747394 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:02.747430 (+    36us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:02.747458 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.747508 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.747612 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:02.748620 11618 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.749131 11618 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.750635  9517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52502 (request call id 273) took 1095 ms. Trace:
I20260709 13:03:02.734256 11617 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.734473 11494 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:02.751879 10759 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:02.752985 11617 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:02.754067 11494 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:02.735899 11336 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.755831 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:02.754626 11692 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:02.751163  9517 rpcz_store.cc:276] 0709 13:03:01.655495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.749885 (+1094390us) service_pool.cc:224] Handling call
0709 13:03:02.750175 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.750339 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.750364 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:02.750406 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:02.750439 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.750488 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.750584 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:02.759693  9520 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:02.763083  9520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1437) took 1102 ms. Trace:
I20260709 13:03:02.763384  9520 rpcz_store.cc:276] 0709 13:03:01.660733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.758934 (+1098201us) service_pool.cc:224] Handling call
0709 13:03:02.759325 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.762829 (+  3504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.763030 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:02.764092 11655 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:02.765640  9519 raft_consensus.cc:1240] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:02.766155  9520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52502 (request call id 274) took 1099 ms. Trace:
I20260709 13:03:02.766306  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1436) took 1146 ms. Trace:
I20260709 13:03:02.766728  9519 rpcz_store.cc:276] 0709 13:03:01.619681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.741416 (+1121735us) service_pool.cc:224] Handling call
0709 13:03:02.765340 (+ 23924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.766081 (+   741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.766254 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:02.768409  9519 raft_consensus.cc:1240] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:02.770426  9517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1175) took 1080 ms. Trace:
I20260709 13:03:02.771358  9517 rpcz_store.cc:276] 0709 13:03:01.689605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.769176 (+1079571us) service_pool.cc:224] Handling call
0709 13:03:02.769819 (+   643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.770064 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.770103 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:02.770158 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:02.770207 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.770277 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.770374 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:02.766572  9520 rpcz_store.cc:276] 0709 13:03:01.667082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.764291 (+1097209us) service_pool.cc:224] Handling call
0709 13:03:02.764646 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.764817 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.764840 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:02.764879 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:02.764912 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.764960 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.766087 (+  1127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:02.756469 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:02.752987 10069 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 2 LEARNER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:03:02.774569  9517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1176) took 1082 ms. Trace:
I20260709 13:03:02.774991  9517 rpcz_store.cc:276] 0709 13:03:01.692036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.772661 (+1080625us) service_pool.cc:224] Handling call
0709 13:03:02.774069 (+  1408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.774265 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.774289 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:02.774330 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:02.774364 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.774413 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.774518 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:02.776666  9517 raft_consensus.cc:1240] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:02.758127 11604 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:02.778378 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:02.779748  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:02.780314 11336 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.781550  9518 raft_consensus.cc:1275] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:02.782153  9518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1432) took 1163 ms. Trace:
I20260709 13:03:02.782215  9520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52502 (request call id 275) took 1044 ms. Trace:
I20260709 13:03:02.782941  9520 rpcz_store.cc:276] 0709 13:03:01.737775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.781498 (+1043723us) service_pool.cc:224] Handling call
0709 13:03:02.781775 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.781936 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.781959 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:02.782010 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:02.782041 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.782087 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.782161 (+    74us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:02.782612  9518 rpcz_store.cc:276] 0709 13:03:01.618604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.733597 (+1114993us) service_pool.cc:224] Handling call
0709 13:03:02.746106 (+ 12509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.781917 (+ 35811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.782106 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:02.787398  9517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1177) took 1086 ms. Trace:
I20260709 13:03:02.787974  9517 rpcz_store.cc:276] 0709 13:03:01.700643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.776210 (+1075567us) service_pool.cc:224] Handling call
0709 13:03:02.776487 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.777096 (+   609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.787329 (+ 10233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:02.782578 11336 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:02.796613  9517 raft_consensus.cc:1240] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:02.795596  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1174) took 1079 ms. Trace:
I20260709 13:03:02.806538  9519 rpcz_store.cc:276] 0709 13:03:01.689341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.767944 (+1078603us) service_pool.cc:224] Handling call
0709 13:03:02.768242 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.768795 (+   553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.768988 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:02.807394  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 79530us
I20260709 13:03:02.807708  9525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1425) took 1196 ms. Trace:
I20260709 13:03:02.798321  9518 raft_consensus.cc:1240] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:02.810979  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:02.783082 11692 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:02.805164  9526 raft_consensus.cc:2955] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:03:02.788239 11655 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:02.812175  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:02.792812 11597 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.821331 11581 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:02.823096 11580 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:02.809831  9525 rpcz_store.cc:276] 0709 13:03:01.611533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.708251 (+1096718us) service_pool.cc:224] Handling call
0709 13:03:02.735196 (+ 26945us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.735392 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:03:02.759081 (+ 23689us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.807346 (+ 48265us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:02.807400 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:02.807444 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.807518 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.807648 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36888,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"thread_start_us":45410,"threads_started":1}
W20260709 13:03:02.826968 11671 log.cc:927] Time spent T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.943s	user 0.003s	sys 0.000s
I20260709 13:03:02.833070  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:02.814623  9341 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:02.834064  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:02.836898  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:02.835057  9517 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:03:02.797139 11677 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:03:02.833094 11675 log.cc:927] Time spent T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.958s	user 0.005s	sys 0.000s
I20260709 13:03:02.850347  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:02.873785  9449 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:02.852603  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:02.853755  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:02.854171  9343 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:02.855495 11704 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:02.849252 11617 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:02.861620  9262 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7260766fbe5c43b1aab09346a89d9ac6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 925acbe78db14db3b9e4cfc857717947 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:02.861810  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:02.862792 11719 log.cc:927] Time spent T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:03:02.863272  9452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 1058) took 1179 ms. Trace:
W20260709 13:03:02.869910  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.840111 11582 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:02.874985  9444 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:03:02.876120  9449 raft_consensus.cc:1240] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:02.877945  9341 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:02.879480  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:02.905354  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:02.929790  9262 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 97185.6us
I20260709 13:03:02.832988 11580 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:02.939020  9446 raft_consensus.cc:1240] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:02.937434  9452 rpcz_store.cc:276] 0709 13:03:01.684320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.847352 (+163032us) service_pool.cc:224] Handling call
0709 13:03:01.847680 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:02.151075 (+303395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.151136 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:02.160462 (+  9326us) log.cc:844] Serialized 26 byte log entry
0709 13:03:02.330687 (+170225us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:02.330735 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.862844 (+532109us) spinlock_profiling.cc:243] Waited 83.7 ms on lock 0x7b54000d7854. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:02.862903 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.862954 (+    51us) raft_consensus.cc:1685] finished
0709 13:03:02.862971 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.863209 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23242,"raft.queue_time_us":115136,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":11776,"spinlock_wait_cycles":192609536,"thread_start_us":318249,"threads_started":2,"wal-append.queue_time_us":186317}
I20260709 13:03:02.931356 11581 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:02.957289 10069 raft_consensus.cc:1240] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: []
W20260709 13:03:02.958979  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 81106.9us
I20260709 13:03:02.968055 10759 consensus_queue.cc:1059] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:03:02.971346  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:02.942528 11671 log.cc:927] Time spent T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:03:02.838599 11692 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.980252  9444 raft_consensus.cc:1275] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:02.840775 11655 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:02.942530 11582 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.838363 11597 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:02.992707  9452 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:03.002355  9448 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:03:03.005895  9418 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:02.967346 11598 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.019032 11494 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.024593  9375 raft_consensus.cc:1240] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:02.934028 11617 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.022753  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:03.033720  9372 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:03.028612  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:03.035312  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:03.035559  9373 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:02.970036 11604 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:03.035928  9376 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:03.038553  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:02.994483 11582 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:03.039363  9372 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:03:02.950120 11601 consensus_queue.cc:1048] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:03:03.043370  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:03.007572 11646 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.007789 11683 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:02.925462 11677 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:03.018965 11586 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:02.964478 11721 consensus_queue.cc:1048] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:03:03.048082  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:03.031479 11667 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:03.032420 11622 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.019098 11651 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.007480 11665 consensus_queue.cc:1048] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
W20260709 13:03:03.056928  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 96654.2us
I20260709 13:03:03.063683  9524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1388) took 1814 ms. Trace:
I20260709 13:03:03.050844  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:03.066736  9373 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:03:03.068871  9376 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:03.066447  9341 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:03.072083  9341 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:03.050205 11644 raft_consensus.cc:3055] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:03.074757  9447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1673) took 1608 ms. Trace:
I20260709 13:03:03.032909 11598 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.040580 11494 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:03.061259 11586 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:03.066263  9524 rpcz_store.cc:276] 0709 13:03:01.249658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.249776 (+   118us) service_pool.cc:224] Handling call
0709 13:03:01.276669 (+ 26893us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:01.392680 (+116011us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:01.430925 (+ 38245us) log.cc:844] Serialized 14 byte log entry
0709 13:03:01.850493 (+419568us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:01.850985 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:03:01.851244 (+   259us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:02.490916 (+639672us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.491166 (+   250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.750638 (+259472us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b180042e800. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58347d522 00007fb58347f7c1 00007fb58347f779 00007fb58347f709 00007fb58347f6d1 00007fb58347e9cd 000000000038f354 000000000038f199 00007fb58346083a
0709 13:03:02.826236 (+ 75598us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:02.860216 (+ 33980us) spinlock_profiling.cc:243] Waited 84.4 ms on lock 0x7b54001a1154. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:02.860272 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:03.063340 (+203068us) raft_consensus.cc:1685] finished
0709 13:03:03.063373 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.063583 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":695041,"prepare.queue_time_us":675297,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":86,"raft.queue_time_us":31513,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":16689,"spinlock_wait_cycles":280035712,"thread_start_us":323271,"threads_started":1,"wal-append.queue_time_us":385945}
I20260709 13:03:03.179244  9447 rpcz_store.cc:276] 0709 13:03:01.456055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.456257 (+   202us) service_pool.cc:224] Handling call
0709 13:03:01.456553 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:01.527563 (+ 71010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.527594 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:01.528042 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:03:01.758852 (+230810us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:01.758894 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.758974 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.782300 (+1023326us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:03.053201 (+270901us) raft_consensus.cc:1685] finished
0709 13:03:03.053232 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.064699 (+ 11467us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23178,"raft.queue_time_us":27563,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":9335,"spinlock_wait_cycles":26017536,"thread_start_us":190478,"threads_started":1,"wal-append.queue_time_us":295839}
I20260709 13:03:03.217410 11586 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:03.217878 11494 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:03.218008  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:03.179775 11622 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:03.189594 11647 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.236s
W20260709 13:03:03.190320 11724 log.cc:927] Time spent T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:03:03.080425 11604 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:03.203444 11655 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:03:03.206802  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.211025 11617 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.196264 11692 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:03.196921 11630 consensus_queue.cc:1059] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:03:03.225786  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:03.225136 11622 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.052716 11646 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.071697 11651 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.277820 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:03.278672 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:03.178757 11644 raft_consensus.cc:740] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:03.282102 11693 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:03.288414 11597 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.055667 11683 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:03.337600  9447 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:03.343892 10070 raft_consensus.cc:2393] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 6: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:03:03.294340 11604 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.196849 11704 consensus_queue.cc:1059] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 6.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.142s
I20260709 13:03:03.334374 11639 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.190570 11722 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.376s
W20260709 13:03:03.342922 11720 log.cc:927] Time spent T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:03:03.339470 11622 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:03.366734  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 406128us
I20260709 13:03:03.310640 11700 consensus_queue.cc:1059] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:03:03.367785  9343 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:03.374720  9343 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:03.374915  9447 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 6.
W20260709 13:03:03.364948  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 345201us
I20260709 13:03:03.376556  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:03.354477 11604 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:03.381888  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:03.379855  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:03.380089  9447 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:03.379508  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:03.381282  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:03.385584  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:03.390375  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:03.408789  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 417871us
I20260709 13:03:03.410998 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:03.418176  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:03.429673 10067 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.005s	sys 0.005s
W20260709 13:03:03.430167 10067 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.005s	sys 0.005s
I20260709 13:03:03.365337 11601 raft_consensus.cc:3055] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:03.445886  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:03.446835  9370 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:03:03.434463 11601 raft_consensus.cc:740] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:03.458093  9368 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50568 (request call id 230) took 2794 ms (client timeout 1647 ms). Trace:
I20260709 13:03:03.452014 11494 consensus_queue.cc:1059] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
W20260709 13:03:03.458595  9368 rpcz_store.cc:269] 0709 13:03:00.658283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.665481 (+  7198us) service_pool.cc:224] Handling call
0709 13:03:03.452012 (+2786531us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b5400186d54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:03.452130 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2097321216}
I20260709 13:03:03.458671 11601 consensus_queue.cc:260] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.460012 11601 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:03.461369  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:03.461705 11598 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.462277 11598 consensus_queue.cc:1059] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:03.463349  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:03.452399  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:03.456753  9520 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:03:03.465153 11646 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.465752  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:03.466192  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:03.421615 11729 raft_consensus.cc:3055] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:03.381716 11630 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:03.460024  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:03.475355  9368 raft_consensus.cc:2393] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 6: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:03.466785  9520 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:03.469758  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:03.475980  9492 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:03.382440 11581 raft_consensus.cc:697] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:03.472963  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:03.474308  9526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1423) took 1881 ms. Trace:
I20260709 13:03:03.385828 11704 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:03.479823  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:03.364148 11639 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.499941  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:03.500056  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:03.502203  9368 raft_consensus.cc:2393] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 5: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:03.507679  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:03.477559  9526 rpcz_store.cc:276] 0709 13:03:01.592553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.699443 (+1106890us) service_pool.cc:224] Handling call
0709 13:03:02.700289 (+   846us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:03:02.700944 (+   655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.700974 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:03:02.718049 (+ 17075us) log.cc:844] Serialized 511 byte log entry
0709 13:03:02.804926 (+ 86877us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:02.950720 (+145794us) log.cc:844] Serialized 14 byte log entry
0709 13:03:03.079477 (+128757us) log.cc:844] Serialized 14 byte log entry
0709 13:03:03.472581 (+393104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.472699 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:03.472764 (+    65us) raft_consensus.cc:1685] finished
0709 13:03:03.472783 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.472985 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":831580,"prepare.queue_time_us":25287,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":269026,"raft.run_cpu_time_us":592,"raft.run_wall_time_us":840544,"thread_start_us":572761,"threads_started":3,"wal-append.queue_time_us":122050}
I20260709 13:03:03.508061  9492 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:03.509325  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:03.511000  9492 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:03.513145  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:03.449361 11617 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:03.516866  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:03.476028 11721 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.474566 11729 raft_consensus.cc:740] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:03.500200 11700 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.476707 11677 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:03.538667  9373 raft_consensus.cc:1275] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:03.502102 11655 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:03.502450 11597 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:03:03.544322  9519 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.000s	sys 0.036s
W20260709 13:03:03.551700  9519 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.001s	sys 0.036s
W20260709 13:03:03.545157  9342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.091s	sys 0.108s
W20260709 13:03:03.552793  9342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.091s	sys 0.109s
I20260709 13:03:03.503275 11738 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:03.523773 11736 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:03.557085  9373 raft_consensus.cc:1240] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:03:03.514452 11730 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:03.567104  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:03.472229 11667 raft_consensus.cc:697] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:03.576589  9447 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:03.566330  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:03.550688 11677 raft_consensus.cc:3055] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:03.418022 11644 consensus_queue.cc:260] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:03.556329 11629 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.591835  9373 raft_consensus.cc:1240] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:03:03.592453  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 67778.6us
I20260709 13:03:03.538434 11721 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.529240 11617 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:03.576541 11704 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.605401  9492 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:03.543190 11700 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:03.606953 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 431421us
W20260709 13:03:03.607628  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 151950us
I20260709 13:03:03.608629  9492 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:03:03.611002  9377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1175) took 1913 ms. Trace:
I20260709 13:03:03.615345  9492 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:03.583899 11677 raft_consensus.cc:740] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:03.556784 11655 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.594853 11647 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.622720  9370 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:03.611478  9377 rpcz_store.cc:276] 0709 13:03:01.697906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.698055 (+   149us) service_pool.cc:224] Handling call
0709 13:03:01.705138 (+  7083us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:01.708667 (+  3529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.708709 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:01.709397 (+   688us) log.cc:844] Serialized 26 byte log entry
0709 13:03:02.229762 (+520365us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b18001b6040. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58345fe07 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b 00007fb586109d23 00007fb58610a0d1 00007fb586525a0f
0709 13:03:02.286455 (+ 56693us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:02.286521 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.751700 (+465179us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4800003fd8. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58b493aa1 00007fb58b48ab37 00007fb58b48a9ca 00007fb58b58226f 00007fb58b581f37 00007fb58b59655c 00007fb58b596508 00007fb58b596488 00007fb58b596443 00007fb58b5956ec 00007fb58a4bfa96
0709 13:03:03.610661 (+858961us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b5400045bd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:03.610708 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:03.610753 (+    45us) raft_consensus.cc:1685] finished
0709 13:03:03.610767 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.610935 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":402,"raft.run_cpu_time_us":4225,"raft.run_wall_time_us":1040499,"spinlock_wait_cycles":40625664,"thread_start_us":55197,"threads_started":1,"wal-append.queue_time_us":647712,"wal-append.run_cpu_time_us":3226,"wal-append.run_wall_time_us":1139688}
I20260709 13:03:03.576045 11597 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:03.605741 11651 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.653123 11642 consensus_queue.cc:1048] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:03.641223 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:03.657675  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:03.601691 11629 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.662807 11629 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:03.664283 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:03.626647 11736 raft_consensus.cc:2804] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:03.668311 11736 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:03.668768 11736 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:03.669646  9521 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:03.670337  9521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1411) took 2243 ms. Trace:
I20260709 13:03:03.670668  9521 rpcz_store.cc:276] 0709 13:03:01.426854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.653384 (+1226530us) service_pool.cc:224] Handling call
0709 13:03:03.669078 (+1015694us) spinlock_profiling.cc:243] Waited 7.22 ms on lock 0x7b5800188498. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445eee 0000000000375939 00007fb58b4b91e0 00007fb58b5820c4 00007fb58b582131 00007fb58b543fc0 00007fb58b52e929 00007fb58b52e3d2 00007fb584aa5bd4
0709 13:03:03.669255 (+   177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:03.670056 (+   801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.670279 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16628224}
I20260709 13:03:03.672362  9451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1683) took 1439 ms. Trace:
I20260709 13:03:03.672799  9451 rpcz_store.cc:276] 0709 13:03:02.233194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.233504 (+   310us) service_pool.cc:224] Handling call
0709 13:03:02.233882 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:02.316357 (+ 82475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.316391 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:02.316755 (+   364us) log.cc:844] Serialized 26 byte log entry
0709 13:03:02.506853 (+190098us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:02.506911 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.671931 (+1165020us) spinlock_profiling.cc:243] Waited 81.7 ms on lock 0x7b540006bdd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:03.672003 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:03.672052 (+    49us) raft_consensus.cc:1685] finished
0709 13:03:03.672068 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.672299 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14180,"raft.queue_time_us":488,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":4995,"spinlock_wait_cycles":187873024,"thread_start_us":161413,"threads_started":1,"wal-append.queue_time_us":274041,"wal-append.run_cpu_time_us":1971,"wal-append.run_wall_time_us":1055139}
I20260709 13:03:03.674724 11655 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:03.675127  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:03.675872  9451 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:03:03.682909  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:03.618341  9447 raft_consensus.cc:1275] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:03.686400  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:03.625725 11738 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:03.676797  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:03.688915  9450 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51016 (request call id 1055) took 1998 ms (client timeout 2065 ms). Trace:
I20260709 13:03:03.647832 11639 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:03.648268 11638 consensus_queue.cc:1059] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:03.650063 11700 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:03.651448 11663 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 1.155s	user 0.000s	sys 0.011s
I20260709 13:03:03.612372 11730 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:03.687866  9418 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:03.687749  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:03.692425 10759 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.697921  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:03.689607  9450 rpcz_store.cc:269] 0709 13:03:01.683294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.691140 (+  7846us) service_pool.cc:224] Handling call
0709 13:03:03.681093 (+1989953us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b5400158bd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:03.681200 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1066836224}
I20260709 13:03:03.705051  9377 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:03.626940 11627 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:03:03.682982 11580 consensus_meta.cc:287] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.718s	user 0.012s	sys 0.000s
I20260709 13:03:03.622659 11683 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:03.708357 10759 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.714027  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:03.710831  9447 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:03:03.592571 11581 consensus_queue.cc:237] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.613986 11704 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.718765  9447 raft_consensus.cc:1240] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:03.729748  9451 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:03.689044 11599 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:03.734032  9445 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:03:03.734530  9445 pending_rounds.cc:85] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 3
I20260709 13:03:03.734354 11599 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.733865 11734 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:03.736544 11599 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.738216  9341 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:03.737365 11630 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:03.739560 11630 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.740679  9450 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:03.741773 11630 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.743155  9341 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:03.734797  9445 pending_rounds.cc:107] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:03:03.745225  9445 raft_consensus.cc:2889] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:03.746104  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:03.746539  9445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1694) took 1112 ms. Trace:
I20260709 13:03:03.746912  9445 rpcz_store.cc:276] 0709 13:03:02.633896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.634161 (+   265us) service_pool.cc:224] Handling call
0709 13:03:02.640712 (+  6551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:03.745681 (+1104969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.746310 (+   629us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400270454. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:03.746479 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2513453824}
I20260709 13:03:03.747385  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:03.747924  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:03.748626  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:03.744599 11630 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:03.749111 11644 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:03.749163  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:03.749660 11630 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.749979  9521 raft_consensus.cc:2468] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
W20260709 13:03:03.750110 11582 consensus_meta.cc:287] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.697s	user 0.010s	sys 0.001s
I20260709 13:03:03.733119 11745 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:03.701752 11651 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:03:03.751673  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 64508.8us
I20260709 13:03:03.755249  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:03.723834 10759 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.757436  9450 raft_consensus.cc:1240] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:03.764058  9524 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:03.701378 11738 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.696354 11655 consensus_queue.cc:1059] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:03:03.724865 11700 raft_consensus.cc:3055] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:03.695564 11622 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.778390 10759 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:03.760651  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:03.770569  9369 raft_consensus.cc:2393] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 8: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:03.724264 11744 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:03.778905 10759 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.684996 11647 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.622336 11729 consensus_queue.cc:260] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.750138 11630 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:03.782943 10759 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:03.780881 11746 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.785176  9418 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:03.790411  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 53294.3us
W20260709 13:03:03.790596  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 44894.3us
I20260709 13:03:03.683246 11667 consensus_queue.cc:237] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:03:03.722756 11580 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.800285  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:03.782289 11693 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.804728 11738 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:03.804486 11622 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.778425 11700 raft_consensus.cc:740] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:03.787117 11621 raft_consensus.cc:3055] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:03.763357 11582 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.718645 11677 consensus_queue.cc:260] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.819813  9374 raft_consensus.cc:1240] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:03.770282 11651 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:03.825103  9418 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:03.811278 11634 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:03.815433 11729 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:03.828617  9418 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:03.819139 11738 raft_consensus.cc:476] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 8 LEADER]: Not starting pre-election -- already a leader
I20260709 13:03:03.796681 11604 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.845930 10759 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.844303 11692 raft_consensus.cc:3055] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:03.819759 11621 raft_consensus.cc:740] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:03.846170  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:03.829119 11688 raft_consensus.cc:2749] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:03.850855 10759 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.815721 11693 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.848658  9418 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:03.808411 11746 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.844905 11651 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:03:03.858893  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 59463.7us
I20260709 13:03:03.829893 11634 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:03.860771  9372 raft_consensus.cc:1240] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:03.863468  9418 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:03:03.852499 11743 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:03.850584 11692 raft_consensus.cc:740] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:03.865209 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:03.869174 11580 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.854408 11655 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.873255  9343 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:03.873490  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:03.860744 11634 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:03.879606  9451 raft_consensus.cc:1275] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:03.872386  9341 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:03.881410  9520 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:03:03.877866  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:03.871708 11651 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.882867 11738 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.882984 11651 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.883401 11738 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.883745 11693 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.865411 11688 raft_consensus.cc:2749] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:03.885423 11738 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:03.886097 11618 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.886683 11618 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:03.886770  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:03.881387  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:03.888487 11604 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.889279 11597 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:03.890057 11746 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.890822 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:03.891146  9444 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:03:03.891521  9448 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51016 (request call id 1051) took 2209 ms (client timeout 1948 ms). Trace:
W20260709 13:03:03.891875  9448 rpcz_store.cc:269] 0709 13:03:01.682063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.682242 (+   179us) service_pool.cc:224] Handling call
0709 13:03:03.891322 (+2209080us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54000d8254. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:03.891426 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2604746112}
I20260709 13:03:03.892486  9444 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:03:03.892781 11622 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:03.870321 11760 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:03.894243 11622 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.894649 11622 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:03.895059 10641 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.882266  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:03.881547  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:03.898787  9522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1396) took 2646 ms. Trace:
I20260709 13:03:03.898427  9526 raft_consensus.cc:2393] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 5: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:03.892848  9444 pending_rounds.cc:85] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 2
I20260709 13:03:03.900589  9444 pending_rounds.cc:107] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:03:03.900848  9444 raft_consensus.cc:2889] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:03.899348  9522 rpcz_store.cc:276] 0709 13:03:01.251967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.841327 (+589360us) service_pool.cc:224] Handling call
0709 13:03:01.846607 (+  5280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.064548 (+217941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.898556 (+1834008us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54003b2754. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:03.898733 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411268992}
I20260709 13:03:03.900627 10641 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:03.903702  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:03.909253  9522 raft_consensus.cc:1275] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:03.910043  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:03.857831 11700 consensus_queue.cc:260] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.875183 11732 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:03.912140 11732 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.912540 11732 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:03.912325 11738 consensus_queue.cc:1175] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d62c9d5a052b42ce8675f8438f846526" responder_term: 6 status { last_received { term: 4 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: [5.4-5.4]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:03.916934  9490 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:03.911582  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:03.918083  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:03.918447  9448 raft_consensus.cc:2393] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 7: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:03.879468 11735 raft_consensus.cc:2804] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:03.919312  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:03.918720  9518 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:03.922159  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:03.924913  9522 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:03.882062 11744 raft_consensus.cc:697] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:03.898835 11730 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.921754  9451 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
W20260709 13:03:03.927163 11756 log.cc:927] Time spent T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:03:03.929072  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:03.930186  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:03.931381 11621 consensus_queue.cc:260] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.935796 11746 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:03.936686 11746 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.937443 11665 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.937958 11665 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.939108 11746 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.940696  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:03.932850  9444 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:03.941797  9448 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:03:03.944203  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:03.944950  9451 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:03.919576 11704 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.880183 11655 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.919361 11651 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.921543 11735 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:03.923936 11629 raft_consensus.cc:2764] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:03:03.953941  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:03.948158  9418 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:03.903749 11755 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:03:03.951831  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:03.956825  9444 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:03.940047 11665 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.960456  9418 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:03.962755  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:03.964084  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:03.966189  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:03.966506  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:03.967362  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:03.967777  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:03.964028 11677 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:03.968489  9372 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:03:03.969870  9418 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:03.967895  9448 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:03.964880 11763 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:03.971000  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:03.946230 11738 consensus_queue.cc:1175] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d62c9d5a052b42ce8675f8438f846526" responder_term: 6 status { last_received { term: 4 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: [5.4-5.4]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:04.003187  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:04.003127 11736 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:04.004624  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:03.960729 11651 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:04.006558  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:04.006625 11651 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.007763  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:04.008692 11651 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.974403  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:03.975446  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:04.020375  9522 raft_consensus.cc:2393] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 4: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
W20260709 13:03:03.976913 11749 log.cc:927] Time spent T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:03:04.020223  9518 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 2.
I20260709 13:03:03.977320 11755 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.024793 11630 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.025856  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:04.027030  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:04.027216 11630 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.978782  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:04.028057  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:04.028916  9369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:04.029224  9377 raft_consensus.cc:2393] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 7: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:04.029454  9369 raft_consensus.cc:606] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:04.024852 11755 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.030793  9369 raft_consensus.cc:1240] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:03.979818 11721 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.980520 11646 raft_consensus.cc:3055] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:03.981228 11598 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:04.047011 11598 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.047495 11598 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:04.047801 11755 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.979837 11746 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.049415 11746 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.983345  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:04.050890  9376 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:04.051615 11746 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:04.052206  9376 raft_consensus.cc:1240] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:03.985117 11494 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:03.985635 11693 consensus_queue.cc:1059] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:03.986482  9418 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:03.988481 11596 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.989921 11744 consensus_queue.cc:237] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.896166 11760 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.997208 11582 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:03.943189 11730 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:03:03.956780 11735 raft_consensus.cc:3060] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:04.002466 11688 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:04.012301  9444 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
W20260709 13:03:04.013545  9262 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7260766fbe5c43b1aab09346a89d9ac6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 925acbe78db14db3b9e4cfc857717947 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:04.069890 11688 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:03.973075  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:04.055168 11494 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.961155 11621 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:04.073846 11494 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:04.033717  9451 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:04.059321 11622 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.078001  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:04.078814  9451 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:03:04.079789 11622 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:04.081681 11765 log.cc:927] Time spent T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:03:04.086186  9372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7a866663507456b9442af6c42748c5f"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:04.044766 11646 raft_consensus.cc:740] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:04.094293 11646 consensus_queue.cc:260] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.096184 11646 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:04.099282 11732 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.101052  9446 raft_consensus.cc:2368] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 8. Current term is 9.
I20260709 13:03:04.107215 11730 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:04.118260 11617 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:04.124203  9368 raft_consensus.cc:1240] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:03:04.128374  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:04.043675  9448 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:04.054229  9341 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:04.059526  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 73135.3us
I20260709 13:03:04.132270  9418 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
W20260709 13:03:04.070475  9262 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 56994.4us
I20260709 13:03:04.014247  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:04.134045  9373 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:03:04.033856 11640 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:03:04.072633 11688 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:04.137300  9418 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
W20260709 13:03:04.138074  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 83952.1us
I20260709 13:03:04.158010  9522 raft_consensus.cc:1240] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:04.160928  9451 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:04.161994  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:04.155478  9341 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:04.170244  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:04.170711  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:04.182241  9371 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:04.183578  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:04.183760  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:04.184221  9448 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:04.184237  9451 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:03:04.053299 11634 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:04.163941 11766 log.cc:927] Time spent T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:03:04.187721 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:04.186563  9418 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:04.167236  9341 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:04.185309  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:04.137072 11586 raft_consensus.cc:2764] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:03:04.112613 11598 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.199875  9451 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:03:04.200088  9341 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:04.163309 11746 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:04.154287 11582 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:04.204433  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:04.215593  9451 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:04.136941 11736 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:04.211288  9341 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:04.219094 11665 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:04.187872 11688 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:04.228610 11688 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.229154 11688 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:04.189461 11651 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:04.233989 11651 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:04.234724 11651 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.187003 11743 raft_consensus.cc:2764] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:03:04.185343 11622 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:04.224078  9341 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:04.215001 11596 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.244966  9341 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:04.225812 11599 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:04.226459 11665 raft_consensus.cc:697] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:04.185551 11630 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:04.221964 11693 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:04.215651 11644 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:03:04.237623  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 305929us
I20260709 13:03:04.210314 11746 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:04.214777 11582 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.188829 11494 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.257508  9448 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:04.257652  9490 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:04.264035  9445 raft_consensus.cc:1240] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:04.240612 11629 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:04.278231  9490 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:04.245764 11760 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:04.282436  9490 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:04.253705 11742 raft_consensus.cc:2804] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:04.251855 11731 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:04.316654  9449 raft_consensus.cc:1240] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:03:04.268105 11746 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:04.262987 11622 raft_consensus.cc:697] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:04.248302 11596 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.256616 11599 raft_consensus.cc:697] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:04.264088 11763 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:04.272276 11754 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:03:04.330214  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 143753us
I20260709 13:03:04.275360 11582 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:04.278312 11644 raft_consensus.cc:697] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:04.286571 11736 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:04.319365 11742 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.346606  9418 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:03:04.286346 11737 consensus_queue.cc:1048] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:03:04.318904 11640 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:04.270411 11693 raft_consensus.cc:697] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:04.357184  9418 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:04.261484 11630 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:04.347702  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 65346.9us
I20260709 13:03:04.288566 11629 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.325492 11731 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:04.360857  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:04.382236  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.348379 11581 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:03:04.362844 11740 log.cc:927] Time spent T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.718s	user 0.001s	sys 0.003s
I20260709 13:03:04.380880  9490 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:04.386245  9490 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:04.351061 11743 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:04.351995 11736 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:04.364321 11760 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:04.358021 11742 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:04.357270 11651 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:04.389971  9490 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:04.353274 11774 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:04.354826 11738 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:04.404382  9447 raft_consensus.cc:1240] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:04.368561 11647 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:04.384073 11732 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:04.385107 11731 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:04.348309 11754 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.346511 11763 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.403373 11736 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:04.351063 11665 consensus_queue.cc:237] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.408886 11651 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:04.406126 11760 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:04.427551  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1183) took 1649 ms. Trace:
I20260709 13:03:04.441263  9519 rpcz_store.cc:276] 0709 13:03:02.778286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.814975 (+ 36689us) service_pool.cc:224] Handling call
0709 13:03:02.815617 (+   642us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:02.815972 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.816010 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:02.837402 (+ 21392us) log.cc:844] Serialized 26 byte log entry
0709 13:03:03.552316 (+714914us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:03.552384 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.552489 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:04.221216 (+668727us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:04.419241 (+198025us) raft_consensus.cc:1685] finished
0709 13:03:04.419273 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.427468 (+  8195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":444638,"raft.queue_time_us":156,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":454754,"spinlock_wait_cycles":70075648,"thread_start_us":710713,"threads_started":1,"wal-append.queue_time_us":768955}
I20260709 13:03:04.418877 11634 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:04.400626 11581 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.402179 11743 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:04.454839 11779 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:04.455332 11779 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:04.455686 11779 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:04.456225 11743 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:04.457998 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:04.435859 11774 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:03:04.461747 11771 log.cc:927] Time spent T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:03:04.417511 11738 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:04.450120 11772 log.cc:927] Time spent T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:03:04.477831  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 87978us
W20260709 13:03:04.475803  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 118681us
I20260709 13:03:04.446440 11760 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:04.460160 11688 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.485776  9418 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:04.418437 11644 consensus_queue.cc:237] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.411475 11622 consensus_queue.cc:237] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.494134  9370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 1078) took 1074 ms. Trace:
I20260709 13:03:04.411417 11599 consensus_queue.cc:237] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.495721  9370 rpcz_store.cc:276] 0709 13:03:03.419565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.536130 (+116565us) service_pool.cc:224] Handling call
0709 13:03:03.536493 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:03.642373 (+105880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.493899 (+851526us) spinlock_profiling.cc:243] Waited 85.8 ms on lock 0x7b540014df54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:04.494070 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197425536}
I20260709 13:03:04.502269  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:04.503623  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:04.475282 11778 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:04.505939  9444 raft_consensus.cc:1240] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:04.479534 11494 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:04.482460 11596 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:04.498682 11634 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:04.528520  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:04.499531 11651 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:04.521428 11770 log.cc:927] Time spent T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:03:04.532092  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:04.482231 11774 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
W20260709 13:03:04.527719 11769 log.cc:927] Time spent T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:03:04.452571 11693 consensus_queue.cc:237] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.547084  9370 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:04.555186 11596 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:04.557556 11782 consensus_queue.cc:1059] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 13:03:04.573654 11739 log.cc:927] Time spent T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.974s	user 0.000s	sys 0.006s
I20260709 13:03:04.557654  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:04.575649  9444 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:04.564030  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:04.528873 11494 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.566982 11627 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:03:04.581789  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:04.555361  9418 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:04.565848 11773 log.cc:927] Time spent T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260709 13:03:04.584199  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 66354.2us
I20260709 13:03:04.585925 10067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 238) took 1712 ms. Trace:
I20260709 13:03:04.587942 10067 rpcz_store.cc:276] 0709 13:03:02.870012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.870163 (+   151us) service_pool.cc:224] Handling call
0709 13:03:02.870707 (+   544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:02.871053 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.871078 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:02.872091 (+  1013us) log.cc:844] Serialized 540 byte log entry
0709 13:03:03.430638 (+558547us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:03.430688 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.430764 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:04.521838 (+1091074us) spinlock_profiling.cc:243] Waited 67.2 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:04.579138 (+ 57300us) raft_consensus.cc:1685] finished
0709 13:03:04.579161 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.582673 (+  3512us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154572544,"thread_start_us":558120,"threads_started":1,"wal-append.queue_time_us":694033}
I20260709 13:03:04.590509  9490 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:04.591354  9444 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:04.556504 11648 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:04.605448 11648 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:04.565979 11629 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:04.564344 11596 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:04.569854 11754 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:04.600551 11621 consensus_meta.cc:287] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.001s
W20260709 13:03:04.612376  9375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52562 (request call id 1070) took 1230 ms (client timeout 1567 ms). Trace:
W20260709 13:03:04.612818  9375 rpcz_store.cc:269] 0709 13:03:03.381546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.381667 (+   121us) service_pool.cc:224] Handling call
0709 13:03:04.612136 (+1230469us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54000613d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:04.612300 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":926350720}
I20260709 13:03:04.603401  9370 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:04.603499 11746 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.579857 11630 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:04.609098  9490 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:04.609885  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 54609.1us
I20260709 13:03:04.564689 11783 consensus_queue.cc:1048] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:03:04.609241 11627 raft_consensus.cc:2749] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:04.612064 11732 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:04.614104  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:04.614652  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.546376 11778 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:03:04.615324  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:04.655279 11778 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:04.655711 11778 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.656154 11778 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:04.659265 11563 consensus_queue.cc:1059] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:04.660372 11563 raft_consensus.cc:3055] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:04.628203  9341 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:04.556594 11651 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.619027  9418 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:04.646535  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:04.630877 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:04.634788  9374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1184) took 1617 ms. Trace:
I20260709 13:03:04.663157  9341 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:04.663317  9374 rpcz_store.cc:276] 0709 13:03:03.017898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.019331 (+  1433us) service_pool.cc:224] Handling call
0709 13:03:03.019732 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:03.824897 (+805165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.634581 (+809684us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x7b5400187254. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:04.634735 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1839432064}
I20260709 13:03:04.649093  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:04.640507  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:04.651177  9490 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:04.583855 11494 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.697363  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:04.698028 10067 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:04.672101 10027 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:04.689843  9369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 1095) took 1002 ms. Trace:
I20260709 13:03:04.689821 11581 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:04.690562  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 71592.4us
I20260709 13:03:04.700331  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:04.701025  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:04.705287  9524 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:03:04.706128  9520 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:03:04.698730  9369 rpcz_store.cc:276] 0709 13:03:03.687477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.032513 (+345036us) service_pool.cc:224] Handling call
0709 13:03:04.032803 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:04.033031 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.033056 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:04.033511 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:03:04.321867 (+288356us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:04.321915 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.322006 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:04.689607 (+367601us) raft_consensus.cc:1685] finished
0709 13:03:04.689628 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.689780 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":258055,"threads_started":1,"wal-append.queue_time_us":326988}
I20260709 13:03:04.638808 11732 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:04.710331  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 59248.6us
I20260709 13:03:04.638702 11655 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:04.715444  9418 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:04.717707  9490 leader_election.cc:400] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 8. Current term is 9.
I20260709 13:03:04.629755 11596 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:04.713332  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:04.720657  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:04.721700 11623 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:04.722774 11629 consensus_queue.cc:1059] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:04.726011  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:04.691165 11743 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:04.727778  9490 leader_election.cc:403] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:04.719458  9492 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:04.730198  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:04.740398  9519 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
W20260709 13:03:04.706501 11677 consensus_meta.cc:287] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.730s	user 0.012s	sys 0.000s
I20260709 13:03:04.731607  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:04.660735 11563 raft_consensus.cc:740] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:04.735203  9341 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:04.614742 11730 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 13:03:04.698786 11594 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:04.708601 11733 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:04.737289  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:04.742457  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:04.741221  9492 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:04.747578  9369 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 13:03:04.754699  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:04.758131 11738 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:04.760699 11735 consensus_meta.cc:287] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.652s	user 0.004s	sys 0.007s
I20260709 13:03:04.702904 11783 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:04.716321 11789 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.724885 11754 consensus_queue.cc:1059] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:03:04.760910 11688 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:04.862864 11776 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:04.872278 11563 consensus_queue.cc:260] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:04.833038  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:04.829421 11594 raft_consensus.cc:697] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:04.887283 10067 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 13:03:04.887777 10067 pending_rounds.cc:85] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: Aborting all ops after (but not including) 3
I20260709 13:03:04.888028 10067 pending_rounds.cc:107] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260709 13:03:04.888311 10067 raft_consensus.cc:2917] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260709 13:03:04.888384  9377 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:04.818823 11638 raft_consensus.cc:3055] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:04.889482 11638 raft_consensus.cc:740] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:04.890465 11638 consensus_queue.cc:260] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.890553 11783 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:03:04.889118 11594 consensus_queue.cc:237] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.732897 11774 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:04.829443  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:04.899869  9520 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:04.888788 10067 raft_consensus.cc:2889] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 3 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:04.895903  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:04.900691  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.765676  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:04.898249  9443 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:03:04.895943  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:04.904608  9524 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:04.900393  9369 pending_rounds.cc:85] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947: Aborting all ops after (but not including) 3
I20260709 13:03:04.762625  9446 raft_consensus.cc:1240] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
W20260709 13:03:04.870090  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 117806us
I20260709 13:03:04.905383  9369 pending_rounds.cc:107] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260709 13:03:04.905936  9369 raft_consensus.cc:2917] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260709 13:03:04.907001  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:04.909060  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:04.889765 11651 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:04.910630  9369 raft_consensus.cc:2889] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:04.937819  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:04.937196  9377 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:04.719904 11746 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:04.913847  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 172763us
I20260709 13:03:04.745354 11621 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:04.743065 11655 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:03:04.845075 11648 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:04.870815 11761 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:04.746300 11743 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.949905  9368 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:04.950582  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:04.988097  9448 raft_consensus.cc:2393] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 7: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:04.948732  9520 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:04.951359 11629 consensus_queue.cc:1059] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:04.952042 11627 consensus_queue.cc:1059] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:04.953084  9492 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:04.957304 11638 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:04.959131 11731 consensus_meta.cc:287] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.529s	user 0.005s	sys 0.003s
I20260709 13:03:04.966526 11630 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:04.971505 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 299480us
I20260709 13:03:04.976051  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:04.944243  9418 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:04.982671  9524 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:04.900732 11733 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:04.907083 11649 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.931s	user 0.001s	sys 0.014s
I20260709 13:03:05.021209  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:04.738585 11581 consensus_queue.cc:1059] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.208s
I20260709 13:03:04.950899 11704 consensus_queue.cc:1059] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:04.989820  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:05.034024  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:05.034919  9520 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:04.899628 11774 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.914564 11688 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:03:05.012686  9525 raft_consensus.cc:1240] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:05.037601 11774 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:05.012756  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 68613.4us
I20260709 13:03:05.038430  9418 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:05.039924 11746 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:05.040035  9418 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:05.040429 11746 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.014847  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:04.894958 11778 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.030370  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:05.021142 11630 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.031108  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:04.946903 11738 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:05.042093  9418 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:04.913023 11783 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:05.022681 11677 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:04.906499 11735 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:04.968516 11692 consensus_queue.cc:260] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:05.044480 11651 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:04.907871 11789 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:04.760758 11779 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.216163  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:05.020545 11733 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:05.050040  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:04.992350 11743 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:05.472628  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 519614us
I20260709 13:03:05.123637  9450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 1078) took 1246 ms. Trace:
I20260709 13:03:05.491580  9450 rpcz_store.cc:276] 0709 13:03:03.877514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.878518 (+  1004us) service_pool.cc:224] Handling call
0709 13:03:03.878777 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.128881 (+250104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.128916 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:04.128963 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:04.128994 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.123367 (+994373us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b5400015754. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:05.123420 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.123564 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":574638464}
I20260709 13:03:05.473744  9524 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
W20260709 13:03:05.101971  9490 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.878s (SENT) [suppressed 28 similar messages]
W20260709 13:03:05.020849 11649 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.002s	sys 0.015s
I20260709 13:03:05.015584 11563 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:05.117478  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:05.467926  9520 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
W20260709 13:03:05.470372  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:05.284777 11795 log.cc:927] Time spent T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:03:05.040891 11746 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:05.117462 11776 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:05.521391 11776 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.523867 11776 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:05.524638 11776 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:05.498370  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:05.218642 11739 log.cc:927] Time spent T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:03:05.474411 11494 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:05.118258 11646 consensus_meta.cc:287] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 1.014s	user 0.010s	sys 0.004s
I20260709 13:03:05.490060 11783 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:05.429324 11796 log.cc:927] Time spent T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
W20260709 13:03:05.048928 11582 consensus_meta.cc:287] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.695s	user 0.006s	sys 0.002s
W20260709 13:03:05.202874 11791 log.cc:927] Time spent T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:03:05.086931 11740 log.cc:927] Time spent T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:03:05.514092  9444 raft_consensus.cc:1240] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:05.518148 11778 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:05.102248 11785 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.475464 11677 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:05.129168 11581 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.400763 11642 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.525795  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:05.526274  9372 raft_consensus.cc:606] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:05.554145  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:05.526618  9519 raft_consensus.cc:2393] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 4: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:05.130615 11604 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.109758 11621 raft_consensus.cc:3055] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:05.102746 11627 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:05.051043 11782 raft_consensus.cc:3055] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:05.461284 11629 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:05.529696  9370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1204) took 1040 ms. Trace:
I20260709 13:03:05.010473 11761 raft_consensus.cc:697] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:05.473973 11651 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:05.572520 11651 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:05.216360 11763 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:05.131745 11704 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
W20260709 13:03:05.531885  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 489822us
I20260709 13:03:05.577966  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:05.578704  9519 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:03:05.532524  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:05.579944  9448 raft_consensus.cc:2410] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:05.031186 11731 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.539983  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:05.582238  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:05.528190 11738 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.525761 11777 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:05.589591  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:05.543967 11582 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.538795 11688 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.597692  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:05.601816  9375 raft_consensus.cc:2393] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 5: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:05.555817  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:05.603294  9520 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:03:05.550679 11677 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:05.586827  9418 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:05.544802 11783 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.561496 11621 raft_consensus.cc:740] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:05.564057 11782 raft_consensus.cc:740] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:03:05.603459  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:05.572019 11736 consensus_meta.cc:287] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 1.126s	user 0.010s	sys 0.001s
I20260709 13:03:05.558122 11785 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.605338 11779 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:05.557768 11581 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.586076 11704 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.564522 11604 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.601162 11688 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:05.611105  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 509113us
I20260709 13:03:05.564298  9370 rpcz_store.cc:276] 0709 13:03:04.488872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.692615 (+203743us) service_pool.cc:224] Handling call
0709 13:03:04.692894 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.693188 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:03:05.029826 (+336638us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.529317 (+499491us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:05.529378 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:05.529426 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.529496 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.529635 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40683,"prepare.queue_time_us":158779,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"raft.queue_time_us":358,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5997,"thread_start_us":765631,"threads_started":2}
I20260709 13:03:05.626327  9418 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:05.598289 11728 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:05.574276 11629 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.665879  9519 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:03:05.611305 11776 raft_consensus.cc:1064] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:03:05.562054 11642 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.604379  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:05.674425  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:05.636670 11621 consensus_queue.cc:260] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:05.637846 11801 log.cc:927] Time spent T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:03:05.639659 11677 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.646328 11731 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:05.628109 11806 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:05.696552 11806 raft_consensus.cc:697] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:05.697932 11677 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:05.697804 11806 consensus_queue.cc:237] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.699779 11581 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:05.628170 11761 consensus_queue.cc:237] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.688730  9449 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:05.701472 11785 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:05.702190 11735 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:05.702543  9449 raft_consensus.cc:1240] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:03:05.703545 11742 consensus_meta.cc:287] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 1.281s	user 0.013s	sys 0.000s
I20260709 13:03:05.703940 11742 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.703893  9449 raft_consensus.cc:1240] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:03:05.706362 11742 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:05.707667  9448 raft_consensus.cc:1240] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:03:05.654767 11783 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:05.636749 11789 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:05.623404 11782 consensus_queue.cc:260] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.628106 11736 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.709507  9448 raft_consensus.cc:1240] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:03:05.711256 11736 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:05.710803 11743 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.597188 11777 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:05.714696 11777 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:05.663626 11704 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:05.664284 11582 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:05.663740 11728 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:05.712306  9450 raft_consensus.cc:1240] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:05.717685  9371 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52548 (request call id 1187) took 2696 ms (client timeout 2191 ms). Trace:
I20260709 13:03:05.648692 11746 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:05.718137  9371 rpcz_store.cc:269] 0709 13:03:03.021830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.021963 (+   133us) service_pool.cc:224] Handling call
0709 13:03:03.846016 (+824053us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b5800000f98. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b5300a0 00007fb58b52f984 00007fb584aaa6d4 00007fb584aaa662
0709 13:03:05.717490 (+1871474us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b5400046ad4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:05.717602 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":647594112}
I20260709 13:03:05.719302 11692 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:05.720228 11746 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:05.720544 11617 raft_consensus.cc:3055] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:05.720949 11617 raft_consensus.cc:740] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:05.721738 11617 consensus_queue.cc:260] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.722857 11617 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:05.723026 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:05.723701 10069 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
W20260709 13:03:05.677559 11776 raft_consensus.cc:1068] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526: Unable to promote non-voter b0812463215649c3b011d36e2f0400c9: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:05.725477 11762 raft_consensus.cc:3055] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:05.725957 11762 raft_consensus.cc:740] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:05.726882 11629 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:05.726850 11762 consensus_queue.cc:260] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.727785 11627 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:05.728324 11762 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:05.723050 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:05.729139 10070 raft_consensus.cc:1240] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:03:05.730250  9447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1736) took 1774 ms. Trace:
I20260709 13:03:05.735843 10067 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
W20260709 13:03:05.671651  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.678462  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:05.728487  9342 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:05.737421  9520 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:05.683799 11598 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:05.684103 11655 consensus_meta.cc:287] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.697s	user 0.000s	sys 0.009s
W20260709 13:03:05.690311  9443 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51016 (request call id 1076) took 2049 ms (client timeout 1878 ms). Trace:
I20260709 13:03:05.739974 11655 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 8. Current term is 9.
W20260709 13:03:05.740067  9443 rpcz_store.cc:269] 0709 13:03:03.644316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.657417 (+ 13101us) service_pool.cc:224] Handling call
0709 13:03:05.690104 (+2032687us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001f9ad4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:05.690232 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2507059968}
W20260709 13:03:05.741734 11774 consensus_meta.cc:287] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.704s	user 0.007s	sys 0.003s
I20260709 13:03:05.742168 11774 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.742624  9523 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:03:05.679510 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 51874.5us
I20260709 13:03:05.691682  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:05.693699 11604 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:05.675084 11763 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:05.748945 11763 raft_consensus.cc:697] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:05.740159 11700 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:05.750015 11763 consensus_queue.cc:237] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.752556 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
W20260709 13:03:05.695690 11638 consensus_meta.cc:287] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.681s	user 0.009s	sys 0.000s
W20260709 13:03:05.695946 11760 consensus_meta.cc:287] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 1.195s	user 0.012s	sys 0.000s
I20260709 13:03:05.709434 11782 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:05.595129 11738 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.707577  9449 raft_consensus.cc:1240] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:03:05.784317  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.785072  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:05.718209 11728 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:05.786753  9524 raft_consensus.cc:2410] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:03:05.670823  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 44587.8us
I20260709 13:03:05.737308  9491 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:05.730648  9447 rpcz_store.cc:276] 0709 13:03:03.955438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.425159 (+469721us) service_pool.cc:224] Handling call
0709 13:03:04.425617 (+   458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.447789 (+ 22172us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:03:04.504839 (+ 57050us) log.cc:844] Serialized 14 byte log entry
0709 13:03:04.593964 (+ 89125us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:04.594028 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:04.594076 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.204612 (+610536us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b18000330a0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58347d3f3 00007fb58347f7c1 00007fb58347f779 00007fb58347f709 00007fb58347f6d1 00007fb58347e9cd 000000000038f354 000000000038f199 00007fb58346083a
0709 13:03:05.536549 (+331937us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b18000330a0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58347d3f3 00007fb58347f7c1 00007fb58347f779 00007fb58347f709 00007fb58347f6d1 00007fb58347e9cd 000000000038f354 000000000038f199 00007fb58346083a
0709 13:03:05.730017 (+193468us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b540027f954. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:05.730069 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.730191 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18239,"prepare.queue_time_us":132513,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":20434,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":5490,"spinlock_wait_cycles":99463424,"thread_start_us":104638,"threads_started":2,"wal-append.queue_time_us":99556}
I20260709 13:03:05.738423  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:05.788681  9520 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:05.690629 11642 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:05.795192  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:05.796932  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:05.746877  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:05.768416  9526 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:05.769997  9445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1722) took 2085 ms. Trace:
I20260709 13:03:05.799337  9445 rpcz_store.cc:276] 0709 13:03:03.684418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.747888 (+ 63470us) service_pool.cc:224] Handling call
0709 13:03:03.748205 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.273774 (+525569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.769743 (+1495969us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b5400114254. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:05.769939 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1185715584}
I20260709 13:03:05.768947  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:05.773167  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:05.805474  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:05.805933  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:05.807652 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 61355.3us
I20260709 13:03:05.758821 11582 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:05.794421  9490 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:05.794582  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:05.791581  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:05.809715  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 72480.6us
W20260709 13:03:05.815172  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.815317  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:05.816018  9521 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:03:05.811050  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:05.820273  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:05.820447  9445 raft_consensus.cc:1240] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:05.822065  9368 raft_consensus.cc:1275] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:05.777412 11785 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:05.831369  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:05.832422  9418 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:05.833163  9523 raft_consensus.cc:2955] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:05.834511  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:05.836727  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:05.837668  9449 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:05.839282  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:05.839782  9449 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:05.806445 11776 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:05.842099  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:05.842835  9521 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:03:05.812572 11655 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:05.851425  9449 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:03:05.817379 11629 raft_consensus.cc:2804] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:05.856995  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:05.784495 11760 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:05.812819 11582 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:05.845456 10025 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:05.823282 11638 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:05.816759 11743 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:05.858867  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:05.862874  9445 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:05.838145 11746 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:05.841692 11627 consensus_queue.cc:1059] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:03:05.870146  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:05.874684  9418 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:05.844682 11599 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:05.844882 11731 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:05.844918 11780 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:05.876672 10759 consensus_queue.cc:1059] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:05.857568 11778 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.904906 11778 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.906014  9526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46902 (request call id 1218) took 1161 ms. Trace:
I20260709 13:03:05.906438  9526 rpcz_store.cc:276] 0709 13:03:04.744869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.745076 (+   207us) service_pool.cc:224] Handling call
0709 13:03:05.905829 (+1160753us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b5400240754. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:05.905954 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1963078528}
I20260709 13:03:05.907425 11778 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:05.907593  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:05.877820  9448 raft_consensus.cc:2393] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 5: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:05.908267  9526 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:05.908859  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:05.909461  9448 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:05.865432 11655 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:05.878440  9418 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:05.860843 11735 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.911721 11655 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:05.912055 11780 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:05.911916 11735 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:05.914609 11738 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:05.873234 11582 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:05.930070  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:05.930923  9521 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:05.881376 11494 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:05.882299 11789 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:05.882810 11599 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.892824 11746 raft_consensus.cc:697] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:05.941864 11599 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:05.886746 11777 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:05.943068 11778 raft_consensus.cc:3055] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:05.887075  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:05.943589 11638 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:05.943786 11630 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:05.944909  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:05.891947 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 46549.5us
I20260709 13:03:05.946002 10025 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:05.946348 11735 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:05.946805 11563 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:05.947866 11743 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:05.950268  9450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1755) took 1305 ms. Trace:
I20260709 13:03:05.950753  9450 rpcz_store.cc:276] 0709 13:03:04.644434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.495206 (+850772us) service_pool.cc:224] Handling call
0709 13:03:05.495526 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.716980 (+221454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.949957 (+232977us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b540012be54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:05.950196 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":497915776}
I20260709 13:03:05.887671 11774 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:05.934286 11810 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:03:05.942751 11777 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:05.893289  9451 raft_consensus.cc:1240] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:05.955617 11777 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:05.900285 11815 log.cc:927] Time spent T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:03:05.864223 11677 consensus_queue.cc:1059] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:03:05.956530  9525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1454) took 1043 ms. Trace:
I20260709 13:03:05.838846 11730 consensus_queue.cc:1059] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:03:05.956763 11677 raft_consensus.cc:3055] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:05.957270 11677 raft_consensus.cc:740] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:05.957370 11730 raft_consensus.cc:3055] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:05.957859 11730 raft_consensus.cc:740] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:05.912599 11780 raft_consensus.cc:697] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:05.958206 11677 consensus_queue.cc:260] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.901831 11728 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:05.958758 11730 consensus_queue.cc:260] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.959017 11780 consensus_queue.cc:237] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.960126 11730 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:05.905407 10759 raft_consensus.cc:3055] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:05.876788  9341 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:05.960983 10759 raft_consensus.cc:740] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:05.961738  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 85031.7us
I20260709 13:03:05.956951  9525 rpcz_store.cc:276] 0709 13:03:04.913407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.913977 (+   570us) service_pool.cc:224] Handling call
0709 13:03:05.012507 (+ 98530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.037815 (+ 25308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.956321 (+918506us) spinlock_profiling.cc:243] Waited 98.2 ms on lock 0x7b540042bb50. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865698ad 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:05.956465 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225831168}
I20260709 13:03:05.924382  9418 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:05.929514  9448 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:05.965873  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:05.967756  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:05.926364  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:05.837777 11785 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:05.857149 11642 consensus_queue.cc:1059] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:03:05.942713 11746 consensus_queue.cc:237] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:05.942972 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:05.873785 11806 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:05.955952  9451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45366 (request call id 283) took 1695 ms. Trace:
W20260709 13:03:05.983515  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.981542 10759 consensus_queue.cc:260] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:05.892074  9262 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7260766fbe5c43b1aab09346a89d9ac6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 925acbe78db14db3b9e4cfc857717947 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:05.857710 11776 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:05.968711  9448 raft_consensus.cc:2393] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 8: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:05.932893  9446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1752) took 1289 ms. Trace:
I20260709 13:03:05.968992  9526 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:05.983095  9518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1468) took 1011 ms. Trace:
I20260709 13:03:05.992128 11642 raft_consensus.cc:3055] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:05.992642 11642 raft_consensus.cc:740] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:05.995963 10759 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:05.998267 11782 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.998883 11782 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.001287 11782 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:06.001405 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:06.002132 10065 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:06.005080 11785 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:05.983215 11738 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:06.009600 11738 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.012068 11738 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:05.979449 11755 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:06.014061 11755 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:06.014642 11755 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:06.018738 11776 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:05.972096 11655 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:06.021901 11655 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:05.931298 11731 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:05.981112 11630 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.989111  9446 rpcz_store.cc:276] 0709 13:03:04.643657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.645172 (+  1515us) service_pool.cc:224] Handling call
0709 13:03:04.645443 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.913047 (+267604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.932527 (+1019480us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54000d7d54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:05.932805 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240979840}
I20260709 13:03:05.941883 11760 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:05.960695 11651 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:05.897789  9343 connection.cc:256] RPC call timeout handler was delayed by -1.0462709429999677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
I20260709 13:03:05.977581  9447 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:03:05.977445 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:05.979959  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:05.984659  9262 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 92664.5us
I20260709 13:03:05.940387 11789 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:05.983675  9451 rpcz_store.cc:276] 0709 13:03:04.260166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.563283 (+303117us) service_pool.cc:224] Handling call
0709 13:03:04.563590 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.954920 (+1391330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.955737 (+   817us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54001fa4d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:05.955898 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3057497856}
I20260709 13:03:06.031747  9446 raft_consensus.cc:1240] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:05.990554  9518 rpcz_store.cc:276] 0709 13:03:04.971653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.753108 (+781455us) service_pool.cc:224] Handling call
0709 13:03:05.753513 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:05.765787 (+ 12274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:05.765818 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:05.772323 (+  6505us) log.cc:844] Serialized 26 byte log entry
0709 13:03:05.813118 (+ 40795us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:05.865985 (+ 52867us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.982791 (+116806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.982867 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:05.982909 (+    42us) raft_consensus.cc:1685] finished
0709 13:03:05.982918 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.983016 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51626,"prepare.queue_time_us":122336,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":14728,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":49155,"thread_start_us":181300,"threads_started":3,"wal-append.queue_time_us":95556}
I20260709 13:03:06.051198  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:05.970345  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 46084.8us
I20260709 13:03:06.052158  9451 raft_consensus.cc:2393] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 6: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:03:06.044068  9521 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:03:06.055063  9448 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:06.055716  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:06.056342  9518 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:05.980672 11743 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:05.943589 11778 raft_consensus.cc:740] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:06.085466  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:05.984189 11677 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:06.082695  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:06.096889 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:06.099954 10067 raft_consensus.cc:2393] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 6: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:03:06.100267  9519 raft_consensus.cc:3060] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:06.024967 11655 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:06.087276  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:06.104336  9518 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:06.086680  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:06.090574  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:06.105238  9451 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:06.106269  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:06.100013 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:06.028339 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:06.109215  9418 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:06.084076  9343 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:06.053511 11731 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:06.056792  9448 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:06.026504 11630 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:06.293922  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.109551  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:06.078606 11648 raft_consensus.cc:3055] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:03:06.300150  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 191021us
W20260709 13:03:06.301375  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 217408us
I20260709 13:03:06.025936 11642 consensus_queue.cc:260] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.333350 11627 consensus_queue.cc:1059] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:06.333849  9418 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:06.085260 11599 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.099100 11743 raft_consensus.cc:697] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:06.294792 11738 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:06.338542 11738 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.339416 11743 consensus_queue.cc:237] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.340869 11810 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:06.341524 11810 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:06.341821 11738 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:06.342988 11789 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:06.342886 11582 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:06.093565 11610 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.250s
I20260709 13:03:06.344442  9418 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:06.093451 11763 consensus_queue.cc:1048] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.252s
I20260709 13:03:06.302040 11776 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.346278 11776 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.348625 11776 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:06.350577 11582 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:06.352065  9343 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:06.353164 11763 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:06.353703 11763 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:06.294309 11782 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:06.327119 11617 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:06.327426 11731 consensus_queue.cc:1059] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:06.329625 11806 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:03:06.233330 11762 consensus_meta.cc:287] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.006s
W20260709 13:03:06.342358 11700 consensus_meta.cc:287] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.592s	user 0.006s	sys 0.004s
I20260709 13:03:06.294581 11785 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:06.366334 11785 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.341935 11810 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:06.301924  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.192807 11778 consensus_queue.cc:260] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.300263  9451 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:03:06.355037  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:06.171504  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:06.373497  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:06.373657  9443 raft_consensus.cc:2376] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7. Re-sending same reply.
I20260709 13:03:06.374203  9451 raft_consensus.cc:2368] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6.
I20260709 13:03:06.374645  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:06.374958  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:06.371176 11779 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.375802  9451 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:03:06.376138 11779 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.381572  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:06.098372 11811 consensus_queue.cc:1059] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.266s
I20260709 13:03:06.382771  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:06.383733  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:06.107847 11629 raft_consensus.cc:697] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 4 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:06.112352  9526 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:06.357741  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:06.385207  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:06.385866  9448 raft_consensus.cc:2393] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 3: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:06.386108  9443 raft_consensus.cc:2410] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:06.387043  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:06.387210  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:06.387778  9448 raft_consensus.cc:2393] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 5: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:06.358724  9518 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:03:06.360121  9519 raft_consensus.cc:2468] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
W20260709 13:03:06.190325 11816 log.cc:927] Time spent T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
W20260709 13:03:06.180351 11733 consensus_meta.cc:287] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.674s	user 0.006s	sys 0.005s
I20260709 13:03:06.391345 11629 consensus_queue.cc:237] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:06.392436 11785 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:06.392030 11733 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.394943 11733 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:06.337507 11599 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.397441 11599 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:06.399780  9523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1467) took 1451 ms. Trace:
I20260709 13:03:06.400413  9523 rpcz_store.cc:276] 0709 13:03:04.948277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.743483 (+795206us) service_pool.cc:224] Handling call
0709 13:03:05.743976 (+   493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:05.744314 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:05.744338 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:05.747745 (+  3407us) log.cc:844] Serialized 540 byte log entry
0709 13:03:05.832997 (+ 85252us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:05.852742 (+ 19745us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.862651 (+  9909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.862770 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:06.399581 (+536811us) raft_consensus.cc:1685] finished
0709 13:03:06.399605 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.399720 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12433,"raft.queue_time_us":9616,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":5832,"thread_start_us":84952,"threads_started":1,"wal-append.queue_time_us":130260}
I20260709 13:03:06.402113 11810 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.132752 11693 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:06.359685 11644 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:06.365526 11630 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:06.354115 11763 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:06.370398  9517 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:06.155661 11651 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:06.189394 11783 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.342128 11688 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:06.355536  9418 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:06.381508  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:06.415865  9451 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
W20260709 13:03:06.416070  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 60611.3us
I20260709 13:03:06.416612  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:06.416945  9418 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:06.192739  9520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1471) took 1207 ms. Trace:
I20260709 13:03:06.387838  9443 raft_consensus.cc:2393] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 4: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:06.388792  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:06.419308  9518 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:06.419840  9418 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:06.417695  9520 rpcz_store.cc:276] 0709 13:03:04.985445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.789597 (+804152us) service_pool.cc:224] Handling call
0709 13:03:05.790049 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:05.821474 (+ 31425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:05.821503 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:05.821955 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:03:05.962260 (+140305us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:05.984079 (+ 21819us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.997413 (+ 13334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.997679 (+   266us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:06.192427 (+194748us) raft_consensus.cc:1685] finished
0709 13:03:06.192456 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.192679 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43993,"prepare.queue_time_us":21847,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":35103,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":4181,"thread_start_us":98161,"threads_started":1,"wal-append.queue_time_us":261590}
W20260709 13:03:06.422823  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.423866  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:06.389537  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:06.357798  9343 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:06.402683  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:06.406989  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:06.407649 11755 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.408674  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:06.362625  9446 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:03:06.362934 11782 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.414556 11693 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:06.411468  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:06.417291  9451 raft_consensus.cc:2393] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 5: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:06.355799 11648 raft_consensus.cc:740] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:06.423890 11826 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:06.424607  9520 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:06.430382  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:06.432418  9525 raft_consensus.cc:1240] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 3. Current term is 4. Ops: []
W20260709 13:03:06.429512  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 71782us
I20260709 13:03:06.464413  9448 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:06.465554  9343 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:06.431883  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:06.466895  9519 raft_consensus.cc:2410] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:03:06.467518  9343 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:06.426236  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:06.468642  9446 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:06.426522  9526 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
W20260709 13:03:06.469430  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 49666us
I20260709 13:03:06.425455  9523 raft_consensus.cc:2393] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 7: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:06.474460  9343 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:06.475044  9490 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:06.475939  9490 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:06.477244  9490 leader_election.cc:400] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6.
I20260709 13:03:06.424836  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:06.477794  9490 leader_election.cc:403] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:03:06.478924  9518 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:03:06.466922  9447 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:06.481199  9446 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:06.481375  9343 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:06.482712  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:06.439770 11667 raft_consensus.cc:1064] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:03:06.506366  9343 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:06.508368  9490 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:06.505467  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:06.510069  9518 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:06.510208  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:06.511132  9520 raft_consensus.cc:2393] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 5: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:06.512177  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:06.513232  9448 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:06.513370  9443 raft_consensus.cc:2393] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 7: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:06.429672 11644 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:06.515537  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:06.525750  9447 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:06.515777  9490 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:06.514654  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:06.527190  9490 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:06.529189  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52502 (request call id 285) took 1517 ms. Trace:
I20260709 13:03:06.529618  9519 rpcz_store.cc:276] 0709 13:03:05.011515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.513435 (+1501920us) service_pool.cc:224] Handling call
0709 13:03:06.528631 (+ 15196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.528836 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:06.528864 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:06.528907 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:06.528954 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.529022 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.529129 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:06.483858 11736 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:06.523597  9518 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:06.427718 11782 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:06.429489 11693 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:06.528160 11638 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:06.568835 11638 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:06.569283 11806 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.569541 11638 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:06.569844 11806 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.572072 11806 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:06.573103 10027 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:06.429029 11755 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:06.429958 11688 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:06.436590 11677 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:06.534871 11810 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:06.484313 11733 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:06.456446 11763 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.536592  9524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46894 (request call id 1456) took 1621 ms. Trace:
I20260709 13:03:06.579021  9524 rpcz_store.cc:276] 0709 13:03:04.915223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.589309 (+674086us) service_pool.cc:224] Handling call
0709 13:03:06.536340 (+947031us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54000a6754. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:06.536507 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":451068288}
W20260709 13:03:06.514883 11667 raft_consensus.cc:1068] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526: Unable to promote non-voter b0812463215649c3b011d36e2f0400c9: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:06.425130 11783 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:06.540479 11642 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:06.531564 11649 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:06.543537 11790 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:06.550421  9517 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46902 (request call id 1226) took 1656 ms (client timeout 2027 ms). Trace:
I20260709 13:03:06.550199 11648 consensus_queue.cc:260] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.584839  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:06.551913 11730 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:06.505522 11599 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:06.511931 11808 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:06.591249  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:06.591368 11648 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:06.591907 11808 raft_consensus.cc:697] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:06.592432  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:06.592792 11808 consensus_queue.cc:237] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.594977  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:06.595458  9522 raft_consensus.cc:2410] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:03:06.595592  9368 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:03:06.584496 11649 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.597815 11649 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:06.598182  9372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:52636 (request call id 16) took 2512 ms. Trace:
I20260709 13:03:06.598444 11763 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:06.598992  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:06.599371  9375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52548 (request call id 1206) took 2110 ms (client timeout 2170 ms). Trace:
W20260709 13:03:06.599715  9375 rpcz_store.cc:269] 0709 13:03:04.489441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.615145 (+125704us) service_pool.cc:224] Handling call
0709 13:03:06.599196 (+1984051us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b5400089b54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:06.599320 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2173229824}
I20260709 13:03:06.600366  9525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52502 (request call id 284) took 1589 ms. Trace:
I20260709 13:03:06.600766  9525 rpcz_store.cc:276] 0709 13:03:05.011153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.976908 (+965755us) service_pool.cc:224] Handling call
0709 13:03:06.432180 (+455272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.464878 (+ 32698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.600173 (+135295us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b54001554d0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865698ad 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:06.600305 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1046137600}
I20260709 13:03:06.602164 11730 raft_consensus.cc:697] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:06.602350  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:06.603241 11730 consensus_queue.cc:237] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.598659  9372 rpcz_store.cc:276] 0709 13:03:04.085847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.086014 (+   167us) service_pool.cc:224] Handling call
0709 13:03:06.598000 (+2511986us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b540021d754. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb586564853 00007fb58b53260a 00007fb584ab87d4 00007fb584ab8762 00007fb584ab8691 00007fb584ab860c 00007fb584ab78c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:06.598098 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3310115584}
I20260709 13:03:06.607173 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:06.600953 11728 raft_consensus.cc:3055] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:06.608063 11728 raft_consensus.cc:740] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:06.587626 11790 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.609659  9521 raft_consensus.cc:1275] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:03:06.610044  9521 pending_rounds.cc:85] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 3
I20260709 13:03:06.609860  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:06.578650 11677 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:06.580034 11733 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:06.610718  9372 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:03:06.610934 11733 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:06.610747 11677 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:06.612849  9375 raft_consensus.cc:1240] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:06.615231  9418 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:06.615597  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.616268  9491 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:06.617839 11651 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:06.618345 11651 raft_consensus.cc:697] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:06.619200 11651 consensus_queue.cc:237] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.621359 11782 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.621850 11785 raft_consensus.cc:2749] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:06.622759  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:06.623072 11789 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:06.623413  9520 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:06.623662 11789 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.617276  9418 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:03:06.625694 11805 consensus_queue.cc:1059] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:06.621869 11782 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.626797 11805 raft_consensus.cc:3055] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:06.627243 11805 raft_consensus.cc:740] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:06.610358  9521 pending_rounds.cc:107] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:03:06.628468  9521 raft_consensus.cc:2889] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:06.628078 11805 consensus_queue.cc:260] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.629460  9444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45366 (request call id 284) took 2356 ms. Trace:
I20260709 13:03:06.629755  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:06.630403  9521 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:06.629873  9444 rpcz_store.cc:276] 0709 13:03:04.273368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.592681 (+319313us) service_pool.cc:224] Handling call
0709 13:03:04.593038 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.542842 (+949804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.629209 (+1086367us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b5400270954. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:06.629391 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2117632384}
I20260709 13:03:06.631268  9451 raft_consensus.cc:1240] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:03:06.630291  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:06.634119  9524 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:06.634953  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:06.635805  9526 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:03:06.635972 11810 raft_consensus.cc:2804] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:06.636495 11810 raft_consensus.cc:697] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:06.597849  9522 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:03:06.634967 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:06.610265 11790 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:06.644775 11810 consensus_queue.cc:237] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:06.637329 11728 consensus_queue.cc:260] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:06.649545  9372 raft_consensus.cc:1275] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:03:06.650099  9372 pending_rounds.cc:85] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947: Aborting all ops after (but not including) 3
I20260709 13:03:06.650410  9372 pending_rounds.cc:107] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:03:06.650738  9372 raft_consensus.cc:2889] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:06.639312  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:06.653825  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.636716  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:06.637830  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:06.656138  9418 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:06.656138  9491 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:06.644799  9522 pending_rounds.cc:85] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 3
I20260709 13:03:06.661121  9522 pending_rounds.cc:107] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:03:06.661403  9522 raft_consensus.cc:2889] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:06.555549  9518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1477) took 1537 ms. Trace:
I20260709 13:03:06.508489 11762 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:06.512826 11629 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:06.484340 11630 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:06.518085  9343 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:03:06.678208  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 160176us
I20260709 13:03:06.678309  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:06.678901  9418 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:06.679286  9343 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:06.679811  9418 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:06.563536  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52502 (request call id 286) took 1041 ms. Trace:
I20260709 13:03:06.681392  9519 rpcz_store.cc:276] 0709 13:03:05.521953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.562421 (+1040468us) service_pool.cc:224] Handling call
0709 13:03:06.562834 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.563052 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:06.563095 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:06.563174 (+    79us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:06.563225 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.563305 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.563456 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:06.564376 11617 raft_consensus.cc:3055] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:06.565260 11586 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.557281 11700 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:03:06.559199 11746 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.017s	sys 0.023s
I20260709 13:03:06.558583 11774 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6.
I20260709 13:03:06.711159  9519 raft_consensus.cc:1240] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:06.471657 11826 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:06.584504  9517 rpcz_store.cc:269] 0709 13:03:04.893624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.893764 (+   140us) service_pool.cc:224] Handling call
0709 13:03:06.109401 (+1215637us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b5800188498. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b5300a0 00007fb58b52f984 00007fb584aaa6d4 00007fb584aaa662
0709 13:03:06.550228 (+440827us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b5400314cd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:06.550357 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122091008}
I20260709 13:03:06.587031  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:06.714413  9376 raft_consensus.cc:2410] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:03:06.577443 11736 raft_consensus.cc:697] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:06.580192 11811 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:06.669199  9518 rpcz_store.cc:276] 0709 13:03:05.018084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.554594 (+1536510us) service_pool.cc:224] Handling call
0709 13:03:06.555017 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.555227 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:06.555252 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:06.555297 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:06.555333 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.555386 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.555490 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:06.670393  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:06.682614  9418 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:06.684844 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 212990us
I20260709 13:03:06.687155  9521 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
W20260709 13:03:06.741114  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 87742.8us
I20260709 13:03:06.747298  9519 raft_consensus.cc:1240] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
W20260709 13:03:06.749622  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 67063.6us
I20260709 13:03:06.755551  9341 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:06.703581  9524 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:06.759562  9522 raft_consensus.cc:1240] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:06.697667 11755 raft_consensus.cc:2804] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:06.689687  9343 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:06.693878  9377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f322b7281d554c459bb8109ed249047b"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:06.707314 11688 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:06.766139  9377 raft_consensus.cc:606] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:06.701545  9523 raft_consensus.cc:2410] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:03:06.655390 11778 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:06.706025 11629 raft_consensus.cc:697] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:06.714571  9517 raft_consensus.cc:1240] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:06.672528 11728 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:06.717132 11789 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:06.677345 11627 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:06.731554 11780 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.690757 11617 raft_consensus.cc:740] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:06.709074 11586 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.697503 11667 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:06.763141  9522 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:06.687546  9520 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:06.717541 11621 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:06.716763 11581 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:03:06.787389  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:06.705638 11746 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.017s	sys 0.024s
I20260709 13:03:06.777592  9519 raft_consensus.cc:1275] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:03:06.808218 11755 raft_consensus.cc:697] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:06.840808  9519 pending_rounds.cc:85] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 2
I20260709 13:03:06.841135  9519 pending_rounds.cc:107] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:03:06.698879 11763 consensus_queue.cc:1048] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 13:03:06.813398  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:06.697763 11790 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:06.762012 11776 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:06.817498  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 127880us
I20260709 13:03:06.847731  9343 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:06.849269  9343 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:06.804003 11580 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:06.705201  9271 catalog_manager.cc:5697] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 2 to 3, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 3 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:03:06.859155  9518 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:03:06.859550  9518 pending_rounds.cc:85] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 4
I20260709 13:03:06.859826  9518 pending_rounds.cc:107] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:03:06.815410  9341 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:06.860061  9518 raft_consensus.cc:2889] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:06.804375 11785 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:06.835098  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 157606us
I20260709 13:03:06.809741 11599 raft_consensus.cc:2749] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:06.705507 11805 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:06.775853 11688 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.705474 11700 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:06.841429  9519 raft_consensus.cc:2889] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:06.778024 11648 consensus_queue.cc:1059] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:03:06.817672 11760 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:06.853394 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 99532.8us
I20260709 13:03:06.854614  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:06.858191  9343 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:06.834811 11644 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:06.809839 11604 consensus_queue.cc:1059] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:03:06.838296 11779 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:06.840255 11581 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:06.858961 11630 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:03:06.871944  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 56666.6us
I20260709 13:03:06.817149 11780 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.898950 10759 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:06.902742 10759 consensus_queue.cc:1059] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:06.864758 11761 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:06.865851 11580 raft_consensus.cc:697] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:06.922859  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.846547 11649 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:06.947309  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 50476.7us
I20260709 13:03:06.872524 11700 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:06.947997  9274 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43244 (request call id 184) took 10907 ms. Trace:
I20260709 13:03:06.866956 11790 raft_consensus.cc:697] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:06.898106 11581 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:06.987960 11783 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:06.870731 11688 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:06.978219 11648 raft_consensus.cc:3055] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:06.981803 11580 consensus_queue.cc:237] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.948690 11599 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:03:06.997022  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 44646.7us
I20260709 13:03:07.013949  9341 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:07.014117 10759 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:07.015745 10759 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:03:06.997717 11834 log.cc:927] Time spent T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.057s	user 0.002s	sys 0.001s
I20260709 13:03:06.867185 11629 consensus_queue.cc:237] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.852730 11736 consensus_queue.cc:237] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.900655 11630 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:06.974077 11622 raft_consensus.cc:3055] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:06.899204 11742 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:06.868013 11785 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:07.010079 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 193422us
I20260709 13:03:07.016103  9341 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:07.046397 10759 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:07.046442  9341 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:07.016762  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 115288us
I20260709 13:03:07.031107 11617 consensus_queue.cc:260] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:07.008653  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.900342 11760 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.952121  9274 rpcz_store.cc:276] 0709 13:02:56.040785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.040942 (+   157us) service_pool.cc:224] Handling call
0709 13:03:06.947925 (+10906983us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:01.609714 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:01.610305 (+   591us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:01.610343 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:03:01.610363 (+    20us) tablet.cc:662] Decoding operations
0709 13:03:01.617596 (+  7233us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:01.617663 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:01.617692 (+    29us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:03:01.626195 (+  8503us) tablet.cc:701] Row locks acquired
0709 13:03:01.626213 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:03:01.626364 (+   151us) write_op.cc:270] Start()
0709 13:03:01.657432 (+ 31068us) write_op.cc:276] Timestamp: P: 1783602181626322 usec, L: 0
0709 13:03:01.657465 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:03:01.913516 (+256051us) log.cc:844] Serialized 8483 byte log entry
0709 13:03:01.994987 (+ 81471us) op_driver.cc:464] REPLICATION: finished
0709 13:03:02.188421 (+193434us) write_op.cc:301] APPLY: starting
0709 13:03:02.193740 (+  5319us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:02.321690 (+127950us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:02.345653 (+ 23963us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:02.419609 (+ 73956us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:02.419937 (+   328us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 13:03:02.419988 (+    51us) write_op.cc:312] APPLY: finished
0709 13:03:02.420403 (+   415us) log.cc:844] Serialized 151 byte log entry
0709 13:03:02.420579 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:02.420776 (+   197us) write_op.cc:454] Released schema lock
0709 13:03:02.420842 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:02.493823 (+ 72981us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:02.495219 (+  1396us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":817728,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":154883,"apply.run_cpu_time_us":7163,"apply.run_wall_time_us":292210,"num_ops":22,"prepare.queue_time_us":204084,"prepare.run_cpu_time_us":21309,"prepare.run_wall_time_us":370176,"raft.queue_time_us":13522,"raft.run_cpu_time_us":70438,"raft.run_wall_time_us":112398,"replication_time_us":333480,"thread_start_us":296028,"threads_started":4,"wal-append.queue_time_us":55558,"wal-append.run_cpu_time_us":15593,"wal-append.run_wall_time_us":1457185}]]}
I20260709 13:03:06.912714 11762 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 13:03:07.048128 10759 raft_consensus.cc:697] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:07.013087 11648 raft_consensus.cc:740] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:07.051064  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 298419us
I20260709 13:03:06.916512 11836 consensus_queue.cc:1059] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.138s
I20260709 13:03:06.975015 11677 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:06.974529 11693 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.037402 11630 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:07.062486  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:07.108330 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 57392us
I20260709 13:03:07.037763 11622 raft_consensus.cc:740] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:07.106824  9522 raft_consensus.cc:1275] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:07.104746 10759 consensus_queue.cc:237] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:07.106420 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 56322.3us
I20260709 13:03:07.050002 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:03:07.118150  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 70058.6us
I20260709 13:03:07.106309 11746 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:03:07.120271 10065 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:03:07.054373 11586 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:07.125434 11604 consensus_queue.cc:1059] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:07.126796 11604 consensus_queue.cc:1059] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:07.129868 11622 consensus_queue.cc:260] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.130461 11582 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:07.131510 11622 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:07.039526 11638 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.132314 11582 consensus_queue.cc:1048] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:07.133607 11644 raft_consensus.cc:3055] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:07.134080 11644 raft_consensus.cc:740] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:07.134693 11638 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:07.134263 11648 consensus_queue.cc:260] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.134985 11644 consensus_queue.cc:260] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.135809 11648 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:07.136224 11677 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:07.137099  9448 raft_consensus.cc:1240] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:07.010517 11755 consensus_queue.cc:237] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.052909 11647 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:03:07.136632 11604 consensus_queue.cc:1175] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6d50f1c263264b21919230bee398022b" responder_term: 3 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:07.165654 11746 consensus_queue.cc:1059] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:07.173674  9525 raft_consensus.cc:2410] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:03:07.173704 11780 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:07.174983 11693 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:07.175177 11733 consensus_meta.cc:287] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.003s
I20260709 13:03:07.056066 11846 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.112s
I20260709 13:03:07.142473 11644 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:07.176378 11785 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:07.053192 11826 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:07.165179  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 59200.3us
I20260709 13:03:07.136688 11617 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:07.215056 11839 log.cc:927] Time spent T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:03:07.217273 11782 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:07.189895  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 69909.2us
W20260709 13:03:07.195276 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 80454.4us
W20260709 13:03:07.199285  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 150556us
I20260709 13:03:07.184329 11630 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.198489 11647 raft_consensus.cc:697] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:07.211437 11581 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.225994 11649 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:07.226302 11760 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:07.227032  9418 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:07.202076 11733 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.238021 11733 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:07.238372 11746 consensus_queue.cc:1048] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:07.240275 11746 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:07.230155  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:07.230115 11853 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:07.231185  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:07.254323  9525 raft_consensus.cc:3055] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:07.049642 11790 consensus_queue.cc:237] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.254746  9525 raft_consensus.cc:740] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:07.233641  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:07.234277  9377 raft_consensus.cc:1240] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:03:07.258548  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:07.258735  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:07.234277  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:07.259541  9370 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:07.260039  9371 raft_consensus.cc:2368] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8.
I20260709 13:03:07.260860  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:07.234633  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:07.234891  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:07.263441  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:07.238801  9373 raft_consensus.cc:1240] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
W20260709 13:03:07.206636 11730 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.018s	sys 0.035s
I20260709 13:03:07.265915  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:07.247460 10069 raft_consensus.cc:1275] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:07.266567  9520 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:07.266687  9519 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:03:07.250370  9524 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:03:07.269943  9524 pending_rounds.cc:85] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 3
I20260709 13:03:07.270092  9523 raft_consensus.cc:1275] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:07.270030  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:07.271075  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:07.271904  9519 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:07.273288  9524 pending_rounds.cc:107] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:03:07.273733  9524 raft_consensus.cc:2889] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:07.275532  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:07.277544  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:07.278026  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:07.279359  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:07.255538  9525 consensus_queue.cc:260] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.280473  9525 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:07.280344  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:07.281361  9520 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:07.283818  9523 raft_consensus.cc:1275] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:03:07.288272  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 67060.7us
I20260709 13:03:07.289790  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:07.290244  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:07.290813  9517 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:03:07.288888  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:07.294323  9448 raft_consensus.cc:1240] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
W20260709 13:03:07.295154  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.298269  9448 raft_consensus.cc:1240] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:07.298316  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:07.297715  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:07.302152  9450 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:07.303064  9519 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:07.286567 11779 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:07.307765 11621 consensus_queue.cc:1048] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:07.315162  9450 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:07.316298  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:07.260341 11642 consensus_meta.cc:287] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.674s	user 0.013s	sys 0.000s
I20260709 13:03:07.308377 11779 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:07.317239  9368 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
W20260709 13:03:07.281920 11730 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.019s	sys 0.035s
I20260709 13:03:07.276028 11774 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.228847 11813 consensus_queue.cc:1059] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:03:07.305718 11761 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:07.324836  9370 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:03:07.331880  9521 raft_consensus.cc:1275] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:03:07.370469  9371 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:03:07.371065  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:07.372246  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:07.372757  9369 raft_consensus.cc:1275] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:03:07.378401  9369 pending_rounds.cc:85] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947: Aborting all ops after (but not including) 4
I20260709 13:03:07.378677  9369 pending_rounds.cc:107] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:03:07.378961  9369 raft_consensus.cc:2889] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:07.378089  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:07.381285  9521 pending_rounds.cc:85] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 3
I20260709 13:03:07.382838  9521 pending_rounds.cc:107] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:03:07.383744  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:07.384431  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:07.363061  9520 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:07.385572  9371 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:07.384030  9521 raft_consensus.cc:2889] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:07.388969 11855 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:07.378755 11778 consensus_meta.cc:287] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.000s
W20260709 13:03:07.414559  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:07.453471  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.381994 11647 consensus_queue.cc:237] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.325920 11746 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:07.468883 11742 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:07.466919  9525 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:03:07.473807  9370 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:07.475979  9526 raft_consensus.cc:2410] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:03:07.490286  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:07.462579 11728 consensus_meta.cc:287] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9: Time spent flushing consensus metadata: real 0.620s	user 0.011s	sys 0.000s
I20260709 13:03:07.465644  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:07.465487 11849 raft_consensus.cc:3055] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:07.492533  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:07.470041 11805 consensus_meta.cc:287] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.599s	user 0.012s	sys 0.000s
I20260709 13:03:07.375120 11774 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.528293  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:07.475479 11858 log.cc:927] Time spent T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.089s	user 0.004s	sys 0.004s
I20260709 13:03:07.472568 11826 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.524175  9341 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:07.519265  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.490271  9525 pending_rounds.cc:85] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 2
I20260709 13:03:07.537284  9525 pending_rounds.cc:107] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:03:07.537613  9525 raft_consensus.cc:2889] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:07.332401 11785 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.545394 11785 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.547968 11785 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:07.548449  9376 raft_consensus.cc:2410] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:07.504750 11610 consensus_queue.cc:1059] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:03:07.549763 11610 raft_consensus.cc:3055] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:07.550120 11610 raft_consensus.cc:740] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:07.551506  9522 raft_consensus.cc:1275] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:03:07.556001 11649 consensus_queue.cc:1059] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:07.551043 11610 consensus_queue.cc:260] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.559108  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:07.560286  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:07.525573  9370 raft_consensus.cc:2410] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:03:07.529740  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 265010us
I20260709 13:03:07.541373 11630 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:07.543560 11581 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:07.544389 11763 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:07.570326  9524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1494) took 1527 ms. Trace:
I20260709 13:03:07.578627  9524 rpcz_store.cc:276] 0709 13:03:06.043087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.764026 (+720939us) service_pool.cc:224] Handling call
0709 13:03:07.250035 (+486009us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:07.274366 (+ 24331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.570133 (+295767us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54003200d0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865698ad 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:07.570271 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1011618560}
I20260709 13:03:07.582250  9372 raft_consensus.cc:2393] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 5: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:07.483860 11700 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.494776 11746 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:07.576373  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:07.504525 11849 raft_consensus.cc:740] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:07.572435  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:07.556005 11846 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:07.475531 11855 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.592933  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:07.566414 11776 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.566406 11810 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.593575 11610 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:07.597206 11688 consensus_meta.cc:287] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.561s	user 0.012s	sys 0.000s
I20260709 13:03:07.621371  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:07.622716 11857 log.cc:927] Time spent T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 13:03:07.622782 11850 log.cc:927] Time spent T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:03:07.592732 11763 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.614804 11776 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.619343 11779 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:07.629747 11494 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.634465 11746 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:07.634961 10065 raft_consensus.cc:3055] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:07.613655 11810 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.638280 11849 consensus_queue.cc:260] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:07.642017  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.644284  9373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1242) took 1044 ms. Trace:
I20260709 13:03:07.644387 11774 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:07.648347  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:07.566717 11826 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.648730 11586 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.652078  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:07.653060 11846 raft_consensus.cc:697] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:07.674288  9370 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
W20260709 13:03:07.859467  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.777041  9374 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:07.861420 11586 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.862569  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:07.861224 10065 raft_consensus.cc:740] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:07.860435  9373 rpcz_store.cc:276] 0709 13:03:06.600177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.600823 (+   646us) service_pool.cc:224] Handling call
0709 13:03:06.601141 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:07.276383 (+675242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.643935 (+367552us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b54001e82d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:07.644197 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1466018688}
I20260709 13:03:07.869077  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:07.871199  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:07.873118  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.873631  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:07.875452  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:07.882853 11846 consensus_queue.cc:237] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.885192 10065 consensus_queue.cc:260] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:07.864847  9371 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:03:07.865500  9375 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:07.887497  9521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1487) took 1846 ms. Trace:
I20260709 13:03:07.893602  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:07.786808 11731 raft_consensus.cc:3055] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:08.030797  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:08.019263 10027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.886606 11810 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:08.015617 11760 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:07.888851  9377 raft_consensus.cc:1275] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:07.888295  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:08.102591 11779 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:08.039399 11629 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:08.047683  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.242434  9450 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:03:08.245968  9370 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:03:08.251891  9371 raft_consensus.cc:2410] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:03:08.259632  9445 raft_consensus.cc:2393] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 8: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:08.242049  9521 rpcz_store.cc:276] 0709 13:03:06.040825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.737288 (+696463us) service_pool.cc:224] Handling call
0709 13:03:06.737642 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:07.471819 (+734177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.887262 (+415443us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b54001b67d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:07.887435 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1365463808}
W20260709 13:03:08.262414  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.263909  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:08.271718  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:08.272318  9450 raft_consensus.cc:1240] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:08.274345  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:08.306890  9448 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:08.301766  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:08.306728  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:08.243468 11610 consensus_meta.cc:287] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.000s
I20260709 13:03:08.318251  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:08.281911  9445 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:08.246804 11746 raft_consensus.cc:1064] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:03:08.276763  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:08.326575  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:08.166395 11774 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:07.757215 11677 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.335047  9418 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:08.248992 10065 raft_consensus.cc:3060] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:08.235814 11785 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.316169 11651 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:08.360162  9371 raft_consensus.cc:1240] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:08.115968 11849 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:08.252395 11763 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:08.117270 11852 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.393290 11852 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:08.396222 11852 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:08.331111  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:08.396894  9376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52562 (request call id 1120) took 1084 ms. Trace:
I20260709 13:03:08.397433  9375 raft_consensus.cc:2393] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 7: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:08.397330  9376 rpcz_store.cc:276] 0709 13:03:07.313042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.316073 (+  3031us) service_pool.cc:224] Handling call
0709 13:03:08.396694 (+1080621us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54000613d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:08.396836 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":531768064}
I20260709 13:03:08.243590 11700 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:08.399684 11700 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:08.400338 11700 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:08.403061 11700 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:08.153873 11847 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:08.404021 11847 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:08.406407  9374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 1109) took 1160 ms. Trace:
I20260709 13:03:08.177759 11876 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:08.253690 11629 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:08.353807  9418 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:08.415812  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 62139.1us
I20260709 13:03:08.242674 11731 raft_consensus.cc:740] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:08.244896 11586 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:08.275621 11810 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.330313 11649 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:08.253145 11779 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:08.013551 11494 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:07.905748 11688 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:08.248610 11760 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:08.386982  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.385363  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:08.457333  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.406790  9374 rpcz_store.cc:276] 0709 13:03:07.246395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.247929 (+  1534us) service_pool.cc:224] Handling call
0709 13:03:07.248295 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:07.862304 (+614009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.406158 (+543854us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b540021c854. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:08.406348 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1215266560}
I20260709 13:03:08.358916 11677 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:08.423925  9418 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:08.414018 11872 log.cc:927] Time spent T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.538s	user 0.002s	sys 0.000s
I20260709 13:03:08.357360 11774 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:08.436956 11743 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:08.337194 11693 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:03:08.457607  9373 raft_consensus.cc:2410] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:03:08.406952 11878 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:08.461767  9418 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:08.365141 11651 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:08.364241 11785 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:08.451191 11862 log.cc:927] Time spent T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:03:08.420086 11700 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:08.492772  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.493993  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:08.467285 11731 consensus_queue.cc:260] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:08.469369  9451 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:03:08.471539 11760 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:08.473230 11885 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.478361  9418 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:08.455302 11776 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:08.498543 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 208008us
I20260709 13:03:08.466717 11586 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:08.452862 11649 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:08.564404  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.587150 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:08.480340 11693 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:08.434353 11810 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:08.422441 11876 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:08.589694  9526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46902 (request call id 1251) took 1969 ms (client timeout 2519 ms). Trace:
W20260709 13:03:08.653575  9526 rpcz_store.cc:269] 0709 13:03:06.620346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.636460 (+ 16114us) service_pool.cc:224] Handling call
0709 13:03:08.589381 (+1952921us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b5400325ad4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:08.589606 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1886397824}
W20260709 13:03:08.487437 11780 consensus_queue.cc:1175] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6d50f1c263264b21919230bee398022b" responder_term: 3 status { last_received { term: 3 index: 4 } last_committed_idx: 3 last_received_current_leader { term: 3 index: 4 } }
I20260709 13:03:08.529234 11790 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.131s
I20260709 13:03:08.529863 11700 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:08.643875 11688 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:08.628047 11885 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:08.695775 11736 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.043s	sys 0.076s
I20260709 13:03:08.961844 11677 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:08.933825 11774 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:08.651845 11731 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:08.963285 11736 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.043s	sys 0.092s
W20260709 13:03:08.808713 11882 log.cc:927] Time spent T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.340s	user 0.000s	sys 0.000s
W20260709 13:03:08.809258 11874 log.cc:927] Time spent T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.346s	user 0.001s	sys 0.000s
W20260709 13:03:08.809794 11880 log.cc:927] Time spent T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.327s	user 0.000s	sys 0.000s
I20260709 13:03:08.809592 11876 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:08.801158 11847 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:08.960801 11878 raft_consensus.cc:697] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:08.987022 11878 consensus_queue.cc:237] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:08.990664 11885 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:09.022655  9341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.002s	sys 0.006s
W20260709 13:03:09.023842  9341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.002s	sys 0.006s
W20260709 13:03:09.025239  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.030220  9369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1255) took 1659 ms. Trace:
I20260709 13:03:09.031033  9374 raft_consensus.cc:1275] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:09.031105  9369 rpcz_store.cc:276] 0709 13:03:07.370263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.387681 (+ 17418us) service_pool.cc:224] Handling call
0709 13:03:07.388096 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:07.462762 (+ 74666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:07.462792 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:08.389279 (+926487us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b18001066c0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58344b2a6 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb584e63a11 00007fb584e73372 00007fb5865a5a01 00007fb58656a43a
0709 13:03:08.391069 (+  1790us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b2c0001afe8. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb584e63a11 00007fb584e73372 00007fb5865a5a01 00007fb58656a43a 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2
0709 13:03:08.391758 (+   689us) log.cc:844] Serialized 26 byte log entry
0709 13:03:08.485405 (+ 93647us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:08.485460 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.485574 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:09.029278 (+543704us) raft_consensus.cc:1685] finished
0709 13:03:09.029377 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.029884 (+   507us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93656,"raft.queue_time_us":74259,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":7012,"spinlock_wait_cycles":8367744,"thread_start_us":93152,"threads_started":1,"wal-append.queue_time_us":245938}
I20260709 13:03:09.042867  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:09.066414  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:09.067386  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.070204  9448 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:09.070901  9444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1809) took 1218 ms. Trace:
I20260709 13:03:09.071762  9444 rpcz_store.cc:276] 0709 13:03:07.851752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.855875 (+  4123us) service_pool.cc:224] Handling call
0709 13:03:07.856273 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.100590 (+244317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:08.100635 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:08.100691 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:08.100734 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.070108 (+969374us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b5400019fd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:09.070214 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.070544 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":561202560}
W20260709 13:03:09.077155  9490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.008s	sys 0.007s
W20260709 13:03:09.077776  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:09.078927  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:09.077819  9490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.008s	sys 0.007s
W20260709 13:03:09.095917 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 469221us
I20260709 13:03:09.097072 11704 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.098207 11494 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:09.098140 11704 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:09.100023 11700 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:09.100593 10027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.101257 11604 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:09.101724 11704 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:09.101998 11604 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:08.970968 11736 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.934840 11651 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:09.105410 10067 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.029s	sys 0.056s
W20260709 13:03:09.106050 10067 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.029s	sys 0.056s
I20260709 13:03:08.933732 11746 consensus_queue.cc:237] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:09.108371 11586 raft_consensus.cc:697] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:09.104941 11736 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:09.110730 11586 consensus_queue.cc:237] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:09.111568 11736 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:09.112427 11736 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.100834 11700 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:09.114445 11629 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:09.115518 11629 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:09.115893 11649 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:09.116469 11629 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:08.970755 11785 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:09.118058 11785 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.119530 11629 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:09.119009 11785 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:09.120234 11604 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:09.120568 11810 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:09.123270 11785 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:03:09.125902  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.128510 11736 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:09.131888 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:09.133285 10066 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
W20260709 13:03:09.135622 11849 consensus_meta.cc:287] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.718s	user 0.012s	sys 0.008s
I20260709 13:03:09.136219  9342 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:09.114423 11700 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:09.137895 11854 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.155361 11688 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:09.156603 11688 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:09.158634  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 680162us
I20260709 13:03:09.155350 11494 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:09.163117 11888 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:09.163641 11494 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:09.164104 11888 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:09.158520 11736 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:09.183275  9449 raft_consensus.cc:1240] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:08.928869 11743 raft_consensus.cc:697] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:09.168968 11888 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:09.186734 11877 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.187456 11893 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.188290 11897 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:03:09.196120  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.202200 11760 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.200325 11604 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:03:09.203338 11760 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:09.206516 11688 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:09.211539 11494 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:09.213579  9418 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:09.214064 11743 consensus_queue.cc:237] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:09.195874 11849 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:09.217253 11651 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:09.217693 11849 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:09.217303 11810 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:09.217798 11651 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:09.219169 11651 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:09.220329 11849 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:09.221311 11893 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:09.222954 11649 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.223572 11649 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:09.224432 11893 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:09.217693 11776 consensus_queue.cc:1048] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:09.225546  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:09.226372 11649 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:09.226434  9451 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:09.228040  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:09.228672 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:09.228852  9447 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 6.
I20260709 13:03:09.216688  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:09.178805 11854 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:09.225244 11877 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:09.246547  9271 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 70) took 4100 ms. Trace:
I20260709 13:03:09.252974  9445 raft_consensus.cc:1275] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:03:09.264231 11760 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:09.267707 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:09.267820 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:09.277038 11854 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:09.293473 11700 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:09.297320 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:09.299749 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:09.301832 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:09.306301 11779 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:03:09.310493  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.312100 11826 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:09.315551  9377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1261) took 1941 ms. Trace:
I20260709 13:03:09.316148  9377 rpcz_store.cc:276] 0709 13:03:07.374322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.510871 (+136549us) service_pool.cc:224] Handling call
0709 13:03:07.888532 (+377661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.249134 (+360602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.315122 (+1065988us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b5400089b50. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865698ad 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:09.315355 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":838263680}
I20260709 13:03:09.319774  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:09.320911  9373 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:09.320516 11651 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:09.324000 11651 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:09.328293 11891 log.cc:927] Time spent T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.686s	user 0.016s	sys 0.013s
W20260709 13:03:09.333160  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.336325 11855 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:09.337212 10025 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:09.339326  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 122838us
I20260709 13:03:09.336365  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:09.345422 11847 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:09.346022 11847 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:03:09.347163  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 107994us
W20260709 13:03:09.352177  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 100773us
I20260709 13:03:09.345455 11780 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:09.346462 11847 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:09.354883 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:09.357656  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:09.362720  9451 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 5.
W20260709 13:03:09.360440  9492 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.011s	sys 0.008s
I20260709 13:03:09.362656 10067 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
W20260709 13:03:09.371891  9492 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.012s	sys 0.008s
W20260709 13:03:09.374711 10065 consensus_meta.cc:287] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9: Time spent flushing consensus metadata: real 1.006s	user 0.006s	sys 0.011s
I20260709 13:03:09.376212 10065 raft_consensus.cc:1275] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:09.376811  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:09.377615 11762 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:09.378098  9449 raft_consensus.cc:2393] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 5: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:09.378382 11762 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:09.381255 11855 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.381953 11855 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:09.382339 11842 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:03:09.383773 11604 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.384663 11604 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:09.376938 10065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 129) took 2066 ms. Trace:
I20260709 13:03:09.388669  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:09.388772  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:09.389185  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:09.389632  9445 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 6.
I20260709 13:03:09.391052 11762 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:09.391239  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:09.380743  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:09.361488 11780 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.392449 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:09.392673  9375 raft_consensus.cc:2410] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:03:09.389753  9377 raft_consensus.cc:2393] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 in current term 6: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
W20260709 13:03:09.388087  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 2.05924e+06us
I20260709 13:03:09.388747 10065 rpcz_store.cc:276] 0709 13:03:07.310502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.329115 (+ 18613us) service_pool.cc:224] Handling call
0709 13:03:07.352444 (+ 23329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:07.634843 (+282399us) spinlock_profiling.cc:243] Waited 49.1 ms on lock 0x7b54005c6fa0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5864e1dc0 00007fb58656c1c0 00007fb58656d231 00007fb586569d8f 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c
0709 13:03:09.376634 (+1741791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.376869 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112887680}
I20260709 13:03:09.399531 10025 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:09.416649 11842 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:09.417308 11842 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.417790 11842 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:09.398416  9417 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:09.401870  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:09.421347  9445 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:09.247032  9271 rpcz_store.cc:276] 0709 13:03:05.145872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.146051 (+   179us) service_pool.cc:224] Handling call
0709 13:03:09.246287 (+4100236us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:07.122081 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:07.122667 (+   586us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:07.122708 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:03:07.122727 (+    19us) tablet.cc:662] Decoding operations
0709 13:03:07.123092 (+   365us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:07.123150 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:07.123181 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:03:07.123382 (+   201us) tablet.cc:701] Row locks acquired
0709 13:03:07.123396 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:03:07.123552 (+   156us) write_op.cc:270] Start()
0709 13:03:07.123666 (+   114us) write_op.cc:276] Timestamp: P: 1783602187123498 usec, L: 0
0709 13:03:07.123689 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:03:07.124413 (+   724us) log.cc:844] Serialized 586 byte log entry
0709 13:03:07.465767 (+341354us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb5834600ac 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b
0709 13:03:07.880482 (+414715us) op_driver.cc:464] REPLICATION: finished
0709 13:03:08.450820 (+570338us) write_op.cc:301] APPLY: starting
0709 13:03:08.454609 (+  3789us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:08.465912 (+ 11303us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:08.468660 (+  2748us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:08.528513 (+ 59853us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:08.633481 (+104968us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:03:08.633560 (+    79us) write_op.cc:312] APPLY: finished
0709 13:03:08.637190 (+  3630us) log.cc:844] Serialized 22 byte log entry
0709 13:03:08.989238 (+352048us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:08.991192 (+  1954us) write_op.cc:454] Released schema lock
0709 13:03:08.991248 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:08.991758 (+   510us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:08.991788 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":819434,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":526776,"apply.run_cpu_time_us":22386,"apply.run_wall_time_us":570477,"mutex_wait_us":523,"num_ops":1,"prepare.queue_time_us":127230,"prepare.run_cpu_time_us":21733,"prepare.run_wall_time_us":414933,"raft.queue_time_us":378317,"raft.run_cpu_time_us":68761,"raft.run_wall_time_us":304956,"replication_time_us":756618,"spinlock_wait_cycles":31750016,"thread_start_us":1134118,"threads_started":5,"wal-append.queue_time_us":722509,"wal-append.run_cpu_time_us":36111,"wal-append.run_wall_time_us":1127340}]]}
I20260709 13:03:09.402828 10069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45690 (request call id 115) took 2091 ms. Trace:
I20260709 13:03:09.403352 11760 consensus_queue.cc:1048] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:03:09.403680  9368 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52562 (request call id 1124) took 1879 ms (client timeout 1983 ms). Trace:
I20260709 13:03:09.422549 10069 rpcz_store.cc:276] 0709 13:03:07.311108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.311272 (+   164us) service_pool.cc:224] Handling call
0709 13:03:07.311605 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:07.325715 (+ 14110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:07.325746 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:07.352332 (+ 26586us) log.cc:844] Serialized 26 byte log entry
0709 13:03:08.387978 (+1035646us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b1800027fa0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58345fe07 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b 00007fb586109d23 00007fb58610a0d1 00007fb586525a0f
0709 13:03:08.494520 (+106542us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:08.494700 (+   180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.495013 (+   313us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:09.327217 (+832204us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:09.402411 (+ 75194us) raft_consensus.cc:1685] finished
0709 13:03:09.402434 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.402654 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6998,"raft.queue_time_us":17351,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":264,"spinlock_wait_cycles":34802176,"thread_start_us":105674,"threads_started":1,"wal-append.queue_time_us":1289708}
W20260709 13:03:09.424026  9368 rpcz_store.cc:269] 0709 13:03:07.524496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.529339 (+  4843us) service_pool.cc:224] Handling call
0709 13:03:09.403278 (+1873939us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b54000456d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:09.403459 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4097610496}
I20260709 13:03:09.399226 11780 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:09.427733 11888 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:09.411796  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:09.428973  9369 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 5.
I20260709 13:03:09.412395 11855 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:09.433308 11877 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:09.433450 11760 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:09.434423 11760 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.434919 11760 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:09.437525  9418 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:09.438526 11651 consensus_queue.cc:1048] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:09.440002  9418 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:09.441184 11494 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:09.441900 11494 raft_consensus.cc:697] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:09.442852 11897 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:09.443466 11494 consensus_queue.cc:237] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:09.441867 11776 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:09.441831  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:09.446071  9448 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:03:09.453613  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:09.444242  9492 connection.cc:256] RPC call timeout handler was delayed by -2.0627370639999754s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.195s for a response
W20260709 13:03:09.456175  9492 connection.cc:256] RPC call timeout handler was delayed by -1.9520690609999747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260709 13:03:09.456883  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:09.457332  9492 connection.cc:256] RPC call timeout handler was delayed by -1.9092710129999659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
I20260709 13:03:09.459494  9522 raft_consensus.cc:2410] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:03:09.388211 11604 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:09.459097 11776 raft_consensus.cc:697] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:09.470567 11776 consensus_queue.cc:237] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:09.479262  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.478443 11847 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:09.493614 10027 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:09.457792  9492 connection.cc:256] RPC call timeout handler was delayed by -1.89685452599997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
I20260709 13:03:09.490168  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:09.495236  9492 connection.cc:256] RPC call timeout handler was delayed by -1.8062822449999771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
W20260709 13:03:09.496049  9492 connection.cc:256] RPC call timeout handler was delayed by -1.8042802549999806s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2171s for a response
W20260709 13:03:09.496578  9492 connection.cc:256] RPC call timeout handler was delayed by -1.793461552999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21000000000000002s for a response
W20260709 13:03:09.496984  9492 connection.cc:256] RPC call timeout handler was delayed by -1.7508710129999372s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1925s for a response
W20260709 13:03:09.498999  9492 connection.cc:256] RPC call timeout handler was delayed by -1.6252992969999696s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
I20260709 13:03:09.499734 11826 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:09.500794  9492 connection.cc:256] RPC call timeout handler was delayed by -1.5538560159999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22490000000000002s for a response
I20260709 13:03:09.509191  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:09.509967  9523 raft_consensus.cc:1240] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:09.510448  9522 raft_consensus.cc:2410] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:03:09.511790  9522 raft_consensus.cc:1240] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7. Ops: []
W20260709 13:03:09.539019  9492 connection.cc:256] RPC call timeout handler was delayed by -1.4957782070000007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 13:03:09.621281  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.513638  9521 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:03:09.590467 11842 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:09.611074  9492 connection.cc:256] RPC call timeout handler was delayed by -1.3940993549999803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
I20260709 13:03:09.514912  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:03:09.636201  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.552156  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:03:09.583390 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 89854.1us
W20260709 13:03:09.691679  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.692206  9369 raft_consensus.cc:2393] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 in current term 6: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:09.511714  9523 raft_consensus.cc:1240] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
W20260709 13:03:09.538221  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 44985.9us
I20260709 13:03:09.630092  9522 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
W20260709 13:03:09.691524  9492 connection.cc:256] RPC call timeout handler was delayed by -1.1198664980000217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2952s for a response
W20260709 13:03:09.693357  9492 connection.cc:256] RPC call timeout handler was delayed by -1.109240710999984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
I20260709 13:03:09.581768  9524 raft_consensus.cc:2393] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 8: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
W20260709 13:03:09.596899  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:09.693816  9492 connection.cc:256] RPC call timeout handler was delayed by -1.0894407110000088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260709 13:03:09.694495  9492 connection.cc:256] RPC call timeout handler was delayed by -1.0891098929999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2146s for a response
I20260709 13:03:09.512491  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:09.563129  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 70210.2us
I20260709 13:03:09.693249  9522 pending_rounds.cc:85] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 3
I20260709 13:03:09.493325 11847 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:09.632797  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:09.630731  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:09.709136  9522 pending_rounds.cc:107] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:03:09.716869  9522 raft_consensus.cc:2889] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:09.589166 11886 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:09.629362 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:09.632815  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:09.625859 11785 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.718590  9521 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:03:09.590260 11888 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:09.637702 11743 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:09.736295  9492 connection.cc:256] RPC call timeout handler was delayed by -1.0115822449999428s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29750000000000004s for a response
W20260709 13:03:09.726220  9448 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51016 (request call id 1134) took 1383 ms (client timeout 1504 ms). Trace:
I20260709 13:03:09.714095 11651 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:09.739981  9448 rpcz_store.cc:269] 0709 13:03:08.328769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.330752 (+  1983us) service_pool.cc:224] Handling call
0709 13:03:09.705830 (+1375078us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54000a14d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:09.712519 (+  6689us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1541800192}
I20260709 13:03:09.742411  9418 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:09.748077  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:09.500329 11826 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:09.748787  9524 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:09.564352 11700 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:09.711223 11760 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:09.604570 11586 consensus_queue.cc:1048] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.133s
I20260709 13:03:09.741760 11893 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.757120 10065 raft_consensus.cc:2368] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6.
I20260709 13:03:09.766711  9518 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:09.770046  9519 raft_consensus.cc:1240] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:09.754122 11780 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:09.776891 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 65078.6us
I20260709 13:03:09.767819  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:09.732136 11785 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:09.780499  9526 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:09.758064 11743 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:09.789975  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.790598 11885 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:09.790900 11914 log.cc:927] Time spent T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:03:09.791227 11885 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:09.795624  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 75855.1us
I20260709 13:03:09.798704 11780 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:09.809522  9341 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:09.810832  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:09.812330  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:09.812649  9524 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:09.778016 11700 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:09.818653 11785 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:09.819751  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:09.820358  9518 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:09.766407 11651 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:09.764038 11494 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:09.820672 11700 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:09.824170 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:09.827564  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:09.828146  9524 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:03:09.824112 11842 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:09.773051 11893 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:09.831957 11644 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:09.851974  9521 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:09.800709  9449 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 6.
I20260709 13:03:09.852684  9517 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:09.858309  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:09.820729 11743 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:09.864167  9519 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:09.864437  9521 raft_consensus.cc:1240] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:09.867667  9520 raft_consensus.cc:2376] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8. Re-sending same reply.
I20260709 13:03:09.869567  9526 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:09.872085  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:09.854691 11644 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.954629 11826 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:09.904784  9377 raft_consensus.cc:1240] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:09.871315  9517 raft_consensus.cc:1275] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:03:09.943318 11918 log.cc:927] Time spent T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:03:09.904775 11604 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.889138  9521 raft_consensus.cc:1275] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:03:09.959504  9271 catalog_manager.cc:5697] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 3 to 4, leader changed from b0812463215649c3b011d36e2f0400c9 (127.8.4.68) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 4 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:09.945590 11846 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:03:09.888618  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 62570us
I20260709 13:03:09.939623  9372 raft_consensus.cc:1240] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:09.888998  9443 raft_consensus.cc:2393] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 in current term 6: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:09.872637  9342 leader_election.cc:400] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Vote denied by peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623) with higher term. Message: Invalid argument: T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6.
I20260709 13:03:10.016675  9342 leader_election.cc:403] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:03:10.014442  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:09.910506 11760 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:09.901830 11651 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:09.862947 11700 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.872278 10025 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:10.027493 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 155295us
I20260709 13:03:09.998579 11644 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:09.994741  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 114196us
I20260709 13:03:10.020651  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:10.011981 11842 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:10.026414  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 191066us
W20260709 13:03:10.031880  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.032102  9518 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:09.867720 11888 consensus_queue.cc:1048] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.154s
I20260709 13:03:10.037582  9517 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:10.039546 11854 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:10.040197 11854 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:10.046514  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:10.036289  9341 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:03:10.047420  9526 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:03:10.051755  9375 raft_consensus.cc:1240] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:10.033820 11847 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:10.036005 11855 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:10.057068 10759 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:10.016831 11604 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:10.059074  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:10.058013 10759 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.060226  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:10.057628  9492 leader_election.cc:336] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.696s (SENT)
I20260709 13:03:10.059710 10759 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:10.048669 11885 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:10.068853  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:10.069142  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.037279 11700 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:10.057092 11599 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.066824  9492 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:10.082453  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:10.083145  9377 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:03:10.051570 11842 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:10.062414  9271 catalog_manager.cc:5697] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 3 to 4, leader changed from b0812463215649c3b011d36e2f0400c9 (127.8.4.68) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 4 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:10.085295 11842 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:10.087532  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:10.087822  9375 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:03:10.066305 11847 raft_consensus.cc:697] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 6 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:10.090560  9443 raft_consensus.cc:2368] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6.
I20260709 13:03:10.049484 11846 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:03:10.095616 11846 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:10.096590  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:10.097424  9374 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:10.077695 11599 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:10.099807  9443 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:03:10.097288  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:10.101855  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:10.101985 11644 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:10.107717  9374 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:10.109973  9520 raft_consensus.cc:3055] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:10.110509  9520 raft_consensus.cc:740] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:10.111483  9520 consensus_queue.cc:260] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:10.114032 11893 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:10.115854  9448 raft_consensus.cc:1275] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:10.117090  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:10.117974 11847 consensus_queue.cc:237] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:10.118885 11599 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:10.081256 11885 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:10.124359  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:10.112752  9520 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:10.142323 11908 log.cc:927] Time spent T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.122s	user 0.003s	sys 0.000s
I20260709 13:03:10.104712 11644 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:10.145750  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:10.146708  9518 raft_consensus.cc:2393] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 8: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:10.147411 10069 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 3 LEARNER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:10.147893  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:10.148545  9518 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:10.149386  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:10.150120  9524 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
W20260709 13:03:10.152163  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.157364  9526 raft_consensus.cc:1275] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:03:10.158179  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 119877us
I20260709 13:03:10.152969  9519 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:10.159323 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:10.165396  9518 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:10.157765  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:10.174485 10067 raft_consensus.cc:2393] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 6: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:03:10.175278  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:10.175930  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.176379  9519 raft_consensus.cc:2393] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 9: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:10.181813  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:03:10.159142 11923 log.cc:927] Time spent T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:03:10.187512  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:10.187760  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:10.187951  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:10.189330  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:10.198827  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:10.183291 11743 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:03:10.187265 11644 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.205835 11644 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:10.213855 11846 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:10.214526 11599 consensus_queue.cc:1048] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:03:10.214811  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.215982 11846 consensus_queue.cc:1059] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:10.216807 11599 raft_consensus.cc:3055] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:10.217199 11599 raft_consensus.cc:740] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:10.218093 11599 consensus_queue.cc:260] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:10.219309 11599 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:10.222391  9343 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:10.224460  9517 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
W20260709 13:03:10.225142  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.120942 11854 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:10.154863 11604 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:10.232298  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:10.231104  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:10.229598  9492 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.749s (SENT) [suppressed 19 similar messages]
I20260709 13:03:10.229969 10027 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:10.242580  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:10.248613  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:10.255829  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:10.269197 11927 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:10.270599 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:10.272616  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:10.273283  9518 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:10.251024 11644 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:10.271303 10067 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
W20260709 13:03:10.276816  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 60292.2us
W20260709 13:03:10.279901  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.284822  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:10.287277  9492 leader_election.cc:336] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.768s (SENT)
I20260709 13:03:10.294327 11919 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:10.295342  9520 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:03:10.295818  9520 pending_rounds.cc:85] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 3
I20260709 13:03:10.296095  9520 pending_rounds.cc:107] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:03:10.296558  9520 raft_consensus.cc:2889] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:10.297653 11926 log.cc:927] Time spent T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:03:10.302650  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:10.302995 11925 log.cc:927] Time spent T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:10.303634  9371 raft_consensus.cc:2393] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 8: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:10.303740  9343 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:10.305512  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:10.305953  9520 raft_consensus.cc:1240] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:10.307242  9518 raft_consensus.cc:1240] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:10.313990  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:10.318954  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:10.319571  9373 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:10.318423  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:10.320585  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:10.321265 11580 consensus_queue.cc:1059] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:10.299835 11927 consensus_queue.cc:1059] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:03:10.306591 11885 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:03:10.328907  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:10.334908  9492 leader_election.cc:336] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.983s (SENT)
I20260709 13:03:10.343225  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:10.343283  9449 raft_consensus.cc:1240] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:10.334797  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:10.343798  9368 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:10.346781  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:10.342892  9369 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:03:10.346490 10759 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:10.353088  9492 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:10.384060  9448 raft_consensus.cc:1275] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:03:10.517781 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 284813us
I20260709 13:03:10.403542  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:10.363983  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:10.519447  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 184569us
I20260709 13:03:10.356766  9443 raft_consensus.cc:1240] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:10.528162  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:10.528470  9449 raft_consensus.cc:1240] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:10.528617  9518 raft_consensus.cc:1275] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:10.528858  9444 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:10.536430  9418 connection.cc:256] RPC call timeout handler was delayed by -1.0527406510000219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
W20260709 13:03:10.537838  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 234170us
I20260709 13:03:10.538484  9341 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:10.331857 11604 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.543128 10025 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:10.336956 11928 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:10.336818 11700 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:10.558499  9341 leader_election.cc:400] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6.
I20260709 13:03:10.403990 11580 raft_consensus.cc:3055] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:10.514966 11733 raft_consensus.cc:3055] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:10.514043 11897 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.581988 11733 raft_consensus.cc:740] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:10.591645 11733 consensus_queue.cc:260] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:10.583003  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:10.528275 11885 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:10.601135  9448 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:10.557955 11886 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:03:10.599665  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 49926.4us
I20260709 13:03:10.604712  9343 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:10.605953  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 45415.2us
I20260709 13:03:10.567744 11888 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:10.567070 11580 raft_consensus.cc:740] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:10.557273 11846 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.621953  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:10.599251 11644 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.608283 11731 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:03:10.564394 11604 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:10.624140 11927 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:10.647590  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:10.653391  9448 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:10.641435 11733 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:10.691205  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.618108 11897 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:10.704356  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.611600  9445 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "807906edc34d41589d9b860b72f70e16"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51006
I20260709 13:03:10.710994  9445 raft_consensus.cc:606] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Received request to transfer leadership
I20260709 13:03:10.642092 11846 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:10.645843 11644 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:10.717356  9492 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:10.651458 11599 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:03:10.645161 11494 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.057s
W20260709 13:03:10.721107  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 112170us
W20260709 13:03:10.723028  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 68401.1us
I20260709 13:03:10.688871 11885 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:10.718087 11855 consensus_meta.cc:287] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.654s	user 0.011s	sys 0.001s
I20260709 13:03:10.733448 11700 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:10.741816  9449 raft_consensus.cc:1240] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7. Ops: []
W20260709 13:03:10.744452  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 124362us
I20260709 13:03:10.733486 11855 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623) with higher term. Message: Invalid argument: T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6.
W20260709 13:03:10.750511  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.709982 11580 consensus_queue.cc:260] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:10.732446 11885 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:10.761602  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 47679.8us
W20260709 13:03:10.776321  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:10.777360  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:10.781929 11939 log.cc:927] Time spent T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:03:10.786752 11644 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:10.791953  9492 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:10.796046  9444 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:10.797371 11700 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:10.798321 11494 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:10.799320  9418 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:10.800206 11494 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:10.748328 11762 consensus_queue.cc:1048] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:03:10.823554  9374 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 6.
I20260709 13:03:10.802134 11586 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:10.826534  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:10.824769  9341 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:10.842602  9443 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:10.843690  9341 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:10.858891 11958 consensus_queue.cc:1048] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:10.859858 11885 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:10.843413 11580 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:10.861845 11941 log.cc:927] Time spent T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:03:10.863318 11897 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:10.844717 11586 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:10.865674  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 120743us
I20260709 13:03:10.845472 11855 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:10.866900 11855 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.867240 11855 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:10.868621 11599 raft_consensus.cc:2804] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:10.869071 11599 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.869441 11599 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:10.810559 11927 consensus_queue.cc:1059] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:03:10.885433 11846 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:10.873836 11586 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:10.887893  9418 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:10.846472 11947 consensus_queue.cc:1048] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:03:10.843983 11955 consensus_queue.cc:1059] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
W20260709 13:03:11.037426  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 170978us
I20260709 13:03:11.038585  9343 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:11.040303  9343 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:11.051016 11954 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:11.059877 11928 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:10.886597 11604 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:03:11.085848  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 198017us
I20260709 13:03:10.886338 11494 consensus_queue.cc:1059] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.195s
W20260709 13:03:11.093636  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 221207us
I20260709 13:03:11.094873  9418 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:11.099992 11888 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:11.104945 11494 raft_consensus.cc:3055] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:11.105413 11494 raft_consensus.cc:740] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:11.106283 11494 consensus_queue.cc:260] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:11.107095 11855 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:11.107578 11494 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:11.088995 11955 raft_consensus.cc:3055] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:11.109375 11955 raft_consensus.cc:740] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:11.110484  9418 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:11.110368 11955 consensus_queue.cc:260] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:11.111636 11960 raft_consensus.cc:2804] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:11.112102 11960 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.112942 11960 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:11.113641 11743 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:11.115216 11743 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:11.115669 11743 raft_consensus.cc:697] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:11.098515 11604 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:11.117285 11604 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:11.112075 11936 log.cc:927] Time spent T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.504s	user 0.004s	sys 0.008s
W20260709 13:03:11.118250  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.123318  9443 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:11.111661 11955 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:11.117733 11604 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:11.149376  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 109203us
I20260709 13:03:11.125403 11888 raft_consensus.cc:697] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:11.154613  9341 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:11.159543 10759 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:11.162796 11762 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:11.163002  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.116592 11743 consensus_queue.cc:237] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:11.153854 11886 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:11.164647 11886 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:11.166829 11855 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:11.167222 11886 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:11.125209 11733 consensus_queue.cc:1059] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:03:11.099521 11897 consensus_queue.cc:1059] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:03:11.170536 11897 raft_consensus.cc:993] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526: : Instructing follower b0812463215649c3b011d36e2f0400c9 to start an election
I20260709 13:03:11.171126 11897 raft_consensus.cc:3055] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:11.171517 11897 raft_consensus.cc:740] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:11.179970 10027 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:11.183578  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:11.191681  9371 raft_consensus.cc:1240] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:11.193842  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:11.194507  9444 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:11.196463 11921 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:11.197031 11921 raft_consensus.cc:697] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 6 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:11.197953 11921 consensus_queue.cc:237] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:11.202322  9444 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:11.200754  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.204058  9374 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 4.
W20260709 13:03:11.214226  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.220899  9341 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:11.226649  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.152410 11888 consensus_queue.cc:237] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:11.233143 10027 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:11.202769 11733 raft_consensus.cc:3055] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:11.234901  9341 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:11.172526 11897 consensus_queue.cc:260] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:11.190881 11762 raft_consensus.cc:697] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:11.244115  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 58682.5us
I20260709 13:03:11.246388 11886 raft_consensus.cc:2804] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:11.246874 11886 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:11.247284 11886 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:11.243096 11959 raft_consensus.cc:1081] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Signalling peer b0812463215649c3b011d36e2f0400c9 to start an election
I20260709 13:03:11.259196  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:11.266938  9492 leader_election.cc:336] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.808s (SENT)
I20260709 13:03:11.234535 11733 raft_consensus.cc:740] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:11.202446 11599 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:11.272181  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 145675us
I20260709 13:03:11.243492 11855 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:11.263420 11960 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:11.278342  9452 raft_consensus.cc:1240] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:11.236037 11961 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:11.280365 11855 raft_consensus.cc:697] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:11.287782  9343 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:11.288587 10759 consensus_queue.cc:1048] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:03:11.290267  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 179857us
I20260709 13:03:11.282436 11897 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:11.307977 10759 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:11.284708 11944 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:11.284783 11961 raft_consensus.cc:697] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:11.317950 10759 raft_consensus.cc:697] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:11.322777 11599 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:11.289644 11733 consensus_queue.cc:260] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:11.314965 10067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "807906edc34d41589d9b860b72f70e16"
dest_uuid: "b0812463215649c3b011d36e2f0400c9"
 from {username='slave'} at 127.0.0.1:44546
I20260709 13:03:11.325572 10067 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:11.325264 11855 consensus_queue.cc:237] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:11.325958 10067 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:11.315232 11762 consensus_queue.cc:237] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:11.287338 11644 consensus_queue.cc:1048] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:03:11.325133 11733 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:11.334548  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:11.335172  9446 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:11.335903 11604 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:11.337462 11950 raft_consensus.cc:3055] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:11.337901 11950 raft_consensus.cc:740] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:11.338758 11950 consensus_queue.cc:260] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:11.339843 11604 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:11.340097 11950 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:11.345804  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:11.347419 10067 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:11.354396  9371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:11.355240  9371 raft_consensus.cc:606] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:11.355831  9371 raft_consensus.cc:614] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:11.357455  9446 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:11.360812  9418 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:11.362193 10067 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:11.366762 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 131214us
W20260709 13:03:11.374603  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.377414 10759 consensus_queue.cc:237] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:11.378875  9418 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:11.384192  9418 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:11.386334  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 98595.8us
I20260709 13:03:11.390316  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:11.391213  9374 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:11.345963 11944 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:11.415551 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:11.418062  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.388042 11494 raft_consensus.cc:2764] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:03:11.413210  9343 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:11.416465  9492 leader_election.cc:336] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.655s (SENT)
I20260709 13:03:11.425770  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:11.426491  9520 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:11.430017  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.381907 11842 consensus_queue.cc:1059] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 13:03:11.432673  9490 leader_election.cc:336] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.603s (SENT)
I20260709 13:03:11.409859 11954 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:11.437512 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 157111us
W20260709 13:03:11.446985  9490 leader_election.cc:336] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.625s (SENT)
I20260709 13:03:11.448055  9374 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 4.
I20260709 13:03:11.448189  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:11.448889  9446 raft_consensus.cc:3055] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:11.449332  9446 raft_consensus.cc:740] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:11.449945  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.436910  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.435720 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:11.455943 10066 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:11.461416  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 52003.8us
I20260709 13:03:11.413383 11963 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:11.469640  9520 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 4.
I20260709 13:03:11.470008  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.415836 11743 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:03:11.475912  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.480017  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.489362  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:11.490460  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:11.491091  9519 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:11.447444 11961 consensus_queue.cc:237] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:11.492226  9262 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7260766fbe5c43b1aab09346a89d9ac6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 925acbe78db14db3b9e4cfc857717947 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:11.492713  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:11.493192 10066 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:11.494068  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:11.494606  9342 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:11.469146  9446 consensus_queue.cc:260] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:11.496313  9446 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:11.498562  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:11.499280  9517 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:03:11.499523 11599 raft_consensus.cc:2804] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:11.500039 11599 raft_consensus.cc:697] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:11.496806  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:11.501077 11599 consensus_queue.cc:237] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:11.502769  9521 raft_consensus.cc:1240] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:11.494769  9526 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:11.501909  9524 raft_consensus.cc:2393] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 4: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:03:11.476963 11877 raft_consensus.cc:3055] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:11.505389  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:11.505681 11877 raft_consensus.cc:740] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:11.505914  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:11.506093  9520 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 3.
I20260709 13:03:11.506618 11877 consensus_queue.cc:260] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:11.507850 11877 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:11.508500  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:11.511629  9524 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:11.513760  9446 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 4.
I20260709 13:03:11.509363  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:11.514559  9520 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:11.466070 11855 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:11.517765  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:11.518765  9521 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:11.470928 11963 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.522680  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:11.523954  9517 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:11.531997  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.534574  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.535655  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:11.536211  9517 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:03:11.526275 11586 consensus_meta.cc:287] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.003s
I20260709 13:03:11.539007  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:11.540628  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.478349 11950 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
W20260709 13:03:11.529434 11974 log.cc:927] Time spent T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:03:11.542949  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:11.544870 11967 log.cc:927] Time spent T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:03:11.520859 11960 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:11.552290  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.523422 11963 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:11.543311  9521 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:11.552295 10025 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:11.558017  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.559587  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.564013  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.564981  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.565383  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:11.566053  9374 raft_consensus.cc:2410] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:03:11.553628 11731 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:11.568310  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 80483.9us
W20260709 13:03:11.599454  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 49347.9us
I20260709 13:03:11.564687 11927 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.605495  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.606698  9446 raft_consensus.cc:2393] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 5: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:11.567153 11604 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.567164 11842 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:11.562637 11649 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:11.615262  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.615346  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.600796 11731 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:11.611317  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.551432 11586 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:11.616791  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.627481  9443 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:03:11.620996  9521 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:11.624563  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:11.614668  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 85978.9us
I20260709 13:03:11.628976  9520 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:11.630383  9443 raft_consensus.cc:1275] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:11.636057  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.637064  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.640236  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.640892  9374 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:03:11.644861  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.631107 11842 raft_consensus.cc:697] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 4 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:11.650949  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:11.652130  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:11.652614  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:11.652998  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.651029  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.653618  9517 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:11.625186 11604 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:11.657799 11975 log.cc:927] Time spent T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:03:11.659336 11604 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:11.632771 11981 consensus_queue.cc:1048] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:03:11.662971 11586 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:11.665807  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.666446  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.666999  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.667254  9448 raft_consensus.cc:2393] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 5: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:11.668143  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.669308  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:11.669417  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.669894  9449 raft_consensus.cc:2376] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9. Re-sending same reply.
I20260709 13:03:11.670744  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.671057  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.671885  9449 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:11.672024  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.628130 11649 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:11.648883 11886 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:11.633822 11927 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:11.668220  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:11.652180  9520 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
W20260709 13:03:11.700909  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.678092  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:11.683363  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:11.679445  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.678174  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.676159  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.708716  9443 raft_consensus.cc:2393] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 7: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:11.683497  9375 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
W20260709 13:03:11.683601  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.709371  9370 raft_consensus.cc:2410] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:11.676596  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.672950  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.680742  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.673202  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.707878  9373 raft_consensus.cc:2376] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5. Re-sending same reply.
I20260709 13:03:11.722453  9448 raft_consensus.cc:2368] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8.
I20260709 13:03:11.730381  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.731346  9374 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:03:11.731606  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.678726  9452 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:03:11.732779  9375 raft_consensus.cc:2410] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:03:11.733911  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.735309  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.740599  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.741747  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.744045  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.744652  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.745620  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.745733  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.745981  9446 raft_consensus.cc:1240] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:03:11.746731  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.746893  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:11.747619  9376 raft_consensus.cc:2410] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:11.748092  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.748528  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.748672  9369 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:11.749939  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:11.749776 11963 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:11.751457  9376 raft_consensus.cc:2410] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:03:11.753139  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.754345 10069 raft_consensus.cc:1240] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:11.755211  9371 raft_consensus.cc:2410] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:11.757771  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.762163  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.763188  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.765632  9369 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:03:11.763463  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.763852  9377 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:11.766790  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.745306  9375 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:11.767596  9369 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
W20260709 13:03:11.765882  9492 leader_election.cc:336] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.941s (SENT)
I20260709 13:03:11.770020  9492 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:11.775970  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:11.780866  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:11.781742  9372 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:11.740599 11987 consensus_queue.cc:1048] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:03:11.796442  9451 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: []
W20260709 13:03:11.856899  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 91028.6us
I20260709 13:03:11.955346  9444 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:03:12.031966  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.799031  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:12.038645  9376 raft_consensus.cc:2410] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:03:11.798842  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:12.040935  9374 raft_consensus.cc:2393] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 8: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
W20260709 13:03:11.872826  9490 leader_election.cc:336] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.504s (SENT)
W20260709 13:03:12.042253  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 196990us
W20260709 13:03:12.042867  9490 leader_election.cc:336] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.574s (SENT)
W20260709 13:03:11.908028 11993 log.cc:927] Time spent T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:03:12.061276  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 50449.2us
I20260709 13:03:12.056533  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:12.060297  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:12.067622  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:12.068447  9520 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:12.057688  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:12.070165  9375 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
W20260709 13:03:12.064252 11888 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.009s	sys 0.012s
I20260709 13:03:11.955168 11984 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.074388  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:11.938377 11963 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:12.076558  9522 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:12.062203 11970 log.cc:927] Time spent T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.232s	user 0.000s	sys 0.005s
I20260709 13:03:11.903590 11886 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:11.898181 11649 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:11.887662 11842 consensus_queue.cc:237] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:12.082072 11927 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:11.801712 11982 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:12.081182 11888 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.010s	sys 0.013s
I20260709 13:03:12.055789 11968 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:03:12.099463  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:12.101951  9520 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:12.108692 11731 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:12.111680  9490 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:12.151023  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.154553  9522 raft_consensus.cc:2410] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:12.079792 11984 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:12.162604  9418 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:12.162755  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:12.162648  9522 raft_consensus.cc:1240] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:12.168877  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:12.169921  9520 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:12.170003  9522 raft_consensus.cc:1275] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:12.181890  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:12.182747  9450 raft_consensus.cc:2393] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 8: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:12.183988  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:12.188401  9271 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 71) took 2317 ms. Trace:
I20260709 13:03:12.197249  9446 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:12.199309  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:12.200215  9375 raft_consensus.cc:2376] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9. Re-sending same reply.
I20260709 13:03:12.169494 11958 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:03:12.202798  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 52207.3us
I20260709 13:03:12.203846  9418 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:12.201691  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:12.208422  9375 raft_consensus.cc:1275] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:12.214021  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:12.215051  9375 raft_consensus.cc:2410] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:03:12.217149  9418 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:12.219553 11897 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:12.220000 11944 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:12.224411  9523 raft_consensus.cc:1240] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:12.224802  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:12.225592  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.225919  9523 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:12.227303  9523 raft_consensus.cc:1275] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:12.228677  9523 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:03:12.228839 11992 log.cc:927] Time spent T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.340s	user 0.002s	sys 0.000s
I20260709 13:03:12.229298  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:12.230136  9374 raft_consensus.cc:2393] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 6: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:12.232583 11897 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:12.233240  9418 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:12.188915  9271 rpcz_store.cc:276] 0709 13:03:09.900688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.900870 (+   182us) service_pool.cc:224] Handling call
0709 13:03:12.188327 (+2287457us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:10.295828 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:10.296613 (+   785us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:10.296674 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:03:10.296694 (+    20us) tablet.cc:662] Decoding operations
0709 13:03:10.297314 (+   620us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:10.297399 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:10.297430 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:03:10.297939 (+   509us) tablet.cc:701] Row locks acquired
0709 13:03:10.297991 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:03:10.298216 (+   225us) write_op.cc:270] Start()
0709 13:03:10.298375 (+   159us) write_op.cc:276] Timestamp: P: 1783602190298132 usec, L: 0
0709 13:03:10.298396 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:03:10.348582 (+ 50186us) log.cc:844] Serialized 900 byte log entry
0709 13:03:10.814955 (+466373us) op_driver.cc:464] REPLICATION: finished
0709 13:03:10.882933 (+ 67978us) write_op.cc:301] APPLY: starting
0709 13:03:10.883086 (+   153us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:10.883291 (+   205us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:10.883477 (+   186us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:10.884074 (+   597us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:10.886516 (+  2442us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:03:10.893219 (+  6703us) write_op.cc:312] APPLY: finished
0709 13:03:11.018726 (+125507us) log.cc:844] Serialized 28 byte log entry
0709 13:03:11.099133 (+ 80407us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:11.116022 (+ 16889us) write_op.cc:454] Released schema lock
0709 13:03:11.116099 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:11.116611 (+   512us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:11.116648 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":67622,"apply.run_cpu_time_us":3308,"apply.run_wall_time_us":233676,"num_ops":2,"prepare.queue_time_us":174935,"prepare.run_cpu_time_us":14355,"prepare.run_wall_time_us":305094,"raft.queue_time_us":33360,"raft.run_cpu_time_us":34089,"raft.run_wall_time_us":67805,"replication_time_us":516359,"thread_start_us":388824,"threads_started":4,"wal-append.queue_time_us":330953,"wal-append.run_cpu_time_us":11904,"wal-append.run_wall_time_us":1376085}]]}
I20260709 13:03:12.236471  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:12.240674 11963 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:12.241201 11963 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:12.241578 11963 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:12.243106  9369 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:03:12.225616  9376 raft_consensus.cc:2393] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 5: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
W20260709 13:03:12.234164 11855 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.009s	sys 0.035s
W20260709 13:03:12.244772 11855 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.009s	sys 0.035s
I20260709 13:03:12.245146 11855 raft_consensus.cc:697] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:12.246196  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.246129 11855 consensus_queue.cc:237] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:12.214169 11958 raft_consensus.cc:697] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:12.248327 11958 consensus_queue.cc:237] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:12.211469 11995 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:12.252159  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:12.252692 11995 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:12.253280 11995 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:12.262182 11984 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:12.271397  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 55499.3us
W20260709 13:03:12.274132 12004 log.cc:927] Time spent T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:03:12.276306  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:12.277248  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:12.277704  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:12.278517  9369 raft_consensus.cc:2410] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:12.278585  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:12.280820  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:12.282321  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:12.282426  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:12.283308  9375 raft_consensus.cc:2376] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9. Re-sending same reply.
I20260709 13:03:12.283499  9520 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
W20260709 13:03:12.282864 11971 log.cc:927] Time spent T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.785s	user 0.000s	sys 0.011s
I20260709 13:03:12.289346 11733 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:03:12.296569  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 184963us
I20260709 13:03:12.297853  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:12.299664  9490 leader_election.cc:336] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.771s (SENT)
W20260709 13:03:12.300101  9490 leader_election.cc:336] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.889s (SENT)
I20260709 13:03:12.303215  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:12.285779 11962 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.011s	sys 0.003s
I20260709 13:03:12.309252  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:12.310246  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:12.314414 10759 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:12.321630  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:12.323899 11961 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.015s	sys 0.015s
W20260709 13:03:12.324355 11961 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.015s	sys 0.015s
I20260709 13:03:12.315685 11982 consensus_queue.cc:1059] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:03:12.330376 11982 raft_consensus.cc:3055] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:12.307394 11981 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:12.330777 11982 raft_consensus.cc:740] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:12.314955 10759 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:12.308600 11962 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.011s	sys 0.004s
I20260709 13:03:12.345693 11983 consensus_queue.cc:1059] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:03:12.346480 11897 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:12.346762 11984 raft_consensus.cc:3055] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:12.347115 11984 raft_consensus.cc:740] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:12.347982 11984 consensus_queue.cc:260] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:12.349426 11984 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:12.350265 10069 raft_consensus.cc:1275] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:03:12.350744 11963 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:12.357313  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:12.358162  9377 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:03:12.360981  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:12.361550  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:12.362529  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:12.378523  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:12.379329  9518 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
W20260709 13:03:12.382592  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 146084us
I20260709 13:03:12.384044  9492 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.399756  9492 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.389278 11599 consensus_queue.cc:1048] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:03:12.401415  9492 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.403383 11897 consensus_queue.cc:1048] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:12.405505  9492 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.352934 11963 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:12.407168 11981 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:12.407685 11983 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:12.412110 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:12.411985 11995 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:12.412375 11983 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:12.409982 11984 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:12.412984 10068 raft_consensus.cc:2393] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 5: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:03:12.413164 11984 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.413609 11984 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:12.413533 10068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 263) took 1008 ms. Trace:
I20260709 13:03:12.414325 11995 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:12.414501 10068 rpcz_store.cc:276] 0709 13:03:11.405521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.408608 (+  3087us) service_pool.cc:224] Handling call
0709 13:03:12.412006 (+1003398us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b5800224798. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445f8c 00007fb583445ef6 0000000000375939 00007fb58b4b91e0 00007fb58b5820c4 00007fb58b582131 00007fb58b5300a0 00007fb58b52f984 00007fb584aaa6d4 00007fb584aaa662
0709 13:03:12.413449 (+  1443us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7614080}
W20260709 13:03:12.417644  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.419315  9447 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:03:12.416169  9418 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:12.422220  9492 leader_election.cc:336] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.625s (SENT)
I20260709 13:03:12.422914  9492 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.428504  9519 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:03:12.429574  9492 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.414356 11991 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:12.431107 11991 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:12.431990 11991 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:12.433559 10759 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:12.434361  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:12.435562  9374 raft_consensus.cc:2410] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:03:12.440821  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.452571  9519 raft_consensus.cc:1275] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:12.432154 11982 consensus_queue.cc:260] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:12.459681  9519 raft_consensus.cc:1275] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:03:12.460047  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:12.412993 11983 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:12.458833  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:12.464427  9523 raft_consensus.cc:2410] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:03:12.465889  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 50139.9us
I20260709 13:03:12.470124  9418 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:12.463790  9526 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:12.472020  9518 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:03:12.475479  9343 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:12.476490  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 46996us
I20260709 13:03:12.477270  9343 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.477485  9492 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.479419 11963 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:12.480206 11963 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:12.480362 10759 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:12.480947 10759 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.480896 11963 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:12.481679 10759 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:12.462781 11995 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:12.487154  9492 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
W20260709 13:03:12.489494 11976 log.cc:927] Time spent T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.996s	user 0.006s	sys 0.009s
I20260709 13:03:12.490831  9445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1866) took 1301 ms. Trace:
I20260709 13:03:12.491254  9445 rpcz_store.cc:276] 0709 13:03:11.189762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.189921 (+   159us) service_pool.cc:224] Handling call
0709 13:03:11.201391 (+ 11470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:11.201757 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:11.201790 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:11.202297 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:03:11.424164 (+221867us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:11.424223 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:11.424328 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:12.458712 (+1034384us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:12.490488 (+ 31776us) raft_consensus.cc:1685] finished
0709 13:03:12.490516 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:12.490758 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":58409,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"spinlock_wait_cycles":62550400,"thread_start_us":221460,"threads_started":1,"wal-append.queue_time_us":290763}
I20260709 13:03:12.494455  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:12.495982  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:12.500383 11944 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:12.504994 11984 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:12.507220 11984 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:12.507828  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:12.508519  9525 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:12.514132  9377 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:12.517591  9418 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:12.526057  9343 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.479416 11982 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:12.528470 10759 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:12.531947  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 48659.1us
I20260709 13:03:12.533057 11599 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:12.482420 11928 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:12.537802 11984 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:12.541904 11963 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:12.543987  9445 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:12.544234 11963 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:12.544826 11963 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:12.545747 11919 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:12.546392  9418 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:12.547482 11950 consensus_queue.cc:1059] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:12.549167 10759 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:12.549723 11950 raft_consensus.cc:3055] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:12.550137 11950 raft_consensus.cc:740] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:12.550987 11950 consensus_queue.cc:260] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:12.551936 11950 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:12.548311  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 61238.7us
I20260709 13:03:12.552896  9343 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.554211 11762 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:12.555227 11762 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.555601 11762 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:12.563633 11996 log.cc:927] Time spent T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.512s	user 0.000s	sys 0.003s
I20260709 13:03:12.565330  9524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1541) took 1052 ms. Trace:
I20260709 13:03:12.565742  9524 rpcz_store.cc:276] 0709 13:03:11.513986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.514173 (+   187us) service_pool.cc:224] Handling call
0709 13:03:11.526035 (+ 11862us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:11.635203 (+109168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:11.635244 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:11.640779 (+  5535us) log.cc:844] Serialized 26 byte log entry
0709 13:03:12.043384 (+402605us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:12.043423 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.043490 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:12.562860 (+519370us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:12.564920 (+  2060us) raft_consensus.cc:1685] finished
0709 13:03:12.564945 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:12.565243 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113937,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":8316,"spinlock_wait_cycles":47284480,"thread_start_us":444349,"threads_started":2,"wal-append.queue_time_us":401806}
I20260709 13:03:12.570163  9343 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.573853  9343 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.574582  9492 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.575624  9418 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:12.576146 10759 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:12.575390  9343 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.576920 11982 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:12.576988 11649 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:12.577966 11855 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:12.576988  9492 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.579123 11984 raft_consensus.cc:2764] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:03:12.582379  9343 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.583572  9418 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:12.584549  9418 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:12.584849 10759 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.585472 10759 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:12.589933  9492 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.569940 11963 raft_consensus.cc:2764] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:03:12.592378  9343 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.594889  9343 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:12.586835 11995 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:12.587073 11897 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:12.587473 12008 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:12.614466  9343 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.589910 11855 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:12.599545 11982 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:12.637396 11855 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.637930 11855 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:12.646486 10069 pending_rounds.cc:85] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9: Aborting all ops after (but not including) 7
I20260709 13:03:12.646900 10069 pending_rounds.cc:107] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:03:12.647214 10069 raft_consensus.cc:2889] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:12.590483 11964 consensus_queue.cc:1048] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:03:12.654722  9449 raft_consensus.cc:1240] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:12.618134  9492 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.605233 11928 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:12.580111 11983 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:12.659179 11983 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:12.659821 11983 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:12.604887 11644 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:12.663357 10027 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:12.621359 10759 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:12.666395 10759 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:12.667089 11968 raft_consensus.cc:2749] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:12.670809  9517 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:03:12.673286  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 55222.8us
I20260709 13:03:12.674047  9492 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.675325  9492 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:12.676100  9492 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.675341 11973 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:03:12.678023 11962 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.678524 11962 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:12.680486 11962 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:12.680959 11973 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:03:12.682415  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.687271 11961 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:12.628279 11762 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:12.702590  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 116762us
I20260709 13:03:12.708350  9492 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.709993  9369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ad4133883414768941dffb952ca7caf"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:12.710654  9369 raft_consensus.cc:606] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:12.711009  9369 raft_consensus.cc:614] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:12.712664  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:12.713572  9376 raft_consensus.cc:2410] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:12.723968  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:12.722316 11983 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:12.728456  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:12.729414  9369 raft_consensus.cc:2393] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 6: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
W20260709 13:03:12.731433  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 117058us
I20260709 13:03:12.744033 11644 raft_consensus.cc:2749] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:12.750298 11762 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:12.752964  9275 catalog_manager.cc:5697] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:12.726547 11983 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.736186  9371 raft_consensus.cc:1240] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:12.737704  9376 raft_consensus.cc:1275] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:12.739140  9372 raft_consensus.cc:1275] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:12.740445  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:12.761154  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:12.741101 11733 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:12.707885 11981 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:12.723109 11988 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:12.755092  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:12.757668  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.731276  9492 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.727275 11984 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:12.777681  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:12.762032  9343 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.783191  9446 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:12.784400  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:12.783399  9451 raft_consensus.cc:1275] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:12.761227 11983 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:12.786888  9275 catalog_manager.cc:5697] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:12.790786  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:12.791167  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:12.791414  9446 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:12.773298 11981 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:12.772466 11988 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:12.800450  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 75436.9us
I20260709 13:03:12.801239  9275 catalog_manager.cc:5697] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 5 to 8, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 8 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:12.803299  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:12.758035 11855 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:12.808658  9492 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:12.777098 11984 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:12.781286 11733 raft_consensus.cc:697] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:12.787892 11897 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:12.807963 11981 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:12.787737 11960 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:12.818745  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:13.003532  9371 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:12.850865  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.804114 11982 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:03:12.854348  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 50369.1us
I20260709 13:03:12.810385  9275 catalog_manager.cc:5697] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:13.009128  9275 catalog_manager.cc:5697] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:12.855020  9448 raft_consensus.cc:1240] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:12.812521 11988 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:12.857278  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 48713.5us
I20260709 13:03:13.013325  9492 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:13.014813  9492 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:13.016113  9492 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:12.858491  9418 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:12.889461  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:12.854619 11897 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:12.926613 12021 log.cc:927] Time spent T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:03:12.819844 11984 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:12.937765 12032 log.cc:927] Time spent T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 13:03:12.938230  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 77740.2us
I20260709 13:03:13.008652 11960 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:13.026801 12008 raft_consensus.cc:2804] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:12.904834 12035 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:12.820636 12024 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.118s
W20260709 13:03:13.050848  9490 leader_election.cc:336] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.978s (SENT)
I20260709 13:03:13.028151 12014 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:13.054824  9449 raft_consensus.cc:1240] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:12.930467 11733 consensus_queue.cc:237] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:12.997578  9370 raft_consensus.cc:1240] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:03:13.038367 11960 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:12.863652  9375 raft_consensus.cc:1240] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:13.006544  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:13.017575  9373 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:13.017606  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 159192us
I20260709 13:03:13.014022  9275 catalog_manager.cc:5697] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
W20260709 13:03:13.016851  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 166414us
I20260709 13:03:13.028492 11897 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:12.817840 11963 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.104s
I20260709 13:03:13.031858 11982 raft_consensus.cc:2764] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:03:12.928767 11995 consensus_queue.cc:1048] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:03:13.051555  9490 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:13.056401  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 45136.3us
I20260709 13:03:12.852982 11944 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:13.065297  9275 catalog_manager.cc:5697] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 6 to 7, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 7 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:13.084924  9343 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:13.085135  9275 catalog_manager.cc:5697] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 6 to 8, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 8 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:13.059422 12008 raft_consensus.cc:697] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:03:13.091980  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.092149  9275 catalog_manager.cc:5697] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 1 to 5, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 5 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:13.095129  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 44320.6us
I20260709 13:03:13.100266 11999 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:13.101462  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:13.102239  9370 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:13.056553 11987 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 13:03:13.119042  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 102989us
I20260709 13:03:13.116297  9275 catalog_manager.cc:5697] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 4 to 6, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 6 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:13.124384  9275 catalog_manager.cc:5697] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 7 to 8, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 8 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:13.126824  9275 catalog_manager.cc:5697] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 5 to 7, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 7 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:13.099125 11855 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:13.121860  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:13.104983 11982 raft_consensus.cc:2749] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:13.128839  9275 catalog_manager.cc:5697] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:13.136543 12044 consensus_queue.cc:1048] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:13.137523  9275 catalog_manager.cc:5697] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 2 to 4, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 4 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:13.139245  9275 catalog_manager.cc:5697] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 4 to 5, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 5 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:13.141594 12031 log.cc:927] Time spent T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:03:13.141310 11944 consensus_queue.cc:1048] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:03:13.144306 12023 log.cc:927] Time spent T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:03:13.145502  9377 raft_consensus.cc:1275] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:13.146466 12015 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:13.141831  9275 catalog_manager.cc:5697] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:13.150074  9492 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:13.151384  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 66528.2us
I20260709 13:03:13.153705  9343 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:13.159257  9343 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:13.153354  9275 catalog_manager.cc:5697] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 4 to 5, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 5 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:13.171072  9275 catalog_manager.cc:5697] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:13.173444  9275 catalog_manager.cc:5697] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 4 to 5, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 5 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:13.182092 12030 log.cc:927] Time spent T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:03:13.173364 12044 consensus_queue.cc:1048] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:03:13.163910 11981 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:13.189937 11987 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:03:13.201967 12029 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 13:03:13.187616  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 52311.6us
W20260709 13:03:13.203933  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.183153 11989 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:13.229338 11989 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.229792 11989 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:13.164724 12015 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:13.203784 11983 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:13.233536  9492 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:13.216007  9373 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:13.234306 11855 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:13.234959  9492 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:13.236202  9492 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:13.215896  9371 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:03:13.216303  9370 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:13.218504  9275 catalog_manager.cc:5697] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 5 to 6, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 6 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:13.237046 12041 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:03:13.244477  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 132395us
I20260709 13:03:13.243369  9275 catalog_manager.cc:5697] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:13.237391 11950 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:13.246770 12014 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:13.248919  9275 catalog_manager.cc:5697] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:13.245349 12025 log.cc:927] Time spent T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.162s	user 0.002s	sys 0.001s
I20260709 13:03:13.256702  9275 catalog_manager.cc:5697] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:13.245378 12015 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:13.238933 11958 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:13.246202  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 181846us
I20260709 13:03:13.267609  9492 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:13.261042  9275 catalog_manager.cc:5697] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 1 to 2, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 2 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:13.271853  9275 catalog_manager.cc:5697] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:13.277757  9525 raft_consensus.cc:1240] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:13.281167  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:13.282114  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:13.283486  9369 raft_consensus.cc:1240] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:03:13.284682  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:13.285333  9520 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:13.285521  9522 raft_consensus.cc:1240] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:03:13.284597  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:13.287380  9526 raft_consensus.cc:1240] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:13.287798  9524 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:13.263012 12015 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.288509  9418 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:13.269330 12014 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:13.175154 12008 consensus_queue.cc:237] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:13.297164  9418 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:13.300665  9517 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:13.307793  9492 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:13.313791  9492 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:13.315161  9517 raft_consensus.cc:1240] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:03:13.289887 11963 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:13.305806 11995 consensus_queue.cc:1048] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:03:13.295027 12015 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:13.299296 11983 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:13.334198  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 173196us
I20260709 13:03:13.322439  9520 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:13.337100  9370 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:13.337327  9373 raft_consensus.cc:1240] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:13.344002  9524 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:13.338690  9375 raft_consensus.cc:1240] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:13.339636  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:13.269636 11958 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:13.349666  9368 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:03:13.280367 12041 consensus_queue.cc:1059] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:03:13.353657  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:03:13.344460  9262 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7260766fbe5c43b1aab09346a89d9ac6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:13.355832 12045 consensus_queue.cc:1048] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:03:13.356621  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:13.357410 11968 raft_consensus.cc:2955] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 4 LEADER]: Committing config change with OpId 3.5: config changed from index 3 to 5, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:13.361164 12026 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:13.317222 11733 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:03:13.316591 11944 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:13.364210 11958 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:13.333076 11743 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:13.364512  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 53062.5us
W20260709 13:03:13.364871 12042 log.cc:927] Time spent T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.166s	user 0.002s	sys 0.002s
I20260709 13:03:13.316026 12051 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:13.328281 12050 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:03:13.367666 11981 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:13.372382  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:13.378055  9370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:13.399230  9341 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:13.408437 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 48661.1us
I20260709 13:03:13.433347 11988 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:13.398156 12052 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.437685  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:13.426091  9370 raft_consensus.cc:606] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:13.410310 12041 raft_consensus.cc:3055] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:13.393985 12024 consensus_queue.cc:1059] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:03:13.391091 11897 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:13.437836 11928 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:03:13.463510  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 149814us
I20260709 13:03:13.467787  9492 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:13.463943  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:13.469713  9524 raft_consensus.cc:2393] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 10: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:13.480960  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:13.448553 12041 raft_consensus.cc:740] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:13.481736  9519 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:13.491150  9492 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:13.461452 11928 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.497552  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:13.498533  9492 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:13.504411  9443 raft_consensus.cc:1275] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:13.508369  9444 raft_consensus.cc:1240] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:13.526099  9444 raft_consensus.cc:1275] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:03:13.600454  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:13.602070  9449 raft_consensus.cc:1240] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:13.482223 11982 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:13.476310 11999 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:03:13.617727  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 119256us
I20260709 13:03:13.628859  9492 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:13.618858  9524 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:13.485263 11981 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:13.473351 12044 consensus_queue.cc:1059] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:03:13.451073 11985 consensus_queue.cc:1059] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:03:13.425786 12051 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:13.503826 11928 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:13.657171 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 227498us
I20260709 13:03:13.502112 11649 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.604904 11984 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:13.654033 12063 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.172s
W20260709 13:03:13.655740 12056 log.cc:927] Time spent T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 13:03:13.655939  9343 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:13.446169 12052 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:13.599779 12014 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:13.670917  9524 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:13.633721 11944 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:13.657229 11983 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:13.636183 11999 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:13.702543  9492 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:13.695420  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.707973  9525 raft_consensus.cc:1240] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:13.742690 11984 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:13.742828 12052 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:13.744958 11988 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:13.745903 12058 log.cc:927] Time spent T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:03:13.739796 11983 raft_consensus.cc:697] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 9 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:13.747716 11983 consensus_queue.cc:237] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:13.753465 11950 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:13.754226 11950 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:13.760998 12066 log.cc:927] Time spent T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:03:13.761736 12057 log.cc:927] Time spent T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 13:03:13.764609 12051 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:13.773563 12064 log.cc:927] Time spent T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.065s	user 0.002s	sys 0.000s
I20260709 13:03:13.709532 12041 consensus_queue.cc:260] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:13.774586 11950 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:13.775647 12041 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:13.777369 11950 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:13.778605 11897 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:13.785738  9519 raft_consensus.cc:1275] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:13.789137 12015 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:13.791441 11989 consensus_meta.cc:287] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.561s	user 0.011s	sys 0.001s
W20260709 13:03:13.711051 11960 consensus_meta.cc:287] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.628s	user 0.011s	sys 0.000s
I20260709 13:03:13.796820 11960 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:13.798978 11960 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:13.799652 11984 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:13.687005 11649 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:13.811635  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 435292us
W20260709 13:03:13.821115  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 190545us
I20260709 13:03:13.824397  9443 raft_consensus.cc:2955] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:13.834041  9523 raft_consensus.cc:1240] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:03:13.835829  9492 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:03:13.843725  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.806734 11989 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:13.856899 11989 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:13.857664  9526 raft_consensus.cc:1240] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:13.854539 11981 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:13.873797 11649 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:13.874260 11981 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:13.874785 11981 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:13.871878 12051 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:03:13.877990  9418 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:13.880151 12067 consensus_queue.cc:1059] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:13.881212 12050 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:13.881808 12050 raft_consensus.cc:697] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:13.882781 12050 consensus_queue.cc:237] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:13.887166  9418 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
W20260709 13:03:13.892768  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 236888us
I20260709 13:03:13.913589  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:13.914639  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 287254us
I20260709 13:03:13.924875  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:13.887786 12008 raft_consensus.cc:3055] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:13.908326 11644 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:13.903429 11962 raft_consensus.cc:3055] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:14.031065  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:14.031942  9517 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
W20260709 13:03:14.034337  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 47993.1us
I20260709 13:03:14.036316  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:14.037505  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:14.037798  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:14.038592  9447 raft_consensus.cc:2393] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 8: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:14.040083  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:14.039680  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:14.037389  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:13.995970  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:13.989557 12051 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:13.930347 12008 raft_consensus.cc:740] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:14.051126  9452 raft_consensus.cc:2393] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 7: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:14.052450  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:14.053898  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:14.055151  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:14.044471  9526 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:14.045466  9446 raft_consensus.cc:2393] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 7: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:14.048300  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:14.068131  9447 raft_consensus.cc:2393] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 5: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:14.069952  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:14.071449  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:14.072928  9449 raft_consensus.cc:2393] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:14.073887  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:14.074744  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:14.077323  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:14.078773  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:14.080405  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 164972us
I20260709 13:03:14.082034  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:14.069123  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:14.087287 12043 consensus_queue.cc:1048] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:03:14.088019 12055 log.cc:927] Time spent T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.690s	user 0.002s	sys 0.022s
I20260709 13:03:14.089212  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:13.998813 11962 raft_consensus.cc:740] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:14.087334  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:13.999984 12014 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.027796 11984 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:14.042250 11960 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.122774  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:14.108210  9447 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:03:14.124269  9447 raft_consensus.cc:606] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:14.109791  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:14.111538  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 97494.9us
W20260709 13:03:14.126672  9490 leader_election.cc:336] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.760s (SENT)
I20260709 13:03:14.127135  9490 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:14.114885  9445 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "807906edc34d41589d9b860b72f70e16"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51006
I20260709 13:03:13.995699 11928 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.045961 12044 raft_consensus.cc:3055] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:14.128000  9517 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:14.132179  9490 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:14.105614 12051 raft_consensus.cc:697] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:14.148190  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:14.149417  9376 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:03:14.066718 11897 consensus_queue.cc:1059] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:03:14.092793 11743 consensus_queue.cc:1059] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:03:14.116096 11644 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.150887  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:14.152674  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:14.153359  9343 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:14.149312  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:14.142371  9517 raft_consensus.cc:1275] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:14.149204  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:14.161809  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:14.166337  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:14.166846  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:14.167676  9372 raft_consensus.cc:2393] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 10: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:14.133214 11989 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.137369 11988 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:14.163334  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:14.170678  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:14.175603  9375 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:14.175668  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 43575.7us
I20260709 13:03:14.170944  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:14.171762 12075 log.cc:927] Time spent T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 13:03:14.135164 12044 raft_consensus.cc:740] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:14.176571  9490 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:14.185598  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:14.127312 11984 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.189836  9343 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:14.191550  9343 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:14.193910  9445 raft_consensus.cc:606] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Received request to transfer leadership
I20260709 13:03:14.194497  9445 raft_consensus.cc:614] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:14.121063 12014 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.135172 11960 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:14.150907 11762 consensus_queue.cc:1059] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:03:14.179239 12026 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:14.221714  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 82493.3us
I20260709 13:03:14.226666  9526 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:03:14.167748 11644 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.194669 11855 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:14.173146 11989 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.195261 11743 consensus_queue.cc:1243] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:03:14.286969  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:14.224931 12045 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:14.228533 11988 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:14.294850  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:14.295723  9443 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:03:14.290879  9450 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
W20260709 13:03:14.297461 12081 log.cc:927] Time spent T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
W20260709 13:03:14.298588 12084 log.cc:927] Time spent T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:03:14.233676 11888 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:14.263756 11599 raft_consensus.cc:3055] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:14.292671 11743 consensus_queue.cc:1059] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:03:14.301976  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.305310  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:14.309048  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:14.311367  9374 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:14.174364 11962 consensus_queue.cc:260] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:14.290375 12074 log.cc:927] Time spent T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 13:03:14.293016  9418 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:14.179461 12008 consensus_queue.cc:260] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:14.339731  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 163251us
I20260709 13:03:14.340776  9490 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:14.342166  9375 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
W20260709 13:03:14.343547  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 50645.2us
I20260709 13:03:14.288753 11964 consensus_queue.cc:1059] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:03:14.315430 12024 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:14.290490 12043 consensus_queue.cc:1048] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:03:14.312291 11599 raft_consensus.cc:740] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:14.291790 11897 consensus_queue.cc:1059] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 6.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:03:14.377602 12102 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.378997 11982 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:14.324031 11888 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:14.329537 12035 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:14.233242 12026 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.301252 12046 consensus_queue.cc:1059] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.265s
I20260709 13:03:14.387786  9374 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:03:14.389799  9525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1316) took 1111 ms. Trace:
I20260709 13:03:14.286819 12051 consensus_queue.cc:237] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.398638  9525 rpcz_store.cc:276] 0709 13:03:13.278657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.278853 (+   196us) service_pool.cc:224] Handling call
0709 13:03:13.279162 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:13.739113 (+459951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.389551 (+650438us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b540042bb54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:14.389731 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":985545600}
W20260709 13:03:14.386616 12077 log.cc:927] Time spent T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
W20260709 13:03:14.412601 11999 consensus_meta.cc:287] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.673s	user 0.009s	sys 0.000s
I20260709 13:03:14.404014 11888 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.415010 11644 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:14.415869 12094 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:03:14.417411 12085 log.cc:927] Time spent T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:03:14.417567 11989 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:14.418458 12083 log.cc:927] Time spent T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:03:14.419378 12086 log.cc:927] Time spent T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:03:14.387938 12008 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:14.452783  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 54438.5us
I20260709 13:03:14.309770 12044 consensus_queue.cc:260] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.462585  9418 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:14.467200  9418 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:14.446005 11928 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:14.382545 12024 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.453578 11961 raft_consensus.cc:3055] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:03:14.534629  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:14.570559  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 379030us
I20260709 13:03:14.594877  9343 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:14.462869 12015 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:14.456588 12101 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:14.392504 12102 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.471201 11743 consensus_queue.cc:1059] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.155s
I20260709 13:03:14.430498 11999 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.549688 12044 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:14.473524 12094 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:14.460573 12035 consensus_queue.cc:1059] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.159s
I20260709 13:03:14.549635 11984 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:14.632526 10759 consensus_queue.cc:1048] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:14.618623 12043 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.551676 11961 raft_consensus.cc:740] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:14.635239  9521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1578) took 1205 ms. Trace:
I20260709 13:03:14.629992 11989 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:14.641166  9521 rpcz_store.cc:276] 0709 13:03:13.429749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.811167 (+381418us) service_pool.cc:224] Handling call
0709 13:03:13.811540 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:13.833562 (+ 22022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:13.833599 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:13.868422 (+ 34823us) log.cc:844] Serialized 26 byte log entry
0709 13:03:14.121385 (+252963us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:14.121435 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.121512 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:14.635028 (+513516us) raft_consensus.cc:1685] finished
0709 13:03:14.635059 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.635177 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2234,"raft.queue_time_us":23747,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":30718,"thread_start_us":252635,"threads_started":1,"wal-append.queue_time_us":315362}
W20260709 13:03:14.645361 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 186544us
I20260709 13:03:14.645278  9343 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:14.669893  9373 raft_consensus.cc:1240] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:14.670230  9343 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:14.458941 11599 consensus_queue.cc:260] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.681818  9492 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:14.683911  9262 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7260766fbe5c43b1aab09346a89d9ac6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:14.649288 11964 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.690701  9492 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:14.633455 12046 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:03:14.671139 12035 raft_consensus.cc:3055] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:14.703395 12095 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:14.704137 12095 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.704648 12095 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:14.705161 12080 log.cc:927] Time spent T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.526s	user 0.027s	sys 0.013s
I20260709 13:03:14.676072 11960 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:14.643810 12043 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.709254  9520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1325) took 1372 ms. Trace:
I20260709 13:03:14.709537 12043 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:14.711136 12078 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:14.709642  9520 rpcz_store.cc:276] 0709 13:03:13.337273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.343807 (+  6534us) service_pool.cc:224] Handling call
0709 13:03:13.375837 (+ 32030us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:13.407411 (+ 31574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:13.407453 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:13.429280 (+ 21827us) log.cc:844] Serialized 52 byte log entry
0709 13:03:13.743982 (+314702us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b180038efc0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58345fe07 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b 00007fb586109d23 00007fb58610a0d1 00007fb586525a0f
0709 13:03:13.985782 (+241800us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:14.056519 (+ 70737us) log.cc:844] Serialized 14 byte log entry
0709 13:03:14.075764 (+ 19245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.075856 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:14.704413 (+628557us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:14.708898 (+  4485us) raft_consensus.cc:1685] finished
0709 13:03:14.708924 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.709181 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63312,"prepare.queue_time_us":63360,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":54291,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":28866,"spinlock_wait_cycles":13071488,"thread_start_us":241543,"threads_started":1,"wal-append.queue_time_us":689489}
I20260709 13:03:14.711922 12078 raft_consensus.cc:697] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:14.713129 12090 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:14.713878 12090 raft_consensus.cc:697] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:14.715094 12090 consensus_queue.cc:237] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.633595 12101 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:14.718634 12105 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:03:14.643762 12045 consensus_queue.cc:1059] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
W20260709 13:03:14.720324 12041 consensus_meta.cc:287] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.944s	user 0.007s	sys 0.002s
I20260709 13:03:14.701184 12035 raft_consensus.cc:740] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:14.721493 12035 consensus_queue.cc:260] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.722697 12035 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:14.723390 11968 consensus_meta.cc:287] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: Time spent flushing consensus metadata: real 1.238s	user 0.010s	sys 0.003s
W20260709 13:03:14.726076  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.688057 11984 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:14.741236  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:14.737344 12100 log.cc:927] Time spent T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:03:14.747287 12091 log.cc:927] Time spent T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.424s	user 0.010s	sys 0.003s
I20260709 13:03:14.742908  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:14.747949  9375 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:14.748867 12026 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:14.749400 12026 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.749858 12026 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.752068 12026 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:14.753144 12049 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:03:14.754091 12111 log.cc:927] Time spent T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:03:14.754317 12046 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:14.754913 12046 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.757316 12046 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:14.757449 12024 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:14.758095 11944 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:14.758898 11944 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:14.760145 12112 log.cc:927] Time spent T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:03:14.760756 12087 log.cc:927] Time spent T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.336s	user 0.000s	sys 0.001s
I20260709 13:03:14.694312 11743 raft_consensus.cc:3055] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:14.758905 12102 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:14.761453 11743 raft_consensus.cc:740] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:14.762358 11743 consensus_queue.cc:260] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:14.746513  9490 leader_election.cc:336] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.897s (SENT)
I20260709 13:03:14.763470  9490 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:14.763630 11743 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:14.764776 12102 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:14.734015 12078 consensus_queue.cc:237] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.710287 11999 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:14.769536  9490 leader_election.cc:336] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.915s (SENT)
I20260709 13:03:14.773535  9521 raft_consensus.cc:1240] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:14.774114 12102 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.775025 11988 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:14.775188 12067 raft_consensus.cc:3055] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:14.775671 12067 raft_consensus.cc:740] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:14.775539 12102 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.776651 12067 consensus_queue.cc:260] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.777774 12052 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:14.777967  9523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1585) took 1122 ms. Trace:
I20260709 13:03:14.778412 12045 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.778282 12052 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.778995 12045 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.778366  9523 rpcz_store.cc:276] 0709 13:03:13.655409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.879297 (+223888us) service_pool.cc:224] Handling call
0709 13:03:13.879719 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:13.887577 (+  7858us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:13.887610 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:13.909791 (+ 22181us) log.cc:844] Serialized 26 byte log entry
0709 13:03:14.126017 (+216226us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:14.126058 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.126136 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:14.746584 (+620448us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:14.777694 (+ 31110us) raft_consensus.cc:1685] finished
0709 13:03:14.777722 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.777914 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":132,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":5206,"spinlock_wait_cycles":12168576,"thread_start_us":129249,"threads_started":1,"wal-append.queue_time_us":299501}
I20260709 13:03:14.780385 12052 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:14.734516 12041 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.701622 11964 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.644447 12094 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:14.724426 12015 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:14.753777 12049 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.784618  9492 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:14.786998  9517 raft_consensus.cc:1275] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:14.787530 12097 raft_consensus.cc:3055] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:14.788038  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:14.789796  9370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:14.789948 12015 raft_consensus.cc:697] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 8 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:14.789924 12102 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:14.792348 12094 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:14.813074  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:14.830585  9517 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:14.812469  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:14.783443 12113 log.cc:927] Time spent T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:03:14.814242  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:14.835224 12094 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:14.835932 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:14.835832 12094 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:14.814380  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.818277  9370 raft_consensus.cc:606] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:14.819396  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:14.840121  9370 raft_consensus.cc:614] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:14.820422  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:14.820804  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:14.821447  9450 raft_consensus.cc:1240] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:14.841981  9520 raft_consensus.cc:2393] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 7: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:14.823755  9523 raft_consensus.cc:2393] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 9: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:14.843145  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:14.825187  9492 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:14.822357  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:14.810523 11888 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:14.814575 12052 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:14.852169 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 180160us
I20260709 13:03:14.847695  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:14.853236  9526 raft_consensus.cc:2393] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 4: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:14.816176 12097 raft_consensus.cc:740] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:14.818168 11984 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:03:14.858057  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.838099 12094 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:14.829969 11988 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:14.813817 12041 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:15.000532  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 217173us
I20260709 13:03:14.876216  9492 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
W20260709 13:03:15.006662  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 130589us
I20260709 13:03:14.901328  9526 raft_consensus.cc:1240] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7. Ops: []
W20260709 13:03:14.994660 11981 consensus_meta.cc:287] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 1.119s	user 0.012s	sys 0.003s
I20260709 13:03:14.855037 12026 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:15.031163  9418 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.008s	sys 0.017s
I20260709 13:03:14.865566 12102 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:14.902014 11919 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.864550 12008 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:14.999871 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:14.865950 11984 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.989326 12022 raft_consensus.cc:3055] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:15.018419 12104 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:03:15.033425  9418 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.008s	sys 0.017s
I20260709 13:03:14.865568 12052 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:14.868986 12045 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:15.039520 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:14.897782 11888 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:15.014086 12094 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.972333 11994 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:14.990453 11964 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:15.009361 11982 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:14.961644 12116 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:14.957898 11944 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:14.902323 12063 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:15.015535  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:15.116775  9526 raft_consensus.cc:2393] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 9: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:15.022245 12101 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:15.078279  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:15.078450  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 609133us
I20260709 13:03:15.123490  9370 raft_consensus.cc:2393] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:14.895453 12059 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:15.079366  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.048534 11984 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:15.021142 11988 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.062023 12022 raft_consensus.cc:740] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:15.042263 12026 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:14.987522 12015 consensus_queue.cc:237] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.039727 11981 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.014878  9517 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:15.095160  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:15.046087 11919 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:15.065407 12008 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.124871  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:14.994400 12097 consensus_queue.cc:260] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.136648  9447 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:03:15.127053  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.090555 11888 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.116123 12051 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:15.138417  9524 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:15.157876  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:15.158926  9451 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
W20260709 13:03:15.182176  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 58252.4us
I20260709 13:03:15.117089 12102 raft_consensus.cc:697] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 9 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:15.185778  9525 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:15.123083 12090 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:15.126520 11944 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:15.092176 12094 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:15.216126 12090 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:15.217666 12122 log.cc:927] Time spent T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:03:15.217557 12119 consensus_queue.cc:1059] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:03:15.218664 12119 raft_consensus.cc:3055] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:15.219038 12119 raft_consensus.cc:740] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:15.220271 12090 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:15.221740 11988 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:15.222999 12103 log.cc:927] Time spent T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e: Append to log took a long time: real 0.761s	user 0.004s	sys 0.000s
I20260709 13:03:15.225208 12102 consensus_queue.cc:237] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.198632  9517 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 13:03:15.191138  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:15.206987  9418 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:15.245784  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:15.185334 12101 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:15.244465 12078 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:15.190894 11982 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.240597 12049 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:15.193220 12051 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:15.292973  9444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1940) took 1033 ms. Trace:
I20260709 13:03:15.293864  9444 rpcz_store.cc:276] 0709 13:03:14.259618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.300081 (+ 40463us) service_pool.cc:224] Handling call
0709 13:03:14.300412 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:14.300636 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:14.397490 (+ 96854us) log.cc:844] Serialized 14 byte log entry
0709 13:03:15.292302 (+894812us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b18000eb060. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb5861124bc 00007fb58346048b 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347a455 00007fb586562060 00007fb586574716 00007fb586585287
0709 13:03:15.292442 (+   140us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:15.292512 (+    70us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:15.292592 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.292702 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.292882 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":71234,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":89778,"raft.run_wall_time_us":5317,"spinlock_wait_cycles":85129472,"thread_start_us":320804,"threads_started":3,"wal-append.queue_time_us":246091}
I20260709 13:03:15.241446 11944 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.260665 11733 consensus_queue.cc:1048] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:03:15.273759 12078 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:15.319520  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:15.301187 12041 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:15.268100 12101 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:15.324754  9524 raft_consensus.cc:2955] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:15.304549 12045 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.282585 12035 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:03:15.284778 11982 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.322227 12078 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:15.326591 12131 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.328189 12008 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:15.324120 12047 consensus_queue.cc:1059] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 13:03:15.342192 12052 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:15.326644 11960 consensus_queue.cc:1059] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 13:03:15.351805 12095 consensus_meta.cc:287] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.003s
W20260709 13:03:15.355878 12120 log.cc:927] Time spent T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:03:15.084425 12104 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:15.358769 12135 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.122714 12116 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:15.126452 12063 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:15.362141 11981 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:15.129757 12059 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.239763 12022 consensus_queue.cc:260] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:15.391785 12129 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:03:15.349553 12045 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.375973 12095 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:15.396551 12134 log.cc:927] Time spent T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:03:15.384102 11888 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:15.401535 12125 log.cc:927] Time spent T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 13:03:15.401816 12133 log.cc:927] Time spent T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:03:15.404467 12116 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:15.405800 12051 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:15.219924 12119 consensus_queue.cc:260] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.113962 11994 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:15.366206 12026 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:15.375473 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:15.449385 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:03:15.464031  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.431205 11982 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:15.389362 12135 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.529865 10068 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:03:15.424949 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:15.386926 11968 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:15.436668  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:15.411034 12094 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:15.442979  9377 raft_consensus.cc:1240] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:03:15.355279 12131 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.407612 11919 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:15.432811 12022 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:15.538107 12044 consensus_meta.cc:287] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.896s	user 0.010s	sys 0.003s
I20260709 13:03:15.554597 12138 raft_consensus.cc:3055] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:15.555413 12143 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:15.595577 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:15.565881  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:15.596376 10070 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:03:15.576638  9526 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 5.
I20260709 13:03:15.565790 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:15.589437  9377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1319) took 1429 ms. Trace:
I20260709 13:03:15.596808  9446 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:15.597896  9377 rpcz_store.cc:276] 0709 13:03:14.160015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.435631 (+1275616us) service_pool.cc:224] Handling call
0709 13:03:15.442762 (+  7131us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:15.589123 (+146361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.589372 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:15.409911  9447 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:15.617198  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:15.564930 12059 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:15.562503 12101 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:15.624949 12095 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:15.589315 12119 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:15.639199  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:15.639712  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 377130us
W20260709 13:03:15.640349  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 360664us
I20260709 13:03:15.588697 11944 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:15.646576  9445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51006 (request call id 66) took 1580 ms. Trace:
I20260709 13:03:15.646690  9371 consensus_queue.cc:237] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:15.684952  9445 rpcz_store.cc:276] 0709 13:03:14.059606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.114709 (+ 55103us) service_pool.cc:224] Handling call
0709 13:03:15.639784 (+1525075us) spinlock_profiling.cc:243] Waited 65.3 ms on lock 0x7b5400114254. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb586564853 00007fb58b53260a 00007fb584ab87d4 00007fb584ab8762 00007fb584ab8691 00007fb584ab860c 00007fb584ab78c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:15.639896 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150203648}
I20260709 13:03:15.684619  9418 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:15.648747  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:15.649724 12144 log.cc:927] Time spent T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:03:15.616632 11733 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.595552 12138 raft_consensus.cc:740] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:03:15.643729 12129 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:03:15.704401  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.590796 11968 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:15.714494  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:15.704555  9341 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:15.719099  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:15.726204  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:15.703658 11733 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.733192 12026 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:15.733462  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:15.734097  9377 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:15.733871 12026 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:15.735116  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:15.736150  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:15.736621 12051 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:15.737174 12051 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:15.739415 12051 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:15.739894 12147 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:15.684458 12059 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:15.692270 12068 raft_consensus.cc:2804] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:15.742287  9492 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:03:15.742440  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.747678  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:15.748843  9370 raft_consensus.cc:2393] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 4: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:15.736202 12026 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:15.740463 12147 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:15.736788  9377 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:03:15.743515  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:15.751243 12131 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:15.754892  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:15.756408 11984 consensus_meta.cc:287] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.619s	user 0.008s	sys 0.004s
I20260709 13:03:15.757207 12148 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
W20260709 13:03:15.752768 11743 consensus_meta.cc:287] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.989s	user 0.016s	sys 0.000s
I20260709 13:03:15.772076  9446 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
W20260709 13:03:15.777750  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 51621.8us
W20260709 13:03:15.790046  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.790896  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:15.709789 12135 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:15.786628  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:15.789633  9376 raft_consensus.cc:1240] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:03:15.793403  9371 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:03:15.795707  9376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1318) took 1636 ms. Trace:
I20260709 13:03:15.796270  9376 rpcz_store.cc:276] 0709 13:03:14.159722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.789078 (+1629356us) service_pool.cc:224] Handling call
0709 13:03:15.789400 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:15.792904 (+  3504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.795640 (+  2736us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:15.813108  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:15.814656  9376 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:15.815092  9374 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:03:15.768582 12068 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:15.626607 12143 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:15.788532  9368 raft_consensus.cc:2955] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:15.825165 12155 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:03:15.829484  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 125061us
I20260709 13:03:15.828878  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:15.840704  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.848799 12143 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:15.851009 12104 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:15.791388 11984 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.854936 11984 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:15.855937 12130 log.cc:927] Time spent T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.595s	user 0.000s	sys 0.007s
I20260709 13:03:15.858193 12063 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:15.858348 12128 log.cc:927] Time spent T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.514s	user 0.001s	sys 0.005s
I20260709 13:03:15.827199 11743 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:15.859933  9521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1597) took 1046 ms. Trace:
I20260709 13:03:15.832151 11897 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:15.860437  9521 rpcz_store.cc:276] 0709 13:03:14.813049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.813163 (+   114us) service_pool.cc:224] Handling call
0709 13:03:14.813467 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:14.818443 (+  4976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:14.818472 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:14.839592 (+ 21120us) log.cc:844] Serialized 26 byte log entry
0709 13:03:15.097058 (+257466us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:15.097119 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.097219 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:15.857643 (+760424us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:15.859653 (+  2010us) raft_consensus.cc:1685] finished
0709 13:03:15.859673 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.859874 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":720,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":10714,"spinlock_wait_cycles":4521728,"thread_start_us":192506,"threads_started":1,"wal-append.queue_time_us":426600}
I20260709 13:03:15.846529  9370 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:03:15.839583  9444 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:15.870085  9341 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:15.778357 12059 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.803754 12026 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:15.788940 12051 consensus_queue.cc:1059] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 6.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:03:15.819327 12045 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:15.889150 12078 consensus_meta.cc:287] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.536s	user 0.012s	sys 0.000s
I20260709 13:03:15.831714 11762 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:03:15.891367  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 77394.3us
I20260709 13:03:15.832964 12068 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:15.897378  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1577) took 2493 ms. Trace:
I20260709 13:03:15.901409  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:15.902036  9445 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 7.
I20260709 13:03:15.881386 12104 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:15.860638 11897 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.899734  9519 rpcz_store.cc:276] 0709 13:03:13.398113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.786665 (+388552us) service_pool.cc:224] Handling call
0709 13:03:13.786993 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:13.813757 (+ 26764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:13.813790 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:13.834321 (+ 20531us) log.cc:844] Serialized 26 byte log entry
0709 13:03:14.065530 (+231209us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:14.119823 (+ 54293us) log.cc:844] Serialized 14 byte log entry
0709 13:03:14.120120 (+   297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.120234 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:14.708581 (+588347us) spinlock_profiling.cc:243] Waited 7.33 ms on lock 0x7b180027b740. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58347d3f3 00007fb58347f7c1 00007fb58347f779 00007fb58347f709 00007fb58347f6d1 00007fb58347e9cd 000000000038f354 000000000038f199 00007fb58346083a
0709 13:03:15.862897 (+1154316us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b180027b740. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58347d3f3 00007fb58347f7c1 00007fb58347f779 00007fb58347f709 00007fb58347f6d1 00007fb58347e9cd 000000000038f354 000000000038f199 00007fb58346083a
0709 13:03:15.891502 (+ 28605us) raft_consensus.cc:1685] finished
0709 13:03:15.891525 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.891668 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23035,"prepare.queue_time_us":55302,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":2490,"raft.queue_time_us":48486,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":30088,"spinlock_wait_cycles":43762944,"thread_start_us":161974,"threads_started":1,"wal-append.queue_time_us":287648}
I20260709 13:03:15.898012 12051 consensus_queue.cc:1243] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 8.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:03:15.910336  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:15.873986 12095 consensus_queue.cc:1059] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:03:15.918345  9446 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 3.
I20260709 13:03:15.919759  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:15.896234 12026 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.926075 11897 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:15.828626 12138 consensus_queue.cc:260] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.929931 12138 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:15.931397 11961 consensus_queue.cc:260] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.899355 12078 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.934983 12078 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:15.937230 12026 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:15.921825 11994 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:15.945248 11958 raft_consensus.cc:3055] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:15.945791 11958 raft_consensus.cc:740] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:15.948071 12014 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:15.957867 11968 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:15.951607 11960 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.968571 11960 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.959774 12151 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.971099 12151 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:15.986013 12059 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:15.988835 12151 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:15.996172  9525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46894 (request call id 1598) took 1182 ms. Trace:
I20260709 13:03:15.996645  9525 rpcz_store.cc:276] 0709 13:03:14.813907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.814020 (+   113us) service_pool.cc:224] Handling call
0709 13:03:15.995959 (+1181939us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54000b9d54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:15.996079 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":807604992}
I20260709 13:03:16.000456 12043 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:16.000736  9368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50568 (request call id 291) took 1842 ms. Trace:
W20260709 13:03:16.010208 12159 log.cc:927] Time spent T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:03:16.011190  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 135718us
I20260709 13:03:16.002799 11960 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:16.001096 12043 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:16.005076  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 262841us
I20260709 13:03:16.005861 12131 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:16.016817  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:16.022068  9374 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:16.022265  9341 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:16.023473 12048 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:16.023859 12048 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:16.023890  9341 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:16.024358 12048 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:16.024693 11928 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:16.025427  9341 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:16.017100  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.016871  9492 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:03:16.026399  9341 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:16.028694  9341 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:16.029562 12167 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:16.030200  9341 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:16.031039 12151 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:16.032037 12151 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.033080  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:16.033250  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.033722  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:16.026505 12099 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.032492 12151 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:16.034966  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:16.037612  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.034795 12099 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.037750  9492 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:16.036353 11985 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:16.045571 11985 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.046021 11985 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:16.047359  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:16.048005  9446 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:16.049430 11982 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:16.041692 12014 raft_consensus.cc:2804] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:16.038127 11928 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:16.050547 12014 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.051047 11928 raft_consensus.cc:697] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:16.051112 12014 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:16.052840  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:16.051115  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:16.041172  9374 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:03:16.053850  9444 raft_consensus.cc:2410] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:03:16.056743  9446 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:16.051973 11928 consensus_queue.cc:237] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:16.042048  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.043252  9492 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:16.027017 12131 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.059553  9373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1326) took 1881 ms. Trace:
I20260709 13:03:16.060691  9492 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:16.061820  9492 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:16.059968  9373 rpcz_store.cc:276] 0709 13:03:14.178543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.184508 (+  5965us) service_pool.cc:224] Handling call
0709 13:03:14.184815 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:14.670348 (+485533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.059334 (+1388986us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b5400188154. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:16.059498 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1115135872}
I20260709 13:03:16.067853  9446 raft_consensus.cc:1240] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:16.058283 11981 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:16.063436 12131 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:16.063932 11982 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:16.080531 12068 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.086597 12068 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:16.090250 12094 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:16.090867 12094 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.093164 12094 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:16.095108  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.096025  9373 raft_consensus.cc:2393] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 7: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:16.065058 11984 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:16.065294 12059 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:16.107362  9341 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:16.132216 12175 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:16.133481 12175 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.074533 11981 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:16.109058 12059 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.146306 12059 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:16.124150 11982 raft_consensus.cc:697] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:16.135211 11944 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:16.137197 11984 raft_consensus.cc:697] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 9 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:16.141346 11981 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:16.144789 12135 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:16.153347  9372 raft_consensus.cc:1275] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:03:16.157264  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 50032.6us
I20260709 13:03:16.158357  9372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1324) took 1996 ms. Trace:
I20260709 13:03:16.158653  9372 rpcz_store.cc:276] 0709 13:03:14.161712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.152668 (+1990956us) service_pool.cc:224] Handling call
0709 13:03:16.152996 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:16.155230 (+  2234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.158310 (+  3080us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:16.169184 12082 log.cc:927] Time spent T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 1.986s	user 0.000s	sys 0.010s
I20260709 13:03:16.154435 11944 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:16.170984 11984 consensus_queue.cc:237] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.172099 11944 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:16.158114 12135 raft_consensus.cc:697] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:16.180294  9341 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:16.172960  9518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1576) took 2794 ms. Trace:
I20260709 13:03:16.178047 12099 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:16.190677 12170 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:16.187929  9518 rpcz_store.cc:276] 0709 13:03:13.379074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.775165 (+396091us) service_pool.cc:224] Handling call
0709 13:03:13.775507 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:13.800841 (+ 25334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:13.800877 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:13.801426 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 13:03:13.889779 (+ 88353us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:13.913706 (+ 23927us) log.cc:844] Serialized 14 byte log entry
0709 13:03:13.913906 (+   200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.913975 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:16.150484 (+2236509us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:16.172667 (+ 22183us) raft_consensus.cc:1685] finished
0709 13:03:16.172756 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.172896 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43552,"prepare.queue_time_us":34443,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":194,"raft.queue_time_us":38758,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":61024,"spinlock_wait_cycles":40100736,"thread_start_us":87939,"threads_started":1,"wal-append.queue_time_us":319062}
I20260709 13:03:16.199920 12170 raft_consensus.cc:697] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:16.177757 12048 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.176616 12014 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:16.233191 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:16.202828 12170 consensus_queue.cc:237] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.242491 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:16.233999  9377 raft_consensus.cc:1240] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:16.173580 11982 consensus_queue.cc:237] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.261875 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:03:16.266419  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 75032us
W20260709 13:03:16.270694  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.270643  9444 raft_consensus.cc:1240] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:16.271577  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:03:16.272120  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.272318  9451 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:16.178372 12135 consensus_queue.cc:237] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.274883  9444 raft_consensus.cc:1240] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:16.242892 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:16.276773 10069 raft_consensus.cc:1275] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:16.277918  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:16.280795  9373 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:16.282037  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.282979 12095 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:16.283532 12095 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:16.285504 12095 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:16.276031  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.241243 12073 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:16.291851  9373 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:03:16.294816 12048 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:16.305507 12098 consensus_queue.cc:1059] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:16.305925 11733 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:16.276700 12045 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:16.313792  9451 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:16.243049 12151 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.306264 12073 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:16.292760 12171 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.241627 11985 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.319324 12045 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.320103 11989 raft_consensus.cc:3055] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:16.327718 11989 raft_consensus.cc:740] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:16.312340 12044 consensus_queue.cc:1059] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:03:16.328913 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:16.329329 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:16.329903 10068 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:16.328650 11989 consensus_queue.cc:260] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.331408 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:16.331382 11989 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:16.335837  9518 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 9 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:16.328670 12045 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:16.337508  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:16.343242  9518 raft_consensus.cc:2410] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:03:16.343094  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:16.338505  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.333770  9341 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:16.343995  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:16.344726  9525 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:16.318585 12171 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.345484 12073 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:16.346676 12067 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:16.347286 12171 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:16.348515  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:16.321142 12059 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.349745  9443 raft_consensus.cc:3055] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:16.351069  9443 raft_consensus.cc:740] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:16.351352  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:16.352070  9518 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:16.352905  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:16.353852  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:16.355422 12050 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:16.355688 11985 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:16.356098 12050 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.357710  9451 raft_consensus.cc:2410] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:03:16.359660  9518 raft_consensus.cc:1275] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:16.360093  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:16.360685  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:16.361188  9446 raft_consensus.cc:2410] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:03:16.361748  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:16.362350  9451 raft_consensus.cc:2393] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 7: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:16.323459 12014 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:16.366504  9342 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:16.367170  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:16.367482  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:16.368131  9444 raft_consensus.cc:2410] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:03:16.368173  9451 raft_consensus.cc:2393] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 6: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:16.369982  9446 raft_consensus.cc:1240] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:16.370543  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:16.372399  9444 raft_consensus.cc:1240] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:16.368171  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:16.371750  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:16.376430  9451 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:16.378719  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:16.380373  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:16.380508  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:16.359666 12175 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:16.357913 11928 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.358705  9443 consensus_queue.cc:260] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.393467  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:16.394722  9521 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:16.397485  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:16.398466  9444 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:03:16.399771  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:16.400645  9446 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:16.402489  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:16.402655  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:16.403885  9446 raft_consensus.cc:2410] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:03:16.369493 12098 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:16.406301  9443 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:16.362077 12131 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.409431  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:16.410046  9447 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:16.411543  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:16.396701 12174 raft_consensus.cc:2764] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:03:16.414739  9524 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:16.414821  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:16.416523  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:16.419925  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:16.420181  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:16.407841 12024 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:16.420563  9522 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:16.421327  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:16.423025  9518 raft_consensus.cc:1240] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 9 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:16.424284  9443 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260709 13:03:16.427486  9443 pending_rounds.cc:85] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 2
I20260709 13:03:16.427842  9443 pending_rounds.cc:107] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 7.3
I20260709 13:03:16.428179  9443 raft_consensus.cc:2889] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:16.424522  9341 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:16.426693  9452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1949) took 1301 ms. Trace:
I20260709 13:03:16.429487  9452 rpcz_store.cc:276] 0709 13:03:15.125377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.125823 (+   446us) service_pool.cc:224] Handling call
0709 13:03:15.126107 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:15.186902 (+ 60795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:15.186956 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:15.187022 (+    66us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:15.187073 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.426462 (+1239389us) spinlock_profiling.cc:243] Waited 60.5 ms on lock 0x7b54000d7354. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:16.426511 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.426635 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139201792}
I20260709 13:03:16.432257  9443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1942) took 2168 ms. Trace:
I20260709 13:03:16.433241  9519 raft_consensus.cc:2393] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 9: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:16.433769  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:16.405488 11928 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.434460  9524 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:16.436228 11928 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:16.436952 12154 consensus_queue.cc:1059] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:16.433073  9418 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:16.438822  9418 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:16.410393 12098 raft_consensus.cc:697] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:16.431354  9341 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:16.432619  9443 rpcz_store.cc:276] 0709 13:03:14.260244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.340536 (+ 80292us) service_pool.cc:224] Handling call
0709 13:03:14.388969 (+ 48433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:16.349636 (+1960667us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b540045ac20. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5864e1dc0 00007fb58656c1c0 00007fb58656d231 00007fb586569d8f 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c
0709 13:03:16.428644 (+ 79008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.428876 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5624064}
W20260709 13:03:16.431631 12089 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:03:16.408193 12105 consensus_queue.cc:1048] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:03:16.432066 12175 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:16.456574  9524 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:16.421366 12024 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.444927 12090 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:16.445545 12078 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:16.469672 12078 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:16.470129 12078 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:16.447149 12047 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:16.473312 12047 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:16.473750 12047 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:16.477270 11964 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:16.478044 12123 consensus_queue.cc:1059] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:16.478278  9375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50568 (request call id 295) took 1624 ms. Trace:
W20260709 13:03:16.467427 12178 log.cc:927] Time spent T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:03:16.468050 11961 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:16.008311  9368 rpcz_store.cc:276] 0709 13:03:14.158331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.164101 (+  5770us) service_pool.cc:224] Handling call
0709 13:03:14.164613 (+   512us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:15.765544 (+1600931us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b180010e1c0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb5861124bc 00007fb58346048b 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347a455 00007fb586562060 00007fb586562bfb 00007fb58656d64b
0709 13:03:15.765719 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:15.765754 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:15.767230 (+  1476us) log.cc:844] Serialized 566 byte log entry
0709 13:03:15.788361 (+ 21131us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:15.999516 (+211155us) log.cc:844] Serialized 14 byte log entry
0709 13:03:16.000085 (+   569us) log.cc:844] Serialized 14 byte log entry
0709 13:03:16.000298 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.000406 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:16.000528 (+   122us) raft_consensus.cc:1685] finished
0709 13:03:16.000542 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.000680 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24038,"prepare.queue_time_us":137,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":75789,"raft.run_cpu_time_us":510,"raft.run_wall_time_us":35019,"spinlock_wait_cycles":42780416,"thread_start_us":64038,"threads_started":2,"wal-append.queue_time_us":130500}
I20260709 13:03:16.455871 12151 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:16.456146 12045 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:03:16.454610 12154 consensus_queue.cc:1243] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 6d50f1c263264b21919230bee398022b log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:16.465893 12090 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:16.490885 12090 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:16.447700 12022 consensus_queue.cc:1048] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:03:16.478802 12123 consensus_queue.cc:1243] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 6d50f1c263264b21919230bee398022b log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:03:16.476992  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.494731 12059 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:16.495522  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:16.499006  9490 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.613s (SENT) [suppressed 46 similar messages]
I20260709 13:03:16.499238 12098 consensus_queue.cc:237] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.499993 11649 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:16.500624 11649 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:16.502391 10027 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:16.503598 12131 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:16.502396 12024 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:16.505837  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:16.506448  9522 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 7.
I20260709 13:03:16.479001  9375 rpcz_store.cc:276] 0709 13:03:14.853750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.477142 (+1623392us) service_pool.cc:224] Handling call
0709 13:03:16.477561 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:16.477851 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:16.477892 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:16.477951 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:16.477997 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.478067 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.478209 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:16.507325  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:16.507272 11649 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:16.508919 12026 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.509475 12026 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.447916 12050 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:16.516921  9368 raft_consensus.cc:1240] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:03:16.454078 12175 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.523907 10027 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:16.527427  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.456861 10068 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:03:16.539235  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.543488  9368 raft_consensus.cc:2393] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 9: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:16.539326 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:16.549815  9447 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:16.551085  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.556135  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.557916  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:16.559551 10027 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:16.566283  9524 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 3.
I20260709 13:03:16.527117 12175 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:16.569410  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:16.574936  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 75956.5us
I20260709 13:03:16.476990 11981 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:16.577124  9490 leader_election.cc:336] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 2.116s (SENT)
I20260709 13:03:16.577157  9376 raft_consensus.cc:2393] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 8: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:16.578464  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.554809 11994 raft_consensus.cc:2764] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:03:16.580260  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.586205  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.578682  9490 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:16.579025  9491 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:16.584216  9517 raft_consensus.cc:1240] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:16.568950 12117 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:16.592201  9373 raft_consensus.cc:1240] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:16.595052 12131 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:16.602639 11981 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:16.604780  9374 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
W20260709 13:03:16.615681  9490 leader_election.cc:336] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 2.135s (SENT)
I20260709 13:03:16.616474  9490 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:16.618688  9490 leader_election.cc:336] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 2.142s (SENT)
I20260709 13:03:16.591044 12101 raft_consensus.cc:2804] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:03:16.610163 12015 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.189s	user 0.019s	sys 0.013s
I20260709 13:03:16.619374  9490 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:16.619913  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 139200us
I20260709 13:03:16.632092  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:16.614563 12022 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.632619  9418 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:16.633870  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.635138 12123 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:16.635567 12123 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.635972 12123 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:16.636615  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.638411  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:16.639711 12022 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.641371 12014 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:16.641929 12022 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:16.642900 12182 log.cc:927] Time spent T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:03:16.646631 11982 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:16.647346 12131 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:16.647195 11982 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.647876 12131 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.628966 11981 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:16.648423 12078 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.638962 12047 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.708957  9376 raft_consensus.cc:1275] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:16.695712  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:16.634231  9418 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:16.710170  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 76008.3us
I20260709 13:03:16.710744  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.711030 12047 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:16.711771  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.726099  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:16.726926  9376 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:16.727356 11599 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:16.729763  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:16.731736  9452 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:16.675971  9450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 1947) took 1552 ms. Trace:
I20260709 13:03:16.633172 12101 raft_consensus.cc:697] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:16.685710 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:16.676744 10065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 279) took 1667 ms. Trace:
I20260709 13:03:16.702574 11958 consensus_queue.cc:260] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:16.699661  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.649457 11981 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:16.698345 12059 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:16.733458  9375 raft_consensus.cc:1240] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:16.654078  9373 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:16.753329 12067 consensus_queue.cc:1048] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:03:16.761085 10065 rpcz_store.cc:276] 0709 13:03:15.009724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.016196 (+  6472us) service_pool.cc:224] Handling call
0709 13:03:15.049227 (+ 33031us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:15.430371 (+381144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:15.432200 (+  1829us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:15.438201 (+  6001us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:15.440194 (+  1993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.676468 (+1236274us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b54006603d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:16.676532 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.676679 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":782005120}
I20260709 13:03:16.754390 12097 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:16.761592  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.764221  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.741966 11950 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:16.686030 12043 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:16.737358  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:16.765875  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:16.766530 11950 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:16.758275  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:16.766992 11950 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:16.745319  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:16.664008  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.769428 12059 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:16.737814  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.771490  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.771826 12059 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:16.771984 12035 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.772385 11958 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:16.773671  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.775823  9372 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:03:16.698807 10027 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:16.705824 11855 raft_consensus.cc:3055] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:16.801653 11855 raft_consensus.cc:740] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:16.801774 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 103051us
I20260709 13:03:16.802578 11855 consensus_queue.cc:260] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.803220 11973 raft_consensus.cc:2804] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:16.803618 11973 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:16.803841 10027 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:16.804108 11973 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:16.806532 12070 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:16.803618 11855 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:16.809095  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.809674  9372 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:16.703438 12175 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.708077  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.810431 12095 raft_consensus.cc:2955] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 3 to 8, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:16.711951 12050 raft_consensus.cc:2804] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:16.713188 12118 consensus_queue.cc:1059] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:16.814358 12118 consensus_queue.cc:1243] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 6d50f1c263264b21919230bee398022b log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:03:16.814865 12118 raft_consensus.cc:3055] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:16.815167 12118 raft_consensus.cc:740] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:16.815217 12175 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:16.816038 12118 consensus_queue.cc:260] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:16.715252  9323 auto_rebalancer.cc:893] Removing replace marker failed: Replica d62c9d5a052b42ce8675f8438f846526 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:16.675616 12123 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.715319  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.817960 12050 raft_consensus.cc:697] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:16.818488  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:16.819228  9377 raft_consensus.cc:2393] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:16.818910 12050 consensus_queue.cc:237] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.820008  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.820683  9377 raft_consensus.cc:2393] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 in current term 6: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:16.820353 11950 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.697561  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:16.717512  9518 raft_consensus.cc:1240] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:03:16.821333  9446 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:16.693907 11962 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:16.719722 12147 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:16.821588 12118 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:16.720688  9524 raft_consensus.cc:1275] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:16.721328  9492 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
W20260709 13:03:16.823428  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 102176us
I20260709 13:03:16.824839  9492 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:16.719622 12078 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:16.721333 12099 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:16.703723 12104 raft_consensus.cc:3055] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:16.829527 12059 consensus_queue.cc:1059] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:03:16.834251 12104 raft_consensus.cc:740] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:16.723767 12187 log.cc:927] Time spent T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.084s	user 0.003s	sys 0.000s
I20260709 13:03:16.699538 12014 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:16.656062 12131 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:16.835397 12131 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:16.835201 12014 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.835916 12131 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:16.761777 11981 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.837440 12014 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:16.732784  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:16.777037  9271 catalog_manager.cc:5697] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 3 to 4, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68), now has a pending config: VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65), VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66), VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67), VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 4 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:16.838277  9443 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:03:16.838397 11981 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:16.838573 12131 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:16.772562 12035 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.767189  9517 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 3.
I20260709 13:03:16.767014  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.779896  9523 raft_consensus.cc:1240] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:16.733402  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:16.781765  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.746177  9369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1325) took 2581 ms. Trace:
I20260709 13:03:16.733202  9450 rpcz_store.cc:276] 0709 13:03:15.123562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.123834 (+   272us) service_pool.cc:224] Handling call
0709 13:03:15.124133 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:15.321941 (+197808us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:15.642697 (+320756us) log.cc:844] Serialized 14 byte log entry
0709 13:03:15.895453 (+252756us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:15.895508 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:15.895549 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.675691 (+780142us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b5400016154. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:16.675740 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.675898 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25274,"prepare.queue_time_us":327408,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":33035,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":11323,"spinlock_wait_cycles":454395136,"thread_start_us":531899,"threads_started":3,"wal-append.queue_time_us":268059}
I20260709 13:03:16.649371 11982 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:16.740841 12089 consensus_queue.cc:1059] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:03:16.659888 12026 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:16.661202 11964 raft_consensus.cc:3055] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:16.857223 11964 raft_consensus.cc:740] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:16.858180 11964 consensus_queue.cc:260] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.859161 11964 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:16.753517  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.790380 12101 consensus_queue.cc:237] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:16.632019 12015 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.227s	user 0.022s	sys 0.014s
I20260709 13:03:16.792904  9418 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:16.794498  9376 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
W20260709 13:03:16.871173  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 78355.2us
I20260709 13:03:16.871941  9376 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:03:16.795529  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 58192.4us
I20260709 13:03:16.828698 11984 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:16.797171 12067 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.797796 11921 raft_consensus.cc:2804] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:16.687515 12090 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.811355  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.810461  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:16.634384  9490 leader_election.cc:336] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 2.224s (SENT)
W20260709 13:03:16.817268  9323 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:03:16.716321  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:16.827633  9446 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:16.829113 12146 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:16.880980  9323 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:03:16.834038 12099 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.750402 12138 raft_consensus.cc:3055] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:16.840497  9519 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:16.853746 12089 raft_consensus.cc:3055] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:16.853919 11973 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:16.855091 11950 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:16.855976  9275 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43240 (request call id 179) took 6775 ms. Trace:
W20260709 13:03:16.861433  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.861611  9341 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:16.829402 12041 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:16.841274  9369 rpcz_store.cc:276] 0709 13:03:14.165337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.180288 (+ 14951us) service_pool.cc:224] Handling call
0709 13:03:14.180646 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:15.758263 (+1577617us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b18001872a0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb5861124bc 00007fb58346048b 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347a455 00007fb586562060 00007fb586562bfb 00007fb58656d64b
0709 13:03:15.758440 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:15.758869 (+   429us) log.cc:844] Serialized 14 byte log entry
0709 13:03:16.740631 (+981762us) spinlock_profiling.cc:243] Waited 54.9 ms on lock 0x7b18001872a0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb5861124bc 00007fb58346048b 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b 00007fb586109d23 00007fb58610a23a
0709 13:03:16.740960 (+   329us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:16.741543 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:03:16.741710 (+   167us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:16.741756 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.745855 (+  4099us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:16.745912 (+    57us) raft_consensus.cc:1685] finished
0709 13:03:16.745932 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.746089 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10756,"prepare.queue_time_us":20573,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":54641,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":31420,"spinlock_wait_cycles":131774720,"thread_start_us":143941,"threads_started":2,"wal-append.queue_time_us":191654}
I20260709 13:03:16.796504  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.871944  9418 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:16.905711  9369 raft_consensus.cc:1240] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:03:16.876298  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:16.906425  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.907083  9341 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:16.881335  9521 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:16.896138  9275 rpcz_store.cc:276] 0709 13:03:10.082169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.082441 (+   272us) service_pool.cc:224] Handling call
0709 13:03:10.192210 (+109769us) spinlock_profiling.cc:243] Waited 82.2 ms on lock 0x7b540016e4d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d4090 00007fb586572f3a 00007fb58c3291cc 00007fb58c42737e 00007fb58a8e82a4 00007fb58a8e8232 00007fb58a8e8161 00007fb58a8e80dc 00007fb58a8e7392 00007fb5848a548c 00007fb5848a48c6
0709 13:03:16.855869 (+6663659us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:13.744090 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:13.744778 (+   688us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:13.744819 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:03:13.744842 (+    23us) tablet.cc:662] Decoding operations
0709 13:03:13.797632 (+ 52790us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:13.797685 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:13.797713 (+    28us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:03:13.902406 (+104693us) tablet.cc:701] Row locks acquired
0709 13:03:13.902439 (+    33us) write_op.cc:260] PREPARE: finished
0709 13:03:13.925130 (+ 22691us) write_op.cc:270] Start()
0709 13:03:13.991952 (+ 66822us) write_op.cc:276] Timestamp: P: 1783602193914508 usec, L: 0
0709 13:03:13.991997 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 13:03:14.155881 (+163884us) log.cc:844] Serialized 9679 byte log entry
0709 13:03:14.834263 (+678382us) spinlock_profiling.cc:243] Waited 83.3 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:15.364191 (+529928us) op_driver.cc:464] REPLICATION: finished
0709 13:03:15.650349 (+286158us) write_op.cc:301] APPLY: starting
0709 13:03:15.650442 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:15.682837 (+ 32395us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:15.682882 (+    45us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:15.887240 (+204358us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:15.887618 (+   378us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=25
0709 13:03:15.887666 (+    48us) write_op.cc:312] APPLY: finished
0709 13:03:15.888302 (+   636us) log.cc:844] Serialized 169 byte log entry
0709 13:03:15.888508 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:15.888737 (+   229us) write_op.cc:454] Released schema lock
0709 13:03:15.888811 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:15.908535 (+ 19724us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:15.909959 (+  1424us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":48,"spinlock_wait_cycles":189012352,"child_traces":[["op",{"apply.queue_time_us":283025,"apply.run_cpu_time_us":7965,"apply.run_wall_time_us":250213,"num_ops":25,"prepare.queue_time_us":308744,"prepare.run_cpu_time_us":28499,"prepare.run_wall_time_us":579292,"raft.queue_time_us":104543,"raft.run_cpu_time_us":18243,"raft.run_wall_time_us":198744,"replication_time_us":1349708,"spinlock_wait_cycles":191659264,"thread_start_us":548897,"threads_started":4,"wal-append.queue_time_us":230271}]]}
I20260709 13:03:16.881780  9444 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:16.881615  9377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7a866663507456b9442af6c42748c5f"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:16.910589  9377 raft_consensus.cc:606] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:16.910955  9377 raft_consensus.cc:614] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:16.880849  9490 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:16.882946  9374 raft_consensus.cc:2393] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 9: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:16.887251  9447 raft_consensus.cc:2410] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:03:16.839389  9271 catalog_manager.cc:5697] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:16.886240 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:03:16.892513  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 99430.2us
I20260709 13:03:16.880468 12078 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:16.898350  9375 raft_consensus.cc:1240] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:16.899600  9376 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
W20260709 13:03:16.913291  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 278908us
I20260709 13:03:16.913722  9418 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:16.885414 12138 raft_consensus.cc:740] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:16.920745  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.893740 12089 raft_consensus.cc:740] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:16.919389  9492 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:16.929441  9343 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:16.930550  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.930963  9418 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:16.931062  9417 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:16.884308 12067 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.926190 12015 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:16.938113  9373 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:16.948113  9341 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:16.950093  9341 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:16.951954  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.939025 11973 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:16.939675 12099 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:16.942533 12090 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:16.924439 12167 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:16.924021 12068 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:16.902601 12041 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:16.958209  9418 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:16.958918  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:16.963471  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:16.978197  9521 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:16.978533  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 49179.1us
I20260709 13:03:16.979223  9418 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:16.927191 12123 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:16.915729 11984 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:16.926362 12043 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:03:16.970199 12172 log.cc:927] Time spent T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:17.003383  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:16.983590  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:16.893224 12146 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:16.972385  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:16.947237 12059 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:16.999150  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:16.948820 12199 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.925997 11644 consensus_queue.cc:1059] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:03:16.965431 12142 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:16.970465 12015 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.038900 12043 raft_consensus.cc:697] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:17.041610  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 62317.1us
I20260709 13:03:17.000248  9418 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:16.999511 12090 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:17.052923  9521 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 4.
W20260709 13:03:16.975301  9490 connection.cc:256] RPC call timeout handler was delayed by -1.4000722939999832s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20779999999999998s for a response
I20260709 13:03:16.969448 12050 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:17.005066 12177 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:17.011879  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 61856.9us
I20260709 13:03:16.983210 12078 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:16.970309 12026 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:17.010099  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:17.011413 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:17.027338 12067 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:17.027882 11888 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:17.030520 12059 raft_consensus.cc:697] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:16.969790 12052 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:03:17.056843  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 56735.6us
W20260709 13:03:17.057636  9490 connection.cc:256] RPC call timeout handler was delayed by -1.3278561970000169s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
I20260709 13:03:17.081719  9490 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:17.062139 11964 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:17.065564  9446 raft_consensus.cc:1240] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
W20260709 13:03:17.123085 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 114301us
I20260709 13:03:17.068289  9445 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:03:16.982082 12041 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:17.040293 12043 consensus_queue.cc:237] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.075062  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:17.076220  9449 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:03:17.075140  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:17.128741  9444 raft_consensus.cc:2393] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 9: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:16.940898 12138 consensus_queue.cc:260] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.085258 11984 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:17.010846 12089 consensus_queue.cc:260] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.086162  9418 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:17.146661  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 60592.3us
I20260709 13:03:17.089963 12146 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:17.153586 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 140088us
I20260709 13:03:17.050426 12199 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.111155 12118 consensus_queue.cc:1048] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:03:17.127338  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 46690us
I20260709 13:03:17.124313 10025 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:17.072007 12015 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:17.135886  9417 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:17.141130  9444 raft_consensus.cc:1240] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:17.150264  9418 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:17.084641  9490 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:17.122205 12052 raft_consensus.cc:697] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:17.078562 12095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:52546 (request call id 75) took 1436 ms. Trace:
I20260709 13:03:17.154428  9452 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:03:17.159230  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 74685.9us
I20260709 13:03:17.159308  9418 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:17.161048  9490 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:17.162726  9418 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:03:17.163393 10027 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:17.165917  9490 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:17.166129  9418 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:17.167336  9490 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:17.129242 12008 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.169435  9490 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:17.153416 12078 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:17.175515  9490 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:17.167689 12015 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:17.174010 12198 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:17.178198 12052 consensus_queue.cc:237] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.137305 12151 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:03:17.170902 11984 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:17.153753 11888 raft_consensus.cc:697] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:17.169107 12138 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:17.182811 11888 consensus_queue.cc:237] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.166041 12026 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:17.165103 12101 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:17.165170 12117 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:17.189023  9418 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:17.167703 12099 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:17.168032 12067 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:17.170616 12089 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:17.168781 12050 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:03:17.193830  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.174203 12097 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:17.197113  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:17.207407  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:17.210690  9519 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:17.210577  9490 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:17.198700  9449 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 1957) took 2014 ms (client timeout 1657 ms). Trace:
I20260709 13:03:17.185796 10065 raft_consensus.cc:1240] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:17.174022 12090 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:17.167693 12068 consensus_queue.cc:1059] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:03:17.212477  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.225435  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:17.192075 12142 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:17.213843  9517 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:17.212347  9449 rpcz_store.cc:269] 0709 13:03:15.184750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.235609 (+ 50859us) service_pool.cc:224] Handling call
0709 13:03:17.198495 (+1962886us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54001590d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:17.198613 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4174399360}
I20260709 13:03:17.219244  9492 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:17.220940  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:17.260330 11644 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:17.290771  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:17.171098 11982 consensus_queue.cc:1059] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:03:17.192443 11984 raft_consensus.cc:2749] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:17.173655 12008 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.222747  9518 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:17.298441  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.298825  9517 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:17.299959  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.229741  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:17.301466  9524 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:17.207679  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:17.213883  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.303984  9523 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:17.305444  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.233453  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:17.306059  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:17.300839  9518 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:03:17.233903 12131 raft_consensus.cc:2749] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:17.232370 12098 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.236505 12068 raft_consensus.cc:3055] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:17.237103  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:17.237862 11921 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:17.239377 12014 raft_consensus.cc:3055] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:17.239962  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:17.248229  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:17.187006 12059 consensus_queue.cc:237] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.208212 12067 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.253263 12117 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:17.255134 12105 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.259256  9369 consensus_queue.cc:237] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:17.262607  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.263780 12151 consensus_queue.cc:1059] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:17.270255  9450 raft_consensus.cc:1240] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:17.270358 12199 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:17.162515 12095 rpcz_store.cc:276] 0709 13:03:15.634857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.635024 (+   167us) service_pool.cc:224] Handling call
0709 13:03:15.690419 (+ 55395us) log.cc:844] Serialized 480 byte log entry
0709 13:03:17.070620 (+1380201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79337,"raft.queue_time_us":68850,"raft.run_cpu_time_us":2200,"raft.run_wall_time_us":158058,"thread_start_us":36299,"threads_started":1,"wal-append.queue_time_us":189603}
I20260709 13:03:17.275734  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.277318  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.279803  9519 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:17.281087 12035 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:17.282713  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.210547 12050 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:17.366130 12050 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:17.365933 12147 consensus_queue.cc:1059] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:17.367522 12147 raft_consensus.cc:3055] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:17.367871 12147 raft_consensus.cc:740] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:03:17.295379  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 76196.1us
I20260709 13:03:17.369400  9525 raft_consensus.cc:2393] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 6: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:17.370216  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.216703 12163 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.371336  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.371446 12163 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.372426  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.373525 12163 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:17.374231  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.374949  9522 raft_consensus.cc:2393] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 9: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:17.375690  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.373564  9519 raft_consensus.cc:1240] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:17.377193  9522 raft_consensus.cc:2393] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 10: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:17.377382  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.378147  9519 raft_consensus.cc:2410] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:03:17.378317  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:17.309425  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:17.379467  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.379837  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:17.380832  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:17.381385  9452 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:03:17.359393 12105 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.382191  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:17.382513  9371 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:03:17.310659  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:17.384266  9444 raft_consensus.cc:2410] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:03:17.385497  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:17.386507  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:17.387074  9418 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:17.310961  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.387434  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:17.389261 11960 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:17.235769 12177 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:17.313848  9372 raft_consensus.cc:2393] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 9: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:17.313776  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:17.390581  9444 raft_consensus.cc:2410] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:03:17.344730  9376 raft_consensus.cc:1240] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:03:17.345957  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:17.393606  9443 raft_consensus.cc:2368] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8.
I20260709 13:03:17.394423  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:17.395156  9443 raft_consensus.cc:2393] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 10: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:17.395900  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:17.346352  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:17.307736  9517 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:17.346971  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:17.227216 12099 consensus_queue.cc:1059] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:03:17.348318  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:17.402024  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:17.360554  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:17.403374  9450 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:03:17.348107 12067 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:17.413190  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:17.415745  9418 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:17.361845  9524 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:17.212862 12104 consensus_queue.cc:260] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.374114 11982 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:17.307823  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:17.423965  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:17.390913  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.392824  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:17.308763  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:17.430998  9446 raft_consensus.cc:2393] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:17.397552  9448 raft_consensus.cc:2410] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:03:17.346520  9370 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:17.396898  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:17.318456 12068 raft_consensus.cc:740] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:17.297554 12015 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:17.421833  9418 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:17.429975  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:17.437923  9450 raft_consensus.cc:2393] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 7: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:17.442471  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:17.440048  9418 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:17.427793  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7260766fbe5c43b1aab09346a89d9ac6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 7)
I20260709 13:03:17.443372  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.445312  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:03:17.445333  9371 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52562 (request call id 1227) took 1736 ms (client timeout 2212 ms). Trace:
W20260709 13:03:17.447135  9371 rpcz_store.cc:269] 0709 13:03:15.709288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.804390 (+ 95102us) service_pool.cc:224] Handling call
0709 13:03:17.445135 (+1640745us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b5400188b54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:17.445258 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3606686592}
I20260709 13:03:17.448732  9448 raft_consensus.cc:1240] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:17.404274 11921 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:17.401351 12014 raft_consensus.cc:740] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:17.451431  9492 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:17.445372  9518 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:17.455190  9368 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:17.344164 12098 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.457818  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:17.461166  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.417972 12198 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:17.457079  9447 raft_consensus.cc:2393] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:17.465567  9418 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:17.476722  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:17.477701  9518 raft_consensus.cc:2393] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 10: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:17.467720  9443 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:17.468999  9522 raft_consensus.cc:1240] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:17.454387 11960 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:17.471589  9524 raft_consensus.cc:1240] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:17.472554  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:17.474753  9521 raft_consensus.cc:2393] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 9: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:17.368709 12147 consensus_queue.cc:260] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.423174 12131 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:17.466720  9370 raft_consensus.cc:1240] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:17.480770  9418 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:17.480509 12050 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:17.481434 11958 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:17.441776 12035 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.482350 11960 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:17.483942 12098 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:17.488251  9377 raft_consensus.cc:1275] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:17.412025 12090 consensus_queue.cc:1048] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:03:17.442095 12163 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:17.498553  9418 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:17.514878  9418 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:17.501879  9521 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:03:17.484583  9375 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
W20260709 13:03:17.505141  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 245504us
I20260709 13:03:17.506611  9517 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:17.511178  9446 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:03:17.517311  9446 pending_rounds.cc:85] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 5
W20260709 13:03:17.517491  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.512339  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.518292  9518 raft_consensus.cc:2393] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 9: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:17.517562  9446 pending_rounds.cc:107] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:03:17.519145  9446 raft_consensus.cc:2889] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:17.476516 12099 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:17.492316 12188 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:17.537252  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:17.539384  9444 raft_consensus.cc:1275] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:17.538401  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:17.540968  9443 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:17.543294  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:17.544312  9517 raft_consensus.cc:2393] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 9: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:17.550412 12089 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:17.551043 12089 raft_consensus.cc:697] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:17.551959 12089 consensus_queue.cc:237] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:17.558225  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:17.559605  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.562778 12050 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:17.502712 12097 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:17.570482 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:17.572446  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:17.573242  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:17.572526  9341 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:17.596360  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.508947 11960 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:17.617700  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 45255us
I20260709 13:03:17.514355 12163 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:17.538031 12118 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:17.647503  9519 raft_consensus.cc:1275] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:17.618534  9341 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:17.619212 12095 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:03:17.624833 12213 log.cc:927] Time spent T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.002s
I20260709 13:03:17.539767 12099 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:17.503624 12131 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.574753 12097 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.618225  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:17.539180 12188 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.646236  9526 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:03:17.659034  9523 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:17.513392 12035 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.538277 12098 consensus_queue.cc:1059] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.117s
I20260709 13:03:17.677982  9518 raft_consensus.cc:2376] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10. Re-sending same reply.
I20260709 13:03:17.641996 12163 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:17.640745 11950 raft_consensus.cc:3055] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:03:17.679776  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 61300.9us
I20260709 13:03:17.537257 12015 consensus_queue.cc:1048] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.124s
W20260709 13:03:17.703830  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 189017us
I20260709 13:03:17.678702 12188 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:17.682545 12052 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:17.563740 11762 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:03:17.713387 12123 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.653524 12095 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.714186 12123 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.715005 12095 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:17.683821  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.717999  9518 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:17.685773 12167 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.718030 12123 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:17.718258  9373 raft_consensus.cc:1275] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:17.718664 12167 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.719780  9374 raft_consensus.cc:1240] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:17.664873 12099 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:17.723055  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:17.729800  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.730492  9517 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:17.731751  9521 raft_consensus.cc:1275] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:17.734203  9447 raft_consensus.cc:1240] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:17.735720 11919 consensus_queue.cc:1059] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:17.736703 12203 raft_consensus.cc:3055] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:17.737241 12203 raft_consensus.cc:740] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:17.738327 12203 consensus_queue.cc:260] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:17.741653  9445 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:17.665344 12118 raft_consensus.cc:697] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:17.682631 12097 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:17.744987  9374 raft_consensus.cc:1240] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:17.749614  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:17.643215 12041 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.731251 12099 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.651767 11921 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:17.699651 12210 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.516871 12014 consensus_queue.cc:260] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:17.778304  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.636971 12067 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.699970 11950 raft_consensus.cc:740] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:17.740111 12203 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:17.773733  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:17.790647  9518 raft_consensus.cc:1240] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:17.702620 11958 raft_consensus.cc:697] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:17.793200  9517 raft_consensus.cc:1240] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:17.794669  9522 raft_consensus.cc:1240] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:17.741149 12177 consensus_queue.cc:1048] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:03:17.810549  9517 raft_consensus.cc:1275] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:17.815577  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.816642  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:17.819470  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:17.823961  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.811957  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.825645  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.826458  9524 raft_consensus.cc:2393] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 6: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:17.827189  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.770789 12090 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:03:17.814057  9449 raft_consensus.cc:2368] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 4. Current term is 5.
I20260709 13:03:17.827968  9524 raft_consensus.cc:2410] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:03:17.766917 12008 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:17.782375 11964 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:03:17.789793 12198 consensus_queue.cc:1059] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
W20260709 13:03:17.846344  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 72256.8us
I20260709 13:03:17.846516  9517 raft_consensus.cc:2376] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6. Re-sending same reply.
I20260709 13:03:17.789368 12050 consensus_queue.cc:1059] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:03:17.850294  9490 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:17.893836  9490 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:17.884533  9418 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:17.885155  9452 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:03:17.784608 12210 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.823736 10068 raft_consensus.cc:1240] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
W20260709 13:03:17.900956  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 48628.9us
W20260709 13:03:17.908926 12221 log.cc:927] Time spent T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:03:17.910238 12041 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:17.911371 12212 log.cc:927] Time spent T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:03:17.888968 12219 consensus_queue.cc:1059] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:03:17.918643  9490 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:17.946136  9490 leader_election.cc:400] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8.
I20260709 13:03:17.947227  9490 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:17.951834  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 47836.7us
I20260709 13:03:17.954881  9490 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:17.958142  9490 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:17.900703 12198 consensus_queue.cc:1243] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:03:17.965643  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.966040  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:17.969893  9524 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:03:17.965291  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:17.971086  9517 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:17.969062  9418 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:17.975230 12219 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:03:17.975556 12230 log.cc:927] Time spent T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:03:17.975778 12219 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.976184 12219 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:17.978011 12067 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:17.978853 12067 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:17.964895 12228 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:17.940613 12059 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:17.900163 11958 consensus_queue.cc:237] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.986881  9490 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:17.987852 11960 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.989632  9450 raft_consensus.cc:1240] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:17.948741 12041 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:18.033391  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:18.034212  9372 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:17.966938 12015 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:18.012496  9418 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:17.959203 12229 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:18.038683  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:17.848953 12118 consensus_queue.cc:237] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:17.992868  9490 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:18.109191  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 116529us
I20260709 13:03:18.110397  9490 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:18.023331 12228 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:03:18.061049  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.047268  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:17.993568 12131 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:18.086758 11964 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:03:18.115025  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 67864.9us
I20260709 13:03:18.115644 12228 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:18.091256 12041 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:18.094674 12101 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:18.111121 12216 log.cc:927] Time spent T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
I20260709 13:03:18.107597 12052 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:18.132316  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:18.095162 12210 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:18.126559 12228 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:18.111440 12099 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:18.119087 12229 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:18.119369 11964 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.224035  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:18.104204 12219 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:18.237469  9448 raft_consensus.cc:2410] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:03:18.238727  9376 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:03:18.128100 12044 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.257560  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:18.258594  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:18.259368  9520 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:03:18.265213  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:18.223119 11960 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:18.237175 12229 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.236096 12041 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:18.269147  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 158865us
I20260709 13:03:18.240243 11964 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:18.126971 12188 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:18.240135 12099 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:18.277812  9490 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:18.243443 12235 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:18.277505 12226 log.cc:927] Time spent T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.323s	user 0.000s	sys 0.001s
I20260709 13:03:18.286927  9490 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:18.291518 12238 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:18.297986 12238 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:18.300307 12238 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:18.293525 12235 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:18.301712  9526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1376) took 1105 ms. Trace:
I20260709 13:03:18.302232  9526 rpcz_store.cc:276] 0709 13:03:17.196021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.196482 (+   461us) service_pool.cc:224] Handling call
0709 13:03:17.223145 (+ 26663us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:17.681915 (+458770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.301343 (+619428us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54000a41d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:18.301633 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":972148096}
I20260709 13:03:18.276556 12229 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:18.306993 12147 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:18.310143 12231 log.cc:927] Time spent T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:03:18.313097 12035 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:18.315982  9450 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:18.303784 12235 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:18.297267  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:18.318953 12014 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:18.295567 12232 log.cc:927] Time spent T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:03:18.322149 12209 log.cc:927] Time spent T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.771s	user 0.001s	sys 0.002s
W20260709 13:03:18.323559  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:18.295953 12227 log.cc:927] Time spent T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:03:18.325187  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:18.325937  9521 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:18.325209 12043 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.327109 12043 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:18.330806  9418 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:18.333946 12035 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:18.334373 12035 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.334738 12035 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:18.337400  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:18.341120 12225 log.cc:927] Time spent T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.348s	user 0.001s	sys 0.000s
I20260709 13:03:18.343828 12219 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:18.344790 12095 consensus_meta.cc:287] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.001s
I20260709 13:03:18.345261 12095 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:18.347343 12095 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:18.261587 12044 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:18.357925  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:18.362231  9520 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:03:18.373961  9418 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:18.375456  9443 raft_consensus.cc:2393] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 8: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:18.376070  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:18.377017  9520 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:18.380488 10027 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:18.384649 11919 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:18.388025 11984 raft_consensus.cc:3055] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:18.388906 11984 raft_consensus.cc:740] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:18.390220 12044 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:18.288936 12041 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:18.391134 12041 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:18.392835 10068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 290) took 1575 ms. Trace:
I20260709 13:03:18.393289 10068 rpcz_store.cc:276] 0709 13:03:16.817340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.840151 (+ 22811us) service_pool.cc:224] Handling call
0709 13:03:17.256550 (+416399us) spinlock_profiling.cc:243] Waited 7.92 ms on lock 0x7b5800224798. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445eee 0000000000375939 00007fb58b4b91e0 00007fb58b5820c4 00007fb58b582131 00007fb58b543fc0 00007fb58b52e929 00007fb58b52e3d2 00007fb584aa5bd4
0709 13:03:17.256729 (+   179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:17.940079 (+683350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.392561 (+452482us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b54004c7054. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:18.392759 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271648896}
I20260709 13:03:18.397322  9523 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:18.390017 11984 consensus_queue.cc:260] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:18.300932 12238 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:18.403759  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:03:18.375254 12097 consensus_meta.cc:287] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.602s	user 0.004s	sys 0.006s
I20260709 13:03:18.404707  9368 raft_consensus.cc:1240] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:18.412912  9418 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:18.413923  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:18.405602  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 118776us
I20260709 13:03:18.403190  9521 raft_consensus.cc:1275] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:03:18.415248  9520 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:18.354491 12099 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:18.412011  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:18.417558  9490 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:18.416558  9526 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:18.385317 12219 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:18.418150  9370 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:18.411866 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:18.383028 12235 consensus_queue.cc:1059] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:03:18.435712  9490 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:18.436590  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:18.437475  9377 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:18.416069 12043 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:18.440362  9446 raft_consensus.cc:1240] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:18.441470  9490 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:18.441470  9370 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:18.418061 12142 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.421566 12050 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:18.444511  9490 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:18.428879 11984 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:18.447751 12247 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:18.448572  9490 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:18.451308  9490 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:18.452497  9490 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:18.445052 12205 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.008s	sys 0.014s
I20260709 13:03:18.457188  9372 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:03:18.417300 12097 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:18.432437 12219 raft_consensus.cc:697] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:18.428042 11960 consensus_queue.cc:1059] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 13:03:18.459275 12205 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.009s	sys 0.014s
I20260709 13:03:18.415505 12044 consensus_queue.cc:1059] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:03:18.433807 12238 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:18.445840 12242 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:03:18.495831 12015 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:18.449154 12014 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:03:18.502056  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 49617.3us
I20260709 13:03:18.444139 10066 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:18.441967 12245 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:18.455557 12199 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:18.443667 12099 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:03:18.467720 12247 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:18.504017  9418 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:18.512292  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:18.513660  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1626) took 1159 ms. Trace:
I20260709 13:03:18.514040  9519 rpcz_store.cc:276] 0709 13:03:17.353787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.378631 (+ 24844us) service_pool.cc:224] Handling call
0709 13:03:17.618363 (+239732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:17.648115 (+ 29752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.513469 (+865354us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54003241d0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865698ad 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:18.513592 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":550627712}
I20260709 13:03:18.504666 12151 raft_consensus.cc:3055] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:18.504379 10065 raft_consensus.cc:1240] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:18.524798  9342 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:18.506951 12049 raft_consensus.cc:3055] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:18.508900 12099 consensus_queue.cc:1243] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer d62c9d5a052b42ce8675f8438f846526 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:18.455907 12142 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:18.477985 12228 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:18.508085 12097 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:18.509545 12014 raft_consensus.cc:697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 4 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:18.524616 12067 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:18.537473 12044 raft_consensus.cc:2804] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:18.551512 12044 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.536136 12049 raft_consensus.cc:740] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:18.551916 12044 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:18.554548 12049 consensus_queue.cc:260] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:18.555811 12049 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:18.556079 12142 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:18.515452 12235 consensus_queue.cc:1048] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:03:18.526538 12151 raft_consensus.cc:740] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:18.547106 12041 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:18.560160 12014 consensus_queue.cc:237] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:18.562668  9522 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:18.566372 12203 consensus_meta.cc:287] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9: Time spent flushing consensus metadata: real 0.764s	user 0.010s	sys 0.000s
I20260709 13:03:18.572496 12104 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:18.554589 12251 log.cc:927] Time spent T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:03:18.549022 12188 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:18.592428 12163 consensus_meta.cc:287] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.887s	user 0.009s	sys 0.002s
I20260709 13:03:18.593037 12163 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:18.593850  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.596448  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:18.597183  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:18.597380  9519 raft_consensus.cc:2410] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:03:18.597560  9448 raft_consensus.cc:1240] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:18.597664  9520 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:03:18.591032 12105 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:18.596782  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.585853 12242 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.561786 12067 raft_consensus.cc:697] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:18.600190  9449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51016 (request call id 1198) took 1295 ms. Trace:
I20260709 13:03:18.596577  9525 raft_consensus.cc:1240] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:18.607638  9520 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:18.607982  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:18.601272  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:18.608484  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 95027.2us
I20260709 13:03:18.608923  9524 raft_consensus.cc:2393] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 7: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:18.609365  9449 rpcz_store.cc:276] 0709 13:03:17.304756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.306609 (+  1853us) service_pool.cc:224] Handling call
0709 13:03:18.599992 (+1293383us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b540012be54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:18.600128 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":973712256}
I20260709 13:03:18.604514  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:18.610729  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:18.615851  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:18.616034  9520 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:03:18.587471 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:18.611138 10065 raft_consensus.cc:1275] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:18.613664  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:18.615200  9449 raft_consensus.cc:1275] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:18.611073  9523 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:18.638722  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:18.640259  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:18.615672 12238 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:18.612888 12242 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:18.612432 12067 consensus_queue.cc:237] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:18.602196 12047 consensus_queue.cc:1059] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:03:18.619410 12229 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:18.620216  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:18.659597  9450 raft_consensus.cc:2393] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:18.660755 12229 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:18.620843  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:18.621752  9444 pending_rounds.cc:85] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 4
I20260709 13:03:18.662225  9444 pending_rounds.cc:107] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:03:18.662545  9444 raft_consensus.cc:2889] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:18.622043 12228 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:18.623767  9521 raft_consensus.cc:1240] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:18.625406  9520 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:18.625216 12151 consensus_queue.cc:260] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:18.625895 12163 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:18.607282 12138 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.627310  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:18.729240  9418 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:18.628711  9490 leader_election.cc:400] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 4. Current term is 5.
I20260709 13:03:18.629917 11921 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:18.630841  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:18.641687  9449 raft_consensus.cc:2368] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8.
I20260709 13:03:18.651553 12047 raft_consensus.cc:3055] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:18.598887 12035 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:18.654277 12238 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:18.657210 12217 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.542098 12219 consensus_queue.cc:237] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:18.719390  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:18.730386  9490 leader_election.cc:403] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:18.830613  9521 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:03:18.830994  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 202484us
W20260709 13:03:18.819185  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.652716 12242 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:18.834586  9490 leader_election.cc:400] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8.
I20260709 13:03:18.839131  9490 leader_election.cc:403] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:03:18.728691 11964 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:18.850764 12147 consensus_meta.cc:287] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.000s
I20260709 13:03:18.852906 12238 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:18.825897 12142 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:18.853173 12118 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.853549  9519 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:18.825623 12151 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:18.818849 12235 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:18.853703 12118 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:18.854449 12235 raft_consensus.cc:697] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:18.755097 12047 raft_consensus.cc:740] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:18.855309 12235 consensus_queue.cc:237] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:18.855954 12047 consensus_queue.cc:260] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:18.826733 12163 consensus_queue.cc:1059] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:03:18.857554 12047 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:18.858955  9451 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:03:18.837607 12041 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 4. Current term is 5.
I20260709 13:03:18.861900  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:18.853612 12142 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:18.874289  9522 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
W20260709 13:03:18.910248  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 306777us
I20260709 13:03:18.833460 12101 consensus_queue.cc:1048] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:03:18.827597 12228 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:18.757623 12138 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:18.929204  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.904704 12217 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:18.922180  9521 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:18.939527  9343 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:18.867908 12142 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:18.920781 11984 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:18.908038 12238 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:18.907768 12199 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8.
I20260709 13:03:18.934684 12049 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:18.950438  9491 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:18.933459 12101 consensus_queue.cc:1243] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [LEADER]: Peer d62c9d5a052b42ce8675f8438f846526 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:03:18.926177 12090 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.957294  9446 pending_rounds.cc:85] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 4
I20260709 13:03:18.999356  9446 pending_rounds.cc:107] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:03:18.999756  9446 raft_consensus.cc:2889] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:18.949709  9343 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:18.962028 12234 raft_consensus.cc:3055] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:03:18.965488  9375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52548 (request call id 1368) took 1734 ms (client timeout 1546 ms). Trace:
I20260709 13:03:18.937635 12242 consensus_queue.cc:1048] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:03:18.975639 12217 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:18.979218 11984 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:18.946903 12151 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:18.874547 12044 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:18.982549  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:19.001816  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 52188.9us
I20260709 13:03:19.029134  9343 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:19.030033 12170 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:19.030377  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.032088  9343 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:19.032867 12170 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:03:19.003361  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 61492.7us
W20260709 13:03:19.004299  9375 rpcz_store.cc:269] 0709 13:03:17.231046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.239738 (+  8692us) service_pool.cc:224] Handling call
0709 13:03:18.965311 (+1725573us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b540021d754. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:18.965415 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320386304}
W20260709 13:03:18.974534  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:19.034677  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.035195  9343 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
W20260709 13:03:19.035892  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.036350 12105 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:18.985070 11950 consensus_queue.cc:260] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.037600 11950 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:18.944692 12228 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:19.039029  9369 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:19.039935  9445 raft_consensus.cc:2410] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:03:19.038560  9343 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:19.033282 12170 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.005255 11599 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:19.027498 12250 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.003801 12234 raft_consensus.cc:740] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:19.018030 12014 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:18.988204 12238 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:18.993098 12049 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.053587  9343 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:19.050554 12170 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:19.061075 12078 raft_consensus.cc:3055] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:19.061568 12078 raft_consensus.cc:740] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:19.062213 12078 consensus_queue.cc:260] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.062894 12078 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:19.054806 12151 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:19.065611 12151 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:19.067719 12151 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:19.054801 12246 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:19.070817 12044 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:19.042030 12110 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.071715 12118 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:19.071506 12110 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.074280 12110 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:19.074548 12218 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:19.075081 12218 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:19.004942 12090 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.078941 12090 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:19.080689 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:19.081664 10066 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:19.083108 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:19.083752 10065 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:19.086264 12218 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:19.087182 12131 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.089685 12131 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:19.100649  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 47967.7us
I20260709 13:03:19.058315  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:19.104601  9342 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:19.084583  9443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 2024) took 1554 ms. Trace:
I20260709 13:03:19.104954  9445 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:19.105595  9443 rpcz_store.cc:276] 0709 13:03:17.529975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.565202 (+ 35227us) service_pool.cc:224] Handling call
0709 13:03:19.084313 (+1519111us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b54001586d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:19.084501 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1753650944}
I20260709 13:03:19.109169 10065 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:19.125491  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:19.135921  9342 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:19.038471 12105 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:03:19.143962  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:19.150869  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:19.151856  9523 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:19.165197  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:19.155874  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:19.102109 12046 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:19.145802 12044 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:19.167634  9523 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:19.148437 12246 raft_consensus.cc:2804] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:19.172708 12218 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.172937 12234 consensus_queue.cc:260] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.052992 12250 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:19.205873  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.179934 12167 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:19.186096 12228 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:19.174974 12044 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:03:19.189531 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 244191us
I20260709 13:03:19.193117  9445 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:19.212342  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:19.213259  9445 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:19.180003 12049 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:19.196614 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:19.170862 11958 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:19.202555 12138 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:19.099493 12068 consensus_queue.cc:260] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:19.207718  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 129306us
I20260709 13:03:19.145713 12151 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 13:03:19.239184  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 209426us
I20260709 13:03:19.248844  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:19.249553  9374 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:19.219866  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:19.252755  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:19.229846  9521 raft_consensus.cc:2410] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:19.254807 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:19.220387  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:19.257243 10069 raft_consensus.cc:2393] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 8: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:03:19.227304  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:19.259454  9375 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:19.260762  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:19.270459  9373 raft_consensus.cc:1240] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:19.269672  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:19.271294  9376 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:19.205520 12246 raft_consensus.cc:697] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:19.277117  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:19.278680  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:19.279564  9372 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:19.210060 12044 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:19.285091  9377 raft_consensus.cc:1275] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:03:19.281342  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:19.283033  9371 raft_consensus.cc:1240] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:19.248696 12228 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.251087 11984 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:19.289934  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:19.223539 12234 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:19.290217  9373 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
W20260709 13:03:19.303365  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.291334 12068 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:19.291873  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:19.320492 12118 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:19.320883  9450 raft_consensus.cc:1275] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:03:19.321091 12118 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.305652 12167 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:03:19.323261 12118 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:19.328159  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 180781us
I20260709 13:03:19.282012 12123 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:19.282619 12138 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:19.254216 11958 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:19.334657 12138 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.335060 12250 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:19.336514 11958 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:19.287891 12090 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:19.329425  9372 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:03:19.341442  9376 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:19.206094 12218 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.331965  9374 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:19.333662 12123 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:19.342973  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 90173.6us
W20260709 13:03:19.350258  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:19.351493  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 181976us
I20260709 13:03:19.336946 12138 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:19.302862 12278 consensus_queue.cc:1059] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:03:19.303229 12228 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.363227 12238 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:19.364316 12035 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:19.365451 12131 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:19.354666 11958 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.377393 11958 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.341782 12090 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.378281  9447 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:19.380218 12078 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.380295 11958 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:19.368849 12142 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:19.380960 12078 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.381804 12142 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.382550 12090 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:19.337152 11599 consensus_queue.cc:1048] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:03:19.384512 12142 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:19.386670 12123 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:19.331182  9343 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:19.371367 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:19.397377  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:19.391070 12098 raft_consensus.cc:3055] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:19.392123 12123 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:19.392493 11958 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:19.358042 12170 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.395004 12090 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:19.398121 12035 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:19.405618 12098 raft_consensus.cc:740] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:19.412458 11921 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.423219 11921 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:19.426419 12270 log.cc:927] Time spent T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.397s	user 0.003s	sys 0.000s
I20260709 13:03:19.418632 12035 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.429726 11921 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:19.373729 12246 consensus_queue.cc:237] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:19.442696 12035 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:19.409123 12123 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.411671 11958 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:19.414978 12090 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.448917 12098 consensus_queue.cc:260] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.455271 12098 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:19.444574 12044 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:19.457293 12279 log.cc:927] Time spent T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.148s	user 0.002s	sys 0.000s
I20260709 13:03:19.458212 12044 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:19.462090 12218 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:19.466315 12123 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:19.468715 12090 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:19.469709 12228 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:19.471053 12170 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:19.471031 12265 log.cc:927] Time spent T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.402s	user 0.000s	sys 0.002s
W20260709 13:03:19.505870  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 117391us
W20260709 13:03:19.514864  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 183585us
I20260709 13:03:19.516352  9343 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:19.518833  9343 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:19.523767  9370 raft_consensus.cc:2393] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 11: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:19.525657  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:19.527653  9372 raft_consensus.cc:2410] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:03:19.403213  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:19.554267  9450 raft_consensus.cc:2410] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:03:19.554461  9443 raft_consensus.cc:2410] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:03:19.555302  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:19.556337  9444 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:03:19.557874  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:19.558993  9444 raft_consensus.cc:2410] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:03:19.559995  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:19.560626  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.561431  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:19.562512  9444 raft_consensus.cc:2393] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 8: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:19.565979  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:19.570137  9444 raft_consensus.cc:2393] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 8: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:19.573952  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:19.574924  9444 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 3.
W20260709 13:03:19.577529  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.579898  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:19.581073  9523 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 4.
I20260709 13:03:19.587327 12044 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:19.593168 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:19.594586 12044 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:19.596004 12044 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:19.578737  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:19.597913  9343 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:19.625464 12089 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.525s	user 0.025s	sys 0.044s
W20260709 13:03:19.625990 12089 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.575s	user 0.026s	sys 0.045s
I20260709 13:03:19.627220  9452 raft_consensus.cc:1240] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7. Ops: []
W20260709 13:03:19.629361  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 226099us
I20260709 13:03:19.629643 12046 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:19.626704 10069 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:19.634007  9342 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:19.634544 12188 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:19.635335 12188 raft_consensus.cc:697] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:19.637666 12043 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:19.638459 12043 raft_consensus.cc:697] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:19.640085 12043 consensus_queue.cc:237] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:19.644748  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 48323.3us
W20260709 13:03:19.645145  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 92250.8us
I20260709 13:03:19.646190 11958 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:19.646807  9343 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:19.636883 12188 consensus_queue.cc:237] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.648041 12105 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:19.648818 12105 raft_consensus.cc:697] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:19.650514 12105 consensus_queue.cc:237] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.651767 12095 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:19.652611 12095 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.654536  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:19.655699 12095 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:19.650944 12098 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:19.657063 12167 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:03:19.658389  9418 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:19.660907  9372 raft_consensus.cc:1240] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:03:19.661459 11958 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:19.661860 11958 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.662221 11958 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:19.662917  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:19.659080 12089 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:19.665220 12089 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.665657 12089 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:19.659157  9374 raft_consensus.cc:1240] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:03:19.666800 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:19.668560  9374 raft_consensus.cc:1275] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:19.670908  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:19.691102  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:19.691989  9376 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:19.647431 12170 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:19.711306  9444 pending_rounds.cc:85] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 2
I20260709 13:03:19.711998  9444 pending_rounds.cc:107] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:03:19.700547 11958 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.719992  9444 raft_consensus.cc:2889] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:19.734439  9526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46902 (request call id 1395) took 1412 ms (client timeout 1842 ms). Trace:
W20260709 13:03:19.734946  9526 rpcz_store.cc:269] 0709 13:03:18.322058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.336994 (+ 14936us) service_pool.cc:224] Handling call
0709 13:03:19.734049 (+1397055us) spinlock_profiling.cc:243] Waited 78.1 ms on lock 0x7b54001a1154. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:19.734258 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179736960}
I20260709 13:03:19.736232  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:19.736435  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:19.737417  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:19.738361  9374 raft_consensus.cc:2368] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8.
I20260709 13:03:19.743806  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:19.745074  9526 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:03:19.745136  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:19.746562  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:19.747505  9517 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:19.747777  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:19.748468  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:19.749320  9525 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:19.749526  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:19.750370  9368 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:19.750995  9517 raft_consensus.cc:1275] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:03:19.751647  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:19.752317  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:19.753278  9526 raft_consensus.cc:2393] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 10: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:19.754958 11964 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:19.755159  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:19.763880  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:19.773718  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:19.764205 12275 log.cc:927] Time spent T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.696s	user 0.001s	sys 0.001s
I20260709 13:03:19.779150  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:19.788949  9376 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
W20260709 13:03:19.794837  9451 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51016 (request call id 1204) took 2487 ms (client timeout 1970 ms). Trace:
W20260709 13:03:19.795415  9451 rpcz_store.cc:269] 0709 13:03:17.306782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.306907 (+   125us) service_pool.cc:224] Handling call
0709 13:03:19.794334 (+2487427us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540006b3d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:19.794594 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3348963200}
I20260709 13:03:19.797966  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:19.805660  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:19.813242 12235 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.004s	sys 0.004s
I20260709 13:03:19.808075  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:19.814443  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:19.813776 12235 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.004s	sys 0.004s
I20260709 13:03:19.820716  9376 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:19.822911  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:19.824251  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:19.826294  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:19.826735  9526 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:19.827721  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:19.830077  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:19.835685 12199 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:19.843250 12046 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:19.844190  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:19.845767 12089 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.846504  9373 raft_consensus.cc:1275] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:19.847958  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:19.848508 12089 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:19.848784  9377 raft_consensus.cc:2376] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8. Re-sending same reply.
I20260709 13:03:19.850229  9526 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:03:19.850409  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:19.851532  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:19.872243  9517 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:03:19.877559  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:19.877451 12041 consensus_queue.cc:1059] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:19.878886  9517 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:19.879084 12041 consensus_queue.cc:1243] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:19.879961 12041 raft_consensus.cc:3055] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:19.880463 12041 raft_consensus.cc:740] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:19.882266 12041 consensus_queue.cc:260] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:19.885205 12041 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:19.887391  9452 raft_consensus.cc:1240] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:19.893239  9492 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:19.895049 12228 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:19.896518  9369 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52548 (request call id 1379) took 1932 ms (client timeout 2106 ms). Trace:
W20260709 13:03:19.897064  9369 rpcz_store.cc:269] 0709 13:03:17.964403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.965795 (+  1392us) service_pool.cc:224] Handling call
0709 13:03:19.896091 (+1930296us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540021c854. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:19.896307 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2458389376}
I20260709 13:03:19.897486  9446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 1239) took 1276 ms. Trace:
I20260709 13:03:19.836602 12199 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.880093  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:19.892560  9271 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 72) took 7559 ms. Trace:
I20260709 13:03:19.898082  9446 rpcz_store.cc:276] 0709 13:03:18.620674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.660390 (+ 39716us) service_pool.cc:224] Handling call
0709 13:03:18.660672 (+   282us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:19.000550 (+339878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:19.000598 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:19.001388 (+   790us) log.cc:844] Serialized 52 byte log entry
0709 13:03:19.030520 (+ 29132us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:19.030568 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.756019 (+725451us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:19.896770 (+140751us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54001f9ad4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:19.896847 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:19.896910 (+    63us) raft_consensus.cc:1685] finished
0709 13:03:19.896930 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:19.897249 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3281,"raft.queue_time_us":2557,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":13232,"spinlock_wait_cycles":772121728,"thread_start_us":28777,"threads_started":1,"wal-append.queue_time_us":59513}
I20260709 13:03:19.908207  9518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1384) took 2167 ms. Trace:
I20260709 13:03:19.911924  9520 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:19.909807  9518 rpcz_store.cc:276] 0709 13:03:17.740557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.740834 (+   277us) service_pool.cc:224] Handling call
0709 13:03:17.741117 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:17.791900 (+ 50783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.907573 (+2115673us) spinlock_profiling.cc:243] Waited 49.3 ms on lock 0x7b54003683d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:19.907988 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113501440}
I20260709 13:03:19.914842 11958 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:19.919137 12105 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.949452  9448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 2034) took 2050 ms. Trace:
I20260709 13:03:19.950114  9448 rpcz_store.cc:276] 0709 13:03:17.899297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.267792 (+368495us) service_pool.cc:224] Handling call
0709 13:03:18.272367 (+  4575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.597887 (+325520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.925869 (+1327982us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54001fa9d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:19.949127 (+ 23258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":747438336}
I20260709 13:03:19.943735  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:19.941268  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:19.959471  9518 raft_consensus.cc:2393] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 11: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:19.957512  9517 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:19.941517 12044 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.972523 10027 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:19.973363 12105 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:19.973282 12044 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:19.982481 12199 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:19.973224  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 80395.1us
I20260709 13:03:19.985852  9492 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:19.993363  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:19.994517  9369 raft_consensus.cc:2410] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:03:19.996282 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 75628.6us
I20260709 13:03:19.987918 12228 consensus_queue.cc:1048] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:20.001727  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:20.002444  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:20.011734  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:20.012786  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:20.013866 12142 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.014176  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:20.014523 12142 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:20.015353  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:20.015605  9518 raft_consensus.cc:1275] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:20.018219  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46894 (request call id 1671) took 1421 ms. Trace:
I20260709 13:03:20.018791 12142 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:20.018858 12044 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:20.020602  9447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 2032) took 2229 ms. Trace:
I20260709 13:03:20.021298  9447 rpcz_store.cc:276] 0709 13:03:17.791282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.791464 (+   182us) service_pool.cc:224] Handling call
0709 13:03:20.020103 (+2228639us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b5400220454. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:20.020356 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3582802176}
I20260709 13:03:20.021595  9370 raft_consensus.cc:1240] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:20.018626  9519 rpcz_store.cc:276] 0709 13:03:18.596756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.604344 (+  7588us) service_pool.cc:224] Handling call
0709 13:03:20.017683 (+1413339us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b540042b654. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:20.018028 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496972672}
I20260709 13:03:20.026757  9372 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
W20260709 13:03:20.057173  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:20.004652 12274 log.cc:927] Time spent T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.823s	user 0.002s	sys 0.000s
I20260709 13:03:20.006505 12199 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:20.016880  9376 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:20.076020  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:20.077890  9523 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:03:19.903193  9271 rpcz_store.cc:276] 0709 13:03:12.333203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.341557 (+  8354us) service_pool.cc:224] Handling call
0709 13:03:19.892270 (+7550713us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:17.563490 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:17.626889 (+ 63399us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:17.626941 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:03:17.626967 (+    26us) tablet.cc:662] Decoding operations
0709 13:03:17.627651 (+   684us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:17.627729 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:17.627781 (+    52us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:03:17.628160 (+   379us) tablet.cc:701] Row locks acquired
0709 13:03:17.628186 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:03:17.628374 (+   188us) write_op.cc:270] Start()
0709 13:03:17.628519 (+   145us) write_op.cc:276] Timestamp: P: 1783602197628318 usec, L: 0
0709 13:03:17.628556 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:03:17.741378 (+112822us) log.cc:844] Serialized 1199 byte log entry
0709 13:03:18.349389 (+608011us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb5834600ac 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b
0709 13:03:18.616859 (+267470us) op_driver.cc:464] REPLICATION: finished
0709 13:03:19.055016 (+438157us) write_op.cc:301] APPLY: starting
0709 13:03:19.057250 (+  2234us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:19.074545 (+ 17295us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:19.074581 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:19.075053 (+   472us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:19.075307 (+   254us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:03:19.075380 (+    73us) write_op.cc:312] APPLY: finished
0709 13:03:19.075636 (+   256us) log.cc:844] Serialized 28 byte log entry
0709 13:03:19.075924 (+   288us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:19.076046 (+   122us) write_op.cc:454] Released schema lock
0709 13:03:19.076104 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:19.076527 (+   423us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:19.076557 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":278772,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":404922,"apply.run_cpu_time_us":2311,"apply.run_wall_time_us":27250,"num_ops":2,"prepare.queue_time_us":452301,"prepare.run_cpu_time_us":28437,"prepare.run_wall_time_us":968320,"raft.queue_time_us":83741,"raft.run_cpu_time_us":11476,"raft.run_wall_time_us":364514,"replication_time_us":960003,"spinlock_wait_cycles":10083200,"thread_start_us":1348859,"threads_started":4,"wal-append.queue_time_us":719760}]]}
I20260709 13:03:20.018222 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:20.093106 10066 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:20.095063  9417 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:20.096215 12142 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:20.096689 12142 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.097327 12142 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:20.076125 12121 raft_consensus.cc:2804] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:20.117640 12121 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.118196 12121 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:20.083139 12043 consensus_queue.cc:1048] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:03:20.129181  9343 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:20.130903  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 69200.3us
I20260709 13:03:20.140496 11599 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:20.143939 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:20.144942 10066 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:20.082708  9371 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:20.078476  9523 pending_rounds.cc:85] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 4
I20260709 13:03:20.142602 12142 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:20.172773  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.180279 12142 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:03:20.182916 12298 log.cc:927] Time spent T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:03:20.190491 12078 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:20.202468  9523 pending_rounds.cc:107] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:03:20.203001  9523 raft_consensus.cc:2889] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:20.203297  9342 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
W20260709 13:03:20.212460  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 59527.3us
I20260709 13:03:20.215643 10065 raft_consensus.cc:1240] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:03:20.219767 10065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45690 (request call id 132) took 1083 ms. Trace:
I20260709 13:03:20.208714 12044 raft_consensus.cc:2804] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:20.220248 10065 rpcz_store.cc:276] 0709 13:03:19.135240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.135883 (+   643us) service_pool.cc:224] Handling call
0709 13:03:20.074119 (+938236us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b5800224798. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b543fc0 00007fb58b52e929 00007fb58b52e3d2 00007fb584aa5bd4
0709 13:03:20.203659 (+129540us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:20.216106 (+ 12447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.218064 (+  1958us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9194880}
I20260709 13:03:20.239364  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:20.224177 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:20.225731 12044 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:20.269697  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 56134.6us
I20260709 13:03:20.257903 10066 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:20.243872 12044 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:20.285790 12299 log.cc:927] Time spent T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.280s	user 0.002s	sys 0.000s
W20260709 13:03:20.262702  9522 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46902 (request call id 1402) took 1721 ms (client timeout 1995 ms). Trace:
I20260709 13:03:20.258266 12228 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:20.287966  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.290068  9343 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:20.290949  9522 rpcz_store.cc:269] 0709 13:03:18.510811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.512054 (+  1243us) service_pool.cc:224] Handling call
0709 13:03:20.213417 (+1701363us) spinlock_profiling.cc:243] Waited 49.8 ms on lock 0x7b5400289bd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:20.231776 (+ 18359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114445568}
W20260709 13:03:20.308465  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 159328us
I20260709 13:03:20.307550  9343 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
W20260709 13:03:20.321834  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.308856 12170 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:20.331919  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 322794us
I20260709 13:03:20.298133 12228 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:20.353353 12142 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:20.358234 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 260423us
I20260709 13:03:20.356771  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:20.361929  9445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 2041) took 1385 ms. Trace:
I20260709 13:03:20.362437  9371 raft_consensus.cc:1275] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:20.362381  9445 rpcz_store.cc:276] 0709 13:03:18.976459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.214025 (+237566us) service_pool.cc:224] Handling call
0709 13:03:19.214375 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:19.335406 (+121031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:19.335438 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:19.335479 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:19.335512 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.337418 (+1001906us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b540024f4d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:20.342237 (+  4819us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.361750 (+ 19513us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":277911936}
W20260709 13:03:20.364042  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 56638.7us
I20260709 13:03:20.375535 12104 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:20.376003 12142 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:20.378515 12142 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:20.384418  9492 leader_election.cc:400] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8.
I20260709 13:03:20.406360  9449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 2037) took 1430 ms. Trace:
I20260709 13:03:20.402936  9343 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:03:20.419234 12294 log.cc:927] Time spent T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.489s	user 0.002s	sys 0.000s
I20260709 13:03:20.420070 12105 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:20.422996 12170 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:03:20.427652  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 72218.9us
I20260709 13:03:20.428840 12170 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.406929  9449 rpcz_store.cc:276] 0709 13:03:18.975399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.977056 (+  1657us) service_pool.cc:224] Handling call
0709 13:03:18.977384 (+   328us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:19.077813 (+100429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:19.077843 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:19.078382 (+   539us) log.cc:844] Serialized 52 byte log entry
0709 13:03:19.207511 (+129129us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:19.207548 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.456590 (+249042us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:20.392926 (+936336us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b5400113354. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:20.394481 (+  1555us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:20.396783 (+  2302us) raft_consensus.cc:1685] finished
0709 13:03:20.396798 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.406150 (+  9352us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1203,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":232882176,"thread_start_us":128339,"threads_started":1,"wal-append.queue_time_us":203781}
I20260709 13:03:20.442065 12228 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:20.443313  9492 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:20.438501 12170 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:20.437355 12104 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.013s
W20260709 13:03:20.455047  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:20.456233  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.466459 12105 consensus_queue.cc:1048] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 13:03:20.469931 12041 consensus_meta.cc:287] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.004s
I20260709 13:03:20.470561 12041 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:20.470780  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:20.471226 12041 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:20.471465  9524 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:20.472705  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:20.473493  9518 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:20.471616  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:20.458959 12044 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:20.498772 12123 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:20.502731 12123 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:20.503373 12199 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:20.504273  9341 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:20.505434 12123 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:20.506212 12167 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:20.506888 12044 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:20.508086 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:20.508723 10065 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:20.509608  9524 raft_consensus.cc:1275] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:20.508594  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:20.525357  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:20.528772  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 85653.5us
I20260709 13:03:20.532148  9524 raft_consensus.cc:1275] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:03:20.532537  9524 pending_rounds.cc:85] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 6
I20260709 13:03:20.532753  9524 pending_rounds.cc:107] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:03:20.532966  9524 raft_consensus.cc:2889] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:20.530736  9522 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:20.510568 12311 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.501219 12041 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:20.524359 12123 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.544536  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:20.544449 12123 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:20.545481 12311 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:20.546759 12123 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:20.537595  9341 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:20.543150 12121 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:20.552742  9518 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:20.552352 12121 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:20.555449  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:20.556083  9374 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:20.561121 11958 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:20.561388 11950 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:20.561834 11950 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.561887 11958 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:20.562299 11950 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:20.562201  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:20.563071  9449 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:03:20.564159 11958 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:20.565655 12284 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:20.566252 12284 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:20.568535 12284 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:20.571254  9525 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:20.578581  9449 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 5.
I20260709 13:03:20.579370  9492 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:20.527304 12044 consensus_queue.cc:1059] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:03:20.624378  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:20.630805  9374 raft_consensus.cc:2410] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:03:20.634364  9444 raft_consensus.cc:2368] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8.
I20260709 13:03:20.640880  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:20.643322  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:20.622087 12041 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.644013  9444 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
W20260709 13:03:20.654402  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 75156.8us
I20260709 13:03:20.639237 12199 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:03:20.655539  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 112953us
I20260709 13:03:20.643435 12309 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:20.641162 10066 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:20.645567 12043 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.656692  9343 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:20.659119  9447 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:20.660920  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:20.662441  9449 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:03:20.662407  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:20.674853 12151 consensus_queue.cc:1048] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:03:20.681794  9450 raft_consensus.cc:2368] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8.
W20260709 13:03:20.685065  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 116027us
I20260709 13:03:20.689642 10069 raft_consensus.cc:1275] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:03:20.689970  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:20.690608  9524 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:20.666303 12309 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:20.696888  9417 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:20.699378  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 51253.1us
I20260709 13:03:20.701040 11950 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:20.703269  9492 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:20.707314 10065 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:20.709110  9451 raft_consensus.cc:2393] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 11: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:20.669628 12041 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:20.712199 12320 raft_consensus.cc:3055] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:20.713137  9492 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:20.713265 12314 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:20.713872 12316 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:20.714548 11950 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:20.694252 12309 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:20.681273 12199 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:20.710777  9342 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:20.705963 12284 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:20.710428 11958 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:20.726681  9418 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:20.735467 12315 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:20.736145 12315 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:20.738416 12315 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:20.681493 12043 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:20.721653 12320 raft_consensus.cc:740] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:20.727075 12284 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.710860 12105 consensus_queue.cc:1048] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:03:20.769299 12050 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:20.769765 12050 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:20.770140 12050 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:20.770392 12041 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:20.771881 12170 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:20.774137 12170 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:20.775695 12319 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:20.776304 12319 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:20.756734 12284 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:20.778658 12319 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:20.779825 12151 consensus_queue.cc:1048] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:20.746541 12199 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:20.786859 12320 consensus_queue.cc:260] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:20.788524 12320 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:20.791107 12228 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.791838 12228 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:20.793244  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:20.794014 12228 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:20.797513  9524 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 5.
I20260709 13:03:20.795327  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:20.796478  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:20.799506 10027 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:20.793300  9443 raft_consensus.cc:1275] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:20.747416 12322 raft_consensus.cc:2804] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:20.759109 12315 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:20.815810  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:20.757745 12308 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:20.729735 12314 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:20.822767  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 112690us
I20260709 13:03:20.823618  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:20.824733 12316 raft_consensus.cc:697] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:20.826176  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:20.826025 12316 consensus_queue.cc:237] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:20.826756  9519 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:03:20.831209  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:20.832429  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:20.816023 12105 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:20.818642 12046 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.834296  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:20.837033  9526 raft_consensus.cc:2393] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 8: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:20.832464 11958 raft_consensus.cc:697] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:20.839923  9519 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:20.818830 12322 raft_consensus.cc:697] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:20.833365 11994 raft_consensus.cc:2804] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:20.843258  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:03:20.844213  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 131128us
I20260709 13:03:20.846935  9492 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:20.833506 12105 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:20.848898 12041 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:20.849928 12105 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:20.851907 12323 log.cc:927] Time spent T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:03:20.861919 12043 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:20.879695  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:20.880503  9525 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:03:20.882601  9449 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:20.893374  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:20.895937 12314 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:20.846187 12050 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:20.901386 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:03:20.904541 12321 log.cc:927] Time spent T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.230s	user 0.005s	sys 0.000s
I20260709 13:03:20.834475 12046 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:20.906872 12046 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:20.907742 12311 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:20.908231 12322 consensus_queue.cc:237] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:20.844434 12308 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:20.914278 12308 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:03:20.893561  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 46715.1us
I20260709 13:03:20.917311  9492 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:20.900609 12050 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:20.930292  9418 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:20.931869 12332 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.932623 12332 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:20.935559 12332 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:20.939281 11958 consensus_queue.cc:237] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:20.871512 11994 raft_consensus.cc:697] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 5 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:20.943881 11994 consensus_queue.cc:237] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:20.955638 12309 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:20.957130  9518 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:20.957226  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:20.963948  9418 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:20.965668 12333 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:20.966411 12333 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:20.967017 12333 consensus_queue.cc:1048] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:20.967223 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:20.968777  9418 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:20.969707 12123 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:20.971841  9418 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:20.974395 12314 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:20.996214 10069 raft_consensus.cc:1240] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:20.987100  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:21.010501  9445 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:21.013240  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.016618  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.025774  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:21.026311 12309 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:21.027938  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 110788us
I20260709 13:03:21.028738  9492 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:21.030299  9492 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:21.031088  9492 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:21.009042 12142 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:21.033936 12142 raft_consensus.cc:697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:21.034111  9418 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:21.034933 12142 consensus_queue.cc:237] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:21.036206  9418 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:21.026475  9523 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:21.003996 12311 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.009198 12105 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.948824 12284 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:21.023006  9343 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:21.041342  9518 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:21.043581  9517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1686) took 1174 ms. Trace:
I20260709 13:03:21.056628  9449 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:21.058578  9444 raft_consensus.cc:1240] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
W20260709 13:03:21.062493  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 66969.7us
W20260709 13:03:21.075879  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 53006.1us
I20260709 13:03:21.051662  9273 catalog_manager.cc:5697] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.043154 12314 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:21.082124  9341 leader_election.cc:400] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8.
I20260709 13:03:21.060346 12309 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:21.080909  9343 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:21.043422 12319 consensus_queue.cc:1059] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:03:21.075322 12315 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:21.057757  9517 rpcz_store.cc:276] 0709 13:03:19.863512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.969265 (+105753us) service_pool.cc:224] Handling call
0709 13:03:20.445407 (+476142us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b5800188498. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b543fc0 00007fb58b52e929 00007fb58b52e3d2 00007fb584aa5bd4
0709 13:03:20.445690 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:20.498570 (+ 52880us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:20.498615 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:20.557878 (+ 59263us) log.cc:844] Serialized 26 byte log entry
0709 13:03:20.641709 (+ 83831us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:20.641763 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.641826 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:20.904232 (+262406us) spinlock_profiling.cc:243] Waited 8.41 ms on lock 0x7b240009c8d8. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833039c4 00007fb583301acb 00007fb5834bcdc9 00007fb5834bca55 00007fb5834bc09d 00007fb5860ee10e 00007fb58610588c 00007fb586104bb6 00007fb5861047d8 00007fb58610e221
0709 13:03:21.037835 (+133603us) raft_consensus.cc:1685] finished
0709 13:03:21.037856 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:21.037982 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39218,"raft.queue_time_us":58026,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"spinlock_wait_cycles":23806080,"thread_start_us":78897,"threads_started":1,"wal-append.queue_time_us":115882}
I20260709 13:03:21.076836 11958 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:21.062736 12311 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:21.083385 12167 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:21.108875  9521 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:21.085878 12309 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:21.088821 12043 raft_consensus.cc:2804] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:21.101900 12334 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:21.102349 12341 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:21.085815 12041 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:21.079413 12316 consensus_queue.cc:1059] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:03:21.092991 12105 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:21.113626  9273 catalog_manager.cc:5697] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 5 to 9, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 9 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.133076 12341 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.135712 12341 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:21.136888 12105 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:21.138307  9273 catalog_manager.cc:5697] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 5 to 7, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 7 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:21.139860  9273 catalog_manager.cc:5697] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 5 to 6, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 6 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.142704  9273 catalog_manager.cc:5697] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 6 to 7, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 7 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.085745 12332 consensus_queue.cc:1048] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
W20260709 13:03:21.148442  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 71354.4us
I20260709 13:03:21.100994 11958 raft_consensus.cc:697] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:21.145395 12167 raft_consensus.cc:697] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:21.150528 12041 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:21.149448  9273 catalog_manager.cc:5697] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.124917 12334 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.115329 12309 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:21.116536 12043 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.158195  9341 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:21.168954  9273 catalog_manager.cc:5697] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 5 to 6, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 6 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.173534 12316 raft_consensus.cc:3055] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:21.193320 12046 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:21.193490  9273 catalog_manager.cc:5697] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.194322 12046 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:21.182173 12334 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:21.195371  9273 catalog_manager.cc:5697] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 5 to 6, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 6 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:21.196549 12046 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:21.197808 11958 consensus_queue.cc:237] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:21.205498  9445 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:21.184280 12043 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:21.208060  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 49969.3us
I20260709 13:03:21.197531  9273 catalog_manager.cc:5697] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 7 to 8, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 8 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.209580  9521 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
W20260709 13:03:21.193312 12342 log.cc:927] Time spent T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:03:21.211531  9341 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:21.213609  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:21.190659 12284 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:21.201164 12170 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:21.219663 12167 consensus_queue.cc:237] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:21.186702 12316 raft_consensus.cc:740] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:03:21.236457  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 87293.2us
I20260709 13:03:21.235172 12322 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:21.207449 12341 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:21.321300  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 232196us
I20260709 13:03:21.324716  9341 leader_election.cc:400] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8.
W20260709 13:03:21.324092  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 142462us
W20260709 13:03:21.320647 12347 log.cc:927] Time spent T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:03:21.249142 12314 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:21.325403  9343 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:21.328293  9273 catalog_manager.cc:5697] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 5 to 8, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 8 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.332020 12044 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:21.332489 12044 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.332881 12320 raft_consensus.cc:3055] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:21.333431 12320 raft_consensus.cc:740] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:21.334403 12320 consensus_queue.cc:260] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:21.335804 12320 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:21.336259 12338 log.cc:927] Time spent T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:03:21.325582 12284 consensus_queue.cc:1059] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:03:21.325989 11950 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:03:21.337754 12284 raft_consensus.cc:3055] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:21.338176 12284 raft_consensus.cc:740] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:21.339084 12284 consensus_queue.cc:260] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:21.336061 12314 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:21.340476 12284 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:21.341717 12314 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:21.332885 12044 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:21.343339 12328 log.cc:927] Time spent T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.422s	user 0.004s	sys 0.000s
I20260709 13:03:21.345474  9341 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:21.350198  9273 catalog_manager.cc:5697] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 2 to 3, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 3 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.351019 12041 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:21.350703 12316 consensus_queue.cc:260] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:21.352170 12316 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:21.352388 11599 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:03:21.359166 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 109346us
I20260709 13:03:21.340554 12311 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:21.354385  9273 catalog_manager.cc:5697] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 3 to 7, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 7 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.322043 12322 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:21.379442  9343 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:21.396910  9273 catalog_manager.cc:5697] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 5 to 6, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 6 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.373539 12322 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:21.408958 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 48513.3us
W20260709 13:03:21.417043  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 168159us
I20260709 13:03:21.422389  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:21.423507  9517 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:21.377104 12315 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:21.425838  9273 catalog_manager.cc:5697] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:21.451768  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:21.456795  9523 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:21.397800 12105 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:21.409277 12311 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:21.474644  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:21.450235 12315 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:21.505590 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 121505us
W20260709 13:03:21.506817  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 97194.8us
W20260709 13:03:21.523675  9490 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.940s (SENT) [suppressed 18 similar messages]
I20260709 13:03:21.526424 12050 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:21.529986 12309 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:21.466017 12311 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:21.552693  9418 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:21.534759 12319 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.574505 12050 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:03:21.581530 12349 log.cc:927] Time spent T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:03:21.585727 12309 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:21.586747 12346 log.cc:927] Time spent T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:03:21.553943 12332 consensus_queue.cc:1048] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:03:21.590287 12332 consensus_queue.cc:1243] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:03:21.601662  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:21.601974 12350 log.cc:927] Time spent T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:03:21.602519  9443 raft_consensus.cc:2393] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 10: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
W20260709 13:03:21.603646  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.605159 12319 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:21.607244 12319 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:21.609560 12324 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.610065 12324 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:21.611989 12324 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:21.613801 12311 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:21.615293 12315 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:21.536420 12043 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:21.655272  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.656739  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.657821  9445 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
W20260709 13:03:21.662422 12318 log.cc:927] Time spent T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:03:21.664389  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.648787 12322 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:21.621650 12170 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:21.599409 12341 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:21.676813  9368 raft_consensus.cc:1240] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:21.678689  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.694146  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.695591  9443 raft_consensus.cc:2368] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8.
W20260709 13:03:21.680884 12142 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.010s	sys 0.007s
I20260709 13:03:21.680858 12105 raft_consensus.cc:697] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:21.698398 12142 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.010s	sys 0.007s
W20260709 13:03:21.702070 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 270874us
W20260709 13:03:21.707299  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 153265us
I20260709 13:03:21.707813  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.708652  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.712424 12044 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:21.714872 12044 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:21.717110 12363 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.717631 12363 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:21.718024  9523 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:21.719431  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.719702 12363 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:21.720166  9447 raft_consensus.cc:1275] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:03:21.712499 12043 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:21.699046 12105 consensus_queue.cc:237] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:21.725131 12334 consensus_meta.cc:287] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.001s
W20260709 13:03:21.725999  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.725689 12334 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:21.728461 12334 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:21.734030 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:21.735401  9445 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:03:21.711079 10066 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:21.738823  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:21.741393 12142 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:21.745872  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.747057  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.748057  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.748420  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.748740  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.749185  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.749491  9450 raft_consensus.cc:2393] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 10: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:21.749802  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.750502  9448 raft_consensus.cc:2393] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 7: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:21.751330  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:21.751998  9447 raft_consensus.cc:2368] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 8. Current term is 9.
I20260709 13:03:21.748443  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:21.753315  9452 raft_consensus.cc:2393] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 8: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:21.754526  9449 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:21.749493  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.762482  9375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "001ad880018f49e5bec36246253efa0f"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:21.763396  9375 raft_consensus.cc:606] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:21.763752  9375 raft_consensus.cc:614] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:21.765097  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.774953 12369 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:21.775559 12369 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:21.774755 12354 consensus_queue.cc:1048] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:21.779945 12305 consensus_queue.cc:1059] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:21.780841 12305 consensus_queue.cc:1243] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:21.781407 12305 raft_consensus.cc:3055] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:21.781826 12305 raft_consensus.cc:740] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
W20260709 13:03:21.781934  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 49202.8us
I20260709 13:03:21.783444 12367 consensus_queue.cc:1048] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:21.783071 12305 consensus_queue.cc:260] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:21.785746 12305 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:21.786098  9375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:21.786844  9375 raft_consensus.cc:606] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:21.787426  9375 raft_consensus.cc:614] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:03:21.792119  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 83856.5us
I20260709 13:03:21.793200  9341 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:21.795164  9341 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:21.797233  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:21.800575  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:21.803721  9375 raft_consensus.cc:2393] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 11: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:21.804814  9341 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:21.808621  9523 raft_consensus.cc:1275] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:03:21.811103  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:21.811343  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:21.811879  9374 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:03:21.812165  9373 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:21.813866  9371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:21.814520  9371 raft_consensus.cc:606] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:21.814920  9371 raft_consensus.cc:614] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:21.815855  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:21.817476 12361 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:21.821274 12364 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:21.822306 12359 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:21.825518  9369 raft_consensus.cc:2393] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 7: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:21.829777 12369 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:21.830950 12322 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:21.831084  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:21.831903  9377 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:03:21.849054  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.852499 12364 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:21.855983  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:21.859977  9377 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:21.865865  9443 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:03:21.866505  9443 raft_consensus.cc:606] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:21.853214 12364 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:21.870244  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:21.871534  9451 raft_consensus.cc:2393] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 10: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:21.874114  9341 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:21.874239  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:21.875200  9523 raft_consensus.cc:2410] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:03:21.879253 12170 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:21.883234  9371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:21.883891  9371 raft_consensus.cc:606] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:21.884261  9371 raft_consensus.cc:614] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:21.888103  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:21.891441  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:21.892046  9371 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:21.893144  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:21.893672  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:21.893505  9341 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:21.894260  9375 raft_consensus.cc:2410] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:03:21.894260  9520 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:21.897552  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:21.899112  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:21.901809  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:21.902830  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.904011  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.905299  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.906121  9446 raft_consensus.cc:2393] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 7: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:21.901367  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.908224  9451 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:21.909145  9377 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:03:21.909749  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:21.910331  9375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:21.910913  9375 raft_consensus.cc:606] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:21.911209  9375 raft_consensus.cc:614] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:21.918830  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.919009  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:21.919523  9449 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:21.922537  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:21.922824  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:21.923257  9374 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:03:21.924140  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:21.924793  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:21.925536 10065 raft_consensus.cc:1275] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:03:21.925930  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:21.927546 12369 consensus_queue.cc:1048] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:21.928710  9374 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:03:21.936398  9520 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:21.935456  9492 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:21.939013  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:21.939860  9526 raft_consensus.cc:2410] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:03:21.944676  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:21.945712  9377 raft_consensus.cc:2410] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:03:21.946117  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:21.911268 12170 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:21.956712  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:21.967777  9375 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:21.958727  9492 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:21.966446  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:21.970259  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:21.970489  9526 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:21.971060  9523 raft_consensus.cc:2393] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 8: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:21.971109  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:21.972847  9492 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:21.971314  9373 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:21.973440  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:21.974494  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:21.974570  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:21.967204  9341 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:21.969905  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:21.982007  9370 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:21.983086  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:21.983167  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:21.984266  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:21.985047 12319 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:21.985723 12319 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.986198 12319 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:21.986716  9343 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:21.988466 12044 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:21.985105  9341 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:21.990609 12105 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:21.990783 12316 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:21.991051 12105 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:21.991442 12316 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.992179 12316 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:21.974751  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:21.991590 12105 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:22.002243  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:22.002874  9522 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:22.006322  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:22.007145  9526 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:22.013459  9343 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:22.015614  9375 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:22.023686  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:21.993168 12309 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:22.037863  9376 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:03:22.039657  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:21.965868 12095 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:22.050344  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:22.051947  9517 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:22.051961  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:22.052781  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:22.053386  9373 raft_consensus.cc:2393] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 10: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
W20260709 13:03:22.055263  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 82481us
I20260709 13:03:22.057561  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:22.058952  9372 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:22.061623  9377 raft_consensus.cc:1240] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:22.058492  9369 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:22.058533  9492 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:22.074987  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:22.079718 12377 log.cc:927] Time spent T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
W20260709 13:03:22.086046 12379 log.cc:927] Time spent T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:03:22.088020  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:22.088644  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:22.088831  9368 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:22.089547  9524 raft_consensus.cc:2393] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 7: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
W20260709 13:03:22.050734  9418 connection.cc:256] RPC call timeout handler was delayed by -1.8891432500000178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18420000000000003s for a response
W20260709 13:03:22.094332  9418 connection.cc:256] RPC call timeout handler was delayed by -1.5613663070000143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
I20260709 13:03:22.095363  9371 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:21.995190 12315 consensus_queue.cc:1059] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:03:22.111420  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:22.043452 12309 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:22.096575 12345 log.cc:927] Time spent T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:03:22.117529  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:22.120023  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:03:22.110639 12343 log.cc:927] Time spent T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:03:22.096815 12369 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:03:22.113181 12321 log.cc:927] Time spent T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:03:22.127445  9520 raft_consensus.cc:2393] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 10: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:22.130749  9418 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:22.114691 12309 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:22.062489 12095 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:22.160467  9520 raft_consensus.cc:1275] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:03:22.163215  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:22.169688  9518 raft_consensus.cc:1275] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:03:22.173593 12369 raft_consensus.cc:697] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:22.174875 12369 consensus_queue.cc:237] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:22.178791  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 53678.8us
I20260709 13:03:22.161599  9520 pending_rounds.cc:85] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 3
W20260709 13:03:22.182662  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 124198us
I20260709 13:03:22.183049  9520 pending_rounds.cc:107] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:03:22.183537  9520 raft_consensus.cc:2889] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:22.185277  9522 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:22.186805  9446 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:03:22.126528 12386 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:22.188745  9492 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:22.191519  9418 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:22.143224 12315 raft_consensus.cc:3055] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:22.198184  9374 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:03:22.200181 12334 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:22.159050 12361 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:22.193567 12386 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:22.213188 12315 raft_consensus.cc:740] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:03:22.269081  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 77629.5us
I20260709 13:03:22.243278 12392 raft_consensus.cc:2804] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:22.258534 12364 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:22.259311 12386 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:22.277679 12344 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:22.302773 12392 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:03:22.337527  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 152867us
I20260709 13:03:22.338598  9492 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:03:22.339682  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 142156us
I20260709 13:03:22.343032  9490 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:22.316792 12142 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:22.352500  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 74371.6us
I20260709 13:03:22.311427 12319 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:22.323136 12392 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:22.355590 10065 raft_consensus.cc:2955] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 3 to 8, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:22.353440  9418 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:22.367848 12391 log.cc:927] Time spent T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:03:22.368729 12334 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:22.369333 12334 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:22.377569  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:22.398030  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 55124.6us
I20260709 13:03:22.363485 12315 consensus_queue.cc:260] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:22.391300 12367 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:03:22.388823 12095 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:22.399885  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 61373.3us
I20260709 13:03:22.462271  9370 pending_rounds.cc:85] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947: Aborting all ops after (but not including) 1
I20260709 13:03:22.803107  9492 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:22.804224 12322 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.805092 12322 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:22.806358  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 406847us
W20260709 13:03:22.509370  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 86308.3us
I20260709 13:03:22.819324  9490 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:22.803184  9370 pending_rounds.cc:107] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947: Aborting uncommitted NO_OP operation due to leader change: 2.2
W20260709 13:03:22.817119  9517 consensus_meta.cc:287] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.754s	user 0.030s	sys 0.053s
I20260709 13:03:22.810482  9371 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:03:22.805661 12305 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:22.821715  9517 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:22.821452  9370 raft_consensus.cc:2889] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:22.794243 12409 log.cc:927] Time spent T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.373s	user 0.001s	sys 0.000s
W20260709 13:03:22.415534 12393 log.cc:927] Time spent T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.094s	user 0.002s	sys 0.000s
I20260709 13:03:22.822701 12305 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:22.830411 12322 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:22.824618 12095 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:22.825529  9490 leader_election.cc:400] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8.
I20260709 13:03:22.820662 12412 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.410425 12105 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:22.416476 12316 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:22.831377 12305 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:22.834604  9490 leader_election.cc:403] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:22.413964  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:22.847819  9373 raft_consensus.cc:2393] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 10: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:22.606426 12394 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:22.832228 12095 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:22.840444 12412 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:22.852138 12105 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:22.793553 12399 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:22.840109 12392 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:22.843940  9492 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:03:22.855129 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 190903us
I20260709 13:03:22.770159 12413 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:22.467034 12400 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:22.853883  9525 raft_consensus.cc:1240] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:22.524315 12411 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:22.853298 12095 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:22.852854 12412 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:22.861397  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:22.522920 12334 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:22.409919 12309 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:22.860299 12382 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.006s	sys 0.018s
I20260709 13:03:22.653700 12386 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:22.855549 12399 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:22.875146  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:22.858036 12413 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:22.870316 12382 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.006s	sys 0.018s
I20260709 13:03:22.869315 12400 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:22.886474 12316 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:22.891963 12316 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:22.887161 12421 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8.
I20260709 13:03:22.888329  9524 raft_consensus.cc:1240] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:22.865279 12319 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:22.879010 12399 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:22.888147  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 62755.5us
I20260709 13:03:22.891776 10027 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:22.899767 12419 raft_consensus.cc:2749] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:22.902330 12334 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:22.905025 12309 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:22.879397 12412 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:22.910842  9490 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:22.915210  9490 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:22.861829 12394 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:22.889237 12413 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:22.920662  9490 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:22.918784  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 74907.8us
I20260709 13:03:22.898308 12316 raft_consensus.cc:697] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:22.866075 12411 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:22.909751 12421 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:22.920279 12309 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:22.919524 12334 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:22.923789 12401 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:22.955971  9490 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:22.962183 12417 consensus_queue.cc:1175] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d62c9d5a052b42ce8675f8438f846526" responder_term: 9 status { last_received { term: 9 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 9 index: 6 } }
I20260709 13:03:22.963151 12417 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.963688 12417 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:22.964234 12415 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:22.968279 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 76588.6us
I20260709 13:03:22.965481 12401 raft_consensus.cc:697] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 8 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:22.954028 12309 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:22.955127 12412 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:22.980225  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.986356  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:22.989243 12316 consensus_queue.cc:237] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:22.965157 12416 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.130s
I20260709 13:03:22.993696 12392 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:22.982182 12415 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:22.996165 12417 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:22.983501 12309 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:23.001653 12386 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:22.967233 12334 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.010813  9443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 2077) took 1111 ms. Trace:
W20260709 13:03:23.014282  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 58424.9us
I20260709 13:03:23.018577  9490 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:23.011262  9443 rpcz_store.cc:276] 0709 13:03:21.898931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.901085 (+  2154us) service_pool.cc:224] Handling call
0709 13:03:21.907093 (+  6008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:21.907346 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:03:22.042666 (+135320us) log.cc:844] Serialized 14 byte log entry
0709 13:03:22.358682 (+316016us) log.cc:844] Serialized 14 byte log entry
0709 13:03:22.413201 (+ 54519us) spinlock_profiling.cc:243] Waited 907 us on lock 0x7b1800041200. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58344b2a6 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db
0709 13:03:22.414936 (+  1735us) spinlock_profiling.cc:243] Waited 51.3 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:23.010333 (+595397us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b1800041200. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb5833f7c0a 00007fb58cb37219 00007fb58347fa40 00007fb58347a4e4 00007fb58347a455 00007fb586562060 00007fb586574716 00007fb586585287 00007fb586585208
0709 13:03:23.010480 (+   147us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:23.010528 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:23.010570 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:23.010632 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:23.010753 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18568,"prepare.queue_time_us":140084,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":81,"raft.queue_time_us":162565,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":12279,"spinlock_wait_cycles":125684224,"thread_start_us":354132,"threads_started":3,"wal-append.queue_time_us":201207}
I20260709 13:03:22.966706 12421 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.027794  9490 leader_election.cc:400] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 8. Current term is 9.
I20260709 13:03:23.028249  9490 leader_election.cc:403] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:03:23.033537 12404 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:23.034283 12404 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:23.034778 12404 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:23.021593 12417 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:23.038128 12417 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.024844 12399 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.041944 12332 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:23.042793 12332 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:23.045207  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 95469.9us
I20260709 13:03:23.053185 12392 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 8. Current term is 9.
I20260709 13:03:23.049350 12309 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.055262 12400 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:23.055214 12309 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:23.026984 12386 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:23.055998 12402 raft_consensus.cc:993] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:03:23.025924 12415 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:23.056540 12402 raft_consensus.cc:1081] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:03:23.008489 12412 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.057231 12401 consensus_queue.cc:237] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:23.074234 12384 log.cc:927] Time spent T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.906s	user 0.004s	sys 0.012s
I20260709 13:03:23.029225 12422 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:23.056979 12415 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.095024 12332 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:23.096273 12427 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:23.100205  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 746768us
I20260709 13:03:23.077746 12309 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:23.071457 12311 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:03:23.085055 12400 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.132309 12400 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.134888 12400 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:23.135183 12395 log.cc:927] Time spent T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.786s	user 0.010s	sys 0.005s
I20260709 13:03:23.140441 12394 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:23.153565  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:23.106389  9418 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:23.096809 12427 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:23.105655 12422 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.107682 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:23.120877 12421 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:23.123740  9375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1438) took 1122 ms. Trace:
I20260709 13:03:23.179802  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:23.131546 12415 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:23.084394 12392 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:23.082962 12334 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:23.145998  9492 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:23.150528 12412 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:23.161957  9525 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:23.165643  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:23.179699  9375 rpcz_store.cc:276] 0709 13:03:22.001149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.042147 (+ 40998us) service_pool.cc:224] Handling call
0709 13:03:22.609477 (+567330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.609691 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:22.609717 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:22.609760 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:22.609791 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.609859 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:23.123475 (+513616us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b540021dc50. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865698ad 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:23.123631 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1303900928}
I20260709 13:03:23.165691  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:23.182638  9343 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:23.168223  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:23.183398  9517 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:23.170526 12402 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:23.172515  9369 raft_consensus.cc:1240] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:23.172833 12404 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:23.189651  9369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1450) took 1025 ms. Trace:
I20260709 13:03:23.189368 12402 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.190048  9369 rpcz_store.cc:276] 0709 13:03:22.164220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.460883 (+296663us) service_pool.cc:224] Handling call
0709 13:03:23.172076 (+711193us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b5800000f98. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b543fc0 00007fb58b52e929 00007fb58b52e3d2 00007fb584aa5bd4
0709 13:03:23.172312 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:23.189375 (+ 17063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:23.189581 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25811840}
I20260709 13:03:23.180387  9521 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:03:23.193827  9343 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:23.196523  9517 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:23.191989 12332 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:23.197754 12332 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:23.198148 12332 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:23.198901 12392 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.201339 12392 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:23.204237  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 58363.6us
I20260709 13:03:23.204758  9492 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:23.206672 12367 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:23.202934 12427 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:23.205511 12407 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.107095 12309 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.209612 12407 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.211177 12309 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:23.211758 12404 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:23.211823 12407 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:23.212446 12412 raft_consensus.cc:2804] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:23.209625 11950 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:23.212946 12415 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:23.213105 12412 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:23.213557 12415 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:23.213681 12412 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:23.213984 12415 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:23.209173  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 108095us
W20260709 13:03:23.208722 12403 log.cc:927] Time spent T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.841s	user 0.007s	sys 0.006s
I20260709 13:03:23.221513  9418 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:23.191422 12402 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:23.221311 12204 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.228588 12404 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:23.229218 12404 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:23.228746 12204 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:23.229630 12404 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:23.233383  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:23.234298  9375 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 6.
I20260709 13:03:23.237994  9446 raft_consensus.cc:1240] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:23.239385  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:23.241506  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:23.242249  9445 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:23.179332 12422 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.243804 12344 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:23.244442 12344 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:23.244963 12422 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:23.245303 12417 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:23.249958  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.241436  9418 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:23.253799  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:23.255092  9418 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:23.255950 12396 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:23.256232  9418 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:23.256709 12396 raft_consensus.cc:697] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:23.261664  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:23.260229  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:23.264189  9452 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:23.237862 12402 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.268601  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:23.260870 12430 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:23.269217 12204 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:23.270248  9377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1440) took 1185 ms. Trace:
I20260709 13:03:23.271914  9445 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:23.255462 12315 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:23.285169  9377 rpcz_store.cc:276] 0709 13:03:22.085266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.102568 (+ 17302us) service_pool.cc:224] Handling call
0709 13:03:22.912505 (+809937us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.912688 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:22.912733 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:22.912791 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:22.912833 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.912895 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:23.270095 (+357200us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b54000460d0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865698ad 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:23.270196 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1824580992}
I20260709 13:03:23.292533  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:23.289053 12437 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:23.297533  9451 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:23.301396  9341 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:23.301856  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:23.302837  9521 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 6.
W20260709 13:03:23.302753  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 96651.7us
I20260709 13:03:23.289649 11950 consensus_queue.cc:1059] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:03:23.307296  9343 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:23.309113 12406 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:23.309719 12406 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:23.310133 12406 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:23.323375  9452 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
W20260709 13:03:23.327653  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 71487.2us
I20260709 13:03:23.329555  9418 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:23.304337 12367 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:23.345359  9343 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:23.260146 12396 consensus_queue.cc:237] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.261873 12413 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.299716 12437 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:23.358114 12437 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:23.344583  9368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1445) took 1257 ms. Trace:
I20260709 13:03:23.284802 12402 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.346657  9341 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:23.348685  9451 raft_consensus.cc:1275] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:03:23.330024  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 50669us
I20260709 13:03:23.352137 12413 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:23.352638 12322 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:23.349401 12367 raft_consensus.cc:697] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:23.354521 12410 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:23.356464 12348 consensus_queue.cc:1048] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:23.361652  9343 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:03:23.361517  9368 rpcz_store.cc:276] 0709 13:03:22.087143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.102763 (+ 15620us) service_pool.cc:224] Handling call
0709 13:03:22.118097 (+ 15334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:22.118470 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:22.118501 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:22.185252 (+ 66751us) log.cc:844] Serialized 26 byte log entry
0709 13:03:22.338939 (+153687us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:22.351369 (+ 12430us) log.cc:844] Serialized 14 byte log entry
0709 13:03:22.357042 (+  5673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.357144 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:23.122268 (+765124us) spinlock_profiling.cc:243] Waited 6.67 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:23.344260 (+221992us) raft_consensus.cc:1685] finished
0709 13:03:23.344355 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:23.344516 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50117,"prepare.queue_time_us":151,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":9383,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":8191,"spinlock_wait_cycles":15341312,"thread_start_us":93645,"threads_started":1,"wal-append.queue_time_us":149128}
I20260709 13:03:23.372817  9341 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:23.386798 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:23.392190  9418 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:23.371166 12319 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.399003 12438 consensus_queue.cc:1059] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:03:23.396873 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:23.383955 12436 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:23.398938 12319 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.370131 12415 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:23.402993 12341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.235s	user 0.014s	sys 0.040s
I20260709 13:03:23.411368 12319 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:23.415133 12402 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:23.415887 12402 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:23.416291 12402 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:23.416677 12402 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:23.403199 12436 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:23.404202 12322 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:23.418211 12322 raft_consensus.cc:697] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:23.419160 12322 consensus_queue.cc:237] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.417600 12436 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:23.421449 12415 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:23.423321  9524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1455) took 1318 ms. Trace:
I20260709 13:03:23.423702  9524 rpcz_store.cc:276] 0709 13:03:22.104799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.105158 (+   359us) service_pool.cc:224] Handling call
0709 13:03:22.122297 (+ 17139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.896575 (+774278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:23.423090 (+526515us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b54000a5354. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:23.423269 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1761204096}
I20260709 13:03:23.424893 12434 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:23.425390 12434 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.423010 12332 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.425765 12434 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:23.427438  9448 raft_consensus.cc:1240] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:23.384224 12430 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 13:03:23.427438 12341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.260s	user 0.014s	sys 0.041s
I20260709 13:03:23.461741 12415 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:23.464586 12415 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:23.466816 12415 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:23.468284 12404 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.470480 12404 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:23.450399 12414 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.009s	sys 0.008s
I20260709 13:03:23.455924 12406 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:23.498361  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 125644us
I20260709 13:03:23.409534 12367 consensus_queue.cc:237] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:23.477198 12369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.002s	sys 0.016s
I20260709 13:03:23.503477  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:23.504181  9444 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
W20260709 13:03:23.500020 12414 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.009s	sys 0.008s
I20260709 13:03:23.512527  9444 raft_consensus.cc:1240] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 9. Current term is 10. Ops: []
W20260709 13:03:23.503104 12369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.002s	sys 0.017s
I20260709 13:03:23.518712  9372 raft_consensus.cc:1240] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:03:23.521494 12422 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.520885  9372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1448) took 1432 ms. Trace:
I20260709 13:03:23.522228 12422 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:23.522444  9372 rpcz_store.cc:276] 0709 13:03:22.088180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.139688 (+ 51508us) service_pool.cc:224] Handling call
0709 13:03:22.159092 (+ 19404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:23.519261 (+1360169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:23.520552 (+  1291us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400187254. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:23.520803 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3126042368}
I20260709 13:03:23.527329 10027 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:23.527688  9443 raft_consensus.cc:1240] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 4. Current term is 5. Ops: []
W20260709 13:03:23.515082  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 127075us
I20260709 13:03:23.498898 12332 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:23.481698 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:23.502789 12415 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:23.533651  9343 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:23.512404 12443 raft_consensus.cc:2804] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:23.509738 12413 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:23.546521 12344 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.550324 11599 raft_consensus.cc:3055] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:23.550721 12406 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:23.551391 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:23.553709 12437 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.515270 12417 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:23.562639 12359 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.564374 12095 consensus_queue.cc:1048] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:23.560599 12415 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.565503 12389 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:23.566157  9342 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:23.594076  9342 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:23.531818 12412 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.541952 12422 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:23.543121 12204 raft_consensus.cc:2804] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:23.595086 12204 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.595592 12204 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:23.576037 11599 raft_consensus.cc:740] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:23.585120  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 179452us
I20260709 13:03:23.587229  9449 raft_consensus.cc:1240] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:23.594275 12359 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.584914 12443 raft_consensus.cc:697] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:23.582960 12413 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.604467 12452 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:23.618701 12452 raft_consensus.cc:697] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:23.619637 12452 consensus_queue.cc:237] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.622185 12434 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.624423 12434 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:23.624218 12402 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.607733  9341 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:23.609086 12167 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:23.587949 12417 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:23.592267  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 58720.1us
W20260709 13:03:23.582506 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 50551.9us
I20260709 13:03:23.613986 12415 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:23.629895  9418 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:23.862074  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 257721us
I20260709 13:03:23.862969  9418 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:23.617955 12413 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:23.864970 12444 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:23.865485 12444 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:23.865867 12444 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:23.871539 12399 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:23.871920 12441 raft_consensus.cc:3055] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:23.872298 12441 raft_consensus.cc:740] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:23.873149 12441 consensus_queue.cc:260] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.874426 12441 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:23.612521 12436 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.876971  9452 raft_consensus.cc:1240] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:23.878088 12436 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:23.879496 12344 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:23.613909 12359 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:23.610271 12437 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:23.651274 12392 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:23.609490 12447 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:23.615937 12443 consensus_queue.cc:237] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:23.651052 12402 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:23.648208 12167 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:23.650205 12151 consensus_queue.cc:1059] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.242s
I20260709 13:03:23.607959 12389 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.858348 12309 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:23.766878 12044 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:23.884816 12411 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:23.907048  9418 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:23.897547 12449 log.cc:927] Time spent T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:03:23.860380 12369 consensus_queue.cc:1059] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:03:23.902240 12344 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:23.904541 12167 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.608512 11599 consensus_queue.cc:260] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:23.899015 12392 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.909902 12412 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:23.950732  9418 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:23.924274 12456 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:23.934015 12167 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:23.953349  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 94394.8us
I20260709 13:03:23.910636 12044 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.958367  9418 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:23.962780  9343 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:23.918411 12309 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.948833 12402 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:23.981653 12151 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.981895 12204 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:23.982311 12151 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:23.984356 12151 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:23.988708 12348 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:23.989954  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:23.995946  9446 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:03:23.959792 12446 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:23.964731 12456 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:24.006644 12446 raft_consensus.cc:697] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:24.007797 12456 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:24.009604  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:23.990435 12204 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:24.010810 12044 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:23.972172 12095 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:23.999727 12369 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:23.964289 12406 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:03:24.007814 12446 consensus_queue.cc:237] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.016203 11599 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:23.995743 12319 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:24.018656 12319 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.020324 12402 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:23.996130 12438 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:24.021301 12438 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.021697 12438 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:24.022873  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:23.951934 12437 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:03:23.986241 12367 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.030982 12359 raft_consensus.cc:3055] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:24.034360 12309 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:24.014817 12369 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:24.046175 12367 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.046777 12369 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:24.048501 12417 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:24.014406 12095 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.049031 12367 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:24.046193 12359 raft_consensus.cc:740] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:24.050906 12359 consensus_queue.cc:260] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.052600 12359 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:23.989451 12348 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.056342 12348 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:24.056831 12460 log.cc:927] Time spent T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.075s	user 0.002s	sys 0.000s
I20260709 13:03:24.038712  9446 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 7.
I20260709 13:03:24.042260  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:03:24.046382  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.058398 12392 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:24.138360 12389 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:24.044675 12444 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.140580 12444 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:24.141688  9444 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:24.080991  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 112704us
I20260709 13:03:24.142860  9343 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:24.104781  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 103023us
I20260709 13:03:24.160277  9443 raft_consensus.cc:1240] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:24.162154  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.164361 12402 consensus_queue.cc:1059] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:24.164929  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:24.165346 12402 raft_consensus.cc:3055] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:24.165642  9522 raft_consensus.cc:2468] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 4.
I20260709 13:03:24.165794 12402 raft_consensus.cc:740] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:24.167054 12402 consensus_queue.cc:260] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.170681 12402 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:24.173499 12046 raft_consensus.cc:3055] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:24.173885  9447 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:24.174008 12046 raft_consensus.cc:740] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:24.153390  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.175169  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.174976 12046 consensus_queue.cc:260] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.175805  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.176127  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.176432  9452 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:24.177089  9451 raft_consensus.cc:2410] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:03:24.178098  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.164772  9377 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:03:24.179157  9377 pending_rounds.cc:85] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947: Aborting all ops after (but not including) 7
I20260709 13:03:24.179411  9377 pending_rounds.cc:107] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:03:24.179680  9377 raft_consensus.cc:2889] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:24.181124 12389 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.182060  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.181879 12389 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.184049 10027 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:24.196190 12454 raft_consensus.cc:2804] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:24.196709 12454 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:24.197096 12454 raft_consensus.cc:3060] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:24.201592  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 53783.9us
I20260709 13:03:24.203482  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.204169  9372 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:24.204391  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:24.188712 12392 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.204761  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:24.205029  9375 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:24.205426  9370 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:24.205263 12392 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.207608 12392 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:24.207453  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:24.189311 12438 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.209316  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:24.209455  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:24.209885  9521 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:24.210565 12438 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:24.210600  9447 raft_consensus.cc:2393] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 9: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:24.146137 12410 raft_consensus.cc:2804] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:24.213488 12410 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:24.213863 12410 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:24.190033  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:24.189787 12389 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:24.185983 12167 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.203606  9445 raft_consensus.cc:3055] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:24.176699 12142 consensus_queue.cc:1059] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:24.208813  9377 raft_consensus.cc:1240] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:24.176236 12046 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:24.212787  9370 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:03:24.020941 12319 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:24.241304  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:24.243050  9370 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:24.245462  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:24.226249  9444 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
W20260709 13:03:24.232928  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.233928  9445 raft_consensus.cc:740] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:24.234799  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:24.050900 12095 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:24.236485  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.239959  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:24.261817  9519 raft_consensus.cc:1240] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:03:24.262024  9520 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:24.252437  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:24.263273  9520 raft_consensus.cc:1240] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:24.263692  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.249603  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:24.235065  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.250373  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:24.227162  9521 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 7.
I20260709 13:03:24.269245 10027 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:24.251433  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.252364  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:24.270818  9374 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:24.252599  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:24.252384  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:24.253348  9522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46902
I20260709 13:03:24.217465  9271 catalog_manager.cc:5697] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 3 to 5, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65), VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66), VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67), VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 4 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:24.271924  9518 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:24.258750  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.272203  9522 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:24.272667  9522 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:24.264163  9369 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:03:24.058529 12369 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.262930  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:24.275130  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:24.280143  9519 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:24.280436  9372 raft_consensus.cc:2393] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 11: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:24.280642  9525 raft_consensus.cc:2393] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 9: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:24.264659  9445 consensus_queue.cc:260] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.276578  9375 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:03:24.277442  9377 raft_consensus.cc:2368] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12.
I20260709 13:03:24.278100  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.282379  9371 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:24.284300  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.285189  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.286623  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.287716  9445 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:24.286938  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:24.286140  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:24.293135  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.294431  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.296422  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:24.297581  9446 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:24.298565  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.299204  9446 raft_consensus.cc:2368] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12.
I20260709 13:03:24.299913  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.293255  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:24.302335  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.303058  9443 raft_consensus.cc:2393] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 6: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:24.303416  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.304970  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:24.305639  9370 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:24.216996 12454 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:24.313727  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.314271  9374 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:03:24.281706 12204 raft_consensus.cc:2804] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:24.277303 12438 raft_consensus.cc:3055] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:24.316382  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:24.316437  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.317135  9369 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:24.317341  9450 raft_consensus.cc:2410] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:24.290997  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:24.318037  9525 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:24.318991  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:24.319545  9444 raft_consensus.cc:1240] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:24.320044  9452 raft_consensus.cc:2368] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8.
I20260709 13:03:24.320924  9449 raft_consensus.cc:2393] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 10: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:24.321573  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:24.323338  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.323563  9445 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:03:24.324026  9376 raft_consensus.cc:2393] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:24.324136  9445 pending_rounds.cc:85] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 5
I20260709 13:03:24.324592  9445 pending_rounds.cc:107] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:03:24.325253  9445 raft_consensus.cc:2889] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:24.327168  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.327394  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.327618  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.308132  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.328155  9374 raft_consensus.cc:2410] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:03:24.328486  9443 raft_consensus.cc:2393] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 8: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:24.328619  9370 raft_consensus.cc:2368] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11.
I20260709 13:03:24.329994  9518 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:24.329667  9519 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:24.331521  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.332230  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:24.331800  9446 raft_consensus.cc:2393] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 10: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:24.322543  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.335180  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.335865  9446 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:24.336794  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:24.329349  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.339330  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.334184 12095 consensus_queue.cc:1059] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:03:24.334004 12204 raft_consensus.cc:697] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 7 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:24.325434 12438 raft_consensus.cc:740] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:24.344945  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:24.345623  9520 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:24.345850 12438 consensus_queue.cc:260] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.347111 12438 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:24.349171  9523 raft_consensus.cc:1240] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:24.349678 12369 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:24.345690 12204 consensus_queue.cc:237] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:24.350716  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.351481  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:24.352059  9517 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:24.354545 12454 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:24.355391  9273 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43244 (request call id 185) took 11690 ms (client timeout 15000 ms). Trace:
I20260709 13:03:24.357900 11950 raft_consensus.cc:3055] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:24.358459 11950 raft_consensus.cc:740] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:24.355816  9273 rpcz_store.cc:269] 0709 13:03:12.664717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.664984 (+   267us) service_pool.cc:224] Handling call
0709 13:03:24.355289 (+11690305us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:21.817906 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:21.818735 (+   829us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:21.818797 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:03:21.818819 (+    22us) tablet.cc:662] Decoding operations
0709 13:03:21.820433 (+  1614us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:21.820548 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:21.820581 (+    33us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:03:21.857523 (+ 36942us) tablet.cc:701] Row locks acquired
0709 13:03:21.857587 (+    64us) write_op.cc:260] PREPARE: finished
0709 13:03:21.857780 (+   193us) write_op.cc:270] Start()
0709 13:03:21.857951 (+   171us) write_op.cc:276] Timestamp: P: 1783602201857711 usec, L: 0
0709 13:03:21.857981 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:03:21.858781 (+   800us) log.cc:844] Serialized 5838 byte log entry
0709 13:03:22.277929 (+419148us) op_driver.cc:464] REPLICATION: finished
0709 13:03:22.522574 (+244645us) spinlock_profiling.cc:243] Waited 51.7 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb5834600ac 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb589fa0ef0
0709 13:03:22.941058 (+418484us) write_op.cc:301] APPLY: starting
0709 13:03:22.947000 (+  5942us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:22.947504 (+   504us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:22.947559 (+    55us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:22.987096 (+ 39537us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:22.987546 (+   450us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:03:22.987606 (+    60us) write_op.cc:312] APPLY: finished
0709 13:03:22.988144 (+   538us) log.cc:844] Serialized 106 byte log entry
0709 13:03:22.988380 (+   236us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:22.988581 (+   201us) write_op.cc:454] Released schema lock
0709 13:03:22.988666 (+    85us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:23.014598 (+ 25932us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:23.015431 (+   833us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11552,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":628931,"apply.run_cpu_time_us":6041,"apply.run_wall_time_us":92046,"num_ops":15,"prepare.queue_time_us":48565,"prepare.run_cpu_time_us":30464,"prepare.run_wall_time_us":96348,"raft.queue_time_us":314658,"raft.run_cpu_time_us":26180,"raft.run_wall_time_us":670509,"replication_time_us":366980,"spinlock_wait_cycles":118901632,"thread_start_us":854283,"threads_started":4,"wal-append.queue_time_us":45974,"wal-append.run_cpu_time_us":44355,"wal-append.run_wall_time_us":2097137}]]}
I20260709 13:03:24.361582  9521 raft_consensus.cc:1240] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:03:24.362864  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.364154  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:24.367647  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:24.367713  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.369539 11950 consensus_queue.cc:260] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.369604  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:24.380287  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.387408  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.388651  9370 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:24.317644 12448 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:24.392529  9377 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:24.388132  9522 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.395303  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.395709  9524 raft_consensus.cc:1240] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 8. Ops: []
I20260709 13:03:24.398638  9525 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:24.401069  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:24.403283  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:24.450875  9521 raft_consensus.cc:3060] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:24.407100  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.423983  9520 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:24.445354  9444 raft_consensus.cc:1275] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:24.447660  9517 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:24.448571  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:24.340144  9446 raft_consensus.cc:2393] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 5: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:24.456681  9377 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:24.316447 12452 consensus_queue.cc:1059] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:03:24.460386  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:24.390652 11950 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:24.463497  9522 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:24.460985  9341 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:24.472889  9521 raft_consensus.cc:2468] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 5.
I20260709 13:03:24.472982  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:24.474565 10027 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:24.476801  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.477937  9444 raft_consensus.cc:2393] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 8: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:24.487023  9445 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e30c155cba64357ae275b3366772777"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:03:24.488852  9445 raft_consensus.cc:606] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:24.489421  9445 raft_consensus.cc:614] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:24.491334  9377 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:03:24.495172  9341 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:24.398538 12371 consensus_queue.cc:1059] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:03:24.361701  9271 catalog_manager.cc:5697] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 4 to 7, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 7 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:24.499409 12348 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:24.521198  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:24.500512  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:24.500852  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.522626  9447 raft_consensus.cc:2393] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:24.501272  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.507201  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:24.465270 12167 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:24.465549 12095 consensus_queue.cc:1059] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:03:24.500303  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.493369 12105 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:24.527050  9446 raft_consensus.cc:1240] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:24.501247  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:24.528229  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.529843  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:24.544423  9443 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:24.529917  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.545549  9444 raft_consensus.cc:2393] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 8: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:24.526412  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.461956 12448 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:24.539732  9452 raft_consensus.cc:1275] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:24.537098  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:24.547302  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.546633  9450 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:24.556813  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:24.469745 12466 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:03:24.558399  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:24.573218  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:24.576730  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.557651  9450 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
W20260709 13:03:24.578622  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.521315 12359 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:03:24.542289 12105 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:24.583251  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:24.590814  9418 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:24.591535 12446 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:24.592326 12444 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:24.594306  9418 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:24.586462  9448 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:03:24.587955  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:24.596539  9450 raft_consensus.cc:3055] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:24.597306  9418 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:24.597108  9450 raft_consensus.cc:740] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:24.599356  9418 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:24.568980 12348 raft_consensus.cc:697] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:24.621709  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.613629  9450 consensus_queue.cc:260] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.629817  9450 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:03:24.630605 12441 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:24.631940 12167 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:24.613384 12344 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:24.633607 12344 consensus_queue.cc:1059] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:24.600477 12105 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:24.601601 12444 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:24.666249 11973 raft_consensus.cc:2804] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:24.667186 11973 raft_consensus.cc:697] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 5 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
W20260709 13:03:24.668767 12473 log.cc:927] Time spent T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:03:24.671533 12407 raft_consensus.cc:3055] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:24.623245 12437 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:24.614495  9271 catalog_manager.cc:5697] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 5 to 7, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 7 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:24.668510 11973 consensus_queue.cc:237] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:24.722064  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:24.732793  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:24.737217  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 164921us
W20260709 13:03:24.741180  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 178606us
I20260709 13:03:24.642676 12142 raft_consensus.cc:3055] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:03:24.752447  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:24.736977 11599 consensus_meta.cc:287] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.720s	user 0.010s	sys 0.003s
I20260709 13:03:24.699036 12407 raft_consensus.cc:740] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:24.744097 12461 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.783571  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.756223 12142 raft_consensus.cc:740] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:24.761811 12389 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:24.805114  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 180391us
I20260709 13:03:24.806267  9418 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
W20260709 13:03:24.808880  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.809772  9443 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:24.811260  9341 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:24.815233  9373 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:24.817363  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:03:24.830071 12476 log.cc:927] Time spent T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:03:24.830979  9271 catalog_manager.cc:5697] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 3 to 5, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 5 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:24.833225 12448 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:03:24.835139  9551 heartbeater.cc:646] Failed to heartbeat to 127.8.4.126:34725 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.8.4.126:34725 timed out after 15.000s (SENT)
I20260709 13:03:24.846035 12407 consensus_queue.cc:260] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.788924 12406 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:24.847499 12406 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.841665 12142 consensus_queue.cc:260] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.850329 12142 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:24.843446 12410 consensus_meta.cc:287] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.629s	user 0.002s	sys 0.006s
I20260709 13:03:24.851323 12410 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.789175 12461 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.853389 12410 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:24.824330 12482 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:24.849635 12406 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:24.854105 12482 raft_consensus.cc:697] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:24.855088 12482 consensus_queue.cc:237] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.770893 12348 consensus_queue.cc:237] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.841614 12319 raft_consensus.cc:3055] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:24.795771 12444 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:24.858378  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:24.858111 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:24.867228  9375 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:24.822986 12402 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:24.872139  9372 raft_consensus.cc:2393] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 6: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
W20260709 13:03:24.877882  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.814950 12389 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.872575 12402 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:24.884809 12402 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:24.881860  9450 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
W20260709 13:03:24.870347 12438 consensus_meta.cc:287] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.523s	user 0.006s	sys 0.006s
I20260709 13:03:24.866547 12319 raft_consensus.cc:740] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:24.896886  9370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:24.902654  9370 raft_consensus.cc:606] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:24.903017  9370 raft_consensus.cc:614] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:24.906188  9368 raft_consensus.cc:1275] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:03:24.933666  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.903111 12389 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:24.878904 12444 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:24.941211 12444 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:24.938095 10068 raft_consensus.cc:1240] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 7 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:24.934443 10066 raft_consensus.cc:1240] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 5 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:24.945444  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.950214 12319 consensus_queue.cc:260] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:24.951025  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.952147  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.952245  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.953361  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.953560  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.954361  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:24.954912  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:24.955602  9374 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:24.955752 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:24.960968  9526 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:03:24.963335  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:24.954996  9371 raft_consensus.cc:2376] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8. Re-sending same reply.
I20260709 13:03:24.964226  9521 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:24.964954  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:24.961524  9519 raft_consensus.cc:1275] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:24.966712  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:24.961054  9443 raft_consensus.cc:1240] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:24.967519  9377 raft_consensus.cc:2376] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7. Re-sending same reply.
I20260709 13:03:24.953958  9376 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:24.989898  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:24.998504  9368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36e88678fcd042e78609b17fe3521242"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:24.999234  9368 raft_consensus.cc:606] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:25.003866  9522 raft_consensus.cc:1240] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:25.004236  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:24.997679  9492 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:25.007315  9517 raft_consensus.cc:1240] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:25.005163  9524 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:25.011754  9375 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:24.944952 12461 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:25.031785  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 208288us
I20260709 13:03:25.033208  9418 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:25.051291  9368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:25.051963  9368 raft_consensus.cc:606] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:25.052285  9368 raft_consensus.cc:614] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:25.053108 12407 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:25.061189 12486 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:25.064777  9368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:25.069332  9368 raft_consensus.cc:606] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:25.070043  9443 raft_consensus.cc:1275] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:03:25.071734 12372 consensus_queue.cc:1048] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:25.075636  9368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f322b7281d554c459bb8109ed249047b"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:25.076303  9368 raft_consensus.cc:606] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:25.076637  9368 raft_consensus.cc:614] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:25.080931  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:24.998507 12151 consensus_queue.cc:1059] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:03:25.087599  9443 raft_consensus.cc:1240] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
W20260709 13:03:25.094529  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:25.112257  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:25.124502  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 91389.5us
I20260709 13:03:25.126914  9520 raft_consensus.cc:1240] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:25.031358 12461 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:03:25.128643  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:25.131060  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:25.132157  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.128134  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:25.139961  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:25.140698  9520 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:03:25.137636 12444 consensus_queue.cc:1059] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:03:25.137957 12151 consensus_queue.cc:1243] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer b0812463215649c3b011d36e2f0400c9 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:25.150313 12437 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:25.151916  9517 raft_consensus.cc:1240] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:25.129273 12461 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.153340 12461 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:25.155434 12444 consensus_queue.cc:1243] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer b0812463215649c3b011d36e2f0400c9 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:25.156009 12444 raft_consensus.cc:3055] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:25.156351 12444 raft_consensus.cc:740] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:03:25.156484  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.157318 12444 consensus_queue.cc:260] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:25.158577 12444 raft_consensus.cc:3060] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:25.159037 12443 raft_consensus.cc:3055] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:25.159442 12443 raft_consensus.cc:740] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:25.160235 12443 consensus_queue.cc:260] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:25.161432 12371 raft_consensus.cc:3055] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:25.161777  9524 raft_consensus.cc:1275] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:03:25.161911 12443 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:25.164283  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.168324  9520 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
W20260709 13:03:25.169502  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 74095.6us
I20260709 13:03:25.161834 12371 raft_consensus.cc:740] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:25.172776 12319 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:25.172969 12371 consensus_queue.cc:260] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:25.174322 12371 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:25.177366  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:25.177865  9517 raft_consensus.cc:1240] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:25.179572  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:25.164093 12490 log.cc:927] Time spent T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:03:25.180863  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:25.181663  9522 raft_consensus.cc:2393] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 7: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:25.185366  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:25.184957  9522 raft_consensus.cc:1275] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:25.186801  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:25.189363  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:25.190192  9517 raft_consensus.cc:2393] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 7: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:25.191501  9374 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:25.191612 12402 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:25.197964  9369 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:25.205574  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:25.207930  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:25.208622  9518 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:03:25.211234 12462 consensus_queue.cc:1059] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:03:25.214991  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 68735.1us
I20260709 13:03:25.216496  9518 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:25.219044  9447 raft_consensus.cc:1240] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
W20260709 13:03:25.218668  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 221046us
I20260709 13:03:25.222779  9418 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:25.221534 12420 consensus_queue.cc:1048] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:03:25.230724 12482 raft_consensus.cc:3055] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:25.231199 12482 raft_consensus.cc:740] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:25.232033 12482 consensus_queue.cc:260] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:25.214496  9521 raft_consensus.cc:2955] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 3 to 8, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:25.240087  9518 raft_consensus.cc:3055] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:25.240505  9518 raft_consensus.cc:740] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:25.223809  9492 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:25.248590  9492 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:25.158991 12105 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:25.254099  9418 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:25.254145  9517 raft_consensus.cc:1275] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:25.247234 12389 raft_consensus.cc:2804] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:25.241197  9518 consensus_queue.cc:260] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:25.265918  9518 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:25.242336 12406 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:25.261405 12495 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:25.259609 12402 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:25.264544  9418 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:25.275769  9418 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:25.277370 12448 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:25.251581 12482 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:25.283048 12483 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:25.283667 12483 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:25.283089 12348 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:03:25.285956 12483 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:25.286440  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.290160  9444 raft_consensus.cc:1275] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:03:25.290689  9444 pending_rounds.cc:85] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 5
I20260709 13:03:25.290967  9444 pending_rounds.cc:107] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:03:25.291263  9444 raft_consensus.cc:2889] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:25.281596 12448 raft_consensus.cc:697] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:25.296619 12448 consensus_queue.cc:237] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:25.282143 12498 consensus_queue.cc:1175] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "925acbe78db14db3b9e4cfc857717947" responder_term: 10 status { last_received { term: 10 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:25.300523  9450 raft_consensus.cc:1240] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:25.301505 12498 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:25.301906 12498 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:25.302271 12498 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:25.305178 12468 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:25.305500 11950 consensus_queue.cc:1059] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:25.306455 11950 raft_consensus.cc:3055] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:25.306800 11950 raft_consensus.cc:740] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:25.307039  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:25.307546 11950 consensus_queue.cc:260] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:25.307657  9444 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:25.309024  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:25.309828  9517 raft_consensus.cc:2393] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 6: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:25.311062  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:25.307644 12461 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:25.324980  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:25.327863  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.332263  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:25.332109  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 56374.6us
I20260709 13:03:25.333190  9368 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:03:25.309233 11950 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:25.334291  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:25.335848 12105 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:25.338507  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:25.339372  9369 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:25.267246 12344 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:03:25.342056  9519 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:25.345350  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:25.333727  9418 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:25.346343  9525 raft_consensus.cc:2393] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 6: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:25.348039  9369 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:25.309315  9341 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:25.354329  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:25.342103 12502 log.cc:927] Time spent T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:03:25.374284  9343 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:25.375849 12461 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:25.381630  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.382661 12468 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:25.383512  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 49863.1us
I20260709 13:03:25.370898  9518 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:25.384779  9418 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:25.358026 12486 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:25.393908  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:25.394899  9369 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:25.393971  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:25.387858 12402 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:25.400939 12495 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:25.347688 12367 consensus_queue.cc:1048] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:03:25.404029  9521 raft_consensus.cc:1240] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:25.405728 12486 raft_consensus.cc:697] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:03:25.420598  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 111380us
I20260709 13:03:25.406385  9524 raft_consensus.cc:1240] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:25.407298  9374 raft_consensus.cc:1240] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:25.391973 12046 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:25.408679 12402 raft_consensus.cc:697] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:25.409919  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:25.410180  9373 raft_consensus.cc:1275] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:25.411346  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:25.412900  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:25.414443  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:25.405194  9343 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:25.418042  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:25.419991  9369 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:25.424882  9450 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:25.425355  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:25.427280  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:25.434312  9518 raft_consensus.cc:1240] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:25.438109  9418 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:25.442873  9418 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:25.437103 12389 raft_consensus.cc:697] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:25.444828  9371 raft_consensus.cc:1275] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:03:25.445211  9371 pending_rounds.cc:85] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947: Aborting all ops after (but not including) 5
I20260709 13:03:25.445679  9371 pending_rounds.cc:107] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:03:25.445945  9371 raft_consensus.cc:2889] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:25.446341  9448 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:25.448221  9343 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:25.444005  9418 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:25.450876  9418 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:25.422112 12495 raft_consensus.cc:697] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:25.428225 12046 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:25.459090 12046 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:25.456972  9343 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:25.462664  9370 raft_consensus.cc:1240] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:25.445389 12095 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:25.447047 12441 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:25.467621  9343 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:25.466912  9374 raft_consensus.cc:1240] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:25.445873 12444 raft_consensus.cc:2764] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:03:25.445215 12389 consensus_queue.cc:237] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:25.472113 12444 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:25.472666  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:25.451467 12406 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:25.457130 12462 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:25.449580 12437 consensus_queue.cc:1059] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 13:03:25.475322  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 226657us
I20260709 13:03:25.485893  9492 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:25.480872 12468 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:25.461458 12319 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:03:25.470283 11950 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:25.495838  9343 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:25.487310  9418 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:25.498907  9492 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:25.503969  9492 leader_election.cc:400] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11.
I20260709 13:03:25.504388  9492 leader_election.cc:403] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:25.505740  9418 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:25.485396 12437 raft_consensus.cc:3055] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:25.484532 12495 consensus_queue.cc:237] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:25.513741  9343 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:25.514552 12105 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:25.515754 12105 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:25.494215 12451 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:03:25.539487  9343 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:25.512739  9418 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:25.539793 12510 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11.
I20260709 13:03:25.541594 12452 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:03:25.493124 12486 consensus_queue.cc:237] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:25.548758  9522 raft_consensus.cc:1240] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:25.519259 12448 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:25.548691 12498 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:25.511008 12506 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:25.539671 12508 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:25.483744 12402 consensus_queue.cc:237] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:25.563767 12508 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:25.564231 12508 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:25.544571 11950 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:25.544164 12441 consensus_queue.cc:1059] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:03:25.517233 12454 consensus_queue.cc:1048] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 13:03:25.562011  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 210532us
I20260709 13:03:25.563126 12448 raft_consensus.cc:697] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:25.567476  9492 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:25.573406 12348 raft_consensus.cc:993] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:03:25.575663  9522 raft_consensus.cc:1275] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:25.512732 12437 raft_consensus.cc:740] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:25.564744 12498 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:25.558027 12509 log.cc:927] Time spent T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:03:25.586848  9492 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:03:25.549243 12507 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:03:25.588378  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.589514 12448 consensus_queue.cc:237] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:25.560570 12406 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:25.568308 12142 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:25.594316  9492 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:25.576203 12454 consensus_queue.cc:1243] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:25.570768 12506 raft_consensus.cc:697] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 9 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:25.605857  9492 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:25.587266 12461 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:25.593144 12348 raft_consensus.cc:1081] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:03:25.606597 11950 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:03:25.611330 12510 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:25.617333 12437 consensus_queue.cc:260] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:25.607858 12498 raft_consensus.cc:2749] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:25.611572 12461 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.682785 12437 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:25.604058 12514 raft_consensus.cc:2764] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
W20260709 13:03:25.709990  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.738641 12482 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:25.739480 12482 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:25.743435 12482 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:25.704030 12461 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:25.752732 12142 raft_consensus.cc:697] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:25.762686 12508 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:25.770619 12046 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:25.803843  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 210425us
W20260709 13:03:25.804080  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 191165us
I20260709 13:03:25.801244 12406 raft_consensus.cc:697] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:25.813839  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:25.814530 12514 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:25.800079 12046 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:25.816723  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:25.830089  9450 raft_consensus.cc:2368] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12.
I20260709 13:03:25.816947  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:25.824337  9492 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:25.815425 12407 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:25.831296  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:25.833958  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:25.832430  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:25.834769  9444 raft_consensus.cc:2368] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11.
I20260709 13:03:25.833154  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:25.836817  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:25.838876  9525 raft_consensus.cc:1275] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:03:25.839111  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.761104 12506 consensus_queue.cc:237] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:25.843015 12508 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:25.845991  9522 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:25.835299  9492 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:25.841643 12531 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:25.835456 12525 consensus_queue.cc:1059] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:03:25.842165  9525 raft_consensus.cc:1240] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:25.850868  9492 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:25.818918 12438 consensus_queue.cc:1059] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:03:25.862141  9418 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:25.862226 12438 consensus_queue.cc:1059] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:25.863760  9418 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:25.865893 12525 raft_consensus.cc:3055] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:25.866304 12525 raft_consensus.cc:740] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:25.866384 12514 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:25.866791 12514 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.867125 12514 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:25.867205 12525 consensus_queue.cc:260] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:25.868635 12525 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:25.869268 12402 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:25.869730 12532 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:25.871430 12532 raft_consensus.cc:697] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:25.869676 12528 consensus_queue.cc:1048] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:25.872327 12532 consensus_queue.cc:237] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:25.864830  9418 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
W20260709 13:03:25.892464  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 321084us
I20260709 13:03:25.900218 12485 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:03:25.900638 12519 log.cc:927] Time spent T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.203s	user 0.000s	sys 0.002s
I20260709 13:03:25.911163  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:25.912853  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:25.913784  9444 raft_consensus.cc:2393] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 8: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:25.895673 12510 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:25.929678  9343 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:25.931452 12151 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:25.932500 12151 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:03:25.937803  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 73034.7us
I20260709 13:03:25.878260 12508 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:25.838419 12407 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:25.874930 12372 consensus_queue.cc:1048] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:03:25.878118 12531 raft_consensus.cc:697] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 8 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:25.944098 12402 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:25.855718 12142 consensus_queue.cc:237] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:25.959565 12446 consensus_queue.cc:1059] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
W20260709 13:03:25.975587  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 120130us
I20260709 13:03:25.976361  9492 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:25.956771 12508 raft_consensus.cc:697] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:25.985683  9525 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:25.990756  9451 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:25.996302  9522 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:26.005851  9525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36e88678fcd042e78609b17fe3521242"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46894
I20260709 13:03:26.006628  9525 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:26.007105  9525 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:26.005205  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 51297.7us
I20260709 13:03:26.009774  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:26.013302  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:26.015064  9523 raft_consensus.cc:1240] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:25.947404 12406 consensus_queue.cc:237] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.016575  9520 raft_consensus.cc:2393] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 6: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:26.023265  9520 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:26.029031  9492 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:26.061957  9418 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:26.067519  9525 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.068719  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:26.095408  9525 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:26.097330 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 222570us
W20260709 13:03:26.100683  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 82088.7us
I20260709 13:03:26.103360  9492 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:26.074455 12448 raft_consensus.cc:3055] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:26.073647 12498 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:26.071938 12528 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:26.110713  9490 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:26.118707  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 50097.2us
I20260709 13:03:26.090497 12482 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.126792 12482 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.129935 12482 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:26.135035  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:26.096613 12483 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.102166 12532 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.117764 12448 raft_consensus.cc:740] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:26.061910 12531 consensus_queue.cc:237] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.150743 12498 raft_consensus.cc:697] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 8 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:26.150602 12545 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:26.140625 12461 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.103693 12508 consensus_queue.cc:237] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.182380  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:26.184630  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:26.186364  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:26.187815  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:26.151790 12483 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.189256  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:26.191562  9443 raft_consensus.cc:2393] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:26.170372 12506 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:26.208968  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:26.164449 12438 consensus_queue.cc:1048] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:03:26.214314 12461 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:26.216010 12483 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:26.217374 12552 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:26.181110 12446 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 13:03:26.190811 12530 log.cc:927] Time spent T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:03:26.184428 12538 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:03:26.222712  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.161224 12532 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.182045 12441 consensus_queue.cc:1059] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:03:26.175295 12528 consensus_queue.cc:1059] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:03:26.193468 12550 consensus_queue.cc:1059] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:03:26.265877  9523 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:03:26.271479 12553 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.289304 12528 consensus_queue.cc:1059] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:26.270129 12538 raft_consensus.cc:697] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:03:26.297060 12539 log.cc:927] Time spent T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
W20260709 13:03:26.296798 12536 log.cc:927] Time spent T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
W20260709 13:03:26.329829  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 226514us
I20260709 13:03:26.271236 12498 consensus_queue.cc:237] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.370541 12532 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:26.370693 12538 consensus_queue.cc:237] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.305109 12528 consensus_queue.cc:1243] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 6d50f1c263264b21919230bee398022b log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:03:26.304280 12553 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:26.375538 12556 log.cc:927] Time spent T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:03:26.376066 12553 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:26.383333  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 272689us
I20260709 13:03:26.295774 12545 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:03:26.407115  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:26.402179 12514 consensus_meta.cc:287] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.535s	user 0.014s	sys 0.000s
I20260709 13:03:26.425413  9377 pending_rounds.cc:85] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947: Aborting all ops after (but not including) 4
I20260709 13:03:26.425810  9377 pending_rounds.cc:107] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.5
I20260709 13:03:26.399416 12528 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:26.431448  9374 raft_consensus.cc:1275] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:26.434885  9374 raft_consensus.cc:1240] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:26.438472  9377 raft_consensus.cc:2917] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Aborting config change with OpId 3.5: Aborted: Op aborted by new leader
I20260709 13:03:26.480237  9377 raft_consensus.cc:2889] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:26.481974  9376 raft_consensus.cc:1240] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:26.429281 12348 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:26.481539 12525 consensus_meta.cc:287] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.005s
I20260709 13:03:26.491760  9374 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:26.493405  9376 raft_consensus.cc:1240] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:26.432622 12514 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.503685  9451 raft_consensus.cc:2410] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:03:26.506562  9377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:52546 (request call id 76) took 9583 ms. Trace:
I20260709 13:03:26.506956  9377 rpcz_store.cc:276] 0709 13:03:16.919834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.920012 (+   178us) service_pool.cc:224] Handling call
0709 13:03:17.186845 (+266833us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b540026c620. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5864e7520 00007fb586570b42 00007fb58656f800 00007fb5865689fa 00007fb58b5304c9 00007fb584aacc54 00007fb584aacbe2 00007fb584aacb11 00007fb584aaca8c 00007fb584aabd42
0709 13:03:17.258221 (+ 71376us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b180023c520. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865a573d 00007fb586570f3f 00007fb5865706b3 00007fb5865689fa 00007fb58b5304c9 00007fb584aacc54 00007fb584aacbe2 00007fb584aacb11 00007fb584aaca8c 00007fb584aabd42
0709 13:03:17.672341 (+414120us) spinlock_profiling.cc:243] Waited 48.9 ms on lock 0x7b4c004d78c0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb584836a20 00007fb584847a29 00007fb58480d644 00007fb584834f2d 00007fb584834b93 00007fb5864c31af 00007fb5864c2f3e 00007fb586548888 00007fb58656575c 00007fb58656676a 00007fb58656591b
0709 13:03:17.701952 (+ 29611us) log.cc:844] Serialized 480 byte log entry
0709 13:03:18.340120 (+638168us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b540026c620. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5864eab26 00007fb5864e449a 00007fb5864e3714 00007fb5864c3eaa 00007fb5864cad53 00007fb5864cacd9 00007fb5864cac69 00007fb5864cac31 00007fb5864c9dfd 000000000038f354
0709 13:03:18.341234 (+  1114us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b540026c620. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5864e3142 00007fb5864c3eaa 00007fb5864cad53 00007fb5864cacd9 00007fb5864cac69 00007fb5864cac31 00007fb5864c9dfd 000000000038f354 000000000038f199 00007fb58347d475
0709 13:03:26.491249 (+8150015us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8814,"raft.run_cpu_time_us":17295,"raft.run_wall_time_us":892879,"spinlock_wait_cycles":265260672,"thread_start_us":63901,"threads_started":1,"wal-append.queue_time_us":234918,"wal-append.run_cpu_time_us":2635,"wal-append.run_wall_time_us":1287113}
I20260709 13:03:26.513257 12516 raft_consensus.cc:3055] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:26.513890 12516 raft_consensus.cc:740] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:26.516044 12533 raft_consensus.cc:3055] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:26.516611 12533 raft_consensus.cc:740] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:26.517954 12550 raft_consensus.cc:3055] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:26.518455 12550 raft_consensus.cc:740] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:26.519459 12550 consensus_queue.cc:260] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.525619 12448 consensus_queue.cc:260] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.527001 12448 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:26.527616 12516 consensus_queue.cc:260] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.441465 12528 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.585479 12516 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:26.596279  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 211341us
I20260709 13:03:26.489373 12348 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.599665  9370 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:03:26.601205  9374 raft_consensus.cc:1240] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:26.605659  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:26.606594  9370 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:26.603452  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:26.610764  9525 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:26.612632  9522 raft_consensus.cc:2393] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 9: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:26.628482  9490 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:26.637956 12569 log.cc:927] Time spent T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.052s	user 0.006s	sys 0.000s
I20260709 13:03:26.638551 12348 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:26.617362 12554 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:03:26.650504  9490 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:26.655439  9525 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:26.645147 12461 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:26.669445  9523 raft_consensus.cc:1240] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:26.650043 12389 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:26.677218  9519 raft_consensus.cc:1240] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:26.691360  9374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:26.693362  9374 raft_consensus.cc:606] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:26.671773 12461 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.697398 12533 consensus_queue.cc:260] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.698701 12533 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:26.700057 12438 raft_consensus.cc:3055] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:26.700627 12438 raft_consensus.cc:740] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:26.703328  9518 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:26.687605 12514 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:26.692471 12528 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:26.700984 12525 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.723052  9449 raft_consensus.cc:1275] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:26.701754 12438 consensus_queue.cc:260] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:26.727423  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.727713  9374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:26.728543  9374 raft_consensus.cc:606] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:26.728933  9374 raft_consensus.cc:614] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:26.722433 12525 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.737396 12438 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:26.747789 12525 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:26.748724 12407 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:26.766752 12516 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.767453 12516 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.769732  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:26.769955 12516 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:26.770563  9376 raft_consensus.cc:2393] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 9: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:26.770911 12402 raft_consensus.cc:3055] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:26.771471 12402 raft_consensus.cc:740] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:26.771875  9370 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:26.773069  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:26.773265  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.773720  9369 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:26.773795  9377 raft_consensus.cc:1240] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:26.776988  9271 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 73) took 4988 ms. Trace:
I20260709 13:03:26.777526  9271 rpcz_store.cc:276] 0709 13:03:21.788590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.788799 (+   209us) service_pool.cc:224] Handling call
0709 13:03:26.776908 (+4988109us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:25.161394 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:25.161944 (+   550us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:25.161986 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:03:25.162003 (+    17us) tablet.cc:662] Decoding operations
0709 13:03:25.162644 (+   641us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:25.162722 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:25.162765 (+    43us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:03:25.163154 (+   389us) tablet.cc:701] Row locks acquired
0709 13:03:25.163172 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:03:25.163319 (+   147us) write_op.cc:270] Start()
0709 13:03:25.163432 (+   113us) write_op.cc:276] Timestamp: P: 1783602205163273 usec, L: 0
0709 13:03:25.163451 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:03:25.236176 (+ 72725us) log.cc:844] Serialized 1769 byte log entry
0709 13:03:25.961260 (+725084us) op_driver.cc:464] REPLICATION: finished
0709 13:03:26.169663 (+208403us) write_op.cc:301] APPLY: starting
0709 13:03:26.175103 (+  5440us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:26.203238 (+ 28135us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:26.255242 (+ 52004us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:26.410176 (+154934us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:26.479963 (+ 69787us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:03:26.483368 (+  3405us) write_op.cc:312] APPLY: finished
0709 13:03:26.507473 (+ 24105us) log.cc:844] Serialized 40 byte log entry
0709 13:03:26.603100 (+ 95627us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:26.610336 (+  7236us) write_op.cc:454] Released schema lock
0709 13:03:26.614173 (+  3837us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:26.628712 (+ 14539us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:26.632870 (+  4158us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":378,"mutex_wait_us":414490,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":193700,"apply.run_cpu_time_us":11031,"apply.run_wall_time_us":458661,"num_ops":4,"prepare.queue_time_us":220732,"prepare.run_cpu_time_us":13182,"prepare.run_wall_time_us":279090,"raft.queue_time_us":361793,"raft.run_cpu_time_us":25222,"raft.run_wall_time_us":106657,"replication_time_us":797572,"thread_start_us":637944,"threads_started":4,"wal-append.queue_time_us":224414}]]}
I20260709 13:03:26.781659 12528 consensus_queue.cc:1059] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:26.782878 12461 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:26.782918 12528 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:26.786334 12407 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.786674 12482 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.786909 12407 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.787143 12482 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.788995 12482 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:26.789608 12516 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:26.789031 12407 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:26.790858 12402 consensus_queue.cc:260] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.792006 12528 consensus_queue.cc:1059] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:26.785899  9418 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:26.794231 12444 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:26.794708 12444 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.795028 12444 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:26.797713 12578 log.cc:927] Time spent T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:03:26.800379  9418 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:26.802726 12516 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:26.803056 12444 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.804250 12516 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:26.804679 12516 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.805052 12516 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:26.805692 12444 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:26.807619 12550 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:26.809522 12495 raft_consensus.cc:3055] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:26.810000 12495 raft_consensus.cc:740] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:26.810969 12495 consensus_queue.cc:260] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.812173 12495 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:26.813773  9370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36e88678fcd042e78609b17fe3521242"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:26.814472  9370 raft_consensus.cc:606] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:26.817332  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:26.818011  9377 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:26.820504 12506 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:26.821067 12506 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:26.827512  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:26.828403  9370 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:26.828423  9418 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:26.831705 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 108189us
W20260709 13:03:26.839596 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 114089us
I20260709 13:03:26.843891  9370 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:26.846102  9418 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:26.847957  9376 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:03:26.846760  8209 auto_leader_rebalancer.cc:438] leader transfer for tablet 36e88678fcd042e78609b17fe3521242 from 925acbe78db14db3b9e4cfc857717947 to 6d50f1c263264b21919230bee398022b failed: Remote error: Service unavailable: leadership transfer for 36e88678fcd042e78609b17fe3521242 already in progress
I20260709 13:03:26.856364 12545 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:26.862622 12420 consensus_queue.cc:1048] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:26.835451 12525 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:26.865074 12525 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.865440 12525 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:26.867982  9370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:26.868753  9370 raft_consensus.cc:606] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:26.873579 12348 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.833513 12437 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:26.867745 12444 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:26.874190 12348 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:26.891523 12420 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:26.879426 12437 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.028492  9373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:27.031816  9373 raft_consensus.cc:606] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:26.901366 12516 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.024015 12451 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:27.051906 12420 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:27.414403 12551 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:27.414657  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 764186us
W20260709 13:03:27.403853 12533 consensus_meta.cc:287] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.705s	user 0.007s	sys 0.006s
I20260709 13:03:27.418479  9490 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:27.426350 12577 log.cc:927] Time spent T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.788s	user 0.010s	sys 0.024s
I20260709 13:03:27.428570  9520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1814) took 1401 ms. Trace:
I20260709 13:03:27.429033  9520 rpcz_store.cc:276] 0709 13:03:26.027655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.028274 (+   619us) service_pool.cc:224] Handling call
0709 13:03:26.028699 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:26.034541 (+  5842us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:26.313030 (+278489us) log.cc:844] Serialized 14 byte log entry
0709 13:03:26.635840 (+322810us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:26.636397 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:03:26.642874 (+  6477us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:26.644279 (+  1405us) log.cc:844] Serialized 14 byte log entry
0709 13:03:26.644523 (+   244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.644617 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:26.788647 (+144030us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b18003efd40. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb5833f7c0a 00007fb58cb37219 00007fb58b493328 00007fb58b48a901 00007fb58b48a8a7 00007fb58b582288 00007fb58b581f37 00007fb58b59655c 00007fb58b596508
0709 13:03:27.425649 (+637002us) spinlock_profiling.cc:243] Waited 5.9 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:27.428287 (+  2638us) raft_consensus.cc:1685] finished
0709 13:03:27.428320 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.428494 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":674123,"prepare.queue_time_us":84691,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":93,"raft.queue_time_us":129533,"raft.run_cpu_time_us":2060,"raft.run_wall_time_us":146491,"spinlock_wait_cycles":16819968,"thread_start_us":473837,"threads_started":2,"wal-append.queue_time_us":284470}
I20260709 13:03:27.302696 12451 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:27.420786 12506 consensus_meta.cc:287] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.597s	user 0.006s	sys 0.004s
I20260709 13:03:27.421473 12372 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:27.447860  9526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1807) took 1449 ms. Trace:
W20260709 13:03:27.451177  9370 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.030s	sys 0.043s
I20260709 13:03:27.449155  9526 rpcz_store.cc:276] 0709 13:03:25.998096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.001681 (+  3585us) service_pool.cc:224] Handling call
0709 13:03:26.002137 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:26.697349 (+695212us) spinlock_profiling.cc:243] Waited 9.8 ms on lock 0x7b4800061ed8. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58b493aa1 00007fb58b48ab37 00007fb58b48a9ca 00007fb58b58226f 00007fb58b581f37 00007fb58b59655c 00007fb58b596508 00007fb58b596488 00007fb58b596443 00007fb58b5956ec 00007fb58a4bfa96
0709 13:03:26.800103 (+102754us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b1800263d40. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb5861124bc 00007fb58346048b 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347a455 00007fb586562060 00007fb586562bfb 00007fb58656d64b
0709 13:03:26.800226 (+   123us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:26.800251 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:26.800816 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:03:26.875668 (+ 74852us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:26.883739 (+  8071us) log.cc:844] Serialized 14 byte log entry
0709 13:03:27.439444 (+555705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.439536 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:27.439587 (+    51us) raft_consensus.cc:1685] finished
0709 13:03:27.439605 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.447771 (+  8166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1279479,"prepare.queue_time_us":9649,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":96294,"raft.run_cpu_time_us":2170,"raft.run_wall_time_us":688117,"spinlock_wait_cycles":59327616,"thread_start_us":197472,"threads_started":2,"wal-append.queue_time_us":356485}
W20260709 13:03:27.453480  9370 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.031s	sys 0.043s
I20260709 13:03:27.449097 12456 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:27.465920 12510 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:27.465849 12456 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:27.466661 12510 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:27.468607 12456 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:27.471228  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:27.453122 12525 consensus_meta.cc:287] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.586s	user 0.009s	sys 0.009s
I20260709 13:03:27.483058  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:27.487618  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:27.489339  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 70989.1us
I20260709 13:03:27.490259  9523 raft_consensus.cc:1240] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:27.490267  9490 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:27.492556  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:27.483944 12510 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:27.525749  9519 raft_consensus.cc:2393] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 9: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:27.527686  9490 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:27.439069 12506 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.472368 12538 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.534703  9490 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:27.451749 12372 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:27.539598  9490 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:27.527043 12348 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:27.526434 12550 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:27.542133  9490 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:27.543751  9520 raft_consensus.cc:1240] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:27.533082 12498 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:27.538344 12514 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:27.488698 12525 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.541177 12531 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:27.545764 12570 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:27.544484 12437 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:27.557685  9490 leader_election.cc:400] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12.
W20260709 13:03:27.559787 12597 log.cc:927] Time spent T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:03:27.564322 12575 log.cc:927] Time spent T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.926s	user 0.019s	sys 0.027s
I20260709 13:03:27.549973 12498 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:27.565871 12389 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:27.568894  9490 leader_election.cc:403] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:27.547971 12348 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.540282 12538 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.541286 12552 consensus_queue.cc:1059] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:03:27.584151 12552 raft_consensus.cc:3055] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:27.551064 12516 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:27.584510 12552 raft_consensus.cc:740] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:27.554874 12568 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:03:27.573143 12591 log.cc:927] Time spent T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:03:27.581136  9490 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:27.585451 12552 consensus_queue.cc:260] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.577252 12451 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:27.583019 12348 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.587517 12552 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:27.566887 12570 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:27.591209 12570 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:27.588253 12348 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:27.588956 12568 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:27.589144 12595 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:03:27.589623 12538 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:27.589777 12531 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12.
I20260709 13:03:27.597412 12372 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:27.582369 12389 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:27.599730 12389 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:27.590405 12506 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:27.600477 12525 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:27.601845  9490 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:27.602907 12506 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:27.603408  9490 leader_election.cc:400] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11.
W20260709 13:03:27.606892 12438 consensus_meta.cc:287] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.831s	user 0.016s	sys 0.000s
I20260709 13:03:27.604947  9490 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:27.609360 12498 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:03:27.611282 12535 log.cc:927] Time spent T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 1.641s	user 0.005s	sys 0.007s
I20260709 13:03:27.614037  9524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1500) took 1391 ms. Trace:
I20260709 13:03:27.614399  9524 rpcz_store.cc:276] 0709 13:03:26.222650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.669739 (+447089us) service_pool.cc:224] Handling call
0709 13:03:26.674949 (+  5210us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:27.415688 (+740739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:27.415725 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:27.416315 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 13:03:27.539096 (+122781us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:27.539136 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.539201 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:27.613822 (+ 74621us) raft_consensus.cc:1685] finished
0709 13:03:27.613843 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.613981 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":798568,"raft.queue_time_us":740321,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":4273,"thread_start_us":95185,"threads_started":1,"wal-append.queue_time_us":148444}
W20260709 13:03:27.619143 12574 log.cc:927] Time spent T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.981s	user 0.009s	sys 0.004s
I20260709 13:03:27.611215  9490 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:27.640820  9490 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:27.637741 10025 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.008s	sys 0.016s
W20260709 13:03:27.643055 10025 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.008s	sys 0.016s
W20260709 13:03:27.643436 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 582034us
I20260709 13:03:27.641140 12498 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:27.638170 12510 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:27.665314 12446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.005s	sys 0.015s
W20260709 13:03:27.668572 12446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.005s	sys 0.015s
I20260709 13:03:27.668967 12444 raft_consensus.cc:697] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:27.669942 12368 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:27.670449 12514 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:27.670024 12444 consensus_queue.cc:237] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.670678 12368 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:27.671010 12514 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:27.674060 12576 log.cc:927] Time spent T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 1.038s	user 0.004s	sys 0.009s
I20260709 13:03:27.678467  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:27.679226  9524 raft_consensus.cc:2393] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 12: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:27.680261  9520 raft_consensus.cc:1240] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:27.680891  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:27.681244  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:27.655716 12389 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:27.687425  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:27.641554 12506 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:27.686358  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:27.691536  9522 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:03:27.692795  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:27.688098  9518 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:27.681568  9519 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:27.693475  9522 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:27.694075  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:27.685549  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:27.695214  9524 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:27.685426  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:27.655570 12531 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:27.694710  9518 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:27.672842 12368 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:27.704293  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:27.676219 12514 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:27.683238 12486 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.709578  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:27.693285 12495 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:27.727502  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:27.727545  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:27.728389  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.698757 12516 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:27.739966  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:27.741401  9517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1805) took 1744 ms. Trace:
I20260709 13:03:27.741799  9517 rpcz_store.cc:276] 0709 13:03:25.997507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.997654 (+   147us) service_pool.cc:224] Handling call
0709 13:03:25.998058 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:26.163252 (+165194us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:26.235748 (+ 72496us) log.cc:844] Serialized 14 byte log entry
0709 13:03:26.614774 (+379026us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:26.620488 (+  5714us) log.cc:844] Serialized 26 byte log entry
0709 13:03:26.620637 (+   149us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:26.620888 (+   251us) log.cc:844] Serialized 14 byte log entry
0709 13:03:26.644869 (+ 23981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.644984 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:26.803984 (+159000us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b180044e780. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58347d522 00007fb58347f7c1 00007fb58347f779 00007fb58347f709 00007fb58347f6d1 00007fb58347e9cd 000000000038f354 000000000038f199 00007fb58346083a
0709 13:03:27.412838 (+608854us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b180044e780. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb5833f7c0a 00007fb58cb37219 00007fb58a43e58f 00007fb58347d571 00007fb58347f7c1 00007fb58347f779 00007fb58347f709 00007fb58347f6d1 00007fb58347e9cd
0709 13:03:27.617895 (+205057us) spinlock_profiling.cc:243] Waited 8.99 ms on lock 0x7b180044e780. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58344b2a6 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db
0709 13:03:27.618533 (+   638us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:27.741168 (+122635us) raft_consensus.cc:1685] finished
0709 13:03:27.741191 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.741321 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":771098,"prepare.queue_time_us":144523,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":4545,"raft.queue_time_us":191851,"raft.run_cpu_time_us":536,"raft.run_wall_time_us":26924,"spinlock_wait_cycles":79964032,"thread_start_us":495855,"threads_started":3,"wal-append.queue_time_us":332251}
I20260709 13:03:27.706629 12531 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.749662 12448 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.750267 12448 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.751186 12531 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:27.752892 12448 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:27.754161 10066 consensus_queue.cc:237] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:27.754985  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:27.755569  9448 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:27.755949  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:27.756325  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:27.757423  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:27.757602  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:27.758052  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:27.758443  9450 raft_consensus.cc:2368] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 9. Current term is 10.
I20260709 13:03:27.758900  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:27.759688  9446 raft_consensus.cc:2393] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 6: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:27.759611  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:27.760352  9447 raft_consensus.cc:2368] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 9.
I20260709 13:03:27.761181  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:27.761790  9452 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:03:27.762615  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:27.763276  9448 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:27.754285 12448 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:27.764526 12448 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:27.759011  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:27.765367 12406 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:27.765405  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:27.781687  9443 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
W20260709 13:03:27.769387  9262 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 45a4f94c156249adab9c2b1ffb00ac46 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 13:03:27.709415 12605 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.757366  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:27.776437  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:27.735070 12525 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:27.730365 12438 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:27.737092 12529 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:27.805675  9262 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 108463us
I20260709 13:03:27.808048  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:27.808674  9443 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
W20260709 13:03:27.792901 12608 log.cc:927] Time spent T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:03:27.813160 12525 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.837232  9451 raft_consensus.cc:2368] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8.
I20260709 13:03:27.792654 12344 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:27.735188 12495 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.806577 12609 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.732841 12486 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.772181 12516 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.860878 12611 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.863597  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:27.816056 12446 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:27.870862  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.834539 12443 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.874608  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:27.876359  9449 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 7.
I20260709 13:03:27.839437 12437 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.879545  9452 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:27.860963 12444 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.843217 12610 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:27.885533  9443 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:03:27.793740 12406 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.817922 12438 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.890755 10025 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:27.890861  9447 raft_consensus.cc:1240] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:27.798826 12605 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:27.892638  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 113203us
W20260709 13:03:27.894137  9492 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.541s (SENT) [suppressed 27 similar messages]
I20260709 13:03:27.834818 12529 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.843986 12483 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:03:27.902660  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:27.849326 12344 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.917476  9452 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:27.921609 10065 consensus_queue.cc:237] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:27.877394 12443 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.944592  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:27.904114 12372 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:27.881644 12446 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.954051 12372 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:27.873358 12609 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.888305 12437 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.895689 12444 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.966921  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:27.968185  9447 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:27.981985  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:27.964776 12372 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:27.958678 12525 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:27.963445 12613 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:27.899142 12610 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:27.891703 12611 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:28.005913  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.010005 12618 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:03:28.026899 12607 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:28.027715 12607 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:28.020963 10026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.022526 12619 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.031376 12619 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:28.036046 12437 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.036655 12486 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.037775 12344 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.039502 12406 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.040448 12483 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:28.040593 12573 log.cc:927] Time spent T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 1.409s	user 0.014s	sys 0.011s
I20260709 13:03:28.041649 12620 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:28.042704 12615 log.cc:927] Time spent T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:03:28.042778 12516 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.044394 12605 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.045670 12420 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:28.045950 12446 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.047266 12443 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:28.022189 12606 log.cc:927] Time spent T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.251s	user 0.001s	sys 0.001s
I20260709 13:03:28.036088 12609 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.050521 12607 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.051963 12619 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.069553 12495 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.056283  9523 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:03:28.059222 10026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.059677  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:28.129179  9518 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 7.
I20260709 13:03:28.073586  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:27.999521 12448 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:03:28.097988  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 198550us
W20260709 13:03:28.098544  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 204416us
I20260709 13:03:28.106752  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:28.131999  9524 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 9.
I20260709 13:03:28.139650 12451 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.140200 12451 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:28.116601 12406 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:28.142964 12406 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:28.147017  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:28.147886  9452 raft_consensus.cc:2393] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 8: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:28.138207  9449 raft_consensus.cc:2468] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 6.
I20260709 13:03:28.148569 10027 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:27.995538 12613 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:28.154696  9343 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:28.064306 12483 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:28.110229 12516 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:28.256664  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.284845  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.285355  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 109459us
I20260709 13:03:28.120926 12344 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.096323 12620 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:28.307694  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:28.318846  9452 raft_consensus.cc:2410] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:03:28.310014  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:28.130542 12617 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:28.324476  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:28.147014 12402 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:28.154202 12570 consensus_meta.cc:287] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.002s
I20260709 13:03:28.317085 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:28.330092  9447 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:28.330605 10069 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:03:28.334849  9491 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:28.334964  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:28.332333 12443 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:28.336119  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:28.336377 12443 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:28.338958 12443 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:28.332507 12407 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:28.342818 12444 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.344936 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:28.322157  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:28.324859  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 170227us
I20260709 13:03:28.326489  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:28.346175  9449 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:03:28.327664  9341 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:28.332569 12538 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:28.350621 12538 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:28.353214 12552 raft_consensus.cc:2804] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:28.353660 12552 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:28.354009 12552 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:28.354369 12407 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:28.358526  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:28.359264  9452 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:28.368280  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:28.336745 12531 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:28.315656 12204 raft_consensus.cc:2804] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:28.371474  9444 raft_consensus.cc:2393] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 5: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
W20260709 13:03:28.333232 12573 log.cc:927] Time spent T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 13:03:28.328550 12622 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.342248 12610 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.369714 12611 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:28.390488 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 241964us
I20260709 13:03:28.315086 12560 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:03:28.400506  9525 raft_consensus.cc:1275] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:03:28.373972 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:28.315203 12516 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:28.324429 12344 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:28.378984 12612 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:28.427150 10027 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:28.432286 12568 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.399801 12609 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:28.386822 12549 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:28.389390 12204 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:28.346324 12570 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:28.396847 12605 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:28.333890 12617 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:28.439158  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 68109.2us
I20260709 13:03:28.455798  9490 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:28.456795  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:28.419504 12611 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:28.461691  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:28.476809  9524 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:28.466037  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:28.478204  9519 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:03:28.466738  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:28.467463 12483 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.467615  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:28.468266  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:28.471305 12372 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:28.394903 12531 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:28.473609 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:28.474527  9525 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:03:28.475111 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 300346us
I20260709 13:03:28.464013  9523 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:03:28.483620  9523 pending_rounds.cc:85] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 4
I20260709 13:03:28.483913  9523 pending_rounds.cc:107] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:03:28.484126  9523 raft_consensus.cc:2889] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:28.440361 12204 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:28.486954  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.438424 12568 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:28.484534 10025 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:28.400759 12622 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:28.488982 12545 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:28.502789  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:28.503453  9524 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:28.502882 12545 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:28.504444  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:28.504688 12633 log.cc:927] Time spent T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:03:28.503683 12613 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.506368 12545 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:28.508407 12617 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.509181 12444 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:28.509774  9520 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
W20260709 13:03:28.517323  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.483461 12495 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.584357 12495 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:28.520778 12635 raft_consensus.cc:2804] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:28.495394 12631 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:28.501665 12420 raft_consensus.cc:2804] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:28.486723 12611 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:28.444774 12609 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:28.590513  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 91643.6us
I20260709 13:03:28.602944 12451 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:28.590962 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 106493us
I20260709 13:03:28.447072 12549 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:28.600423  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 144695us
I20260709 13:03:28.600618 12638 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:03:28.601598 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 174504us
I20260709 13:03:28.602736 12486 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.492395 12612 raft_consensus.cc:697] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:28.494927 12626 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:03:28.636086 10027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.480962 12605 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:28.625099  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:28.637241  9524 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:28.638249  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:28.638864  9524 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:28.639638  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:28.640221  9524 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:28.627085  9490 leader_election.cc:400] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 9. Current term is 10.
I20260709 13:03:28.597510 12617 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.633419  9418 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:28.641486  9490 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:28.615196 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:28.617293 12635 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:28.648833  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 159809us
I20260709 13:03:28.627936 12568 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:28.652374  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:28.669415  9524 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:28.670683  9524 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:03:28.654242 12549 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:28.657425 12612 consensus_queue.cc:237] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:28.661389 12531 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:28.649283 12617 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:28.661857  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:28.685690  9525 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:03:28.662849  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:28.664436 12438 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.643553 12634 consensus_queue.cc:1048] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:03:28.665995 12570 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:28.667963  9520 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:03:28.649299 12545 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:28.678978  9418 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:28.651767 12620 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.621579 12420 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:28.696636  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 197247us
I20260709 13:03:28.697587  9517 raft_consensus.cc:2393] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 11: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:28.649796 12635 raft_consensus.cc:3060] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:28.639686 12486 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:28.628132 12631 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:28.681056 12549 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:28.721676 12617 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.729720 12344 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.730404 12486 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.673785 12444 consensus_queue.cc:1059] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:03:28.708707  9341 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:28.703073 12420 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:28.694926 12516 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.651535 12621 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
I20260709 13:03:28.649958 12626 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:28.737725  9341 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:28.705055  9418 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:28.715916 12620 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:28.749461  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:28.749279  9418 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:28.750306  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:28.750550 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 70941.4us
W20260709 13:03:28.742878  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 101463us
I20260709 13:03:28.751238  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:28.751665  9490 leader_election.cc:400] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 9.
I20260709 13:03:28.750916  9445 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:28.752400  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:28.752559  9490 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:28.756376  9418 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:28.757318  9418 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:28.757536  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:28.758467  9449 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:28.755200  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:28.762467  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:28.839751 12402 consensus_meta.cc:287] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.506s	user 0.002s	sys 0.006s
I20260709 13:03:28.884646  9341 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:28.885840  9450 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:28.898610  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:28.798707 12552 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:28.899359  9450 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:28.887348 12631 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.796041 12438 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:28.902144 12438 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.897135  9448 raft_consensus.cc:1275] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:03:28.904673  9341 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:28.762595 12516 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.143s
I20260709 13:03:28.905508 12552 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:28.906253 12624 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:28.897192 12482 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:03:28.868351  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 115839us
I20260709 13:03:28.782794 12614 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:28.910787 12614 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:28.911340 12614 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:28.921547  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 575111us
I20260709 13:03:28.921547 12614 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:28.924198 12614 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.908812 12482 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.927211 12482 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:28.762679 12344 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:28.928440 12344 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.928836 12344 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:28.894057 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:28.904343 12635 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:28.789168  9449 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 8.
I20260709 13:03:28.754690 12095 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:28.745257 12486 raft_consensus.cc:3055] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:28.880205  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:28.782323  9418 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:28.909714  9490 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:28.955251  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 45640.2us
I20260709 13:03:28.842623 12529 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.907044  9341 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:28.909150 12438 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:28.961158 12443 raft_consensus.cc:993] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:03:28.961670 12443 raft_consensus.cc:1081] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:03:28.907009 12448 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.962662 12448 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:28.953639 12486 raft_consensus.cc:740] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:03:28.963860  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 56895.1us
I20260709 13:03:28.963986 12486 consensus_queue.cc:260] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:28.965153 12486 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:28.966584  9448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 1344) took 1193 ms. Trace:
I20260709 13:03:28.948173 10025 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:28.966939  9448 rpcz_store.cc:276] 0709 13:03:27.773721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.776136 (+  2415us) service_pool.cc:224] Handling call
0709 13:03:27.776422 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.902637 (+1126215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.966354 (+ 63717us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400221354. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:28.966527 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2576403840}
I20260709 13:03:28.968005 12481 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:28.968510 12481 raft_consensus.cc:697] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 8 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:28.969367 12481 consensus_queue.cc:237] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:28.965912 12344 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:28.846184 12626 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:28.956103  9490 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:28.996878 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:28.998034  9490 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:28.906706 12624 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.015362  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:28.835035 12406 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.761943 12549 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:03:28.958317  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 176098us
W20260709 13:03:29.020799  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 61922.8us
I20260709 13:03:29.020989  9418 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:29.021539  9343 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:29.021864  9418 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:28.761754 12372 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:28.754288 12620 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:28.771879 12613 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:28.960050 12466 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.962069  9451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:03:28.974336  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:29.048648  9451 raft_consensus.cc:606] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:29.049554  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:28.976372  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:28.977357 12554 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.990665 12614 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:28.978366 12344 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:28.979537 12204 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:28.981547 12611 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:28.982805 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:29.095049  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:28.908701 12622 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:29.098414  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:28.992218  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:28.952113 12095 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.993360  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:29.099691 12095 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:29.100049  9370 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:28.979552 12348 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:29.070360 12613 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:29.101312 12613 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:29.101037 12348 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:29.103240 12348 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:28.740175 12641 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:29.006669 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:29.104276 12641 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.104657 12641 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:28.762236 12444 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.197s
I20260709 13:03:29.077888 12533 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:29.105448 12533 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:29.009047 12639 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.105921 12533 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:29.106359 12639 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:29.108467 12639 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:29.011430 12635 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:28.952422 12609 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:29.034509  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:29.027135 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:28.999583  9490 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:29.050138  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:03:29.110284  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 110803us
I20260709 13:03:29.110407 12550 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:29.110570  9375 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:29.110868 12550 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:29.111340 12550 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:29.112089  9490 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:28.959460 12571 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:29.113317 12570 consensus_queue.cc:1059] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:29.113638 12571 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:29.114140 12571 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:29.114322 12570 raft_consensus.cc:3055] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:29.114552 12571 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:29.114743 12570 raft_consensus.cc:740] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:03:29.062443  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.115644 12570 consensus_queue.cc:260] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:28.977830 12619 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:29.074349 12614 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.117061 12619 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.117249 12614 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:29.116765 12570 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:29.117568 12619 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:29.071621  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:29.048287 12420 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:29.118997  9377 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:29.074878  9418 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:29.120852 12420 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:29.121191  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 46417us
I20260709 13:03:29.121659 12344 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:29.122133 12344 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.121203 12372 raft_consensus.cc:2955] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 4 to 7, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:29.016969 12451 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.123282 12451 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:29.124035  9373 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:29.125296 12451 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:29.018987 12443 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.098251 12622 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:29.126075 12443 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:29.126222 12622 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:29.128114 12443 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:29.071538 12632 consensus_queue.cc:1059] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:03:29.048620 12620 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:29.129580 12632 raft_consensus.cc:3055] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:29.129961 12632 raft_consensus.cc:740] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:29.131115 10069 raft_consensus.cc:2393] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 8: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:03:29.130757 12632 consensus_queue.cc:260] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:29.131953 12204 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:29.041652 12549 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:29.085505 12516 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:03:29.133220 12549 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:29.023151 12624 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:29.016445  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:29.033126 12618 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:29.075196  9449 raft_consensus.cc:1240] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:29.156208  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:29.157541  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:29.137580 10026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.991394 12545 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:29.078763 12554 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:29.164687 12095 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:29.166915 12095 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:29.167092 12554 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:29.167734 12552 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:29.168258 12552 raft_consensus.cc:697] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:29.138216  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:29.169497  9520 raft_consensus.cc:2393] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 in current term 10: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:29.139740  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:29.169363 12552 consensus_queue.cc:237] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:29.140561  9375 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:29.170281  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:29.171380  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:29.154845  9490 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:29.172080  9521 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:29.087707 12612 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:29.172797 12644 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:29.122551 12344 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:29.173348 12644 raft_consensus.cc:697] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:29.148692 12533 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:29.174221 12644 consensus_queue.cc:237] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:29.175350 12533 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:29.175160 12550 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:29.122455 12406 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:29.145102  9451 raft_consensus.cc:1240] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:29.095458 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:29.152856  9523 raft_consensus.cc:1275] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:03:29.153513  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:29.143263  9525 raft_consensus.cc:2955] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 4 to 7, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:29.177493  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:29.177549  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:29.154273  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:29.181386  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 68485.4us
I20260709 13:03:29.182103  9490 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:29.132007 12632 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:29.154646 12620 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:29.191324 12620 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:29.191767 12438 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:29.077804 12466 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:29.193154 12568 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:29.193624  9371 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:29.193679 12568 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:29.020663 12510 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:29.171770 12618 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:29.195071 12510 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:29.195528 12510 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:29.173074  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:29.142370  9444 raft_consensus.cc:1275] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:29.172096  9449 raft_consensus.cc:1240] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:29.128746 12622 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:29.170223  9377 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:29.179859  9523 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:03:29.181022  9517 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:03:29.152436 12613 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:29.207042 12618 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:29.298147  9371 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
W20260709 13:03:29.323493  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.271957  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:29.241663  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:29.303207  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 281701us
I20260709 13:03:29.208811  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:29.282897  9447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51016 (request call id 1354) took 1301 ms. Trace:
W20260709 13:03:29.324826  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 319129us
I20260709 13:03:29.328143  9343 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:29.324129  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:29.330188  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:29.257758  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 75716.4us
I20260709 13:03:29.207659  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:29.328346  9447 rpcz_store.cc:276] 0709 13:03:27.981591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.981722 (+   131us) service_pool.cc:224] Handling call
0709 13:03:29.282604 (+1300882us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b540012c354. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:29.282754 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":798438272}
I20260709 13:03:29.333477  9521 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:29.336529  9375 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:03:29.323544 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 139738us
I20260709 13:03:29.338332  9343 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:29.339527  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:29.340305  9517 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:29.341792  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:29.330401  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:29.346787  9451 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:29.347798  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:29.349151  9444 raft_consensus.cc:2393] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 11: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:29.348680  9451 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:29.351676  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:29.356009  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:29.356818  9447 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:29.357779  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:29.358695  9444 raft_consensus.cc:2393] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 10: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:29.363699  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:29.364794  9517 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:29.367473  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:29.368562  9517 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:03:29.369887  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:29.371503  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:29.371618  9377 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:29.372157  9525 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:29.194701 12466 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:29.376469  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:29.286002 12550 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:29.220811 12554 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:29.376469  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:29.386868  9517 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:29.386976  9377 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:03:29.390250  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:29.391500  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:29.335642 12568 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:29.346796 12618 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:29.414256  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:29.420699  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 89118us
I20260709 13:03:29.246830 12571 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:29.421459  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:29.421669  9490 leader_election.cc:400] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8.
I20260709 13:03:29.428611  9490 leader_election.cc:403] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:03:29.421600  9521 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 8.
I20260709 13:03:29.431746  9521 raft_consensus.cc:1240] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:29.434249  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:29.435413  9490 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:29.325281 12624 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:29.440685  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:29.415695 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:29.412019 12372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:34492 (request call id 1) took 1503 ms. Trace:
I20260709 13:03:29.447212  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:29.448614  9375 raft_consensus.cc:1275] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:03:29.449977  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:29.478789  9525 raft_consensus.cc:1813] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Handling vote request from an unknown peer d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:29.476549  9517 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:03:29.485558  9525 raft_consensus.cc:2368] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 10.
I20260709 13:03:29.412601 12510 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:29.494522  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:29.419644 12482 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:29.499049  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:29.507447  9375 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:29.504719  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:29.508882  9370 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:29.479274 12664 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:29.461462 12451 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:29.440086 12662 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8.
I20260709 13:03:29.445346 12568 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:03:29.462883 12438 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:29.519177  9341 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:29.526727  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:29.492105 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:29.533913  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:29.516919 12451 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:29.523370 12486 consensus_meta.cc:287] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.558s	user 0.006s	sys 0.006s
W20260709 13:03:29.558347  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 117529us
I20260709 13:03:29.560122  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:29.565670  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:29.567011  9443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 1349) took 1690 ms. Trace:
I20260709 13:03:29.567114  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:29.576638 10026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.579596  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:29.584368  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:29.532548 12619 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:29.570173 12643 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.642115  9342 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:29.684518  9447 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
W20260709 13:03:29.885878  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 366729us
I20260709 13:03:29.886656  9341 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:29.886479  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:03:29.821792  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.888176  9374 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
W20260709 13:03:29.671558 12570 consensus_meta.cc:287] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.000s
I20260709 13:03:29.896194  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:29.898847  9343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.010s	sys 0.009s
W20260709 13:03:29.898532 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 347483us
I20260709 13:03:29.888933  9369 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
W20260709 13:03:29.886868 12552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.026s	sys 0.083s
I20260709 13:03:29.889104  9443 rpcz_store.cc:276] 0709 13:03:27.876389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.876508 (+   119us) service_pool.cc:224] Handling call
0709 13:03:27.878088 (+  1580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:27.892683 (+ 14595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.566671 (+1673988us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b5400019ad4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:29.566925 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14520704}
W20260709 13:03:29.902858 12552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.026s	sys 0.083s
I20260709 13:03:29.903810  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:29.898634  9418 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.013s	sys 0.005s
I20260709 13:03:29.892409  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:29.905573  9418 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.013s	sys 0.005s
W20260709 13:03:29.889463  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 247467us
I20260709 13:03:29.887125  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:29.906181  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 546969us
I20260709 13:03:29.887910  9377 raft_consensus.cc:2393] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 11: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:29.481685 12563 raft_consensus.cc:2955] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 5 to 7, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:29.905530  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:29.907253  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:29.463290 12372 rpcz_store.cc:276] 0709 13:03:27.890807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.893077 (+  2270us) service_pool.cc:224] Handling call
0709 13:03:27.988169 (+ 95092us) log.cc:844] Serialized 480 byte log entry
0709 13:03:29.391370 (+1403201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16434,"raft.queue_time_us":44942,"raft.run_cpu_time_us":1024,"raft.run_wall_time_us":1023,"thread_start_us":322492,"threads_started":1,"wal-append.queue_time_us":416057}
W20260709 13:03:29.902144  9343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.010s	sys 0.009s
W20260709 13:03:29.917243  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 578927us
I20260709 13:03:29.913117  9520 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:29.919253  9343 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:29.888756  9375 raft_consensus.cc:2393] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 10: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:29.920827  9343 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:29.921419  9372 raft_consensus.cc:1275] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:03:29.910061  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:29.914059  9418 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:29.924660  9343 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:29.844363 12613 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:29.928659  9368 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:03:29.891734 12451 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:29.934219  9418 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:29.891598 12618 raft_consensus.cc:2804] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:29.899329 12631 raft_consensus.cc:2804] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:29.943672 12486 consensus_queue.cc:1048] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:03:29.950233 12631 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.950644 12631 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:29.940474  9343 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:29.945863  9261 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 45a4f94c156249adab9c2b1ffb00ac46 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 2)
I20260709 13:03:29.954005  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:03:29.957701 12654 log.cc:927] Time spent T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.346s	user 0.000s	sys 0.001s
I20260709 13:03:29.944088 12406 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:29.973966  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:29.974632  9519 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:29.974876 12510 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:29.975363  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.978962  9443 raft_consensus.cc:1275] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:03:29.891487 12443 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:29.981864 12482 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:29.934394 12622 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:29.983119  9446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 2205) took 1662 ms. Trace:
I20260709 13:03:29.984709 10064 raft_consensus.cc:1240] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 9. Current term is 10. Ops: []
W20260709 13:03:29.988613 12614 consensus_meta.cc:287] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.871s	user 0.011s	sys 0.004s
W20260709 13:03:29.990399  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.983951  9446 rpcz_store.cc:276] 0709 13:03:28.320514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.326610 (+  6096us) service_pool.cc:224] Handling call
0709 13:03:28.677624 (+351014us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.677975 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.678001 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:28.678038 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:28.678065 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.678119 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:29.982876 (+1304757us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b540012c850. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865698ad 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:29.983035 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":806367488}
I20260709 13:03:29.887969 12624 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:29.947086 10068 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45690 (request call id 138) took 1630 ms (client timeout 2082 ms). Trace:
I20260709 13:03:29.947438 10066 raft_consensus.cc:1240] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:29.939548 12438 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:29.997570  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:03:29.948266 12663 log.cc:927] Time spent T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.392s	user 0.001s	sys 0.000s
I20260709 13:03:29.929265 12639 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:03:29.948953 12659 log.cc:927] Time spent T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.385s	user 0.001s	sys 0.000s
I20260709 13:03:30.001552  9519 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:29.949536 12618 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:29.949928 12670 log.cc:927] Time spent T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:03:29.983327 12622 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.993037  9448 raft_consensus.cc:1240] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:29.941349  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:29.998502  9443 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:30.000192  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:30.012545  9452 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:30.014430  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 73145.9us
I20260709 13:03:29.929597 12466 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:03:30.004252  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 63968us
I20260709 13:03:30.005210  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:29.630926 12641 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.002668  9446 raft_consensus.cc:1240] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:30.015833  9418 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:30.004362 12549 consensus_meta.cc:287] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.871s	user 0.002s	sys 0.013s
I20260709 13:03:29.972251 12631 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.029490  9519 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:30.031315  9341 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:30.037129  9452 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:30.040431  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:29.997841 12438 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:29.893505 12643 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.002961 12639 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:30.008761 12618 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:30.087018  9519 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:30.088526  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:03:30.024047 12550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.015s	sys 0.005s
W20260709 13:03:29.991796 10068 rpcz_store.cc:269] 0709 13:03:28.312871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.315422 (+  2551us) service_pool.cc:224] Handling call
0709 13:03:29.468106 (+1152684us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b5800224798. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b5300a0 00007fb58b52f984 00007fb584aaa6d4 00007fb584aaa662
0709 13:03:29.943480 (+475374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6145792}
I20260709 13:03:30.095669  9372 raft_consensus.cc:1240] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:30.096899  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:30.097193  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:30.046134 12549 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:30.097716 12675 log.cc:927] Time spent T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:03:30.098003  9372 raft_consensus.cc:2393] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
W20260709 13:03:30.098745 12666 log.cc:927] Time spent T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:03:30.098901  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:30.099565 12549 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:30.101300 12482 consensus_queue.cc:1059] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:30.101889  9370 raft_consensus.cc:1240] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:03:30.009888 12443 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:30.102969 12369 raft_consensus.cc:3055] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:30.103292 12443 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:30.104065 12443 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:30.104452 12612 consensus_meta.cc:287] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.932s	user 0.006s	sys 0.005s
I20260709 13:03:30.104851 12612 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:30.105576  9373 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:03:30.065594 12438 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:30.106984 12631 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:30.013466 12622 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:30.043977 12632 consensus_queue.cc:1059] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:03:30.055339 12533 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:30.109349 12533 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:30.109754 12533 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:30.110136  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.001663 12372 consensus_queue.cc:1048] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:03:29.999526 12614 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.112325 12555 consensus_queue.cc:1048] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:30.090871  9376 raft_consensus.cc:2393] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 6: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:30.113462 12614 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:30.092281  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:30.099699  9372 raft_consensus.cc:2410] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:03:30.103402 12369 raft_consensus.cc:740] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:30.114416  9377 raft_consensus.cc:2393] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 10: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:30.115468  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:30.115154 12369 consensus_queue.cc:260] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:30.116001  9368 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:30.032965 12613 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:30.018379 12466 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:30.093946  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 207566us
I20260709 13:03:29.964876 12451 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.108935 12632 raft_consensus.cc:3055] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:30.137341 12632 raft_consensus.cc:740] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:30.138465 12632 consensus_queue.cc:260] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:30.140202 12344 consensus_meta.cc:287] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.966s	user 0.009s	sys 0.000s
I20260709 13:03:30.062985 12669 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:30.130285 12571 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:30.146520 12643 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:30.146152  9525 raft_consensus.cc:2955] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 5 to 7, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:30.119048  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:30.121874  9490 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:30.148322  9372 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:30.125736  9443 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:30.154310 12549 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:30.155002 12549 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:30.155536 12549 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:30.157800 12555 consensus_queue.cc:1059] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:30.123628  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:30.160768  9376 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:03:30.162412 12605 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:30.166060 12495 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:30.129990  9374 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:30.086077 12639 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:30.134044 12619 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:30.135578 12451 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:30.120882 12613 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:30.094327 12550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.016s	sys 0.005s
I20260709 13:03:30.197196 12613 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:30.177085 12669 raft_consensus.cc:697] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:30.200067 12669 consensus_queue.cc:237] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.129632 12466 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:30.214799 12438 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.094982 12568 consensus_queue.cc:1059] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.117s
I20260709 13:03:30.140839 12344 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.238950 12618 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.309159 12641 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:30.310750 12618 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:30.300163 12613 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.332584 12622 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.343020 12639 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.346283 12639 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:30.421877  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 405886us
I20260709 13:03:30.423391  9369 raft_consensus.cc:1240] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:30.424058  9418 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:30.424712  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:30.426374  9418 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:30.427134  9377 raft_consensus.cc:1240] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:30.427835  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:30.428954  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:30.430190  9418 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:30.432367  9418 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:30.430769  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:30.426309  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:30.435237  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:30.436635  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:30.414662  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:30.461171 12528 raft_consensus.cc:2804] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:30.462157 12528 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.462884 12528 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:30.466658  9368 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
W20260709 13:03:30.469780 12554 consensus_meta.cc:287] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 1.075s	user 0.016s	sys 0.004s
I20260709 13:03:30.470139 12622 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:30.470722 12554 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:30.471843 10026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:30.472194 10027 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.027s	sys 0.054s
W20260709 13:03:30.472687 10027 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.027s	sys 0.054s
W20260709 13:03:30.475374  9371 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52548 (request call id 1503) took 1483 ms (client timeout 1850 ms). Trace:
I20260709 13:03:30.476984 12563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:34492 (request call id 0) took 2765 ms. Trace:
I20260709 13:03:30.477815 12563 rpcz_store.cc:276] 0709 13:03:27.711571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.717503 (+  5932us) service_pool.cc:224] Handling call
0709 13:03:27.768758 (+ 51255us) log.cc:844] Serialized 480 byte log entry
0709 13:03:28.041791 (+273033us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:30.476622 (+2434831us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14615,"raft.run_cpu_time_us":2129,"raft.run_wall_time_us":167116,"spinlock_wait_cycles":24228224,"thread_start_us":45814,"threads_started":1,"wal-append.queue_time_us":108383,"wal-append.run_cpu_time_us":4293,"wal-append.run_wall_time_us":1457606}
I20260709 13:03:30.468751  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:30.481268  9368 raft_consensus.cc:2376] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11. Re-sending same reply.
I20260709 13:03:30.315658 12533 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:30.486855  9526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.004s	sys 0.013s
W20260709 13:03:30.487490  9526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.004s	sys 0.013s
I20260709 13:03:30.481206 12486 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:30.476037  9371 rpcz_store.cc:269] 0709 13:03:28.991600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.992867 (+  1267us) service_pool.cc:224] Handling call
0709 13:03:30.474834 (+1481967us) spinlock_profiling.cc:243] Waited 84.1 ms on lock 0x7b54000604d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:30.475090 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193533696}
I20260709 13:03:30.489303 12614 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:30.488955  9526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1537) took 1337 ms. Trace:
I20260709 13:03:30.494580  9518 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:30.495833 12344 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:30.502197  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:30.502964 12614 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:30.503537 12614 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:30.504002 12614 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:30.503767  9261 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 807906edc34d41589d9b860b72f70e16 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:30.505877 12555 consensus_queue.cc:1243] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [LEADER]: Peer d62c9d5a052b42ce8675f8438f846526 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:30.507045 12555 raft_consensus.cc:3055] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:30.507599 12555 raft_consensus.cc:740] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:30.508944 12568 raft_consensus.cc:3055] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:30.509150 12495 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.509768 12568 raft_consensus.cc:740] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:30.510324 12495 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:30.513283  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.512084 12568 consensus_queue.cc:260] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.515964 12533 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:30.517056 12533 raft_consensus.cc:2764] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:03:30.518054 12533 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.518901 12568 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:30.493046  9526 rpcz_store.cc:276] 0709 13:03:29.151062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.284017 (+132955us) service_pool.cc:224] Handling call
0709 13:03:29.284426 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:29.284710 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:29.349032 (+ 64322us) log.cc:844] Serialized 14 byte log entry
0709 13:03:30.488093 (+1139061us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:30.488239 (+   146us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:30.488360 (+   121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.488505 (+   145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.488834 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":108375,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":581996,"spinlock_wait_cycles":47070976,"thread_start_us":982859,"threads_started":3,"wal-append.queue_time_us":212307}
I20260709 13:03:30.560072  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:30.560906 12448 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:30.561734  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:30.564456 12495 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:30.556445 12555 consensus_queue.cc:260] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:30.560870 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 58012.6us
W20260709 13:03:30.519968  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 432146us
W20260709 13:03:30.522334  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.571125 12510 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:30.570307 12533 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.571473 12672 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:30.571945 12510 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:30.525031  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.489519 12613 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:30.526713  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 60789.6us
I20260709 13:03:30.577378 12531 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:30.577773 12095 consensus_queue.cc:1059] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:30.578378 12531 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:30.579077 12095 consensus_queue.cc:1059] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:30.580122  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:30.580821 12451 raft_consensus.cc:3055] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:30.581323 12451 raft_consensus.cc:740] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:30.583240 12622 raft_consensus.cc:3055] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:30.582988 12451 consensus_queue.cc:260] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.583706 12622 raft_consensus.cc:740] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:30.585263  9445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 2223) took 1836 ms. Trace:
I20260709 13:03:30.585719  9341 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:30.585186 12622 consensus_queue.cc:260] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.585925  9445 rpcz_store.cc:276] 0709 13:03:28.748768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.752923 (+  4155us) service_pool.cc:224] Handling call
0709 13:03:29.288515 (+535592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:29.288763 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:29.288808 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:29.288868 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:29.288919 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.289040 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.584827 (+1295787us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b540012c350. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865698ad 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:30.585077 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1230930176}
I20260709 13:03:30.586897 12622 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:30.587177 12639 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:30.587826 12639 raft_consensus.cc:697] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:30.525723 12552 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.572541 12672 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.589466 12639 consensus_queue.cc:237] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.590493  9368 raft_consensus.cc:1240] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:30.592525 12672 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:30.535756 12632 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:30.537390  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:30.564303 12538 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:30.589498 12552 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.593930  9341 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:30.527976 12486 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:30.597990 10068 raft_consensus.cc:1240] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 8 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:30.530951  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:30.593263  9368 raft_consensus.cc:3055] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:30.615104  9368 raft_consensus.cc:740] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:30.621803  9377 raft_consensus.cc:1240] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:30.635794  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:30.596683 12438 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:30.636847  9377 raft_consensus.cc:2376] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11. Re-sending same reply.
I20260709 13:03:30.638229  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:30.639883  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:03:30.642169 10069 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45690 (request call id 140) took 2307 ms (client timeout 1538 ms). Trace:
W20260709 13:03:30.642701 10069 rpcz_store.cc:269] 0709 13:03:28.334051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.344649 (+ 10598us) service_pool.cc:224] Handling call
0709 13:03:30.641564 (+2296915us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b540017d254. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:30.641849 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1805981440}
I20260709 13:03:30.645478 12555 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:30.645929 12533 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:30.648350 10067 raft_consensus.cc:1240] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:30.649379  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:30.584940 12451 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:30.659452 12549 consensus_meta.cc:287] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.503s	user 0.019s	sys 0.007s
I20260709 13:03:30.660037 12549 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.661733  9518 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:30.664287 12510 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:30.645768  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:03:30.668893  9372 consensus_meta.cc:287] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.006s
I20260709 13:03:30.669054  9368 consensus_queue.cc:260] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:30.697695  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.669539 12531 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:03:30.703598  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 271541us
I20260709 13:03:30.693131  9372 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:30.725646  9371 raft_consensus.cc:2393] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:30.731014  9450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 2229) took 1882 ms. Trace:
I20260709 13:03:30.731657  9450 rpcz_store.cc:276] 0709 13:03:28.848449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.907909 (+ 59460us) service_pool.cc:224] Handling call
0709 13:03:28.908194 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.910183 (+  1989us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:28.917706 (+  7523us) log.cc:844] Serialized 14 byte log entry
0709 13:03:30.534811 (+1617105us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b1800353b60. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58345fe07 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b 00007fb586109d23 00007fb58610a23a 00007fb586574a2a
0709 13:03:30.730224 (+195413us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:30.730340 (+   116us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:30.730492 (+   152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.730639 (+   147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.730819 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":170,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"spinlock_wait_cycles":3697920,"thread_start_us":164886,"threads_started":1}
I20260709 13:03:30.733219 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:30.734608 12446 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:30.735864  9368 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:30.725191  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:30.743166  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:30.741148  9492 connection.cc:256] RPC call timeout handler was delayed by -1.0715978029999178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.34340000000000004s for a response
I20260709 13:03:30.745994 10027 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:30.756471 12549 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:30.765884  9517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1554) took 1321 ms. Trace:
I20260709 13:03:30.766835 10067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 342) took 2332 ms. Trace:
I20260709 13:03:30.767243 10067 rpcz_store.cc:276] 0709 13:03:28.434312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.473106 (+ 38794us) service_pool.cc:224] Handling call
0709 13:03:30.647919 (+2174813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.648836 (+   917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.766589 (+117753us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b540017d250. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865698ad 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:30.766762 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5000479616}
W20260709 13:03:30.770233  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 176475us
I20260709 13:03:30.773527 12689 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:30.774418 12689 raft_consensus.cc:697] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:30.780123  9492 leader_election.cc:336] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.517s (SENT)
I20260709 13:03:30.782562 12486 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:30.787601 12446 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:30.786289  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.790946  9518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46902 (request call id 1551) took 1412 ms. Trace:
I20260709 13:03:30.766379  9517 rpcz_store.cc:276] 0709 13:03:29.444424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.497769 (+ 53345us) service_pool.cc:224] Handling call
0709 13:03:29.521059 (+ 23290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:29.916709 (+395650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:29.916740 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:30.085975 (+169235us) log.cc:844] Serialized 26 byte log entry
0709 13:03:30.485785 (+399810us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:30.485925 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.486109 (+   184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:30.765469 (+279360us) raft_consensus.cc:1685] finished
0709 13:03:30.765492 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.765677 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":378421,"raft.queue_time_us":572471,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":3737,"thread_start_us":794383,"threads_started":2,"wal-append.queue_time_us":671332}
I20260709 13:03:30.807282  9377 raft_consensus.cc:2393] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 10: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:30.811707  9518 rpcz_store.cc:276] 0709 13:03:29.378993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.420013 (+ 41020us) service_pool.cc:224] Handling call
0709 13:03:30.790612 (+1370599us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003142d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:30.790818 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2424377600}
W20260709 13:03:30.815899 12466 consensus_meta.cc:287] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.013s
I20260709 13:03:30.816413  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:30.818351 12552 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:30.819414 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 116750us
I20260709 13:03:30.821569 12590 raft_consensus.cc:2804] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:03:30.821775  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.822185 12590 raft_consensus.cc:697] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 8 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
W20260709 13:03:30.823738  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.813062  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:30.828603  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 108286us
I20260709 13:03:30.837584  9371 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:30.838750 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:30.776018 12689 consensus_queue.cc:237] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.844260  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:30.843866  9369 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:03:30.816637 12466 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.827977 12446 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:30.893329 10026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.899667 10067 raft_consensus.cc:2393] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 7: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:03:30.905213  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:30.907006  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 318783us
I20260709 13:03:30.909587 12369 raft_consensus.cc:3060] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:30.911648 12549 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.911988 12638 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:30.912381 12549 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.911630 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:30.915841 12549 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:30.919467  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 139400us
W20260709 13:03:30.909492  9525 consensus_meta.cc:287] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.761s	user 0.016s	sys 0.004s
I20260709 13:03:30.930805  9368 raft_consensus.cc:1275] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:03:30.940029 12443 consensus_meta.cc:287] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.735s	user 0.018s	sys 0.004s
I20260709 13:03:30.940966  9374 raft_consensus.cc:2393] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 10: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
W20260709 13:03:30.949307  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 47444us
W20260709 13:03:30.960235  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 90583.1us
I20260709 13:03:30.924623 12552 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:30.913236 12638 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:30.972757  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:30.960482 12686 consensus_queue.cc:1059] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
W20260709 13:03:31.012965  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.976608 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:31.058914  9376 raft_consensus.cc:1240] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:31.059427 12617 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:31.060034 12617 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.060474 12617 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:31.064520  9418 leader_election.cc:400] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 10.
I20260709 13:03:31.064982  9418 leader_election.cc:403] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:31.065785 12486 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 10
W20260709 13:03:31.066584 12516 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.012s	sys 0.004s
W20260709 13:03:31.067130 12516 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.012s	sys 0.004s
I20260709 13:03:31.077857 12552 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:31.082170  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:31.083144  9368 raft_consensus.cc:2368] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 9. Current term is 10.
I20260709 13:03:31.082996  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:31.084118  9377 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:31.084079  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:31.084422  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:31.085410  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:31.085448  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:31.086966  9371 raft_consensus.cc:2393] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
W20260709 13:03:31.096355 12568 consensus_meta.cc:287] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.002s
I20260709 13:03:30.964222 12443 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:31.110014 12614 consensus_meta.cc:287] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.605s	user 0.014s	sys 0.001s
I20260709 13:03:31.113540  9375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 1358) took 1020 ms. Trace:
I20260709 13:03:30.823659 12590 consensus_queue.cc:237] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:30.972272 12528 consensus_meta.cc:287] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.004s
I20260709 13:03:31.117585 12486 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 10.
I20260709 13:03:31.066005  9418 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:31.138985  9373 raft_consensus.cc:1240] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:31.139154 12638 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:31.140584 12692 log.cc:927] Time spent T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.066s	user 0.002s	sys 0.000s
W20260709 13:03:31.143368  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.148422  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:03:31.159256  9492 leader_election.cc:336] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.541s (SENT)
I20260709 13:03:31.080832 12552 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:31.169430 12622 consensus_meta.cc:287] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.003s
I20260709 13:03:31.178679  9492 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:31.191603  9372 raft_consensus.cc:1275] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:03:31.192865  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.199189  9523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1557) took 1289 ms. Trace:
I20260709 13:03:31.158051  9375 rpcz_store.cc:276] 0709 13:03:30.092498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.095351 (+  2853us) service_pool.cc:224] Handling call
0709 13:03:30.096020 (+   669us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:30.478272 (+382252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:30.478358 (+    86us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:30.479796 (+  1438us) log.cc:844] Serialized 52 byte log entry
0709 13:03:30.699457 (+219661us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:30.711781 (+ 12324us) log.cc:844] Serialized 14 byte log entry
0709 13:03:30.817295 (+105514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.817449 (+   154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:31.113066 (+295617us) raft_consensus.cc:1685] finished
0709 13:03:31.113091 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:31.113303 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87800,"prepare.queue_time_us":6569,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":116927,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":200,"thread_start_us":599682,"threads_started":2,"wal-append.queue_time_us":447481}
W20260709 13:03:31.211555  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 145661us
I20260709 13:03:31.174234 12614 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:31.231734 12486 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:31.245690  9521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1548) took 1900 ms. Trace:
I20260709 13:03:31.246152 12486 raft_consensus.cc:697] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:31.247680 12486 consensus_queue.cc:237] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:31.250809 12614 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:31.171571 12528 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:31.235311 12555 consensus_meta.cc:287] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.581s	user 0.012s	sys 0.004s
I20260709 13:03:31.204356  9523 rpcz_store.cc:276] 0709 13:03:29.576178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.121188 (+545010us) service_pool.cc:224] Handling call
0709 13:03:30.121503 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:30.121823 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:30.121851 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:30.133685 (+ 11834us) log.cc:844] Serialized 26 byte log entry
0709 13:03:30.544130 (+410445us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b1800284080. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58345fe07 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b 00007fb586109d23 00007fb58610a0d1 00007fb586525a0f
0709 13:03:30.726546 (+182416us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:30.750330 (+ 23784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.832519 (+ 82189us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:30.832674 (+   155us) raft_consensus.cc:1685] finished
0709 13:03:30.832744 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.865231 (+ 32487us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":305283,"raft.queue_time_us":9053,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":17755,"spinlock_wait_cycles":87232256,"thread_start_us":126797,"threads_started":1,"wal-append.queue_time_us":614769}
W20260709 13:03:31.306845  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:31.308143  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.246181  9521 rpcz_store.cc:276] 0709 13:03:29.345367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.452129 (+106762us) service_pool.cc:224] Handling call
0709 13:03:29.462852 (+ 10723us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:30.153567 (+690715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:30.153612 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:30.484259 (+330647us) log.cc:844] Serialized 26 byte log entry
0709 13:03:30.715444 (+231185us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:30.724174 (+  8730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.970403 (+246229us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b54003200d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:30.970461 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:31.228843 (+258382us) raft_consensus.cc:1685] finished
0709 13:03:31.228871 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:31.245508 (+ 16637us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":316078,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":338,"spinlock_wait_cycles":1587156352,"thread_start_us":230348,"threads_started":1,"wal-append.queue_time_us":312541}
I20260709 13:03:31.318302  9418 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:31.352650  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.363394 12466 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:31.364471 12443 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:31.365331 12528 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:31.366031  9373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 1367) took 1230 ms. Trace:
W20260709 13:03:31.366170  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 64126.7us
I20260709 13:03:31.366395  9373 rpcz_store.cc:276] 0709 13:03:30.119280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.119420 (+   140us) service_pool.cc:224] Handling call
0709 13:03:30.136267 (+ 16847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:31.138601 (+1002334us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b540026d520. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5864e1dc0 00007fb58656c1c0 00007fb58656d231 00007fb586569d8f 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c
0709 13:03:31.185112 (+ 46511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:31.313600 (+128488us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b5400384d54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:31.350084 (+ 36484us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2155725952}
I20260709 13:03:31.366948  9418 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:31.380321  9415 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.010s	sys 0.019s
W20260709 13:03:31.386569  9415 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.011s	sys 0.019s
I20260709 13:03:31.392230 12669 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:31.382252 12693 log.cc:927] Time spent T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.191s	user 0.001s	sys 0.001s
W20260709 13:03:31.401103  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.395321  9452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45366 (request call id 476) took 1132 ms. Trace:
W20260709 13:03:31.394459 12632 consensus_meta.cc:287] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.748s	user 0.009s	sys 0.006s
W20260709 13:03:31.398859 12690 log.cc:927] Time spent T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:03:31.382858 12638 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:31.410130  9369 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:31.390424 12528 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:31.393224 12614 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:31.398810 12555 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:31.400089 12568 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.421444 12483 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:31.422181 12483 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:31.424657  9370 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:31.425232 12614 raft_consensus.cc:697] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:31.426029 12483 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:31.421690  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.393111 12669 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:31.402830  9452 rpcz_store.cc:276] 0709 13:03:30.122457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.123233 (+   776us) service_pool.cc:224] Handling call
0709 13:03:30.123570 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:30.177349 (+ 53779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:30.177393 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:30.481594 (+304201us) log.cc:844] Serialized 26 byte log entry
0709 13:03:30.961603 (+480009us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:30.967668 (+  6065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.978054 (+ 10386us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:31.254527 (+276473us) raft_consensus.cc:1685] finished
0709 13:03:31.254562 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:31.254765 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2045,"raft.queue_time_us":65432,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":158,"thread_start_us":416374,"threads_started":1,"wal-append.queue_time_us":769702}
I20260709 13:03:31.431835 12549 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:31.433501  9525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52502 (request call id 487) took 1322 ms. Trace:
I20260709 13:03:31.426465 12614 consensus_queue.cc:237] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:31.433900  9525 rpcz_store.cc:276] 0709 13:03:30.111191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.117370 (+  6179us) service_pool.cc:224] Handling call
0709 13:03:30.145706 (+ 28336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.146005 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:30.965474 (+819469us) log.cc:844] Serialized 14 byte log entry
0709 13:03:31.390954 (+425480us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:31.395597 (+  4643us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:31.413702 (+ 18105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:31.417107 (+  3405us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:31.433445 (+ 16338us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":200590,"raft.queue_time_us":202735,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":9020,"thread_start_us":124782,"threads_started":1,"wal-append.queue_time_us":261442}
I20260709 13:03:31.419150 12528 raft_consensus.cc:697] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:31.437881 12555 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:31.442122  9418 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:31.443924  9418 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:31.432528 12549 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:31.445986 12611 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:31.446306 12549 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:31.446393 12611 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:31.447024  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 475827us
I20260709 13:03:31.447857 12528 consensus_queue.cc:237] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:31.448132 12446 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:31.449340  9492 leader_election.cc:336] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 2.039s (SENT)
I20260709 13:03:31.449806  9492 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:31.451050 12609 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:03:31.452210 12707 log.cc:927] Time spent T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:03:31.454200 12669 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:31.455853  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.457652 12568 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:31.459981 12568 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:31.460667 12568 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:31.416922 12552 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:31.461025  9370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52562 (request call id 1372) took 1043 ms. Trace:
I20260709 13:03:31.461404  9370 rpcz_store.cc:276] 0709 13:03:30.417347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.430135 (+ 12788us) service_pool.cc:224] Handling call
0709 13:03:31.460698 (+1030563us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b5400186d54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:31.460950 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2219211136}
I20260709 13:03:31.461540 12552 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:31.464141 12700 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:31.464170  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1555) took 1965 ms. Trace:
I20260709 13:03:31.464972 12700 raft_consensus.cc:697] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:31.464908  9519 rpcz_store.cc:276] 0709 13:03:29.498714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.095351 (+596637us) service_pool.cc:224] Handling call
0709 13:03:30.100216 (+  4865us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:30.461152 (+360936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:30.461245 (+    93us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:30.462636 (+  1391us) log.cc:844] Serialized 26 byte log entry
0709 13:03:30.925639 (+463003us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:30.926031 (+   392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.950613 (+ 24582us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:31.463822 (+513209us) raft_consensus.cc:1685] finished
0709 13:03:31.463840 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:31.463995 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57046,"raft.queue_time_us":369505,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":148,"thread_start_us":461375,"threads_started":1,"wal-append.queue_time_us":707890}
I20260709 13:03:31.466104 12700 consensus_queue.cc:237] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:31.451754 12609 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:31.475442 12609 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:31.464072 12552 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:31.477728 12617 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:31.480396  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:31.446962 12611 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:31.486536  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:31.486562 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:31.487321  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:31.488251  9370 raft_consensus.cc:2468] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 7.
I20260709 13:03:31.489476  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:31.488433  9377 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 8.
I20260709 13:03:31.490624  9368 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 8.
I20260709 13:03:31.481213 12669 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.487130 12555 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:31.499418 10026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.497735 12669 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:31.510669 12446 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:31.544723  9492 leader_election.cc:336] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.538s (SENT)
I20260709 13:03:31.545493  9492 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:31.546386 12555 raft_consensus.cc:2749] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:03:31.548055  9492 leader_election.cc:336] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.630s (SENT)
W20260709 13:03:31.549351  9492 leader_election.cc:336] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 2.210s (SENT)
I20260709 13:03:31.550153 12669 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:31.578688 12617 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:31.584609 12555 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:31.606540  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:31.609316  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 165472us
I20260709 13:03:31.602020 12552 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:31.619441  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:31.623158 12638 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:31.624073 12638 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:31.628760 12638 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:31.632853 12672 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:31.633817 12672 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:31.638002 12672 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:31.639066 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:31.590634  9274 catalog_manager.cc:5697] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 5 to 6, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 6 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:31.605911 12549 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.649821  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:31.653249  9368 raft_consensus.cc:2468] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 7.
I20260709 13:03:31.659543  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:31.609587 12555 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:31.662474  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:31.663107  9370 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 10.
I20260709 13:03:31.664659  9519 raft_consensus.cc:2410] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:03:31.681912  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:31.656656 12614 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:31.652611 12552 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
W20260709 13:03:31.698086  9492 leader_election.cc:336] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 2.220s (SENT)
I20260709 13:03:31.699952 12718 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.678435 10066 raft_consensus.cc:1240] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 8 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:31.749393 12552 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:31.750255 12718 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:31.751668  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:31.678926 12549 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:31.752866 12718 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:31.753691 12669 consensus_queue.cc:1059] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:31.754603 12669 consensus_queue.cc:1243] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer b0812463215649c3b011d36e2f0400c9 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:31.755070 12549 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:31.755254  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:31.755925  9518 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:31.756551  9492 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:31.757174  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:31.712256 10027 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:31.712975 12634 consensus_queue.cc:1048] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:31.713212 12637 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:31.708547 12618 raft_consensus.cc:3055] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:31.714306 12555 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:31.715756 12611 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:31.732940  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:31.734973  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:31.734459  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:31.733796  9526 raft_consensus.cc:1240] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:31.734001  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:31.744206  9377 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 8.
W20260709 13:03:31.745569  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 45848.2us
I20260709 13:03:31.656471 12638 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:31.752945  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:31.787866  9519 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:31.772645 12618 raft_consensus.cc:740] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:31.788856  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:31.788976  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:31.789151 12618 consensus_queue.cc:260] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:31.790715 12618 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:31.790827  9519 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:31.791126  9524 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:31.791664  9526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46894
I20260709 13:03:31.792654  9526 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:31.786087  9520 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
W20260709 13:03:31.784247  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.795632 12552 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:03:31.797500  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 99457.6us
I20260709 13:03:31.797788  9518 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
W20260709 13:03:31.799739 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 87643.4us
I20260709 13:03:31.802194 12634 consensus_queue.cc:1048] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:31.803165 10027 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:31.804255 12640 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:31.804672 12640 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:31.805063 12640 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:31.808346 12611 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:31.809906 10027 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:31.799585  9492 leader_election.cc:336] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 2.473s (SENT)
I20260709 13:03:31.812250  9492 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:31.737287 12568 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.813321 12637 raft_consensus.cc:2804] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:31.813305 12568 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:31.813973 12637 raft_consensus.cc:697] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 7 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
W20260709 13:03:31.814265  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.815207 12637 consensus_queue.cc:237] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:31.815691 12568 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:31.793072  9526 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:31.839573  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:31.840361  9521 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:31.785563 12708 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:31.845432  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:31.846393  9518 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:31.853116  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:31.773144 12614 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:31.854111  9445 raft_consensus.cc:1240] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
W20260709 13:03:31.862627  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.860548  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:31.860647  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:03:31.866993  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.870440  9374 raft_consensus.cc:2393] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 11: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:31.844347 12672 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:31.829622 12638 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:31.878095  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:31.884367  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:31.879489  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:31.880290  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:31.882001  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:31.882416  9449 raft_consensus.cc:1240] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:31.883172  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:31.884367  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:31.874102  9526 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:31.886474  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:31.884445  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 84921.7us
I20260709 13:03:31.890763  9518 raft_consensus.cc:2410] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:03:31.878532  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:31.889329  9445 raft_consensus.cc:2393] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 7: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:31.893890  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:31.894604  9521 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:31.894857  9446 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:31.894629  9452 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:31.905267  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:31.906250  9377 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:31.910105 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 100269us
I20260709 13:03:31.917876  9447 raft_consensus.cc:2368] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9.
I20260709 13:03:31.920086  9526 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:31.924045  9524 raft_consensus.cc:1240] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:31.924809  9520 raft_consensus.cc:2393] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 11: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:31.935146  9443 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:31.942340  9446 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
W20260709 13:03:31.956645  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:31.977104  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.982067  9524 raft_consensus.cc:1240] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:31.985018  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:31.970323 12552 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.987257  9274 catalog_manager.cc:5697] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 5 to 6, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 6 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
W20260709 13:03:31.994350 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 83489.4us
I20260709 13:03:31.989142  9374 raft_consensus.cc:2376] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9. Re-sending same reply.
I20260709 13:03:31.988626 12614 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:32.011037  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:32.019735  9526 raft_consensus.cc:1240] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:32.039657  9524 raft_consensus.cc:1240] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:32.040933  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:32.046096  9525 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:32.059927  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:32.060828  9526 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:32.071776  9444 raft_consensus.cc:1240] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:32.017174 12552 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:32.081957  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:32.084798  9377 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:32.087103  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:32.089715  9520 raft_consensus.cc:1240] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:32.098351  9525 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:32.103138  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:32.100338  9274 catalog_manager.cc:5697] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:32.107211  9517 raft_consensus.cc:2393] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 12: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:32.107091  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:32.107941  9520 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:32.109390  9443 raft_consensus.cc:1275] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:32.114543  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:32.119342  9518 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:32.138715 12724 raft_consensus.cc:993] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:03:32.139400 12724 raft_consensus.cc:1081] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:03:32.139940 12638 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:32.142815  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:32.144069  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:32.144678  9520 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:32.145505 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 83769.6us
I20260709 13:03:32.145579  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:32.147641  9519 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:32.136165  9274 catalog_manager.cc:5697] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 3 to 5, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 5 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:32.139710 12733 log.cc:927] Time spent T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:03:32.158769  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:03:32.158833  9418 connection.cc:256] RPC call timeout handler was delayed by -2.4920708319999676s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18500000000000003s for a response
W20260709 13:03:32.160564  9418 connection.cc:256] RPC call timeout handler was delayed by -2.4754046839999546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
W20260709 13:03:32.160883  9418 connection.cc:256] RPC call timeout handler was delayed by -2.3926046839999344s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
I20260709 13:03:32.165282  9521 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:32.164856  9526 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:32.149943 12710 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.119019 12640 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:32.201316 12723 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:03:32.215932  9418 connection.cc:256] RPC call timeout handler was delayed by -2.2675046839999595s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
W20260709 13:03:32.220261  9418 connection.cc:256] RPC call timeout handler was delayed by -2.2522046839999348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
I20260709 13:03:32.216920  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:32.215219  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:32.233644  9518 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:03:32.234462  9521 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:32.192863 12710 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:32.243414  9371 raft_consensus.cc:1275] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:32.245364  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:32.250209  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:32.250666  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:32.250933  9446 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:03:32.251329  9525 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:32.253523  9446 raft_consensus.cc:1240] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:32.256721  9450 raft_consensus.cc:1240] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:32.256778  9445 raft_consensus.cc:1240] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 11. Current term is 12. Ops: []
W20260709 13:03:32.258339  9418 connection.cc:256] RPC call timeout handler was delayed by -2.2360046839999086s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
W20260709 13:03:32.258767  9418 connection.cc:256] RPC call timeout handler was delayed by -2.1802046839999321s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
W20260709 13:03:32.259090  9418 connection.cc:256] RPC call timeout handler was delayed by -2.1685046839999131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
W20260709 13:03:32.259409  9418 connection.cc:256] RPC call timeout handler was delayed by -2.1658046839999088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1899s for a response
W20260709 13:03:32.259706  9418 connection.cc:256] RPC call timeout handler was delayed by -2.1406046839999817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1927s for a response
W20260709 13:03:32.260023  9418 connection.cc:256] RPC call timeout handler was delayed by -2.0713046839999834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
W20260709 13:03:32.260392  9418 connection.cc:256] RPC call timeout handler was delayed by -2.058704683999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
W20260709 13:03:32.260707  9418 connection.cc:256] RPC call timeout handler was delayed by -2.05060468399995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
I20260709 13:03:32.263051  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:32.265409  9418 connection.cc:256] RPC call timeout handler was delayed by -1.8724046839998891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22250000000000003s for a response
W20260709 13:03:32.268669  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.217808 12638 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:32.276964  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.289129  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:32.293525  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:32.295506  9418 connection.cc:256] RPC call timeout handler was delayed by -1.6825046839999231s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2436s for a response
W20260709 13:03:32.296033  9418 connection.cc:256] RPC call timeout handler was delayed by -1.6447046839999757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24780000000000002s for a response
W20260709 13:03:32.296635  9418 connection.cc:256] RPC call timeout handler was delayed by -1.3558489779999263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
W20260709 13:03:32.297070  9418 connection.cc:256] RPC call timeout handler was delayed by -1.3234489779999876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
W20260709 13:03:32.297451  9418 connection.cc:256] RPC call timeout handler was delayed by -1.3216489779999847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
W20260709 13:03:32.297818  9418 connection.cc:256] RPC call timeout handler was delayed by -1.1560489779999443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
W20260709 13:03:32.298187  9418 connection.cc:256] RPC call timeout handler was delayed by -1.1119489779999867s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
W20260709 13:03:32.298600  9418 connection.cc:256] RPC call timeout handler was delayed by -1.1014966349999895s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
W20260709 13:03:32.298985  9418 connection.cc:256] RPC call timeout handler was delayed by -1.0552489780000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
W20260709 13:03:32.299360  9418 connection.cc:256] RPC call timeout handler was delayed by -1.0366966349999984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
I20260709 13:03:32.282116  9525 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:32.285065  9520 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:03:32.304653  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:32.301348  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:32.326840  9444 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:32.329077  9519 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:32.269471 12716 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.344853  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:32.327557  9443 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:32.339707  9524 raft_consensus.cc:1240] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7. Ops: []
W20260709 13:03:32.355996  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.371635  9521 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:03:32.379052  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:32.383869  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:32.337328 12672 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.269976 12723 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:32.300925 12638 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:32.368137 12568 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.404769  9341 leader_election.cc:400] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9.
I20260709 13:03:32.405210  9341 leader_election.cc:403] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:03:32.403920  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:32.406028  9371 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:32.407249  9418 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:32.411337 12640 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:32.413308  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:32.414476 12611 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:32.414985 12611 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:32.415377 12611 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:32.356695 12716 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:32.411983  9418 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:32.305022 12689 consensus_queue.cc:1059] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:03:32.428015  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:32.429275  9519 raft_consensus.cc:1275] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:32.439893  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:32.421759 12622 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9.
I20260709 13:03:32.454219  9375 raft_consensus.cc:2393] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 8: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:32.457602  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:32.461468  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:32.462263  9519 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:32.468225 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:32.478166 12638 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:32.478847 12638 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:03:32.483515 12743 log.cc:927] Time spent T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:03:32.484622 12689 consensus_queue.cc:1059] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:32.485837 12689 consensus_queue.cc:1243] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer d62c9d5a052b42ce8675f8438f846526 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:03:32.486820 12622 raft_consensus.cc:3055] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:32.487308 12622 raft_consensus.cc:740] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:32.488276 12622 consensus_queue.cc:260] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:32.489841  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:32.490532  9375 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:03:32.491483  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:32.492553  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:32.493609  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:32.494124  9375 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:32.497826  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:32.498584  9376 raft_consensus.cc:2393] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 7: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:03:32.499330  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:32.499842  9376 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:32.500563  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:32.501302  9375 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:03:32.502328  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:32.502892  9375 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:32.509446  9492 leader_election.cc:336] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.841s (SENT)
I20260709 13:03:32.512480  9372 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:03:32.436791 12552 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:32.437402 12698 raft_consensus.cc:2764] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:03:32.420485 12568 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:32.504788 12739 log.cc:927] Time spent T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:03:32.514815  9376 raft_consensus.cc:2393] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 7: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:32.520351  9368 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:03:32.408532 12672 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:32.518734  9370 raft_consensus.cc:2955] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 5 to 7, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:32.529634  9375 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
W20260709 13:03:32.533334  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 121446us
I20260709 13:03:32.535508 12640 consensus_queue.cc:1048] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:32.536521 12672 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:32.531368  9452 consensus_meta.cc:287] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.636s	user 0.012s	sys 0.000s
I20260709 13:03:32.547750  9452 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:32.518230  9373 raft_consensus.cc:2955] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 4 to 7, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:32.568017  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:32.575345  9519 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
W20260709 13:03:32.576012  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.592918  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:32.593600  9368 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:32.594596  9418 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:32.560632 12710 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:32.603863  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:32.614526  9374 raft_consensus.cc:1275] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:32.549037 12552 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:03:32.626987  9447 raft_consensus.cc:3060] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:32.557665 12640 consensus_queue.cc:1048] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:03:32.633858 12723 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:32.573282 12614 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:03:32.600786 12724 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:32.638430  9418 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:32.639143 12716 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:32.654522 12618 raft_consensus.cc:3055] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:32.655035 12618 raft_consensus.cc:740] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:32.656040 12618 consensus_queue.cc:260] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:32.658736 12618 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:32.663622 12672 consensus_queue.cc:1059] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:32.664819 12672 consensus_queue.cc:1059] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:32.665617 12672 raft_consensus.cc:3055] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:32.665946 12672 raft_consensus.cc:740] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:32.666412  9447 raft_consensus.cc:1275] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:32.666771 12672 consensus_queue.cc:260] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:32.668035 12672 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:32.640347 12568 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:32.669481 12552 raft_consensus.cc:3055] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:32.670101 12552 raft_consensus.cc:740] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:32.686985  9371 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
W20260709 13:03:32.694118  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 320364us
I20260709 13:03:32.676766  9368 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 9.
I20260709 13:03:32.697515 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:32.703508 12635 consensus_queue.cc:1048] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:03:32.695338 12716 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:32.734666  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 304214us
W20260709 13:03:32.740742  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.745703 10027 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:32.750844  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 50223.5us
I20260709 13:03:32.748553  9341 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:32.766052 12611 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:32.768335 12611 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:32.736735 12552 consensus_queue.cc:260] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:32.738117 12637 consensus_queue.cc:1048] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 13:03:32.777632  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 139308us
I20260709 13:03:32.762559 12683 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:32.793933  9418 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
W20260709 13:03:32.802518  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 70945us
I20260709 13:03:32.800333 12683 raft_consensus.cc:697] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 9 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:32.804329 12689 raft_consensus.cc:2804] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:32.796816 12754 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:03:32.805546 12611 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:03:32.833961  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:32.846222  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 55530.8us
I20260709 13:03:32.849852 12683 consensus_queue.cc:237] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:32.851819  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.821521 12689 raft_consensus.cc:697] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:32.821275 12611 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.852669 12611 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:32.853121 12689 consensus_queue.cc:237] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:32.857302 12638 consensus_queue.cc:1059] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:32.857795 12754 consensus_queue.cc:1048] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:32.858194 12638 consensus_queue.cc:1243] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:03:32.858794 12638 raft_consensus.cc:3055] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:32.859202 12638 raft_consensus.cc:740] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:03:32.862710 12751 log.cc:927] Time spent T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:03:32.871263 12611 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:32.874161  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:32.877496  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:32.880635  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:32.881536  9517 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:32.888142  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:32.889493  9525 raft_consensus.cc:2393] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 6: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:32.893815  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:32.898497  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:32.900368  9520 raft_consensus.cc:2368] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9.
I20260709 13:03:32.903609 12622 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:32.913807  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:32.919607 12611 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:32.860409 12638 consensus_queue.cc:260] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:32.928432  9524 raft_consensus.cc:1240] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 9. Current term is 10. Ops: []
W20260709 13:03:32.929875 12749 log.cc:927] Time spent T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.195s	user 0.002s	sys 0.000s
I20260709 13:03:32.891451 12698 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:03:32.945413  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:32.948442  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 56389.8us
W20260709 13:03:32.949249  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 108167us
W20260709 13:03:32.946136  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 197745us
I20260709 13:03:32.957617  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:32.958539  9526 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:32.962338  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:32.962620  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:32.963694  9518 raft_consensus.cc:2410] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:03:32.972019 10066 raft_consensus.cc:1240] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 9 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:32.973928  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:32.976397  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.978160  9520 raft_consensus.cc:1240] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:32.980449  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:32.967974 12760 log.cc:927] Time spent T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.088s	user 0.001s	sys 0.001s
I20260709 13:03:32.988863 12768 consensus_queue.cc:1059] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:32.990074 12768 consensus_queue.cc:1059] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:32.991108 12768 consensus_queue.cc:1059] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:32.991971 12768 raft_consensus.cc:3055] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:32.992303 12768 raft_consensus.cc:740] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:32.993245 12756 raft_consensus.cc:3055] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:32.993681 12756 raft_consensus.cc:740] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:32.994622 12756 consensus_queue.cc:260] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:32.995939 12756 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:32.998705 12698 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:32.987920 12764 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.988452  9341 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:32.985073  9522 raft_consensus.cc:3055] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:33.000324  9418 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:32.986181 12618 consensus_queue.cc:1059] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:33.015326  9517 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:32.959419 12755 consensus_queue.cc:1059] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:03:33.016323  9522 raft_consensus.cc:740] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:03:33.022399 12759 log.cc:927] Time spent T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 13:03:33.023592 12762 log.cc:927] Time spent T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.096s	user 0.001s	sys 0.001s
I20260709 13:03:33.024145 12552 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:33.026296  9522 consensus_queue.cc:260] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:32.975798 12689 consensus_queue.cc:1048] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:03:33.018759 12764 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:33.031288  9490 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.916s (SENT) [suppressed 51 similar messages]
I20260709 13:03:33.040095  9526 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:33.019578 12638 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:33.032104 12772 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.032295 12698 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:33.036278  9343 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:33.049311 12767 raft_consensus.cc:3055] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:33.053059 12672 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.047673 12766 consensus_queue.cc:1059] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:03:33.036382 12611 consensus_queue.cc:1048] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:03:33.063045  9341 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:33.054292 12755 consensus_queue.cc:1243] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer d62c9d5a052b42ce8675f8438f846526 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:03:33.066582  9343 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:33.068007 12764 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:33.053035 12772 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:33.069715 12774 log.cc:927] Time spent T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 13:03:33.070848  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.060287 12773 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:33.071717 12773 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.072160 12773 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:33.073246  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.073290 12766 consensus_queue.cc:1243] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:33.059965 12767 raft_consensus.cc:740] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:33.106420 12776 raft_consensus.cc:3055] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:33.106830 12776 raft_consensus.cc:740] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:33.107302  9418 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:33.106972 12767 consensus_queue.cc:260] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.108496 12767 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:33.064553 12672 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.017369 12768 consensus_queue.cc:260] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.114795 12768 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:33.116387 12772 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:33.116508 12672 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:33.099292 12755 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:33.117864 12755 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:33.099084 12698 consensus_queue.cc:1059] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:33.119071 12698 consensus_queue.cc:1243] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer b0812463215649c3b011d36e2f0400c9 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:03:33.119570 12698 raft_consensus.cc:3055] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:33.119974 12698 raft_consensus.cc:740] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:33.120844  9525 raft_consensus.cc:2410] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:03:33.100466  9343 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:33.101092 12618 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:33.105018  9445 raft_consensus.cc:1275] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:33.105571  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.105914 12764 raft_consensus.cc:3055] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:03:33.109076  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.106926  9443 raft_consensus.cc:1240] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:33.109916  9522 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:33.086723 12775 log.cc:927] Time spent T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.061s	user 0.000s	sys 0.002s
W20260709 13:03:33.122967  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.138795 12755 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:33.143580 12618 raft_consensus.cc:697] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:33.146731 12761 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:33.147940  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 47594.4us
I20260709 13:03:33.147475 12618 consensus_queue.cc:237] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:33.148869  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.136718 12764 raft_consensus.cc:740] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:33.152850  9524 raft_consensus.cc:1275] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:03:33.153476  9524 pending_rounds.cc:85] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 5
I20260709 13:03:33.156704  9343 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:33.120854 12698 consensus_queue.cc:260] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:33.162846 12698 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:33.163125 12769 log.cc:927] Time spent T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.138s	user 0.006s	sys 0.000s
I20260709 13:03:33.153772  9524 pending_rounds.cc:107] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:03:33.172524  9524 raft_consensus.cc:2889] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:33.180724 12622 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:33.183602 12622 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:33.184212 12622 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:33.191128  9492 leader_election.cc:336] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.526s (SENT)
W20260709 13:03:33.198053  9492 leader_election.cc:336] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.605s (SENT)
I20260709 13:03:33.196537 12773 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.180442 12756 consensus_queue.cc:1048] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:03:33.177731 12776 consensus_queue.cc:260] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.207098  9418 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:33.208186 12611 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:33.208781 12611 raft_consensus.cc:697] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:33.210064 12611 consensus_queue.cc:237] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.194059 12764 consensus_queue.cc:260] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.211779 12764 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:33.221138  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.232244 12773 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:33.259433  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 109008us
W20260709 13:03:33.260385  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 51648.7us
I20260709 13:03:33.260948  9522 raft_consensus.cc:1275] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:03:33.261524  9522 pending_rounds.cc:85] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 4
I20260709 13:03:33.261803  9522 pending_rounds.cc:107] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:03:33.262257  9522 raft_consensus.cc:2889] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:33.261628  9418 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
W20260709 13:03:33.262605  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 64608.2us
I20260709 13:03:33.263365  9343 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:33.262012  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 91587.6us
I20260709 13:03:33.269043 12776 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:33.269757 12790 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:33.270355 12790 raft_consensus.cc:697] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:33.271214 12790 consensus_queue.cc:237] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.275278  9371 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:03:33.277935 12640 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:03:33.280552  9492 leader_election.cc:336] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.660s (SENT)
I20260709 13:03:33.286912  9492 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:33.264298 12785 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.292003 12638 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:33.295558  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:33.284781 12773 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:03:33.317195  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 53023.2us
W20260709 13:03:33.321368  9490 leader_election.cc:336] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.526s (SENT)
I20260709 13:03:33.327531  9490 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:33.328408  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 54800.4us
I20260709 13:03:33.329051 12552 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:33.327211 12773 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:33.331295 12773 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:33.333446  9492 leader_election.cc:336] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.823s (SENT)
I20260709 13:03:33.327549 12785 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.338608 12785 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:33.338954 12622 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:33.291194 12776 consensus_queue.cc:1059] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.056s
W20260709 13:03:33.346248  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.325315  9343 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:33.352993  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:33.348832 12622 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:33.363375 12761 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:33.369292 12767 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:33.369506  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 79086.3us
I20260709 13:03:33.371637  9343 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:33.372599 12785 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.373791  9343 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:33.374182 12780 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:33.376199  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:33.375820  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.377317  9443 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:33.379633  9370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "001ad880018f49e5bec36246253efa0f"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:33.379890  9341 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:33.380530  9370 raft_consensus.cc:606] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:33.380854 12776 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:33.374701 12780 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:33.381985 12780 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:33.382685 12785 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:33.386322 12784 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:33.386826 12784 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.387197 12784 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:33.389174 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:33.390101 10066 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:33.390820  9445 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:03:33.391434  9445 raft_consensus.cc:606] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:33.391759  9445 raft_consensus.cc:614] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:03:33.394263  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.396627  9370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:33.399536  9370 raft_consensus.cc:606] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:33.368719 12764 raft_consensus.cc:3055] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:33.391696  9342 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:33.406090  9370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:33.406980  9370 raft_consensus.cc:606] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:33.407471  9370 raft_consensus.cc:614] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:03:33.412006  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 62525.9us
I20260709 13:03:33.415113  9418 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:33.414283 12552 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:33.418522 12552 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:33.421844  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 48144.3us
I20260709 13:03:33.402396 12785 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:33.414480 12622 raft_consensus.cc:2804] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:33.405962 12764 raft_consensus.cc:740] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:33.425863  9370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f322b7281d554c459bb8109ed249047b"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:33.426512  9370 raft_consensus.cc:606] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:33.427167  9370 raft_consensus.cc:614] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:33.425321 12611 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:33.442736 12611 raft_consensus.cc:697] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:33.450099 12611 consensus_queue.cc:237] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.443771 12552 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:33.453770  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:33.453204 12796 log.cc:927] Time spent T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:03:33.425674 12622 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.459682 12622 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:33.456274 12795 log.cc:927] Time spent T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:03:33.456687  9452 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:03:33.461886 12784 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:33.456933  9492 leader_election.cc:336] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.932s (SENT)
I20260709 13:03:33.464212 12784 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:33.456715 12764 consensus_queue.cc:260] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.464932  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:33.465631  9452 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:33.458695  9343 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:33.464936  9492 leader_election.cc:336] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.981s (SENT)
I20260709 13:03:33.469332 12764 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:33.472972 12637 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:03:33.474455  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.475657  9452 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:03:33.476832  9341 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:33.481144 12780 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.486372 12784 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:33.491683 12785 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:33.501147  9370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:33.502023  9370 raft_consensus.cc:606] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:33.482964 12773 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.502710  9370 raft_consensus.cc:614] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:33.503295  9343 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:33.488178 12784 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:33.506814 12755 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:33.507004  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:33.508812  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:33.508843  9343 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:33.514047 12618 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:33.505641 12785 raft_consensus.cc:697] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:33.517335 12780 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:33.518128  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:33.518028 12785 consensus_queue.cc:237] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.523713  9452 raft_consensus.cc:1275] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:03:33.527560 12776 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:33.530359 12773 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:33.531915  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:33.546299  9343 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:33.513420 12784 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:33.552551 12776 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:03:33.555590  9492 leader_election.cc:336] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 2.082s (SENT)
I20260709 13:03:33.573725  9492 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:33.554527 12622 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:33.562588  9343 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:33.578363  9343 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
W20260709 13:03:33.580221  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:33.580412  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 153164us
I20260709 13:03:33.582073  9343 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:33.582506 12618 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:33.583576 12780 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:33.581157 12552 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:33.591282  9273 catalog_manager.cc:5697] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 4 to 5, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 5 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.592989  9273 catalog_manager.cc:5697] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 7 to 8, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 8 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.594431  9273 catalog_manager.cc:5697] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 4 to 7, term changed from 5 to 7, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New cstate: current_term: 7 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.596019  9273 catalog_manager.cc:5697] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 6 to 8, leader changed from b0812463215649c3b011d36e2f0400c9 (127.8.4.68) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 8 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:33.601029  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:33.602212 12804 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:33.602839 12804 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.604460 12804 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:33.610790 12780 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:33.612378 12804 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.613741  9273 catalog_manager.cc:5697] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 3 to 8, term changed from 5 to 10, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to <none>, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New cstate: current_term: 10 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:33.616561 12804 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:33.615649  9418 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:33.618263 12622 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:33.618350  9418 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:33.620002 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:33.620604 10066 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:33.620896 12793 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:33.621656 12793 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:33.621999 12793 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.622332 12793 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:33.610955  9343 leader_election.cc:400] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9.
I20260709 13:03:33.627751  9343 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:33.629448  9343 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:33.631242 12776 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:33.631953 12776 consensus_queue.cc:1059] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:33.633441 12776 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:33.634083 12776 raft_consensus.cc:3055] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:33.634400 12776 raft_consensus.cc:740] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:33.638165  9343 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:33.637491  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:33.640712  9343 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:33.642091  9343 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:33.642668  9418 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:33.645797  9418 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:33.647264  9418 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:33.650167  9343 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:33.640620 12622 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:33.652220  9492 leader_election.cc:336] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 2.181s (SENT)
I20260709 13:03:33.652863  9492 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:33.644814 12780 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:33.645905 12618 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:33.636389 12776 consensus_queue.cc:260] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.645637 12761 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:33.649963 12698 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:33.656925 12552 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:33.649729 12716 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:33.651719 12790 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:33.661573 12698 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.664510 12698 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:33.659740 10066 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:33.654999 12785 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:33.668979 12785 raft_consensus.cc:697] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:33.670886  9342 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:33.646703 12804 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:03:33.662910  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.676584  9443 raft_consensus.cc:2393] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 12: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:33.691082 12761 raft_consensus.cc:697] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 12 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:33.691622  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.692587  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.692034  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.693442 12761 consensus_queue.cc:237] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.694239  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.694967  9372 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:33.695858  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:33.696499  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:33.696825  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.697077  9375 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:33.697494  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.695955  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.698261  9370 raft_consensus.cc:2393] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:33.698244  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.696837  9374 raft_consensus.cc:2368] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11.
I20260709 13:03:33.706764  9369 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:03:33.708078  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.708925  9371 raft_consensus.cc:2410] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:33.689692 12780 consensus_queue.cc:1048] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:03:33.712893  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:33.714375  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:33.714563  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.715857  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.716645  9448 raft_consensus.cc:2393] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 11: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:33.717281  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.717783  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:33.717893  9449 raft_consensus.cc:1240] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:03:33.719148  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.719988  9447 raft_consensus.cc:2393] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 12: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:33.720542  9449 raft_consensus.cc:1217] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 6.4->[7.5-7.5]   Dedup: 7.5->[]
I20260709 13:03:33.721071  9449 raft_consensus.cc:1240] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:03:33.721294  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.721750  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:33.722532  9451 raft_consensus.cc:2368] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 9. Current term is 10.
I20260709 13:03:33.724093 12785 consensus_queue.cc:237] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.722388  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.726182  9373 raft_consensus.cc:2393] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 10: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:33.719168 12784 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.729349  9377 raft_consensus.cc:2393] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 10: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:33.730144  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.730907  9368 raft_consensus.cc:2393] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:33.731992  9444 raft_consensus.cc:1240] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:33.732807  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:33.733660  9447 raft_consensus.cc:2368] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12.
I20260709 13:03:33.732879 12622 raft_consensus.cc:2804] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:33.734597  9448 raft_consensus.cc:1240] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:33.734795 12793 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.735167 12622 raft_consensus.cc:697] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:33.736241 12622 consensus_queue.cc:237] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:33.737167 12776 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:33.737340  9449 raft_consensus.cc:1240] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 8. Current term is 10. Ops: []
I20260709 13:03:33.737617  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.737167  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.737990  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:33.717875  9372 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:03:33.734706  9452 raft_consensus.cc:1240] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:33.697284  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:33.744082  9375 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:03:33.744581  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.745364  9370 raft_consensus.cc:2393] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 7: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:33.745404  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.746248  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.738970 12784 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:33.747078  9369 raft_consensus.cc:2410] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:03:33.747720  9492 leader_election.cc:336] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.544s (SENT)
I20260709 13:03:33.750159  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:33.751369  9443 raft_consensus.cc:2393] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 12: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:33.752626  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.753387  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.748405 12793 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:33.689409 12618 consensus_queue.cc:1048] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
W20260709 13:03:33.757736  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.758232  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:33.764176  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.764176  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.766081  9376 raft_consensus.cc:2393] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 8: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:33.765245  9375 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:33.767180  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.767685  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.768020  9377 raft_consensus.cc:2393] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 7: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:33.768481  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.773289  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.774147  9374 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:33.775087  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.775920  9369 raft_consensus.cc:2393] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:33.778445 12698 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.773373 12790 raft_consensus.cc:697] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:33.780941  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:33.780738  9490 leader_election.cc:336] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.544s (SENT)
I20260709 13:03:33.783597  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.787599  9444 raft_consensus.cc:1275] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:03:33.789474  9490 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:33.789921  9368 raft_consensus.cc:2410] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:03:33.791246 12618 consensus_queue.cc:1048] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:33.795058  9443 raft_consensus.cc:2393] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 7: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:33.794968  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.798082  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:33.798775  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.799254  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.825606 12552 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:33.827948  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.788065 12716 raft_consensus.cc:697] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:03:33.829344  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.829489  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:33.829919  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.830931  9376 raft_consensus.cc:2393] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:33.830906  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:33.832161  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.836366  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.830331  9273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 74) took 3383 ms. Trace:
I20260709 13:03:33.833628  9377 raft_consensus.cc:2393] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:33.837363  9449 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:33.837162 12716 consensus_queue.cc:237] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.838407 12698 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:33.837157  9372 raft_consensus.cc:2393] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 10: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:33.836891  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.839846  9448 raft_consensus.cc:2393] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 7: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
W20260709 13:03:33.841473  9490 leader_election.cc:336] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.589s (SENT)
I20260709 13:03:33.841362 12790 consensus_queue.cc:237] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.842056  9490 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:33.843400 12552 raft_consensus.cc:2749] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:33.844592  9370 raft_consensus.cc:3055] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:33.845247  9370 raft_consensus.cc:740] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:33.846189  9370 consensus_queue.cc:260] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.847453  9370 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:03:33.837373  9273 rpcz_store.cc:276] 0709 13:03:30.415299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.421431 (+  6132us) service_pool.cc:224] Handling call
0709 13:03:33.798156 (+3376725us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:33.626950 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:33.627504 (+   554us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:33.627536 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:03:33.627552 (+    16us) tablet.cc:662] Decoding operations
0709 13:03:33.628193 (+   641us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:33.628241 (+    48us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:33.628265 (+    24us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:03:33.628703 (+   438us) tablet.cc:701] Row locks acquired
0709 13:03:33.628717 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:03:33.628861 (+   144us) write_op.cc:270] Start()
0709 13:03:33.628962 (+   101us) write_op.cc:276] Timestamp: P: 1783602213628813 usec, L: 0
0709 13:03:33.628978 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:03:33.629621 (+   643us) log.cc:844] Serialized 1989 byte log entry
0709 13:03:33.631841 (+  2220us) op_driver.cc:464] REPLICATION: finished
0709 13:03:33.632290 (+   449us) write_op.cc:301] APPLY: starting
0709 13:03:33.632367 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:33.632541 (+   174us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:33.632636 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:33.633388 (+   752us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:33.633651 (+   263us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:03:33.633700 (+    49us) write_op.cc:312] APPLY: finished
0709 13:03:33.633925 (+   225us) log.cc:844] Serialized 46 byte log entry
0709 13:03:33.634120 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:33.634223 (+   103us) write_op.cc:454] Released schema lock
0709 13:03:33.634269 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:33.634647 (+   378us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:33.634684 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":44445,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":230,"apply.run_cpu_time_us":2310,"apply.run_wall_time_us":2310,"num_ops":5,"prepare.queue_time_us":119,"prepare.run_cpu_time_us":2951,"prepare.run_wall_time_us":2960,"replication_time_us":2706}]]}
W20260709 13:03:33.852995  9274 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43252 (request call id 168) took 23816 ms (client timeout 15000 ms). Trace:
I20260709 13:03:33.857712 12552 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:33.862313 12552 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:33.859385  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:33.861665  9274 rpcz_store.cc:269] 0709 13:03:10.036563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.057185 (+ 20622us) service_pool.cc:224] Handling call
0709 13:03:33.852882 (+23795697us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:32.764296 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:32.849699 (+ 85403us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:32.849750 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:03:32.849787 (+    37us) tablet.cc:662] Decoding operations
0709 13:03:32.850557 (+   770us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:32.850638 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:32.850667 (+    29us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:03:32.851152 (+   485us) tablet.cc:701] Row locks acquired
0709 13:03:32.851205 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:03:32.851378 (+   173us) write_op.cc:270] Start()
0709 13:03:32.851547 (+   169us) write_op.cc:276] Timestamp: P: 1783602212851318 usec, L: 0
0709 13:03:32.851568 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:03:32.948922 (+ 97354us) log.cc:844] Serialized 1669 byte log entry
0709 13:03:33.202602 (+253680us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b540016e4d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb586565e28 00007fb589fa0581 00007fb589f9fd58 00007fb589fa49f1 00007fb589fa49a9 00007fb589fa4939 00007fb589fa4901 00007fb589fa3b2d 000000000038f354 000000000038f199
0709 13:03:33.249887 (+ 47285us) op_driver.cc:464] REPLICATION: finished
0709 13:03:33.417421 (+167534us) write_op.cc:301] APPLY: starting
0709 13:03:33.417521 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:33.417673 (+   152us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:33.417706 (+    33us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:33.460685 (+ 42979us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:33.461035 (+   350us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:03:33.465475 (+  4440us) write_op.cc:312] APPLY: finished
0709 13:03:33.513884 (+ 48409us) log.cc:844] Serialized 40 byte log entry
0709 13:03:33.544675 (+ 30791us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:33.544840 (+   165us) write_op.cc:454] Released schema lock
0709 13:03:33.544907 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:33.545423 (+   516us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:33.545468 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":476420,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":167183,"apply.run_cpu_time_us":3477,"apply.run_wall_time_us":128013,"num_ops":4,"prepare.queue_time_us":457695,"prepare.run_cpu_time_us":20789,"prepare.run_wall_time_us":466510,"raft.queue_time_us":152231,"raft.run_cpu_time_us":13968,"raft.run_wall_time_us":100198,"replication_time_us":398096,"spinlock_wait_cycles":53931392,"thread_start_us":537235,"threads_started":4,"wal-append.queue_time_us":115167}]]}
I20260709 13:03:33.858615  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.860055  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.860442  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.861389  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.860773  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.861423  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:33.867527  9446 raft_consensus.cc:2393] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 13: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
W20260709 13:03:33.855018  9492 leader_election.cc:336] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 2.250s (SENT)
I20260709 13:03:33.871026  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:33.871605  9371 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:33.872231  9445 raft_consensus.cc:2368] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12.
I20260709 13:03:33.833819  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.833209  9368 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:33.873939  9443 raft_consensus.cc:2393] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 8: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:33.864853 12552 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:33.880512  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.877907  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.886351  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.888487  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:33.888528  9370 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:03:33.889495  9445 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:03:33.891932  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.892197  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.892562  9370 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:33.893764  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:03:33.910283  9492 leader_election.cc:336] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 2.109s (SENT)
I20260709 13:03:33.911219  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.911917  9271 catalog_manager.cc:5697] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 6 to 9, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 9 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.916357  9271 catalog_manager.cc:5697] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 8 to 11, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 11 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:33.917891  9271 catalog_manager.cc:5697] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 7 to 10, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 10 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.919642  9271 catalog_manager.cc:5697] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 5 to 7, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 7 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.921588  9271 catalog_manager.cc:5697] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 7 to 8, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 8 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.923413  9271 catalog_manager.cc:5697] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 8 to 10, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 10 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.931147  9271 catalog_manager.cc:5697] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 6 to 8, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 8 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:33.933511  9271 catalog_manager.cc:5697] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 6 to 9, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 9 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:33.934563  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.938957  9271 catalog_manager.cc:5697] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:33.940027  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.944919  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.945641  9371 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:03:33.946053  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.947117  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.948534  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:33.952409  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.952554  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.953202  9376 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:03:33.955111  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:33.957104  9492 leader_election.cc:336] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 2.141s (SENT)
I20260709 13:03:33.957439  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:33.958127  9374 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:03:33.959277  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.959666  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:33.964679  9368 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:03:33.972656  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.973145  9450 raft_consensus.cc:1240] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:03:33.995469  9445 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:03:33.996630  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:34.006137  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:34.006999  9377 raft_consensus.cc:2393] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 7: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:34.007839  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:34.008620  9377 raft_consensus.cc:2393] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 10: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:34.008530  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:34.009346  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:34.013447  9524 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:34.014024  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:34.009465  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:34.010149  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:34.014597  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:34.014943  9448 raft_consensus.cc:2393] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 13: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:34.015172  9369 raft_consensus.cc:2393] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:34.015388  9451 raft_consensus.cc:2393] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 12: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:34.010455  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:34.015928  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:34.011233  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:34.016443  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:34.011555  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:34.017125  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:34.017705  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:34.017968  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:34.018391  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.016781  9373 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:03:34.016443  9375 raft_consensus.cc:2410] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:03:34.015486  9444 raft_consensus.cc:2393] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 7: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:34.013278  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:34.019657  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:34.010862  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:34.014433  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:34.022965  9450 raft_consensus.cc:2393] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 12: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:34.006137  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:33.966775  9271 catalog_manager.cc:5697] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 7 to 8, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 8 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:34.023649  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:34.013352  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:34.024830  9374 raft_consensus.cc:2393] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:34.025290  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:34.026530  9443 raft_consensus.cc:2393] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 11: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:34.025835  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:34.028067  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:34.018362  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:34.028928  9370 raft_consensus.cc:2393] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:34.028015  9374 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:34.030195  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:34.030812  9369 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:03:34.031764  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:34.032855  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:34.032801  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:34.034055  9445 raft_consensus.cc:2393] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 12: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:34.037667  9271 catalog_manager.cc:5697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:34.039767  9448 raft_consensus.cc:2393] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 8: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:34.040741  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:34.041803  9374 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:34.045748  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:34.046595  9377 raft_consensus.cc:2376] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12. Re-sending same reply.
I20260709 13:03:34.047763  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:34.048805  9373 raft_consensus.cc:2393] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 7: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:34.077095  9524 raft_consensus.cc:1240] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:34.077200  9522 raft_consensus.cc:1275] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:34.079744  9271 catalog_manager.cc:5697] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:34.074728  9492 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:34.086107  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:34.086942  9520 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:34.087103  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:34.087859  9518 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:34.088685  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:34.089555  9518 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:34.093431  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:34.094247  9519 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:34.095412  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:34.096820  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:34.097678  9517 raft_consensus.cc:2393] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 10: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:34.099004  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:34.099659  9526 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:34.102453  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.106930  9526 raft_consensus.cc:2410] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:03:34.113997  9526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46902
I20260709 13:03:34.114449  9374 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:34.115675  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:34.117574  9525 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:34.117601  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:34.117664  9377 raft_consensus.cc:1275] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:34.118579  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:34.120247  9518 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:03:34.121100  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:34.121702  9518 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:34.123144  9519 raft_consensus.cc:1240] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:34.125469  9524 raft_consensus.cc:1240] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 12. Ops: []
I20260709 13:03:34.121436  9271 catalog_manager.cc:5697] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 5 to 7, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 7 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:34.129928  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:34.130666  9373 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:34.132886  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:34.137526  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:34.139791  9520 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:34.141217  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:34.141985  9523 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:34.146391  9522 raft_consensus.cc:1240] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:34.148313  9518 raft_consensus.cc:1275] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:34.149984  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:34.150665  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:34.151047  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:34.151835  9525 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:34.154022  9374 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:03:34.155144  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:34.155781  9520 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:34.156791  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:34.157593  9375 raft_consensus.cc:1240] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:34.155635  9518 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:34.158305  9374 raft_consensus.cc:1240] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:03:34.158540  9271 catalog_manager.cc:5697] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:34.161404  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:34.167410  9369 raft_consensus.cc:1275] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:34.167569  9520 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:34.173889  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:34.144548 12814 log.cc:927] Time spent T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:03:34.178735  9518 raft_consensus.cc:1240] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:34.179018  9370 raft_consensus.cc:1240] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:03:34.179903  9368 raft_consensus.cc:1240] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:03:34.180784  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:34.184454  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 109868us
I20260709 13:03:34.189831  9525 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:34.193598  9271 catalog_manager.cc:5697] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:34.197036  9370 raft_consensus.cc:1240] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:34.196791  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:34.198995  9518 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:34.199838  9519 raft_consensus.cc:1275] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:03:34.200212  9519 pending_rounds.cc:85] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 5
I20260709 13:03:34.200405  9519 pending_rounds.cc:107] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:03:34.200608  9519 raft_consensus.cc:2889] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:34.202549  9492 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:34.202872  9517 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:34.214677  9518 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:34.219475  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:34.220137  9370 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:34.223142  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:34.224030  9517 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:34.216264  9271 catalog_manager.cc:5697] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 10 to 9, leader changed from <none> to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 9 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:34.229593  9271 catalog_manager.cc:5697] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:34.231673  9435 tablet_service.cc:1558] Processing DeleteTablet for tablet 45a4f94c156249adab9c2b1ffb00ac46 with delete_type TABLET_DATA_TOMBSTONED (TS d62c9d5a052b42ce8675f8438f846526 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:51006
I20260709 13:03:34.238639  9448 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:34.242794  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:34.278394  9368 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:34.243474  9374 raft_consensus.cc:1240] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:34.245522  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:34.247318  9524 raft_consensus.cc:1275] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:03:34.282327  9369 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:34.249816  9343 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:34.250671 12618 consensus_queue.cc:1059] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:34.260900  9271 catalog_manager.cc:5697] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 2 to 4, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 4 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:34.288022  9343 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:34.290277  9368 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:34.272137  9418 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:34.248404  9519 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:34.291244  9523 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:34.270216  9441 tablet_service.cc:1558] Processing DeleteTablet for tablet 7260766fbe5c43b1aab09346a89d9ac6 with delete_type TABLET_DATA_TOMBSTONED (TS d62c9d5a052b42ce8675f8438f846526 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:51006
I20260709 13:03:34.303158 12822 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:34.305289  9271 catalog_manager.cc:5697] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 6 to 9, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 9 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:34.307555  9271 catalog_manager.cc:5697] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 6 to 7, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 7 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:34.316272  9343 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:34.310473 12761 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:34.319523  9517 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:34.294924 12776 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:34.352669  9369 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:34.322743 12622 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:03:34.358439  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 162503us
I20260709 13:03:34.337999  9271 catalog_manager.cc:5697] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:34.318849  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 46919.1us
I20260709 13:03:34.363965  9492 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:34.388784  9418 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:34.324393 12618 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
W20260709 13:03:34.405802  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 73197.5us
W20260709 13:03:34.412915  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.354633 12776 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:34.415942  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 52065.4us
I20260709 13:03:34.416898  9492 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:34.432065  9526 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:34.432570  9526 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:34.418300 12776 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:34.434015  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 117849us
I20260709 13:03:34.422777 12761 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:34.439566  9343 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:34.397619 12622 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:03:34.430670 12764 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:34.483512 12618 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:34.458230 12823 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:34.484973 12823 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.485363 12823 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:34.486856 12761 raft_consensus.cc:697] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:34.487594 12781 raft_consensus.cc:3055] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:34.488230 12781 raft_consensus.cc:740] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:34.489559 12824 log.cc:927] Time spent T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:03:34.491804 12784 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:34.487875 12761 consensus_queue.cc:237] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:34.494285  9526 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:34.484192 12618 raft_consensus.cc:697] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:34.500242  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 83420.2us
I20260709 13:03:34.502794  9492 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:34.506877 12827 tablet_replica.cc:333] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:03:34.496606 12552 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:34.508127 12618 consensus_queue.cc:237] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:34.505656 12781 consensus_queue.cc:260] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:34.513441 12781 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:34.498629 12826 consensus_queue.cc:1059] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 13:03:34.530974  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 142304us
I20260709 13:03:34.535528  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:34.534844  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 127177us
I20260709 13:03:34.569212  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:34.505558  9492 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:03:34.575896  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 252602us
I20260709 13:03:34.582170  9418 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:34.583369  9418 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:34.584487  9418 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:34.585898 12809 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:03:34.581754 12821 log.cc:927] Time spent T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.259s	user 0.001s	sys 0.001s
I20260709 13:03:34.602196  9445 raft_consensus.cc:3055] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:03:34.596027  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 136951us
I20260709 13:03:34.623181  9445 raft_consensus.cc:740] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:34.578405 12825 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:34.598225 12790 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:03:34.608268 12842 log.cc:927] Time spent T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:03:34.615334 12828 log.cc:927] Time spent T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:03:34.633507 12827 raft_consensus.cc:2243] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.634979 12827 raft_consensus.cc:2272] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.617874 12823 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:34.612273  9418 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:34.585713 12716 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:34.593853 12834 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:34.597429 12836 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:34.627854  9445 consensus_queue.cc:260] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:34.645577  9418 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:34.649370  9418 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:34.624843 12825 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.654716  9445 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:34.619454 12776 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:34.658311  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 152820us
I20260709 13:03:34.659330  9492 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:03:34.669104  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 126156us
I20260709 13:03:34.652233 12790 raft_consensus.cc:2804] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:34.647337 12836 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:34.673578 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 341890us
I20260709 13:03:34.656462 12809 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:34.655220 12825 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:34.692188  9490 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:34.668401 12841 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.672708 12834 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:34.704279 12827 ts_tablet_manager.cc:1916] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:34.705713 10066 raft_consensus.cc:1275] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:34.701100 12846 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:34.712626  9526 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:34.716303 12835 raft_consensus.cc:3055] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:34.677958 12826 consensus_queue.cc:1059] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:03:34.686697 12836 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:34.695037 12790 raft_consensus.cc:697] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:34.695325  9445 raft_consensus.cc:1275] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:03:34.743817  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 51736.5us
I20260709 13:03:34.751729  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:03:34.743371  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 82821.9us
W20260709 13:03:34.747110  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 97826.3us
I20260709 13:03:34.728878 12845 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:34.743060 12846 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.743305 12835 raft_consensus.cc:740] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:34.762051 12780 consensus_queue.cc:1048] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:34.763981  9492 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:34.753118 12776 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:34.774001 12823 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:34.747749 12838 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.729511 12841 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:34.797338 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 64652.7us
I20260709 13:03:34.779493 12846 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:34.806161  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 54926.7us
I20260709 13:03:34.807371  9490 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:34.787809 12809 raft_consensus.cc:697] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:34.760186 12837 consensus_queue.cc:1048] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:03:34.811448  9490 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:34.793854 12852 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:03:34.809448  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 47751.9us
I20260709 13:03:34.824806  9490 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:34.818928 12822 consensus_meta.cc:287] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.515s	user 0.004s	sys 0.011s
W20260709 13:03:34.845889  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 82012us
I20260709 13:03:34.793954 12838 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:34.812054 12826 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:03:34.858423  9492 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:34.864754  9492 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:34.867720  9490 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:34.854811 12822 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:34.844197 12851 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:34.867156 12852 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:34.858739 12835 consensus_queue.cc:260] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:34.914877  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.915561 12835 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:34.894929 12780 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.917430 12780 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:34.921643 12863 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:34.922717 12863 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:34.923843 12863 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:34.924328 12863 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:34.924697 12863 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:34.870199 12845 raft_consensus.cc:697] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:34.827232 12790 consensus_queue.cc:237] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:34.871048 12834 raft_consensus.cc:697] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:34.875351 12809 consensus_queue.cc:237] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:34.912420 12851 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:34.936898 12845 consensus_queue.cc:237] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:34.962522  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.913697 12852 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:34.913234 12855 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:34.935683 12823 raft_consensus.cc:3055] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:34.942142 12822 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:34.927945 12862 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:34.975852  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:34.981415 12841 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:34.938295 12761 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:03:34.964519 12850 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.990376 12834 consensus_queue.cc:237] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:34.973248 12823 raft_consensus.cc:740] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:35.001791 12838 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:34.971024 12852 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:35.017526  9450 raft_consensus.cc:3055] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:35.020337  9450 raft_consensus.cc:740] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:35.010845  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:35.021819  9444 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:03:35.023110  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:35.024525  9450 consensus_queue.cc:260] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:35.033680  9450 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:35.005638 12825 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.043622 12825 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:35.055019  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.057638 12780 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:35.013815 12850 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:35.065660  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 198080us
I20260709 13:03:35.032557  9341 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:35.067464  9490 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:35.070639  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 205949us
I20260709 13:03:35.071269  9450 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:03:35.074173  9492 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:35.102494  9492 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:35.102545  9490 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:35.130543  9490 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:35.128793  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 249047us
I20260709 13:03:35.131487  9492 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:35.105540 12862 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:35.149475  9492 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:35.147796  9418 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:35.067766 12850 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:35.154788  9492 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:35.153100 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:35.134027 12552 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:35.103386 12780 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:35.154211  9490 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:35.133284 12822 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:35.150617 12825 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:35.105255 12837 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:03:35.159515 12857 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:35.165869 12857 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:35.154014 12823 consensus_queue.cc:260] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.166224 12857 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:35.166522 12823 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:35.173646 12876 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:35.174257 12876 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:35.174849 12876 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:35.151172 12851 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:35.179258  9490 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:35.161370 12780 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:35.193068 12780 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:35.193737 12831 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.194284 12831 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.196498 12831 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:35.160773 12859 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:35.198452 12826 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:35.181740 12869 raft_consensus.cc:2764] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:03:35.192027 12844 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.182282 12862 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:35.192339 12827 ts_tablet_manager.cc:1929] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.6
I20260709 13:03:35.197542 12552 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.185920 12838 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.164880 12825 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:35.196338 12836 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.261053 12836 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:35.161126 12850 consensus_queue.cc:1048] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:03:35.201687 12826 raft_consensus.cc:697] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:35.263546 12826 consensus_queue.cc:237] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.265214 12827 log.cc:1199] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-1-root/wals/45a4f94c156249adab9c2b1ffb00ac46
I20260709 13:03:35.217329 12844 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.204507 12872 consensus_queue.cc:1059] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:03:35.267437 12844 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:35.220117  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:35.270933  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:35.271327  9374 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:35.272158  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:35.273036  9370 raft_consensus.cc:2393] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 10: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:35.274398  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:35.275043  9370 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
W20260709 13:03:35.276015 12875 log.cc:927] Time spent T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:03:35.276893  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:35.277082  9492 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:35.266808 12827 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51006 (request call id 67) took 1073 ms. Trace:
I20260709 13:03:35.277509  9372 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:35.277853 12827 rpcz_store.cc:276] 0709 13:03:34.221351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.231266 (+  9915us) service_pool.cc:224] Handling call
0709 13:03:34.506459 (+275193us) ts_tablet_manager.cc:1151] Deleting tablet 45a4f94c156249adab9c2b1ffb00ac46
0709 13:03:34.506561 (+   102us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:03:34.951512 (+444951us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:35.192191 (+240679us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:35.266661 (+ 74470us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28118,"tablet-delete.queue_time_us":228594,"thread_start_us":153690,"threads_started":1}
I20260709 13:03:35.280589 12827 tablet_replica.cc:333] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:03:35.219717  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:35.281486  9369 raft_consensus.cc:2393] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 10: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:35.218643 12784 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.277196  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:35.282423 12784 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.282657  9371 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:35.268848 12855 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:35.256916 12552 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.285333 12852 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.287212 12552 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:35.213238 12822 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:35.287454 12852 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:35.288262 12825 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:35.289389 12838 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:35.244537  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 65329.4us
I20260709 13:03:35.291618 12838 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:35.203050 12831 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.290789 12827 raft_consensus.cc:2243] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.292325 12831 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:35.293215  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.292801 12827 pending_rounds.cc:70] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526: Trying to abort 2 pending ops.
I20260709 13:03:35.294950 12831 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:35.212891 12857 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.295378 12827 pending_rounds.cc:77] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526: Aborting op as it isn't in flight: id { term: 7 index: 7 } timestamp: 7305634576403558400 op_type: NO_OP noop_request { }
I20260709 13:03:35.295895 12827 raft_consensus.cc:2889] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:35.296258 12827 pending_rounds.cc:77] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526: Aborting op as it isn't in flight: id { term: 5 index: 6 } timestamp: 7305634538760044544 op_type: NO_OP noop_request { }
I20260709 13:03:35.296643 12827 raft_consensus.cc:2889] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:35.297050 12827 raft_consensus.cc:2272] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.304581  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:35.306800  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:35.292899  9372 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:03:35.284934  9374 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:03:35.297493 12857 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:35.306155  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:35.298466  9371 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:35.308413  9448 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:03:35.292395  9490 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:35.305687 12827 ts_tablet_manager.cc:1916] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:35.314728  9341 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:35.284889 12784 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:35.334587  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 186812us
I20260709 13:03:35.185189 12846 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:35.342746  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 65799.3us
I20260709 13:03:35.346671  9492 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:35.348826  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:35.350605  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:35.351424  9372 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:35.336162 12869 raft_consensus.cc:3055] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:35.361589  9372 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
W20260709 13:03:35.363554  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 71226.1us
I20260709 13:03:35.364892 12844 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:35.366241  9492 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:35.367870  9492 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:35.369351 12852 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:35.369781 12872 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:35.369964 12852 raft_consensus.cc:697] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:35.370450 12872 raft_consensus.cc:697] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:35.371436 12872 consensus_queue.cc:237] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.371470 12852 consensus_queue.cc:237] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.356588 12846 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:35.342468 12785 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:35.372812 12785 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:35.334072 12863 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.357656  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:35.341626 12841 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.288256 12876 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.374337  9418 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:35.374466  9492 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:35.373332 12785 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:35.377596  9343 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:35.372995 12846 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:03:35.391587  9418 raft_consensus.cc:2686] T 45a4f94c156249adab9c2b1ffb00ac46 P d62c9d5a052b42ce8675f8438f846526: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:03:35.396610  9525 raft_consensus.cc:1275] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:35.389724  9343 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:35.358297 12823 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:35.358608 12869 raft_consensus.cc:740] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:35.400743  9525 raft_consensus.cc:1275] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:35.400655  9418 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:35.406448  9418 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:35.416136  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:35.417330  9521 raft_consensus.cc:2393] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 10: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:35.417218  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:35.417457  9523 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:03:35.418167  9525 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:35.421198  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:35.421679  9418 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:35.422080  9519 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:35.395619 12776 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:35.402189 12846 raft_consensus.cc:697] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:35.423012 12781 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:35.441278 12846 consensus_queue.cc:237] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.441439 12781 raft_consensus.cc:697] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:35.443326 12781 consensus_queue.cc:237] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.401917 12784 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:03:35.395506 12831 consensus_queue.cc:1048] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:03:35.423975 12865 consensus_queue.cc:1059] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:03:35.446099 12865 consensus_queue.cc:1243] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 6d50f1c263264b21919230bee398022b log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:35.446692 12865 raft_consensus.cc:3055] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:35.395403 12844 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:35.400307 12823 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:35.435628  9448 raft_consensus.cc:1240] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:35.452757  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:35.471092  9523 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:35.450937  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:35.460167  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:35.451166  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:35.485277  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 63660.3us
I20260709 13:03:35.389192 12841 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.508455  9518 raft_consensus.cc:2410] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:03:35.514676 12892 consensus_queue.cc:1059] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:35.510023  9525 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:35.515766 12892 raft_consensus.cc:3055] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:35.516680 12892 raft_consensus.cc:740] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:35.516206  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:35.519558  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 129821us
I20260709 13:03:35.527551  9519 raft_consensus.cc:1240] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: []
W20260709 13:03:35.436842 12870 log.cc:927] Time spent T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 13:03:35.525096  9372 raft_consensus.cc:1240] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:35.447104 12865 raft_consensus.cc:740] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:03:35.431259 12880 log.cc:927] Time spent T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.331s	user 0.000s	sys 0.005s
I20260709 13:03:35.520740  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:35.534598  9519 raft_consensus.cc:1275] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:03:35.525792  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.540187  9372 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:35.545177  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:35.529035 12761 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:35.549299  9371 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:35.440006 12776 raft_consensus.cc:697] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:35.429486 12876 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:35.406600 12834 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 13:03:35.426997 12884 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:35.436679 12863 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:35.466622 12835 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.424146 12883 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:35.577699  9517 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:03:35.578136  9522 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:35.427754 12869 consensus_queue.cc:260] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.561414  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:35.610738  9517 raft_consensus.cc:1240] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:35.457635 12831 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:35.458856 12622 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:35.453243 12844 raft_consensus.cc:697] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:35.457527 12618 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:35.582363  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:35.642110  9519 raft_consensus.cc:1813] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Handling vote request from an unknown peer d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:35.582653  9374 raft_consensus.cc:2393] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 10: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:35.452658 12823 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:35.585757  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:35.439692 12780 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.440666 12825 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.602121  9371 raft_consensus.cc:1275] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:03:35.648478  9371 pending_rounds.cc:85] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947: Aborting all ops after (but not including) 3
I20260709 13:03:35.648763  9371 pending_rounds.cc:107] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:03:35.649106  9371 raft_consensus.cc:2889] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:35.604382  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:35.439881 12882 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.168s
I20260709 13:03:35.642690  9519 raft_consensus.cc:2393] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 11: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:35.644239 12622 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.653628 12622 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:35.654731 12780 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:35.643756 12884 raft_consensus.cc:697] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:35.657936 12884 consensus_queue.cc:237] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:35.662873  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.643997 12850 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.665541 12850 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.667970 12850 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:35.669824  9323 placement_policy_util.cc:248] tablet 7260766fbe5c43b1aab09346a89d9ac6: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:03:35.574688 12865 consensus_queue.cc:260] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.678227  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:35.518266 12892 consensus_queue.cc:260] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:35.708532  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 179156us
I20260709 13:03:35.621598 12761 raft_consensus.cc:697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:35.618793 12883 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:35.712317  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 135715us
I20260709 13:03:35.714149  9519 raft_consensus.cc:1240] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:35.721684  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:35.722877  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:35.723505  9448 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:35.683429 12827 ts_tablet_manager.cc:1929] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 13:03:35.705655 12865 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:35.706779 12869 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:35.642696 12835 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.726287  9443 raft_consensus.cc:2393] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 12: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:35.682066 12882 consensus_queue.cc:1243] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 6d50f1c263264b21919230bee398022b log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:35.728680  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:35.641067 12831 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.740597  9343 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:35.646625 12618 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.744621  9522 raft_consensus.cc:1240] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:35.729604 12827 log.cc:1199] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-1-root/wals/7260766fbe5c43b1aab09346a89d9ac6
I20260709 13:03:35.719533 12883 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:35.731738 12892 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:35.752938  9523 raft_consensus.cc:2393] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 10: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:35.758538 12618 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:35.759298  9522 raft_consensus.cc:1240] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:35.760888  9522 raft_consensus.cc:1240] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:03:35.743062 12844 consensus_queue.cc:237] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.765898  9260 catalog_manager.cc:5028] TS d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): tablet 45a4f94c156249adab9c2b1ffb00ac46 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
W20260709 13:03:35.766656  9260 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 118141us
I20260709 13:03:35.778614 12825 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:35.784304 12825 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:35.754796 12841 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:35.784852 12825 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.785388 12901 consensus_queue.cc:1048] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:35.785790 12841 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:35.787863 12841 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:35.788774 12823 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.790302  9521 raft_consensus.cc:2393] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 13: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:35.791419 12823 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:35.733789 12776 consensus_queue.cc:237] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.762579  9522 raft_consensus.cc:1240] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:35.796281  9522 raft_consensus.cc:1275] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:35.802716 12761 consensus_queue.cc:237] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.810206  9448 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
W20260709 13:03:35.814688  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 177358us
I20260709 13:03:35.788441 12825 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:35.821118 12618 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:35.824216 12898 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.823982 12618 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.750010 12900 consensus_queue.cc:1048] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 13:03:35.832976 12898 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.849696 12898 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:35.854454 12618 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:35.866462 12831 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:35.828158 12827 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51006 (request call id 68) took 1597 ms. Trace:
I20260709 13:03:35.870885 12827 rpcz_store.cc:276] 0709 13:03:34.228184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.269338 (+ 41154us) service_pool.cc:224] Handling call
0709 13:03:35.280176 (+1010838us) ts_tablet_manager.cc:1151] Deleting tablet 7260766fbe5c43b1aab09346a89d9ac6
0709 13:03:35.280261 (+    85us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:03:35.425281 (+145020us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:35.647283 (+222002us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:35.821987 (+174704us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":981623}
I20260709 13:03:35.873265 12835 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:35.901537  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 161073us
I20260709 13:03:35.902566  9343 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:35.824496 12785 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.905519  9522 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:03:35.906231  9520 raft_consensus.cc:1240] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 13:03:35.908862  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 386776us
I20260709 13:03:35.910272  9490 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:35.911446  9490 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:35.911516  9343 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:35.913430  9520 raft_consensus.cc:1275] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:35.913219  9490 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:35.915486  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:35.916143  9443 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:35.916914  9490 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:35.918159  9490 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:35.919979  9490 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:35.921075  9490 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:35.929127  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:35.914917 12835 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:35.930117  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:35.930907  9448 raft_consensus.cc:2393] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 11: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
W20260709 13:03:35.929473  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.932760  9490 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:35.933908  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:35.935806  9490 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:35.912385 12898 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:35.926433 12823 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:35.926120 12844 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:35.926616 12863 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:35.931439 12913 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:35.981841 12913 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:35.926548 12872 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:35.982299 12913 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:35.955576 12835 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:35.990864 12785 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:35.957283 12846 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:35.927672 12776 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.969146 12908 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:35.992479 12776 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.980036 12781 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.993599 12781 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:35.994834 12776 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:35.996306 12781 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:35.968716  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:35.969839  9375 raft_consensus.cc:1275] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:35.997977  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:35.998564  9375 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:35.999730  9375 raft_consensus.cc:1275] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:35.969772  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:36.000813  9374 raft_consensus.cc:2393] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 10: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:35.970888  9490 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:36.001500  9323 auto_rebalancer.cc:629] Failed to schedule move for tablet 7f7d9e2ac04d41d69afab7dd1be321e2: Illegal state: Replica 925acbe78db14db3b9e4cfc857717947 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:36.002511  9490 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:35.971181  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:36.005326 12826 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:35.969290  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:36.006245  9377 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:35.928273 12618 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:35.972164  9373 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:35.928009 12836 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:36.035166 12618 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:35.975256  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.036665  9369 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:36.040143  9372 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:03:36.043210  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:36.053282  9522 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:03:36.053891  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:36.054206  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:36.054569  9519 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:03:36.043859  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:36.054324 12883 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.055481  9518 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:36.055559  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:36.055780  9448 raft_consensus.cc:1240] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:36.056387  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:35.992661 12908 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.058602  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:36.059369 12908 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:35.969372  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:36.059877  9376 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:35.967399 12831 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.060714 12831 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.031522 12846 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:36.026439 12823 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:35.934433 12825 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:03:36.050202  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.978133  9341 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:36.041973  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:36.059403  9518 raft_consensus.cc:2393] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 11: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:36.042850 12826 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:35.996696 12835 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:36.067958  9343 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:36.071748  9492 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:03:36.062645  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 84768.8us
I20260709 13:03:36.073240  9369 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:35.990725 12913 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.073493  9341 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:36.074985  9343 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:36.075749 12905 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:36.076805  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:36.077346  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:36.077571  9450 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:36.078011  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:36.078572  9445 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:36.081355  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:36.081776  9343 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:36.085127 12913 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:36.085253 12905 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:36.085738 12905 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.086069 12905 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:36.087600 12781 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.088104 12781 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.088459  9341 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:36.089293 12784 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:36.089691 12784 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.090062 12784 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:36.091785 12781 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:36.093586  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:36.097675 12784 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.099879 12784 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:36.101068  9343 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:36.101846 12892 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:36.102517 12892 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:36.102352 12905 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.103034 12892 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:36.103402  9450 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
I20260709 13:03:36.105029 12905 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:36.105775  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:36.106380  9447 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:03:36.107447 12905 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.107995 12905 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.109860  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:36.110436 12905 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:36.110762  9447 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:03:36.111117  9343 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:36.111930 12905 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:36.112401 12905 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:36.112792 12905 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:36.112903  9343 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:36.116750  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:36.110334 12892 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.120282  9447 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:36.120929 12892 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:36.121099  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.131296  9522 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
W20260709 13:03:36.132807  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:36.126272  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 54602.8us
I20260709 13:03:35.977129 12898 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.138384  9517 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:36.139560  9377 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:03:36.135802  9341 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:36.141132 12776 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:36.141674 12776 raft_consensus.cc:697] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:36.142478 12776 consensus_queue.cc:237] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.145051  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:36.145614  9525 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:36.132984  9274 catalog_manager.cc:5697] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 7 to 8, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 8 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:36.146301  9370 raft_consensus.cc:1275] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:36.140553  9341 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:36.071345 12908 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:36.148764  9517 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:03:36.128334 12844 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:03:36.155345 12883 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:36.156473 12872 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:36.122473 12622 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:36.157802  9519 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:36.071525 12846 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.163296  9343 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:36.162151  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:36.164860  9521 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:36.165776  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:36.166253  9521 raft_consensus.cc:2393] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 10: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:36.166878  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:36.167331  9524 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:36.168217  9519 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
I20260709 13:03:36.169510  9341 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:36.146384 12898 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:36.171805  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:36.173054  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:36.176401  9343 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:36.178764  9343 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:36.180114  9521 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:03:36.181068  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:36.181710  9521 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:36.162825 12622 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.184454  9343 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:36.169281 12781 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:36.164227 12892 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:36.188390  9525 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:36.188872  9521 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:36.189432  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:36.174458 12780 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:36.176993 12618 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:36.169924 12908 raft_consensus.cc:697] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:36.190196  9525 raft_consensus.cc:2393] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 10: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:36.190237  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:36.190649  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:36.191036  9343 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:36.177505 12900 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:36.187801 12838 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:36.194949  9521 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:36.183709 12837 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:36.196431  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:36.186813 12622 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:36.189601 12785 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:36.190642 12892 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.204357  9525 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:36.203254  9343 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:36.204476 12900 raft_consensus.cc:697] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:36.217993 12900 consensus_queue.cc:237] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.220456 12780 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:36.221019 12780 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:36.221499 12831 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:36.203976 12837 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.222205 12837 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:36.221720 12882 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:36.203519 12781 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:36.248678 12781 raft_consensus.cc:697] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:36.255848 12781 consensus_queue.cc:237] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.262696  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:36.259793  9274 catalog_manager.cc:5697] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 5 to 7, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New cstate: current_term: 4 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:36.262936  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:36.267208  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:36.268179  9448 raft_consensus.cc:2393] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 12: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:36.233469 12846 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:36.233469 12831 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.235837 12882 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:36.240628 12903 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:36.205713 12892 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:36.243420  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:36.279069  9522 raft_consensus.cc:2410] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 11 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 3.
I20260709 13:03:36.244374 12622 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.247587 12908 consensus_queue.cc:237] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.225709 12785 raft_consensus.cc:697] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:36.254165 12838 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:36.270574  9525 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
I20260709 13:03:36.292121  9341 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:36.279060  9376 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
W20260709 13:03:36.273124  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 44866.1us
I20260709 13:03:36.296288  9343 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:36.269309 12831 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.302556  9343 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:36.301664  9525 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:03:36.305362 12622 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:36.306258 12622 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:36.306727 12622 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.307168 12622 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:36.310581 12913 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:36.299098 12901 consensus_queue.cc:1059] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:03:36.312544 12901 raft_consensus.cc:3055] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:36.313028 12901 raft_consensus.cc:740] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:36.282346 12903 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.332242  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:36.332522  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:36.333396  9450 raft_consensus.cc:2410] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:03:36.334445  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:36.335464  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:36.335584  9446 raft_consensus.cc:1240] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:03:36.336773  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:36.337364  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:36.225529 12905 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.339048 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:36.353552  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:36.350278  9274 catalog_manager.cc:5697] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 8 to 9, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 9 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:36.339181  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:36.343777  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:36.355867  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:36.297847 12841 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:36.297387 12784 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:36.357851  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:36.406240  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:03:36.412386  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 109910us
I20260709 13:03:36.412590  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:36.413268  9443 raft_consensus.cc:3055] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:36.413388  9343 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:36.414214  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 80975.9us
I20260709 13:03:36.334409 12903 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:36.413687  9443 raft_consensus.cc:740] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:36.423611  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:36.430282 12908 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:36.430940 12908 raft_consensus.cc:697] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:36.434172  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.360383 12863 raft_consensus.cc:2764] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:03:36.446044 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 63117us
I20260709 13:03:36.406771 12618 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.406139 12922 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.449981  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:36.482254  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:03:36.484371  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 71085us
I20260709 13:03:36.485801  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:36.487758  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:36.489073  9452 raft_consensus.cc:2393] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 11: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:36.477339 12884 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.503944  9446 raft_consensus.cc:3055] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:36.504549  9446 raft_consensus.cc:740] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:36.514050  9418 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:36.419880 12901 consensus_queue.cc:260] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.519608  9448 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:36.522607  9418 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:36.474610 12780 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.505548  9446 consensus_queue.cc:260] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.491838 12913 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:36.530922  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.531831  9446 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:36.477074 12618 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.532871  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:36.542143  9418 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:36.456357 12785 consensus_queue.cc:237] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:36.566879  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.520879 12834 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:36.628244  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.664685  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:36.479703 12908 consensus_queue.cc:237] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.667420  9446 raft_consensus.cc:1275] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:03:36.673408  9446 pending_rounds.cc:85] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 3
I20260709 13:03:36.673743  9446 pending_rounds.cc:107] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:03:36.674085  9446 raft_consensus.cc:2889] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:36.675549  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:36.527572 12776 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.534927 12858 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:03:36.737663 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 61431.6us
W20260709 13:03:36.738894  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:36.740746  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.515718 12884 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.548151 12865 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:36.479153 12922 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.524370 12851 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.137s
I20260709 13:03:36.527082 12883 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.148s
I20260709 13:03:36.747848  9446 raft_consensus.cc:2393] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 11: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:36.674197 12901 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:36.757426  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 210529us
I20260709 13:03:36.524214 12761 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.201s
I20260709 13:03:36.545329 12913 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.766624  9452 raft_consensus.cc:1275] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:36.745595 12831 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:36.534724 12925 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.228s
I20260709 13:03:36.564997 12837 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.763406 12905 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:36.743413 12776 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.760263 12622 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.776610 12831 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.793695 12618 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:36.804780 12836 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.841287 12929 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:36.841552 12836 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.841917 12929 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:36.843402  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:36.843711  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:36.806684 12913 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:36.806634 12837 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:36.844700 12872 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.810159 12826 consensus_queue.cc:1048] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:36.845232 12872 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.759603 12858 consensus_queue.cc:1059] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:03:36.847277 12872 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:36.843798 12869 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.848407 12869 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.848577 12936 consensus_queue.cc:1059] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:36.849635 12858 raft_consensus.cc:3055] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:36.850008 12858 raft_consensus.cc:740] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:36.850584 12869 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:36.850809 12858 consensus_queue.cc:260] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.851994  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:36.852698  9525 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:36.855455 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:36.857882  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:36.858258 12865 consensus_queue.cc:1059] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:03:36.858528  9519 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:36.859261 12865 raft_consensus.cc:3055] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:36.858477 12929 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:36.843861 12932 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
W20260709 13:03:36.808359  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 672949us
I20260709 13:03:36.901780  9492 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:36.903566  9492 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:36.844218  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:36.859728 12865 raft_consensus.cc:740] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:36.840159 12831 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.871563  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:36.905097  9492 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:36.906467  9526 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:36.922122 12929 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:36.921948 12934 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:03:36.924037 12892 consensus_meta.cc:287] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.626s	user 0.008s	sys 0.000s
I20260709 13:03:36.926306  9343 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:36.941247 12869 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:36.941737 12892 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.942255 12834 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:36.942478 12913 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:36.943509 12865 consensus_queue.cc:260] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.944100 12913 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.944625 12913 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:36.944832 12865 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:36.941819 12869 raft_consensus.cc:697] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:36.953612  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:36.953979  9377 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:03:36.956624  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:36.958102  9368 raft_consensus.cc:2393] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 8: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:36.958931 12622 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:36.948550 12869 consensus_queue.cc:237] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.960741 12922 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:36.963835 12898 consensus_meta.cc:287] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.782s	user 0.004s	sys 0.005s
I20260709 13:03:36.964263 12898 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.931718  9518 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:36.965358 12776 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:36.947280 12892 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:36.967674 12831 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:36.931327 12932 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:36.964596  9525 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:36.843712 12836 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:36.931613 12846 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.254s
I20260709 13:03:37.186051 12932 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:37.046216  9518 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:37.009658 12929 raft_consensus.cc:697] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:37.189800 12929 consensus_queue.cc:237] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:37.011674  9377 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:37.067032  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:37.068794  9525 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:37.196563  9343 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:03:37.067394  9490 leader_election.cc:336] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.531s (SENT)
I20260709 13:03:37.197968  9490 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:37.199266  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 131924us
I20260709 13:03:37.200371 12845 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:37.155233  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.201390 12845 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.102267  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:37.202912  9368 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:36.931483 12863 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:37.188256  9443 consensus_queue.cc:260] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:37.188303  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:37.311318  9443 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:37.216015  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:37.067798  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 80904.5us
I20260709 13:03:37.347227  9341 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:37.347875 12932 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:37.183640 12882 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:37.348511 12932 raft_consensus.cc:697] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:37.350318 12932 consensus_queue.cc:237] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:37.346401  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 149900us
I20260709 13:03:37.353675  9343 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:37.355062  9343 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:37.202101 12845 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:37.357146 12831 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:37.357816 12831 raft_consensus.cc:697] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:37.311494  9376 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:37.358808 12845 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:37.358934 12831 consensus_queue.cc:237] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:37.355917 12837 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:37.362066 12892 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:36.938870 12933 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:03:37.370371  9415 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.007s	sys 0.022s
W20260709 13:03:37.372151  9415 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.008s	sys 0.022s
I20260709 13:03:37.377408 12925 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:37.378053 12925 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:37.366664 12785 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.017s	sys 0.011s
W20260709 13:03:37.381913  9524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.006s	sys 0.024s
I20260709 13:03:37.378857 12837 raft_consensus.cc:697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:37.103657 12825 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:03:37.194757 12903 consensus_meta.cc:287] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.751s	user 0.011s	sys 0.000s
W20260709 13:03:37.387748 10027 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.037s	sys 0.089s
W20260709 13:03:37.388144 10027 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.037s	sys 0.089s
I20260709 13:03:37.113112 12822 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.272s
W20260709 13:03:37.397588  9418 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.041s	sys 0.089s
W20260709 13:03:37.397974  9418 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.041s	sys 0.089s
W20260709 13:03:37.398619  9340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.023s	sys 0.020s
W20260709 13:03:37.399688  9340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.023s	sys 0.020s
I20260709 13:03:37.008737 12934 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:37.384603 12863 raft_consensus.cc:697] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:03:37.400393  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:37.399778  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 640474us
W20260709 13:03:37.406533  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:37.386034 12785 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.018s	sys 0.011s
I20260709 13:03:37.384423 12882 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.385640 12846 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:37.385074  9524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.007s	sys 0.024s
I20260709 13:03:37.407267  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:37.407732  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.423022  9376 raft_consensus.cc:1240] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:03:37.504938  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:37.506676  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.506821  9368 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
W20260709 13:03:37.507321  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.400112 12901 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.401898 12838 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:37.551903  9450 raft_consensus.cc:3055] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:37.552490  9450 raft_consensus.cc:740] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:37.553774  9450 consensus_queue.cc:260] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:37.561229  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:37.563017  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:37.564376  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:37.593411  9450 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:37.594384  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:37.396957 12903 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:37.608664 12903 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:37.404146 12836 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.153s
I20260709 13:03:37.640336  9450 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:03:37.647817  9447 raft_consensus.cc:3055] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:37.649073  9447 raft_consensus.cc:740] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:37.649585  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:37.650245  9450 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:37.661068 12946 consensus_queue.cc:1059] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:37.397157 12933 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:37.407778 12825 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:37.525321 12882 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:37.695824  9444 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:37.539093 12846 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:37.650315  9447 consensus_queue.cc:260] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:37.699946  9447 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:37.557262 12901 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:37.704352  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:37.709589  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:37.710273  9450 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:37.704383  9522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.010s	sys 0.018s
W20260709 13:03:37.712201  9522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.010s	sys 0.018s
I20260709 13:03:37.694916 12622 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.441993 12934 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:37.733122  9369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.003s	sys 0.025s
W20260709 13:03:37.733778  9369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.004s	sys 0.026s
W20260709 13:03:37.742595  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:37.743747  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.750841  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:37.785485  9443 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:37.714941 12863 consensus_queue.cc:237] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:37.792821  9443 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51016 (request call id 1431) took 1452 ms (client timeout 1927 ms). Trace:
I20260709 13:03:37.670886 12837 consensus_queue.cc:237] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:37.800998  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:37.793813  9443 rpcz_store.cc:269] 0709 13:03:36.333779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.333899 (+   120us) service_pool.cc:224] Handling call
0709 13:03:36.780457 (+446558us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4c00442400. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb584836a20 00007fb584847a29 00007fb58480d644 00007fb584834f2d 00007fb584834b93 00007fb58656518b 00007fb586565cb5 00007fb586560f30 00007fb5865627de 00007fb58656e27c 00007fb58b52fb17
0709 13:03:37.187808 (+407351us) spinlock_profiling.cc:243] Waited 70.5 ms on lock 0x7b540045ac20. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5864e806f 00007fb586560f60 00007fb5865627de 00007fb58656e27c 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2
0709 13:03:37.786513 (+598705us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190546560}
I20260709 13:03:37.734030 12845 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:37.814786 12925 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:37.826303 12934 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:37.831743  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:37.839918  9448 raft_consensus.cc:2393] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 9: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
W20260709 13:03:37.844677  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 460568us
I20260709 13:03:37.848021  9492 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:37.727382 12622 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:37.853690 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 465015us
I20260709 13:03:37.852540  9492 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:37.859634  9450 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
W20260709 13:03:37.867604  9521 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.027s	sys 0.031s
W20260709 13:03:37.868184  9521 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.027s	sys 0.031s
W20260709 13:03:37.881404  9490 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.010s	sys 0.043s
W20260709 13:03:37.888398  9490 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.010s	sys 0.043s
W20260709 13:03:37.888994  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.889942 12929 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:37.890118  9492 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:03:37.890552  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.893838  9373 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:37.818521 12845 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:37.853801 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:03:37.889127  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 684619us
I20260709 13:03:37.865234 12934 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:37.904093  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:37.920897  9520 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:37.905189  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:37.922281  9377 raft_consensus.cc:2393] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 11: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:37.906078  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:37.922974  9518 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:37.906078  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:37.891036  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 483817us
I20260709 13:03:37.908165  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:37.925081  9526 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:37.910112  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:37.925974  9523 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
W20260709 13:03:37.914040  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:37.928253 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 50286.4us
I20260709 13:03:37.887012 12949 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.924285  9375 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 2.
I20260709 13:03:37.890604 12929 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:37.949388 12942 log.cc:927] Time spent T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:03:37.951610  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:37.991056  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.920624 12934 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:38.006903  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.970331 12929 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:38.046198  9274 catalog_manager.cc:5697] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 6 to 7, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 7 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:36.406692  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:37.996731 12951 log.cc:927] Time spent T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
W20260709 13:03:38.049496 12945 log.cc:927] Time spent T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:03:38.050565  9370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 1487) took 1100 ms. Trace:
I20260709 13:03:38.051090  9370 rpcz_store.cc:276] 0709 13:03:36.950458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.955364 (+  4906us) service_pool.cc:224] Handling call
0709 13:03:36.955827 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:36.956251 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.956290 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:36.956851 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 13:03:37.400864 (+444013us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:37.400904 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.400972 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:38.050280 (+649308us) raft_consensus.cc:1685] finished
0709 13:03:38.050308 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.050480 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3367,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":443523,"threads_started":1,"wal-append.queue_time_us":653908}
I20260709 13:03:38.054991 12929 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:37.935247 12822 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:38.061367 12822 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.061928 12822 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:38.062038  9369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 1491) took 1104 ms. Trace:
I20260709 13:03:38.062520  9369 rpcz_store.cc:276] 0709 13:03:36.957394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.968392 (+ 10998us) service_pool.cc:224] Handling call
0709 13:03:36.968820 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:36.969362 (+   542us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.969404 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:36.969945 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:03:37.744952 (+775007us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:37.745029 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.745118 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:38.061797 (+316679us) raft_consensus.cc:1685] finished
0709 13:03:38.061822 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.061975 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1915,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":57098,"thread_start_us":774397,"threads_started":1,"wal-append.queue_time_us":994114}
I20260709 13:03:38.065552 12934 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:38.067984 12865 consensus_meta.cc:287] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 1.122s	user 0.009s	sys 0.007s
I20260709 13:03:38.068897  9449 raft_consensus.cc:2410] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:03:38.069824 12845 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:38.070851  9522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1949) took 1213 ms. Trace:
W20260709 13:03:38.040428 12944 log.cc:927] Time spent T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.347s	user 0.003s	sys 0.005s
I20260709 13:03:37.999897 12825 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:37.996518 12901 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:38.073750  9521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1929) took 1990 ms. Trace:
W20260709 13:03:38.076655  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.003430 12949 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:37.963562 12948 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:03:38.041468  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.041911 12961 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:38.082032 12948 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:38.071246  9522 rpcz_store.cc:276] 0709 13:03:36.857767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.867183 (+  9416us) service_pool.cc:224] Handling call
0709 13:03:36.867589 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:36.900220 (+ 32631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.900258 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:36.921503 (+ 21245us) log.cc:844] Serialized 26 byte log entry
0709 13:03:37.191767 (+270264us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b18003983e0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58345fe07 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b 00007fb586109d23 00007fb58610a0d1 00007fb586525a0f
0709 13:03:37.712572 (+520805us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:37.712615 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.712685 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:38.070578 (+357893us) raft_consensus.cc:1685] finished
0709 13:03:38.070598 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.070795 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32116,"raft.queue_time_us":32734,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":2594560,"thread_start_us":520584,"threads_started":1,"wal-append.queue_time_us":1014526}
W20260709 13:03:38.088267  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:38.041034  9371 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.007s	sys 0.037s
W20260709 13:03:38.091593  9371 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.008s	sys 0.037s
I20260709 13:03:38.095165  9371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 1494) took 1117 ms. Trace:
I20260709 13:03:38.101670  9520 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:03:38.074488  9521 rpcz_store.cc:276] 0709 13:03:36.083218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.203693 (+120475us) service_pool.cc:224] Handling call
0709 13:03:36.204068 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:36.816773 (+612705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.816807 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:36.817291 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:03:37.150689 (+333398us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:37.879549 (+728860us) log.cc:844] Serialized 14 byte log entry
0709 13:03:37.889773 (+ 10224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.889914 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:38.073497 (+183583us) raft_consensus.cc:1685] finished
0709 13:03:38.073523 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.073678 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":622256,"prepare.queue_time_us":916703,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":625058,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":3863,"thread_start_us":848804,"threads_started":2,"wal-append.queue_time_us":750606}
I20260709 13:03:38.045490 12882 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:38.105042 12961 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:38.075913 12962 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:03:38.105755 12961 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:38.101022  9371 rpcz_store.cc:276] 0709 13:03:36.977890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.009097 (+ 31207us) service_pool.cc:224] Handling call
0709 13:03:37.187781 (+178684us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:37.193283 (+  5502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:37.193317 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:37.193756 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:03:38.094716 (+900960us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:38.094784 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.094868 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:38.094919 (+    51us) raft_consensus.cc:1685] finished
0709 13:03:38.094931 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.095088 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4813,"raft.queue_time_us":4943,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":900436,"threads_started":1,"wal-append.queue_time_us":871815}
W20260709 13:03:38.119686  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 172015us
I20260709 13:03:38.068645 12865 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:38.125466  9343 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:38.127914  9343 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:03:38.121551  9490 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.895s (SENT) [suppressed 30 similar messages]
I20260709 13:03:38.121439  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:38.133937  9371 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:38.138095 12901 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:38.138576 12901 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.138949 12901 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:38.141094 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:38.141484 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:38.143327 12784 raft_consensus.cc:2804] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:38.143783 12784 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.144141 12784 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:38.123781 12960 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.146796 12960 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:38.148729 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 217885us
I20260709 13:03:38.150489 12949 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:38.112567 12913 consensus_meta.cc:287] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 1.167s	user 0.011s	sys 0.003s
I20260709 13:03:38.084303 12933 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:03:38.155100  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 230560us
W20260709 13:03:38.156030  9490 leader_election.cc:336] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.934s (SENT)
I20260709 13:03:38.111680 12846 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:38.130668  9343 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:38.184427  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:38.188170  9451 raft_consensus.cc:3055] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:38.188755  9451 raft_consensus.cc:740] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:38.166193 12961 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:38.165221 12825 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:38.193415  9451 consensus_queue.cc:260] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.152727 12865 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:38.172703 12845 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:38.159778 12913 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.176661 12892 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:38.289499 12958 consensus_queue.cc:1059] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.173s
I20260709 13:03:38.207520 12933 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.325241  9451 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:38.242935  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 80130.3us
I20260709 13:03:38.241943  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:38.335170  9376 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:38.309437 12973 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.211284  9343 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:03:38.207547  9490 leader_election.cc:336] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.511s (SENT)
I20260709 13:03:38.325218 12929 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:38.308391 12948 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:38.313632 12960 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:38.337497 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 154243us
I20260709 13:03:38.256880 12961 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:38.318250 12974 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:38.345698  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 138177us
W20260709 13:03:38.348992  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 137812us
I20260709 13:03:38.352067 12934 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.354524 12913 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:38.355341 12979 raft_consensus.cc:3055] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:38.328115 12825 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.410005  9492 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:03:38.243569 12846 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.330385 12892 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:38.366794  9418 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
W20260709 13:03:38.416445  9418 raft_consensus.cc:2686] T 7260766fbe5c43b1aab09346a89d9ac6 P d62c9d5a052b42ce8675f8438f846526: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:03:38.416936  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 50272.2us
I20260709 13:03:38.418740  9418 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:38.420405  9376 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:38.320849 12901 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.376966  9524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1932) took 2288 ms. Trace:
I20260709 13:03:38.369514 12961 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:38.389097 12972 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:03:38.391314 12965 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:38.370402 12929 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:03:38.395740  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.428615 12865 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:38.397547 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:38.364799 12963 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:38.398742 12948 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.399631 12858 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:38.358163 12973 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.401772 12960 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:38.373525 12949 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 13:03:38.397601 12923 log.cc:927] Time spent T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 1.965s	user 0.029s	sys 0.048s
I20260709 13:03:38.334641 12933 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.495716  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:38.341777 12845 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.413820  9525 raft_consensus.cc:2393] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 11: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:38.242589 12622 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:38.422300  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:38.422953 12846 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.408548 12958 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:38.428211 12876 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:38.374657 12974 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:38.429078 12784 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.429845 12892 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:38.436187 12934 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:38.449496  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:38.450977  9369 raft_consensus.cc:1240] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:38.550155  9373 raft_consensus.cc:2393] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 12: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:38.452376  9521 raft_consensus.cc:1240] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:03:38.453562  9520 raft_consensus.cc:1217] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Deduplicated request from leader. Original: 5.4->[6.5-10.7]   Dedup: 6.5->[8.6-10.7]
I20260709 13:03:38.550858  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:38.454977  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.551218  9520 raft_consensus.cc:1240] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 10. Current term is 11. Ops: [6.5-10.7]
I20260709 13:03:38.551499  9369 raft_consensus.cc:1813] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Handling vote request from an unknown peer d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:38.551630  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:38.552124  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.552145  9369 raft_consensus.cc:2410] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:03:38.457437  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.396106 12822 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.458505  9522 raft_consensus.cc:1240] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 11. Ops: []
I20260709 13:03:38.553481  9369 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:03:38.406188 12979 raft_consensus.cc:740] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:38.461788  9451 raft_consensus.cc:1275] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:03:38.578714  9451 pending_rounds.cc:85] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 5
I20260709 13:03:38.579044  9451 pending_rounds.cc:107] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:03:38.579560  9451 raft_consensus.cc:2889] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:38.580549  9451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 1450) took 2087 ms. Trace:
I20260709 13:03:38.441685  9524 rpcz_store.cc:276] 0709 13:03:36.088414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.266030 (+177616us) service_pool.cc:224] Handling call
0709 13:03:36.266397 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:36.818451 (+552054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.818482 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:36.818928 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:03:37.505993 (+687065us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:38.084392 (+578399us) log.cc:844] Serialized 14 byte log entry
0709 13:03:38.376255 (+291863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.376332 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:38.376703 (+   371us) raft_consensus.cc:1685] finished
0709 13:03:38.376720 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.376902 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":642915,"prepare.queue_time_us":561628,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":680729,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":44900,"thread_start_us":1382682,"threads_started":3,"wal-append.queue_time_us":953951}
I20260709 13:03:38.492059  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:38.582290  9526 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:38.436250 12825 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:38.497218  9377 raft_consensus.cc:1240] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:38.586081 12979 consensus_queue.cc:260] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.502127  9518 raft_consensus.cc:1275] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:03:38.587383 12979 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:38.528925  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.544423  9368 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: []
W20260709 13:03:38.553169  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.589824  9373 raft_consensus.cc:1240] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:03:38.589864  9369 raft_consensus.cc:1240] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 7. Current term is 8. Ops: []
W20260709 13:03:38.590626  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:38.550832  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.462337 12965 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.587374  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:38.591411  9451 rpcz_store.cc:276] 0709 13:03:36.493317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.493423 (+   106us) service_pool.cc:224] Handling call
0709 13:03:36.526792 (+ 33369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.188030 (+1661238us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54000fb520. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5864e1dc0 00007fb58656c1c0 00007fb58656d231 00007fb586569d8f 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c
0709 13:03:38.580183 (+392153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.580462 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":558034176}
W20260709 13:03:38.593436  9418 connection.cc:256] RPC call timeout handler was delayed by -1.3974911379999639s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
I20260709 13:03:38.593586 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:03:38.595472  9418 connection.cc:256] RPC call timeout handler was delayed by -1.0914911380000376s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
I20260709 13:03:38.494014 12929 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:38.602425  9370 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:38.541280 12985 raft_consensus.cc:2804] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:38.599109  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:38.600188  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:38.602319  9526 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:38.596436  9376 raft_consensus.cc:1240] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:38.505796 12948 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.598654  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:03:38.611797  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.613442  9451 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:38.613785  9444 raft_consensus.cc:3055] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:38.614696  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:38.578436 12876 raft_consensus.cc:697] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:38.614161  9444 raft_consensus.cc:740] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:38.593236 12622 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
W20260709 13:03:38.621240  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 71692.8us
I20260709 13:03:38.617839  9452 consensus_queue.cc:237] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:03:38.622097  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:38.624944  9443 raft_consensus.cc:2410] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:03:38.625344 12992 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:38.625089 12851 consensus_queue.cc:1048] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:38.625985 12992 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.627686 12961 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:38.628150 12784 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:38.611575 12921 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.629024 12784 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.597664 12934 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:38.544024 12978 consensus_queue.cc:1059] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.149s
I20260709 13:03:38.628216 12845 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:38.601676 12834 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:38.539208 12963 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:38.622889  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:38.619511  9444 consensus_queue.cc:260] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.637054  9444 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:38.633056 12622 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.637863 12834 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.623570 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:38.639410 12622 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:38.601445 12865 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:38.548353 12958 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.629540 12784 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.604415 12985 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:38.639828 12834 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:38.653522  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:38.654616  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.654470  9368 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:38.620887 12949 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.629251 12921 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:38.661271  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.630069 12946 consensus_queue.cc:1059] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:03:38.648590 12978 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.668234 12901 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:38.673940  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:38.635859 12934 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:38.656059 12985 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:38.683955  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:38.689327  9518 raft_consensus.cc:1813] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Handling vote request from an unknown peer d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:38.690034  9518 raft_consensus.cc:2410] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:03:38.689941  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 278651us
I20260709 13:03:38.690572 12995 raft_consensus.cc:3055] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:38.688066  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:38.688632  9523 raft_consensus.cc:1240] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:38.648821 12865 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.685775  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:38.691485  9492 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:38.693873  9520 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:38.701694  9524 raft_consensus.cc:1240] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 10. Ops: []
I20260709 13:03:38.702327  9368 raft_consensus.cc:1240] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:03:38.662314 12949 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.682807 12846 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:38.691054 12995 raft_consensus.cc:740] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:38.710929 12969 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:38.711580 12969 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.712525 12846 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:38.712968 12846 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:38.713181 12981 log.cc:927] Time spent T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:03:38.713496 12846 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:38.713959 12969 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:38.700701 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:38.680862 12978 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.722467  9368 raft_consensus.cc:1240] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 11. Ops: [9.4-9.4]
W20260709 13:03:38.732221  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 114105us
I20260709 13:03:38.733942  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:38.734776  9519 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:38.747318  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:38.748010  9519 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:38.735495  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:38.737325  9523 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:03:38.749074  9520 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:38.739012  9521 raft_consensus.cc:1275] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:03:38.740617  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:38.756187  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:38.757201  9517 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:03:38.742995  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:38.759115  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:38.756356  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:38.760465  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:38.760740  9523 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:38.760812  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:38.761588  9521 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:38.761665  9517 raft_consensus.cc:2410] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:03:38.768796  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:38.769420  9520 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:38.708920 12973 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:38.746208 12986 log.cc:927] Time spent T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:03:38.769587  9518 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:38.679733 12876 consensus_queue.cc:237] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.783631  9526 raft_consensus.cc:1240] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:38.786512  9368 raft_consensus.cc:1240] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 7. Current term is 9. Ops: []
I20260709 13:03:38.787335  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:38.791810  9519 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
W20260709 13:03:38.802511  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.753687 12822 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:38.806877  9375 raft_consensus.cc:1240] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:38.806922  9368 raft_consensus.cc:1240] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:38.809100  9521 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:38.760656 12960 raft_consensus.cc:697] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:38.821321 12929 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:38.823118 12988 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:38.821662 12958 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:38.833526  9368 raft_consensus.cc:1240] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:38.835045 12822 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:38.847615 13006 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.848116 13006 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.847625 12822 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.850615 13006 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:38.851076 12822 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:38.851394 12963 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:38.852262  9343 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:38.846988 12883 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:38.813512 12948 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:38.821451 12992 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:38.859737  9343 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:03:38.810530 12865 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:38.864611  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 59492.5us
I20260709 13:03:38.856817  9523 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:38.870864  9343 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:38.897210  9418 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:38.886562  9343 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:38.907842  9343 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:38.844807 12974 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:38.857544 12784 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:38.861227 12822 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:38.918373  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 286943us
I20260709 13:03:38.870237 12837 consensus_queue.cc:1048] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:03:38.871129 12948 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:38.852732 12958 consensus_queue.cc:1048] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:03:38.932591 13009 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:38.862157 12883 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:38.909917 12973 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:38.858860 12892 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.860834 12963 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:03:38.933732 12993 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:38.916051 12934 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:38.895908 12988 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:03:38.911520 12865 consensus_queue.cc:1048] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
W20260709 13:03:38.964042 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 271866us
W20260709 13:03:38.966970  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 69834.9us
I20260709 13:03:38.919999 12822 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.949992 12921 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:38.953466 12949 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:38.952225 12973 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:38.997761 12973 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:39.003474 12978 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:38.986618 12999 consensus_queue.cc:1059] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:03:38.995102 13010 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:03:38.997146 12997 log.cc:927] Time spent T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.268s	user 0.002s	sys 0.000s
I20260709 13:03:38.997447 13013 consensus_queue.cc:1059] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:03:38.956606 12993 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.914214 12960 consensus_queue.cc:237] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:38.964699 13009 raft_consensus.cc:697] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:39.035039  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.968932 12934 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:39.041388  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 133607us
W20260709 13:03:39.066668  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 98560.1us
I20260709 13:03:39.049649 13010 raft_consensus.cc:697] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:39.057628  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:38.995157 13000 log.cc:927] Time spent T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:03:39.064281  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:39.069293  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:39.065847  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:39.042392  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 103722us
I20260709 13:03:39.029125 12921 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:39.076309  9341 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:39.066958  9343 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:39.029873 12994 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:38.965277 12948 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:03:39.066605 13013 consensus_queue.cc:1243] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 6d50f1c263264b21919230bee398022b log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:03:39.106212 13013 consensus_queue.cc:1048] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:39.088707  9343 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:39.112787  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:39.112936  9517 raft_consensus.cc:1275] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:39.114674  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:39.115545  9520 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
W20260709 13:03:39.088161  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 396705us
I20260709 13:03:39.058290 12993 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:39.091158 13020 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:03:39.091311 12983 log.cc:927] Time spent T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e: Append to log took a long time: real 0.274s	user 0.002s	sys 0.000s
W20260709 13:03:39.091737  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.067850 13010 consensus_queue.cc:237] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:39.082976 13007 consensus_queue.cc:1059] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.230s
I20260709 13:03:39.095350 13015 raft_consensus.cc:3055] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:39.073508 12934 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:39.099083 12994 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:39.070294 12999 consensus_queue.cc:1059] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:03:39.100405 13004 log.cc:927] Time spent T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:03:39.101095 13009 consensus_queue.cc:237] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:39.017158 13003 consensus_queue.cc:1059] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.277s
I20260709 13:03:39.103060 12822 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:39.104323 12973 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:39.105299 12921 consensus_queue.cc:1059] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:03:39.159439  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.159065  9492 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:39.134385 12837 raft_consensus.cc:2804] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:03:39.183326  9446 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 2378) took 2513 ms (client timeout 2086 ms). Trace:
I20260709 13:03:39.162640 13015 raft_consensus.cc:740] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:03:39.183928  9446 rpcz_store.cc:269] 0709 13:03:36.664057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.675219 (+ 11162us) service_pool.cc:224] Handling call
0709 13:03:39.177656 (+2502437us) spinlock_profiling.cc:243] Waited 71.3 ms on lock 0x7b540012b954. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:39.177825 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164034432}
I20260709 13:03:39.169431 12883 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:39.088567 12998 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
W20260709 13:03:39.194840  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 118721us
I20260709 13:03:39.177316 12784 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:39.165277 12846 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:39.201514  9418 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:39.210659  9371 raft_consensus.cc:1240] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 11. Current term is 12. Ops: []
W20260709 13:03:39.208997  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 76790.9us
I20260709 13:03:39.187546 12837 raft_consensus.cc:697] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:39.203006 13025 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:39.205801 13023 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.236159  9418 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:39.240005  9418 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:39.243410 13020 raft_consensus.cc:697] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:39.244396 13020 consensus_queue.cc:237] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:39.247026  9343 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:39.247876 12948 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:39.248262 12948 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.248610 12948 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:39.254199  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:39.255102  9519 raft_consensus.cc:2368] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 9. Current term is 10.
I20260709 13:03:39.216271 13007 raft_consensus.cc:3055] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:39.228504 12784 raft_consensus.cc:697] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:39.275399 12837 consensus_queue.cc:237] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:39.391667 10024 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.003s	sys 0.007s
W20260709 13:03:39.490526  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 414273us
W20260709 13:03:39.371991  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 132051us
I20260709 13:03:39.284750  9343 leader_election.cc:400] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 9. Current term is 10.
I20260709 13:03:39.228785 12892 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:39.537081  9343 leader_election.cc:403] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:03:39.537083 10024 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.012s	sys 0.013s
I20260709 13:03:39.544409 12934 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:39.545359 12921 consensus_queue.cc:1243] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 6d50f1c263264b21919230bee398022b log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:39.546761 12846 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:39.277323 12960 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.514911 13007 raft_consensus.cc:740] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:39.231088 12900 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.317s
I20260709 13:03:39.376638 13025 raft_consensus.cc:697] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:39.285470 13023 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:39.568171  9446 raft_consensus.cc:3055] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:39.589735  9446 raft_consensus.cc:740] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:39.590265  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:39.590569  9446 consensus_queue.cc:260] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:39.592002  9446 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:39.571398  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:39.572235  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:39.572566  9452 raft_consensus.cc:3055] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:39.594684  9452 raft_consensus.cc:740] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:03:39.439585 13019 log.cc:927] Time spent T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:03:39.393772 13017 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:39.594785  9451 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:39.597195  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:39.598538  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:39.601200  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.608108  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:39.608300  9443 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:03:39.611054  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:39.614670  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:39.622298  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.584290 12921 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:39.597311  9452 consensus_queue.cc:260] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:39.627766  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:39.628232  9452 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:39.569674 12892 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:39.628674  9444 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:39.577191 12934 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:39.578677 12998 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:39.633121 12900 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:39.637537  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:03:39.609144 12979 consensus_meta.cc:287] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 1.021s	user 0.016s	sys 0.000s
W20260709 13:03:39.633965  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 71250.7us
I20260709 13:03:39.637374  9446 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:03:39.642378  9446 pending_rounds.cc:85] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 6
W20260709 13:03:39.633548 12869 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.671s	user 0.029s	sys 0.019s
W20260709 13:03:39.634265  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 355878us
I20260709 13:03:39.643975  9446 pending_rounds.cc:107] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:03:39.577139 12960 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:39.646597  9446 raft_consensus.cc:2889] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:39.612341 12973 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:39.666276  9444 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:39.321265 13015 consensus_queue.cc:260] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:39.677403 13015 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:39.642449  9341 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:39.685246  9341 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:39.686931  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:39.687528  9444 raft_consensus.cc:2368] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11.
I20260709 13:03:39.645862 12876 consensus_queue.cc:1059] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:03:39.682427 12979 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.689318  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:39.690708  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:03:39.646341 12869 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.683s	user 0.030s	sys 0.019s
W20260709 13:03:39.682024 12858 consensus_meta.cc:287] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 1.188s	user 0.000s	sys 0.014s
I20260709 13:03:39.640843 12892 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:39.704636 12961 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.707101 12961 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:39.707672 12892 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:03:39.708690 12993 consensus_meta.cc:287] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.005s
I20260709 13:03:39.708945  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:39.709120 12993 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:39.709782 13028 log.cc:927] Time spent T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:03:39.710518  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:39.711154  9444 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:03:39.711292 12993 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:39.711462 13037 log.cc:927] Time spent T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:03:39.712036  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:39.712656 13023 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:39.681433 13040 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:39.714701  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:39.647742 12971 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:39.682575 12921 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:39.684824 12994 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:39.643541 12934 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:39.713625 12858 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:39.639986 12784 consensus_queue.cc:237] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:39.617553 13017 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:39.722608  9447 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
W20260709 13:03:39.716622 13038 log.cc:927] Time spent T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:03:39.733426  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:39.747845  9444 raft_consensus.cc:2410] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:03:39.754446  9452 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:03:39.755201  9452 pending_rounds.cc:85] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 5
I20260709 13:03:39.755589  9452 pending_rounds.cc:107] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:03:39.755967  9452 raft_consensus.cc:2889] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:39.763011 13036 raft_consensus.cc:3055] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:39.763541 13036 raft_consensus.cc:740] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:39.720507 13040 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:39.730608 13029 log.cc:927] Time spent T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.399s	user 0.000s	sys 0.001s
I20260709 13:03:39.696630 12979 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:39.648001 12998 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:39.780813  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:39.785158  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.797832  9443 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:39.723282 12876 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.802966 12998 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:39.805256 12922 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:39.805904 12892 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:03:39.791445 13022 log.cc:927] Time spent T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
I20260709 13:03:39.763245 12971 raft_consensus.cc:697] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:03:39.790705 12985 consensus_meta.cc:287] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 1.084s	user 0.012s	sys 0.002s
I20260709 13:03:39.817447 13049 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:39.690021 13007 consensus_queue.cc:260] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:39.824286 12927 log.cc:927] Time spent T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 3.330s	user 0.028s	sys 0.023s
I20260709 13:03:39.730057 12921 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:39.832379  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:39.742441 12858 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:39.799600 13040 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:39.830982  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:39.768726  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:39.761495 12948 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:39.851477  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:39.853252  9445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 1433) took 3518 ms. Trace:
I20260709 13:03:39.821134 12876 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:39.857568  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:39.858330  9445 rpcz_store.cc:276] 0709 13:03:36.334401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.334553 (+   152us) service_pool.cc:224] Handling call
0709 13:03:36.339154 (+  4601us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:36.339567 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.339596 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:36.340188 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:03:36.418329 (+ 78141us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:36.418542 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.419119 (+   577us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:39.823458 (+3404339us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:39.852909 (+ 29451us) raft_consensus.cc:1685] finished
0709 13:03:39.852933 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.853168 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1465,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":123,"spinlock_wait_cycles":686305024,"thread_start_us":76864,"threads_started":1,"wal-append.queue_time_us":97089}
I20260709 13:03:39.854008 12921 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:39.867654 12780 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:39.868382 12876 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:39.703038 13025 consensus_queue.cc:237] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:39.875000  9447 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:03:39.829835 12985 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:39.879611  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:39.886719  9452 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:39.889595 12979 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:39.884439 12884 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:39.874333 12960 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:39.881403  9446 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:39.894148 12898 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:39.896689 13052 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:03:39.899349 12858 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:39.900638 12934 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:39.835209 13049 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:39.895357 13017 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:39.914263  9445 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:03:39.916239  9447 raft_consensus.cc:3055] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:39.940882  9447 raft_consensus.cc:740] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:39.942122  9447 consensus_queue.cc:260] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:39.944573  9447 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:39.948995  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:39.928138  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 243016us
I20260709 13:03:39.929364 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:39.933183 12985 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:39.962934  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:39.963657  9524 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:39.978188 13026 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:03:39.979378 13049 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:39.903935 12971 consensus_queue.cc:237] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:39.986605 12961 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:39.992303 12948 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:38.465600  9260 catalog_manager.cc:5028] TS d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): tablet 7260766fbe5c43b1aab09346a89d9ac6 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:03:39.997123  9524 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:03:40.000103  9341 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:39.993034 12900 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 9. Current term is 10.
I20260709 13:03:40.002033  9341 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:39.999840  9260 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 1.53684e+06us
I20260709 13:03:40.001951 12977 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:03:39.919145 13036 consensus_queue.cc:260] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:39.987931 13040 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:40.005306 12948 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:40.019771 12999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.008s	sys 0.015s
W20260709 13:03:40.036020 12999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.009s	sys 0.015s
W20260709 13:03:40.038677  9370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52548 (request call id 1600) took 1577 ms (client timeout 1522 ms). Trace:
W20260709 13:03:40.051621  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.100497 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
W20260709 13:03:40.101555  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.101758 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:03:40.041205  9370 rpcz_store.cc:269] 0709 13:03:38.461062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.461245 (+   183us) service_pool.cc:224] Handling call
0709 13:03:40.038393 (+1577148us) spinlock_profiling.cc:243] Waited 44.9 ms on lock 0x7b5400384d54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:40.038575 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103310720}
I20260709 13:03:40.102419 12968 raft_consensus.cc:3055] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:40.102819 12968 raft_consensus.cc:740] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:40.103849 12968 consensus_queue.cc:260] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:40.112305  9525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46894 (request call id 1955) took 2207 ms (client timeout 2654 ms). Trace:
W20260709 13:03:40.115275  9525 rpcz_store.cc:269] 0709 13:03:37.904778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.905168 (+   390us) service_pool.cc:224] Handling call
0709 13:03:40.112088 (+2206920us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b54004961d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:40.112241 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":855791872}
I20260709 13:03:40.085230  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:40.037314  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 383717us
I20260709 13:03:40.079843 13024 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:40.089633  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:40.035674 13036 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:40.034006 12963 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:40.096408 12834 raft_consensus.cc:3055] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:03:40.125674  9490 leader_election.cc:336] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.745s (SENT)
I20260709 13:03:40.179848  9447 raft_consensus.cc:3055] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:03:40.179886  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 54274.9us
I20260709 13:03:40.180763  9447 raft_consensus.cc:740] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:03:40.181257  9490 leader_election.cc:336] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.757s (SENT)
W20260709 13:03:40.182296  9490 leader_election.cc:336] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.895s (SENT)
I20260709 13:03:40.112515  9522 raft_consensus.cc:1240] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 10. Current term is 11. Ops: []
W20260709 13:03:40.173211  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 50612.4us
W20260709 13:03:40.113415  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 95628.4us
I20260709 13:03:40.177762  9452 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:40.112571 13040 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:40.193517  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:40.194180  9444 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:03:40.195397  9447 consensus_queue.cc:260] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:40.196664  9447 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:40.182772  9490 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:40.198520  9490 leader_election.cc:336] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.927s (SENT)
I20260709 13:03:40.199169  9490 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:40.199288  9343 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:40.104969 12968 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:40.105417 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:40.200587  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:40.202813 12964 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:40.203151  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.207587  9452 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:40.178846 12834 raft_consensus.cc:740] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:40.218044  9448 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:40.221242  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:40.223601  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:40.188673 13011 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:40.228971  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:40.229245 12834 consensus_queue.cc:260] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:40.246765  9525 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:40.246584 13011 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:40.231179 12985 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:40.247831 12985 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:40.250140 12985 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:40.231590  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:40.184266 12963 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:40.251010  9452 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:03:40.252113  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:40.252710  9452 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:40.234086  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:40.200979 12999 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:40.204321 13025 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:40.247164 12834 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:40.211120 12932 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:40.256879  9518 raft_consensus.cc:2468] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:03:40.263793  9525 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:40.230839  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:40.269711 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:40.190018 12837 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:40.216800 13002 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:40.252621 12963 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:40.183732 13024 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:40.384158  9374 raft_consensus.cc:1240] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:40.295611  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:40.295882  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:40.826107  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.826272  9523 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:03:40.826629  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.398301  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:40.398077  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:40.295251  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:40.827445  9445 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:03:40.827769  9444 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:40.383814  9452 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:40.328392  9524 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:40.328930  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:40.396838  9447 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
W20260709 13:03:40.830024  9341 connection.cc:256] RPC call timeout handler was delayed by -1.3976836889999049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
I20260709 13:03:40.831233  9521 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:40.831808  9447 pending_rounds.cc:85] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 7
I20260709 13:03:40.832226  9447 pending_rounds.cc:107] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:03:40.254977 12784 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:40.837401  9447 raft_consensus.cc:2889] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:40.417047 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:40.416657 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:40.416461 10065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:40.838270  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:03:40.833971  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:40.550344 13070 log.cc:927] Time spent T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.124s	user 0.002s	sys 0.000s
I20260709 13:03:40.863687  9452 raft_consensus.cc:2393] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 9: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
W20260709 13:03:40.654778 13067 log.cc:927] Time spent T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:03:40.838353  9489 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.000s	sys 0.024s
I20260709 13:03:40.864255 10067 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
W20260709 13:03:40.867662  9489 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.004s	sys 0.029s
I20260709 13:03:40.379159 13007 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:40.277978 12934 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.873353  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:40.865273  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:40.865840  9523 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
W20260709 13:03:40.838438 13020 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.011s	sys 0.015s
I20260709 13:03:40.397660 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:40.870867  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:40.869879  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:40.837689 13011 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:40.280331 12985 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.354000 13025 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:40.275622 12999 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:40.486428 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:40.861043 12932 raft_consensus.cc:697] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:40.378715 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:40.417769 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:03:40.876339 13020 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.011s	sys 0.016s
I20260709 13:03:40.252660 12995 consensus_queue.cc:260] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:40.875854 13002 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:40.861141 12784 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:40.929701 12822 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:40.839251 12837 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:40.881035 12934 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:40.945799 13049 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.032s	sys 0.076s
I20260709 13:03:40.972661 12999 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:40.973599 12932 consensus_queue.cc:237] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:40.952544 12995 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:40.936879 12985 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:40.967512 13049 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.032s	sys 0.077s
I20260709 13:03:40.939221 13025 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:40.951333 13002 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:40.979488 13076 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.981227 13024 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:40.990494 13076 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:40.994501 13076 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:41.022941  9417 consensus_peers.cc:597] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7f6a0746767b404997bb10c4d3ecd42c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:40.871752  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:41.027678  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:41.030869  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:41.022727  9341 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.8.4.126:34725, user_credentials={real_user=slave}} blocked reactor thread for 154949us
I20260709 13:03:41.033421  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:41.034821  9444 raft_consensus.cc:2468] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 3.
I20260709 13:03:41.036964  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:41.038388  9444 raft_consensus.cc:2468] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:03:41.040393  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:41.041782  9444 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:03:41.043795  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:40.874819  9445 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:40.878885  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:41.045890  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:41.046484  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:41.047010  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:41.047088  9448 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:41.047575  9445 raft_consensus.cc:2376] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11. Re-sending same reply.
I20260709 13:03:40.877631  9447 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:41.049057  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:41.050088  9452 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:03:41.051431  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:41.053403  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:41.054286  9452 raft_consensus.cc:2376] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11. Re-sending same reply.
I20260709 13:03:41.056123  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:41.057229  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:41.059305  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:41.060469  9445 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:03:41.062065  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:03:41.040998  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:41.068885  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 553802us
W20260709 13:03:41.069737  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:41.070428  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:41.070942  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:41.071659  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.073552  9520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 1998) took 1118 ms. Trace:
I20260709 13:03:41.074126  9520 rpcz_store.cc:276] 0709 13:03:39.954908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.955113 (+   205us) service_pool.cc:224] Handling call
0709 13:03:39.955520 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:39.962675 (+  7155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.962723 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:39.963270 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:03:40.182289 (+219019us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:40.182340 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.182423 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:41.072667 (+890244us) raft_consensus.cc:1685] finished
0709 13:03:41.072719 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:41.073260 (+   541us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20397,"raft.queue_time_us":2774,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":10444,"thread_start_us":217904,"threads_started":1,"wal-append.queue_time_us":294957}
I20260709 13:03:41.077564  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:41.078369  9524 raft_consensus.cc:1240] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:41.078619  9521 raft_consensus.cc:2468] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:03:41.075645  9523 raft_consensus.cc:1240] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:41.081909  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:41.082361  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:41.083128  9523 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:41.081918  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:41.085080  9521 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:03:41.089493  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:41.090655  9521 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:03:41.092152  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:41.093894  9523 raft_consensus.cc:2410] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:03:41.096956  9520 raft_consensus.cc:1217] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Deduplicated request from leader. Original: 10.5->[11.6-11.6]   Dedup: 11.6->[]
I20260709 13:03:41.097779  9520 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:03:41.100154  9523 raft_consensus.cc:1240] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14. Ops: [9.6-13.8]
I20260709 13:03:41.102908  9521 raft_consensus.cc:1240] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:03:41.107537 12822 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:41.111199 12822 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:41.106431 12784 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:41.113551 12784 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.114777 12784 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:41.117961 12831 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:41.119043 12831 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:41.119799  9447 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:41.120944  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:41.122902 12784 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:41.123445 12831 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:41.123759  9523 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:03:41.136818  9445 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:03:41.146965 12971 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:41.147920  9490 leader_election.cc:336] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.862s (SENT)
I20260709 13:03:41.148139 12971 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:41.149245 13025 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:41.152113 12971 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:41.152842 12822 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.153694 12934 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:41.153820 12822 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:41.156661 12822 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:41.148723  9490 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:41.158492 13002 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:41.159444 13002 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:41.160223  9490 leader_election.cc:336] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.863s (SENT)
I20260709 13:03:41.160856  9490 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:41.163393  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:41.164050 12968 consensus_meta.cc:287] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.945s	user 0.011s	sys 0.002s
I20260709 13:03:41.163884 12822 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:41.123517 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:41.173090  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:41.171954  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:41.198098  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:41.211521  9490 leader_election.cc:336] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 2.010s (SENT)
I20260709 13:03:41.207043 12837 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:41.219434  9447 raft_consensus.cc:2410] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:03:41.224575  9375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1601) took 2730 ms. Trace:
I20260709 13:03:41.225102  9375 rpcz_store.cc:276] 0709 13:03:38.493964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.494218 (+   254us) service_pool.cc:224] Handling call
0709 13:03:38.494669 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.807360 (+312691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.223804 (+2416444us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54001ffed4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:41.224282 (+   478us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":717471488}
I20260709 13:03:41.220885  9445 raft_consensus.cc:1275] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:03:41.227672  9444 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:03:41.227068  9452 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:03:41.226883  9445 pending_rounds.cc:85] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 4
I20260709 13:03:41.220706 12968 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:41.234890  9444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 2406) took 1041 ms. Trace:
I20260709 13:03:41.240619  9444 rpcz_store.cc:276] 0709 13:03:40.187503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.187358 (+999855us) service_pool.cc:224] Handling call
0709 13:03:41.214437 (+ 27079us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.228158 (+ 13721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.228404 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:41.234053  9445 pending_rounds.cc:107] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:03:41.244127  9445 raft_consensus.cc:2889] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:41.239823 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:03:41.263491  9451 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51016 (request call id 1471) took 1666 ms (client timeout 1863 ms). Trace:
W20260709 13:03:41.258417  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 389647us
W20260709 13:03:41.267273  9446 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51016 (request call id 1472) took 1657 ms (client timeout 2010 ms). Trace:
W20260709 13:03:41.267988  9446 rpcz_store.cc:269] 0709 13:03:39.609880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.714222 (+104342us) service_pool.cc:224] Handling call
0709 13:03:41.266845 (+1552623us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54000d1454. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:41.267039 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":338234624}
I20260709 13:03:41.267190  9341 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:41.269263  9443 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:41.267294 12985 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:41.269654  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:41.271449  9443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 1468) took 1692 ms. Trace:
I20260709 13:03:41.271960  9443 rpcz_store.cc:276] 0709 13:03:39.579720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.904876 (+325156us) service_pool.cc:224] Handling call
0709 13:03:41.268433 (+1363557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.269794 (+  1361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.271194 (+  1400us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54000d1450. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865698ad 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:41.271352 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3115956992}
W20260709 13:03:41.264246  9451 rpcz_store.cc:269] 0709 13:03:39.596656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.610775 (+ 14119us) service_pool.cc:224] Handling call
0709 13:03:41.262898 (+1652123us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b5400220954. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:41.263235 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1951195392}
I20260709 13:03:41.273666  9526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1625) took 2592 ms. Trace:
I20260709 13:03:41.274139  9526 rpcz_store.cc:276] 0709 13:03:38.681426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.681667 (+   241us) service_pool.cc:224] Handling call
0709 13:03:38.682286 (+   619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.784145 (+101859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.273108 (+2488963us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400154fd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:41.273446 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232597248}
I20260709 13:03:41.276553  9518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46894 (request call id 2002) took 1053 ms. Trace:
I20260709 13:03:41.277045  9518 rpcz_store.cc:276] 0709 13:03:40.223173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.223298 (+   125us) service_pool.cc:224] Handling call
0709 13:03:41.276133 (+1052835us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b5400313dd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:41.276361 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71656320}
W20260709 13:03:41.278347 12834 consensus_meta.cc:287] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 1.004s	user 0.021s	sys 0.000s
I20260709 13:03:41.279003  9375 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:41.279826  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.280992  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:41.281921  9377 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:41.282348 10067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45690 (request call id 152) took 1013 ms. Trace:
I20260709 13:03:41.282858 10067 rpcz_store.cc:276] 0709 13:03:40.268832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.269244 (+   412us) service_pool.cc:224] Handling call
0709 13:03:41.281911 (+1012667us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b54004c7054. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:41.282156 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83122560}
I20260709 13:03:41.255348 12968 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:41.284759  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.286468 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:03:41.287586  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.287669 10068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45690 (request call id 153) took 1003 ms. Trace:
I20260709 13:03:41.270563  9448 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:41.290952  9448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51016 (request call id 1489) took 1031 ms. Trace:
I20260709 13:03:41.282202  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.292935  9372 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:03:41.293785  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.294732  9375 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:41.305549  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:41.306671  9370 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:41.291271  9448 rpcz_store.cc:276] 0709 13:03:40.259128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.048318 (+789190us) service_pool.cc:224] Handling call
0709 13:03:41.269490 (+221172us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b5800003098. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445f8c 00007fb583445ef6 0000000000375939 00007fb58b4b91e0 00007fb58b5820c4 00007fb58b582131 00007fb58b5300a0 00007fb58b52f984 00007fb584aaa6d4 00007fb584aaa662
0709 13:03:41.290882 (+ 21392us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4144896}
I20260709 13:03:41.288355 10068 rpcz_store.cc:276] 0709 13:03:40.286328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.354374 (+ 68046us) service_pool.cc:224] Handling call
0709 13:03:41.286050 (+931676us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b5800224798. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb583445b71 00007fb583445a22 00007fb58c35ec09 00007fb58b4b8ee0 00007fb58b5820ab 00007fb58b582131 00007fb58b5300a0 00007fb58b52f984 00007fb584aaa6d4 00007fb584aaa662
0709 13:03:41.287591 (+  1541us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8871296}
I20260709 13:03:41.309859 12968 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:41.318552 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:03:41.333387 12883 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:03:41.334172  9521 raft_consensus.cc:1240] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:41.340746  9341 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:03:41.341660  9526 raft_consensus.cc:1240] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:41.342048 13012 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:41.342615 13012 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:41.343089 13012 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:41.344308  9443 pending_rounds.cc:85] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 3
I20260709 13:03:41.344693  9443 pending_rounds.cc:107] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:03:41.344954  9443 raft_consensus.cc:2889] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:41.355268  9341 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:41.355530  9377 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:41.360255 12965 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:41.365402 12932 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:03:41.368364  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.370602  9448 raft_consensus.cc:3055] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:41.372053  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:41.375075  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.376742  9448 raft_consensus.cc:740] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:03:41.386508  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.389729  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.378249 12932 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
W20260709 13:03:41.400082  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.411288  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:41.414505  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.401285 12932 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:41.421514  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.423424 12987 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:41.424788  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 69657.7us
I20260709 13:03:41.425536  9374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1604) took 2924 ms. Trace:
I20260709 13:03:41.426016  9374 rpcz_store.cc:276] 0709 13:03:38.500943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.501149 (+   206us) service_pool.cc:224] Handling call
0709 13:03:38.501448 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.824460 (+2323012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.424948 (+600488us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b54000622d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:41.425317 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4329237888}
I20260709 13:03:41.427350  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.423288 12825 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:41.429764 12865 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
W20260709 13:03:41.430104  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.411371  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:41.428668  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.407505  9448 consensus_queue.cc:260] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:41.447850  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.447997  9370 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:41.453121  9376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1596) took 3010 ms. Trace:
I20260709 13:03:41.453915  9376 rpcz_store.cc:276] 0709 13:03:38.442652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.461380 (+ 18728us) service_pool.cc:224] Handling call
0709 13:03:38.497371 (+ 35991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.605924 (+108553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.431716 (+2825792us) spinlock_profiling.cc:243] Waited 98.8 ms on lock 0x7b540021dc54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:41.452868 (+ 21152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227304192}
I20260709 13:03:41.456439  9518 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 11.
I20260709 13:03:41.452968  9371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1597) took 3009 ms. Trace:
I20260709 13:03:41.449961  9341 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
W20260709 13:03:41.463652  9449 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51012 (request call id 2379) took 3955 ms (client timeout 1595 ms). Trace:
I20260709 13:03:41.456898 12825 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:41.464171  9449 rpcz_store.cc:269] 0709 13:03:37.508507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.508673 (+   166us) service_pool.cc:224] Handling call
0709 13:03:41.463156 (+3954483us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b5400220e54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:41.463400 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1088564096}
I20260709 13:03:41.466869 12825 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:41.467397  9522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1628) took 2783 ms. Trace:
I20260709 13:03:41.470172  9372 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:41.471033  9369 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:41.472275  9448 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:41.476401  9490 leader_election.cc:336] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 2.043s (SENT)
I20260709 13:03:41.479048  9452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 1490) took 1196 ms. Trace:
I20260709 13:03:41.481761  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.458393  9371 rpcz_store.cc:276] 0709 13:03:38.443027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.446843 (+  3816us) service_pool.cc:224] Handling call
0709 13:03:38.447292 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.211253 (+763961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.431182 (+2219929us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b540014cb54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:41.452707 (+ 21525us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1754990464}
I20260709 13:03:41.478135  9522 rpcz_store.cc:276] 0709 13:03:38.683806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.683972 (+   166us) service_pool.cc:224] Handling call
0709 13:03:40.112249 (+1428277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.184870 (+ 72621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.466964 (+1282094us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54004961d0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865698ad 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:41.467204 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3283729280}
I20260709 13:03:41.485232 12622 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:41.485517 12851 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.489593  9377 raft_consensus.cc:2393] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
W20260709 13:03:41.485754  9418 connection.cc:256] RPC call timeout handler was delayed by -1.2514291389999244s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260709 13:03:41.492499  9418 connection.cc:256] RPC call timeout handler was delayed by -1.2496291390000351s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
W20260709 13:03:41.492982  9418 connection.cc:256] RPC call timeout handler was delayed by -1.0552291389999482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
I20260709 13:03:41.485829 12622 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:41.493537 12991 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:41.493721 12622 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:41.494184  9449 pending_rounds.cc:85] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 5
I20260709 13:03:41.494632  9449 pending_rounds.cc:107] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:03:41.494925  9449 raft_consensus.cc:2889] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:41.496878 12949 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:03:41.499966 12933 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:41.501684  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 53886.5us
I20260709 13:03:41.494372 12991 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:41.506621 12883 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.506395 12851 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:41.506450  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 80798us
I20260709 13:03:41.507376 12883 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:41.509563  9341 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:41.486413 12865 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:41.486133 12968 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:41.513438  9446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 1491) took 1226 ms. Trace:
W20260709 13:03:41.515744  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.539870 12971 consensus_queue.cc:1059] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:03:41.541329 13092 log.cc:927] Time spent T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:03:41.541510 12991 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:41.542135 12865 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:41.545702 12937 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:41.513140 12834 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.548905 12834 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:41.551568 12834 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:41.552744 12851 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:41.552752 13007 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:41.542649 12933 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:41.561241  9447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 2415) took 1284 ms. Trace:
I20260709 13:03:41.559126 12933 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:41.567889 12933 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:41.569824 12982 consensus_queue.cc:1059] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:41.571223 12982 raft_consensus.cc:3055] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:41.571609 12982 raft_consensus.cc:740] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
W20260709 13:03:41.573217 12995 consensus_meta.cc:287] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.593s	user 0.016s	sys 0.000s
I20260709 13:03:41.574473 12883 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:41.576155 12622 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:41.579368 12865 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:41.561735  9447 rpcz_store.cc:276] 0709 13:03:40.271048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.225868 (+954820us) service_pool.cc:224] Handling call
0709 13:03:41.226444 (+   576us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:41.246735 (+ 20291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:41.246791 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:41.255826 (+  9035us) log.cc:844] Serialized 26 byte log entry
0709 13:03:41.349672 (+ 93846us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:41.481223 (+131551us) log.cc:844] Serialized 14 byte log entry
0709 13:03:41.511763 (+ 30540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.511837 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:41.555337 (+ 43500us) raft_consensus.cc:1685] finished
0709 13:03:41.555359 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:41.555491 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42937,"prepare.queue_time_us":140791,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":56415,"raft.run_cpu_time_us":399,"raft.run_wall_time_us":6462,"thread_start_us":206841,"threads_started":2,"wal-append.queue_time_us":121730}
I20260709 13:03:41.534086  9446 rpcz_store.cc:276] 0709 13:03:40.287383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.270501 (+983118us) service_pool.cc:224] Handling call
0709 13:03:41.271005 (+   504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:41.271465 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:41.271516 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:41.272287 (+   771us) log.cc:844] Serialized 26 byte log entry
0709 13:03:41.376957 (+104670us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:41.481807 (+104850us) log.cc:844] Serialized 14 byte log entry
0709 13:03:41.512371 (+ 30564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.512439 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:41.512478 (+    39us) raft_consensus.cc:1685] finished
0709 13:03:41.512488 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:41.513383 (+   895us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45274,"prepare.queue_time_us":114001,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":55070,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":134,"spinlock_wait_cycles":1123200,"thread_start_us":152149,"threads_started":2,"wal-append.queue_time_us":156720}
I20260709 13:03:41.589314  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:41.592727  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:41.593269  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.563134 13007 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:41.593761  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:41.594221  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.595163 13007 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:41.595681 13096 log.cc:927] Time spent T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:03:41.598431 13016 consensus_queue.cc:1059] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:41.616676 13016 raft_consensus.cc:3055] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:41.617174 13016 raft_consensus.cc:740] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:41.618291 13016 consensus_queue.cc:260] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:41.619115 10027 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:41.619717 13016 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:41.620213 13080 raft_consensus.cc:2804] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:03:41.602012 13088 log.cc:927] Time spent T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:03:41.602311  9376 raft_consensus.cc:1240] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:41.602908  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.603472  9368 raft_consensus.cc:1240] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:41.587070 12973 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.620671 13080 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:41.627707  9517 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:03:41.627998 13080 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:41.628401 12934 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.606765  9370 raft_consensus.cc:1217] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 5.4->[6.5-10.7]   Dedup: 6.5->[8.6-10.7]
I20260709 13:03:41.628997 12934 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:41.630501 12622 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:41.629143  9449 raft_consensus.cc:3055] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:41.629613  9451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 2418) took 1285 ms. Trace:
I20260709 13:03:41.631695  9449 raft_consensus.cc:740] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:41.606421 13012 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:41.631953  9451 rpcz_store.cc:276] 0709 13:03:40.344166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.275277 (+931111us) service_pool.cc:224] Handling call
0709 13:03:41.275806 (+   529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:41.290170 (+ 14364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:41.290199 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:41.305978 (+ 15779us) log.cc:844] Serialized 26 byte log entry
0709 13:03:41.349261 (+ 43283us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:41.349333 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.349438 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:41.629375 (+279937us) raft_consensus.cc:1685] finished
0709 13:03:41.629396 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:41.629548 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":309,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":144,"thread_start_us":41917,"threads_started":1,"wal-append.queue_time_us":92927}
I20260709 13:03:41.632869  9449 consensus_queue.cc:260] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:41.608505  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.635479  9449 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:41.609508  9418 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:41.479432  9452 rpcz_store.cc:276] 0709 13:03:40.279852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.240368 (+960516us) service_pool.cc:224] Handling call
0709 13:03:41.264794 (+ 24426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:41.276567 (+ 11773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:41.276598 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:41.277169 (+   571us) log.cc:844] Serialized 26 byte log entry
0709 13:03:41.354122 (+ 76953us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:41.411807 (+ 57685us) log.cc:844] Serialized 14 byte log entry
0709 13:03:41.448802 (+ 36995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.448867 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:41.476455 (+ 27588us) raft_consensus.cc:1685] finished
0709 13:03:41.476474 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:41.476607 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34847,"raft.queue_time_us":40174,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":222,"spinlock_wait_cycles":347008,"thread_start_us":95833,"threads_started":2,"wal-append.queue_time_us":138237}
I20260709 13:03:41.636454 13007 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:41.637626  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.638952  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.639495  9418 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:41.639710 12933 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:41.640059  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.640432 12971 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:41.641510  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:41.642176  9450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 2399) took 3043 ms. Trace:
I20260709 13:03:41.642206  9371 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:41.610795  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:41.609503  9448 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:03:41.607719 12932 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:41.612706  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:41.640120  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.624336  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:41.605588  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.633443 12973 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:41.629317  9370 raft_consensus.cc:1240] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 10. Current term is 11. Ops: [6.5-10.7]
I20260709 13:03:41.572644 12982 consensus_queue.cc:260] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:41.644021  9369 raft_consensus.cc:1240] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:41.644049  9448 pending_rounds.cc:85] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 7
W20260709 13:03:41.612216 13094 log.cc:927] Time spent T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:03:41.647861  9448 pending_rounds.cc:107] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:03:41.583110 12968 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:41.648617  9448 raft_consensus.cc:2889] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:41.649506  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:41.651165 10027 connection.cc:256] RPC call timeout handler was delayed by -1.6119202999999516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
I20260709 13:03:41.652047 12982 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:41.654736  9445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 2408) took 1466 ms. Trace:
I20260709 13:03:41.655647 12973 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:41.657755  9449 raft_consensus.cc:1275] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:03:41.655154  9445 rpcz_store.cc:276] 0709 13:03:40.188243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.199160 (+1010917us) service_pool.cc:224] Handling call
0709 13:03:41.219987 (+ 20827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.259445 (+ 39458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.654497 (+395052us) spinlock_profiling.cc:243] Waited 6.12 ms on lock 0x7b54001590d0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865698ad 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:41.654675 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14077312}
I20260709 13:03:41.658648  9449 pending_rounds.cc:85] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 4
I20260709 13:03:41.660321  9449 pending_rounds.cc:107] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:03:41.660411  9447 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:41.660488  9375 raft_consensus.cc:1240] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:41.660708  9449 raft_consensus.cc:2889] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:41.661908  9444 raft_consensus.cc:2393] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 10: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:41.662281  9446 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:41.642575  9450 rpcz_store.cc:276] 0709 13:03:38.598803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.598921 (+   118us) service_pool.cc:224] Handling call
0709 13:03:39.177792 (+578871us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.223989 (+ 46197us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:39.438459 (+214470us) log.cc:844] Serialized 14 byte log entry
0709 13:03:39.994955 (+556496us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:39.995034 (+    79us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:39.995100 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.995170 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:41.641799 (+1646629us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b540012b950. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865698ad 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:41.641954 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18999,"prepare.queue_time_us":383399,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":7433,"raft.queue_time_us":60899,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":4606,"spinlock_wait_cycles":1292476160,"thread_start_us":622227,"threads_started":3,"wal-append.queue_time_us":464791,"wal-append.run_cpu_time_us":1622,"wal-append.run_wall_time_us":1117990}
I20260709 13:03:41.669086  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:41.669747  9445 raft_consensus.cc:2410] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:03:41.671284  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.675175 12933 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:41.675415  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.676047 12834 raft_consensus.cc:3055] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:41.676258  9368 raft_consensus.cc:2393] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 10: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:41.676487 12834 raft_consensus.cc:740] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:41.677528  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.682176  9445 raft_consensus.cc:3055] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:41.682628  9445 raft_consensus.cc:740] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:41.683575  9445 consensus_queue.cc:260] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:41.684670  9445 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:41.685148  9491 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:41.682191 12834 consensus_queue.cc:260] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:41.686537 12834 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:41.687965  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:41.682659 13090 log.cc:927] Time spent T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:03:41.683892  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:41.689070 13007 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:41.689881  9452 raft_consensus.cc:2410] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:03:41.690002  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.691133  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.692152 12963 raft_consensus.cc:2804] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:41.692108  9452 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:41.692548 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:41.693166  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.696918  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:41.698679  9371 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:03:41.692564 12963 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:41.700098  9518 raft_consensus.cc:1240] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:41.700068 12963 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:41.701850  9444 raft_consensus.cc:3055] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:41.702690  9522 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:03:41.704739  9449 raft_consensus.cc:1275] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:41.705924  9443 raft_consensus.cc:1275] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:41.703037  9444 raft_consensus.cc:740] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:41.710640  9418 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:41.696907 13012 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:41.715188  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:41.715694  9452 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:03:41.716753  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:41.718492  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:41.719781  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:41.722692 10026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.722846  9526 raft_consensus.cc:2410] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:03:41.723490  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:41.725699  9520 raft_consensus.cc:1240] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:41.717746 13007 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:41.728698  9523 raft_consensus.cc:2393] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 10: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:41.730566  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:41.731923  9525 raft_consensus.cc:1240] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:41.725881  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:41.734103  9524 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:41.736380  9521 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:03:41.739076  9368 raft_consensus.cc:1240] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:03:41.732823 12934 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:41.733867 12968 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:41.768160  9524 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:03:41.773123  9368 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 12. Current term is 14. Ops: [12.8-12.8]
I20260709 13:03:41.761978 12932 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:41.779928  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:41.783393  9451 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:41.785230 12863 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:41.785835 12863 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:41.786291  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 336092us
I20260709 13:03:41.786237 13012 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:41.789043  9490 leader_election.cc:336] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 2.134s (SENT)
I20260709 13:03:41.788919 13012 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:41.789604  9490 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:41.791093  9490 leader_election.cc:336] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 2.250s (SENT)
I20260709 13:03:41.791412 13012 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:41.791520  9490 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:41.792649 13002 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:41.793475 13002 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:41.798195  9444 consensus_queue.cc:260] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:41.799427  9444 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:41.802084  9372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:41.802910  9372 raft_consensus.cc:606] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:41.803268 12863 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:41.804320 13101 log.cc:927] Time spent T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:03:41.804687  9372 raft_consensus.cc:1240] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:41.808115 13080 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:41.815400 12963 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:41.818251  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:41.819621  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:41.820353  9449 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:41.814543 13080 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:41.821257  9449 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e30c155cba64357ae275b3366772777"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:03:41.822475  9368 raft_consensus.cc:1240] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:41.837177  9451 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
I20260709 13:03:41.825659 13080 consensus_queue.cc:1059] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:03:41.847818  9445 raft_consensus.cc:1275] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 6. (term mismatch)
I20260709 13:03:41.849618  9445 pending_rounds.cc:85] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 5
I20260709 13:03:41.850167  9445 pending_rounds.cc:107] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:03:41.850530  9445 raft_consensus.cc:2889] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:41.850978  9445 pending_rounds.cc:107] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:03:41.851297  9445 raft_consensus.cc:2889] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:41.851759  9445 pending_rounds.cc:107] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:03:41.852010  9445 raft_consensus.cc:2889] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:41.853623  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:03:41.853940  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.862828  9418 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:41.845258 12863 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:03:41.865643 13035 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:41.868320  9418 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:41.869567 13035 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:41.871050  9449 raft_consensus.cc:606] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:41.871444  9449 raft_consensus.cc:614] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:41.871951  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.872388  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.886811  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:41.887578  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:41.888267  9451 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:41.893435 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:41.881440  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:41.897675  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:41.901531  9444 raft_consensus.cc:1275] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:03:41.902081  9444 pending_rounds.cc:85] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 3
I20260709 13:03:41.902410  9444 pending_rounds.cc:107] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:03:41.903558  9444 raft_consensus.cc:2889] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:41.902391 12963 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:03:41.913594  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.881954 12863 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:03:41.915253  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.915644 12863 consensus_queue.cc:1243] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [LEADER]: Peer d62c9d5a052b42ce8675f8438f846526 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:41.921234 12863 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.921783 12863 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:41.925436  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:41.925923  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:41.926210  9518 raft_consensus.cc:2393] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 in current term 12: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:41.928157 10027 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:41.930929 13033 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:41.933180 12996 raft_consensus.cc:3055] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:41.933633 12996 raft_consensus.cc:740] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:41.937207  9374 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:41.928536 12863 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:41.938865  9418 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:41.940356  9490 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:41.944367  9517 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46894 (request call id 2008) took 1649 ms (client timeout 1979 ms). Trace:
I20260709 13:03:41.945021 12996 consensus_queue.cc:260] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:41.945564  9490 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:41.945556  9275 catalog_manager.cc:5697] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:41.946655  9490 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:41.947407 12934 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:41.947837 12934 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:41.948282 12934 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:41.947968  9275 catalog_manager.cc:5697] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:41.945063 13002 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:41.949760 13002 raft_consensus.cc:697] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:41.949820  9375 raft_consensus.cc:1240] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:41.950960  9368 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:03:41.950810 13002 consensus_queue.cc:237] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:41.952306  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.952692  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:41.954366  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:41.944808  9517 rpcz_store.cc:269] 0709 13:03:40.294863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.294986 (+   123us) service_pool.cc:224] Handling call
0709 13:03:41.943723 (+1648737us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b5400314cd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:41.944310 (+   587us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1715748736}
I20260709 13:03:41.961577  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:03:41.961653  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 50212.6us
W20260709 13:03:42.071854 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 118031us
I20260709 13:03:42.073297 13035 consensus_queue.cc:1059] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:42.073787 12836 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:42.074371 12968 consensus_queue.cc:1059] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:42.074445 13035 raft_consensus.cc:3055] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:03:42.075353  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 165317us
I20260709 13:03:42.056681  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.057578  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.057677  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.076637 13007 raft_consensus.cc:3055] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:42.077090 13007 raft_consensus.cc:740] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:42.059285  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:42.059944  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.059641  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.078051 13007 consensus_queue.cc:260] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:42.079469 13007 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:42.084195  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:42.085091  9522 raft_consensus.cc:1813] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Handling vote request from an unknown peer d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:42.060648 12996 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:42.061316  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.065830 12934 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:42.067101 12834 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:41.943897 12963 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:03:42.076067  9341 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:42.089205  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:42.079694  9490 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:42.080590  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:42.058933  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:42.089488  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.090145 10069 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:03:42.090997  9522 raft_consensus.cc:2393] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 5: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
W20260709 13:03:42.093786  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.095386  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:42.095238  9376 raft_consensus.cc:2393] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 11: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:42.074358 12836 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.098634  9517 raft_consensus.cc:2410] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:03:42.098930  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:42.098696  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:42.102641  9523 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:42.095214  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:42.081604 13035 raft_consensus.cc:740] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:42.109359  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.109917 12845 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:03:42.090591 12863 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.111908  9519 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:42.115347  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.116956  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.117286 12863 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:42.117973  9373 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:03:42.119798 12863 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:42.120260  9490 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:03:42.120885 13035 consensus_queue.cc:260] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:03:42.106895 12834 raft_consensus.cc:697] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:42.133050  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:42.123191  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 47217.8us
I20260709 13:03:42.127322  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.112352 13002 raft_consensus.cc:2749] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:42.128711 12785 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:42.130759  9370 raft_consensus.cc:1240] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:42.138166  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.130833  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:42.135111  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.102808 12836 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:42.136364  9525 raft_consensus.cc:2410] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:03:42.136319  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.137054  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:42.132561 12845 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.140311  9374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:42.140576  9274 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 75) took 8201 ms. Trace:
I20260709 13:03:42.141486  9371 raft_consensus.cc:1240] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:42.148490  9374 raft_consensus.cc:606] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:42.145823  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.142570  9376 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:42.145186  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:42.149711  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.150259  9523 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:42.155087  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:42.155709  9375 raft_consensus.cc:2376] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11. Re-sending same reply.
I20260709 13:03:42.157634  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:42.167385  9452 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:42.169543  9435 tablet_service.cc:1558] Processing DeleteTablet for tablet 807906edc34d41589d9b860b72f70e16 with delete_type TABLET_DATA_TOMBSTONED (TS d62c9d5a052b42ce8675f8438f846526 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:51006
I20260709 13:03:42.168380 13103 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.169158  9275 catalog_manager.cc:5697] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 6 to 9, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 9 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:42.141721 12863 raft_consensus.cc:2804] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:42.177821  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.170437 13103 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:42.179738  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:42.181855  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:42.185691  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 65643.3us
W20260709 13:03:42.186491  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.168928 13035 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:42.190496  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:42.191494  9452 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:03:42.196072  9444 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:03:42.176402 12863 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:03:42.201658  9271 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43252 (request call id 169) took 14397 ms (client timeout 15000 ms). Trace:
I20260709 13:03:42.202118  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.206382  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:42.202539  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.202786 12934 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:42.206521  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.208541  9373 raft_consensus.cc:2376] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10. Re-sending same reply.
I20260709 13:03:42.210139  9490 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:03:42.208843  9376 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:03:42.210660  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.212718  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.213426  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.214006  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:42.214696  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:42.217744  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.219237  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.168768 12834 consensus_queue.cc:237] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:42.176270 12845 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:42.210850 12863 raft_consensus.cc:3060] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:42.211252 13103 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:42.228925  9490 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:42.230664 12963 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:42.231060 12963 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:42.231462 12963 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:42.231189  9490 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:42.235293  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:42.235649  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:42.236056  9418 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:03:42.240051  9275 catalog_manager.cc:5697] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 3 to 5, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 5 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:42.241601  9275 catalog_manager.cc:5697] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 6 to 7, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 7 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
W20260709 13:03:42.207974  9271 rpcz_store.cc:269] 0709 13:03:27.804454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.804727 (+   273us) service_pool.cc:224] Handling call
0709 13:03:42.201397 (+14396670us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:34.631228 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:34.632006 (+   778us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:34.632071 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:03:34.632097 (+    26us) tablet.cc:662] Decoding operations
0709 13:03:34.634056 (+  1959us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:34.634177 (+   121us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:34.634227 (+    50us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:03:34.636441 (+  2214us) tablet.cc:701] Row locks acquired
0709 13:03:34.636481 (+    40us) write_op.cc:260] PREPARE: finished
0709 13:03:34.644024 (+  7543us) write_op.cc:270] Start()
0709 13:03:34.647045 (+  3021us) write_op.cc:276] Timestamp: P: 1783602214643946 usec, L: 0
0709 13:03:34.652608 (+  5563us) op_driver.cc:348] REPLICATION: starting
0709 13:03:34.719204 (+ 66596us) log.cc:844] Serialized 8104 byte log entry
0709 13:03:35.085232 (+366028us) op_driver.cc:464] REPLICATION: finished
0709 13:03:35.338231 (+252999us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb5834600ac 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb589fa0ef0
0709 13:03:35.586444 (+248213us) write_op.cc:301] APPLY: starting
0709 13:03:35.593574 (+  7130us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:35.651088 (+ 57514us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:35.651108 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:35.801991 (+150883us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:35.802439 (+   448us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:03:35.802520 (+    81us) write_op.cc:312] APPLY: finished
0709 13:03:35.803060 (+   540us) log.cc:844] Serialized 145 byte log entry
0709 13:03:35.803271 (+   211us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:35.803457 (+   186us) write_op.cc:454] Released schema lock
0709 13:03:35.803528 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:35.803978 (+   450us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:35.804014 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":290112,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":450498,"apply.run_cpu_time_us":10499,"apply.run_wall_time_us":233594,"num_ops":21,"prepare.queue_time_us":122467,"prepare.run_cpu_time_us":23055,"prepare.run_wall_time_us":204404,"raft.queue_time_us":133110,"raft.run_cpu_time_us":21740,"raft.run_wall_time_us":328637,"replication_time_us":432362,"spinlock_wait_cycles":40402816,"thread_start_us":639299,"threads_started":4,"wal-append.queue_time_us":165859,"wal-append.run_cpu_time_us":16741,"wal-append.run_wall_time_us":1897460}]]}
I20260709 13:03:42.221606  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:42.223778  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.218619  9452 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:03:42.227281  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.228132  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:42.229216 13111 ts_tablet_manager.cc:933] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:42.244843  9450 raft_consensus.cc:2376] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10. Re-sending same reply.
I20260709 13:03:42.250119  9418 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:42.221606  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:42.148627  9274 rpcz_store.cc:276] 0709 13:03:33.936676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.943503 (+  6827us) service_pool.cc:224] Handling call
0709 13:03:42.134770 (+8191267us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:38.196275 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:38.196879 (+   604us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:38.196912 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:03:38.196931 (+    19us) tablet.cc:662] Decoding operations
0709 13:03:38.197562 (+   631us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:38.197640 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:38.197667 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:03:38.198086 (+   419us) tablet.cc:701] Row locks acquired
0709 13:03:38.198105 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:03:38.198257 (+   152us) write_op.cc:270] Start()
0709 13:03:38.198375 (+   118us) write_op.cc:276] Timestamp: P: 1783602218198200 usec, L: 0
0709 13:03:38.198398 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:03:38.260293 (+ 61895us) log.cc:844] Serialized 1650 byte log entry
0709 13:03:39.831460 (+1571167us) op_driver.cc:464] REPLICATION: finished
0709 13:03:40.226928 (+395468us) write_op.cc:301] APPLY: starting
0709 13:03:40.243637 (+ 16709us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:40.243824 (+   187us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:40.243991 (+   167us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:40.244622 (+   631us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:40.244899 (+   277us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:03:40.244961 (+    62us) write_op.cc:312] APPLY: finished
0709 13:03:40.372439 (+127478us) log.cc:844] Serialized 41 byte log entry
0709 13:03:40.372661 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:40.372765 (+   104us) write_op.cc:454] Released schema lock
0709 13:03:40.372814 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:40.373281 (+   467us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:40.373313 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3134132,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":371907,"apply.run_cpu_time_us":2969,"apply.run_wall_time_us":155310,"num_ops":4,"prepare.queue_time_us":138460,"prepare.run_cpu_time_us":41455,"prepare.run_wall_time_us":168236,"raft.queue_time_us":627951,"raft.run_cpu_time_us":17192,"raft.run_wall_time_us":256122,"replication_time_us":1632850,"thread_start_us":870110,"threads_started":4,"wal-append.queue_time_us":277382,"wal-append.run_cpu_time_us":41920,"wal-append.run_wall_time_us":2919509}]]}
I20260709 13:03:42.220197 12934 raft_consensus.cc:2804] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:42.243297  9275 catalog_manager.cc:5697] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 8 to 9, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 9 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:42.262890 13002 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:42.263530 13002 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.263940 13002 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:42.273123 13103 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:42.256130 12934 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:42.285646 12934 raft_consensus.cc:3060] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:42.254181 13007 raft_consensus.cc:2804] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:42.289425 13007 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:42.289819 13007 raft_consensus.cc:3060] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:42.250762 12963 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:42.295473  9275 catalog_manager.cc:5697] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 6 to 7, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 7 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:42.304338  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 54287.6us
I20260709 13:03:42.305898  9418 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:42.310588  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.312636  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:42.315780  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.314313 13103 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:42.320356 13103 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:42.320724 13103 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:42.321661 13112 tablet_replica.cc:333] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
W20260709 13:03:42.322453  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 162761us
I20260709 13:03:42.318614  9275 catalog_manager.cc:5697] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 7 to 8, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 8 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:42.323173  9371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:42.323649  9418 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:42.323697  9371 raft_consensus.cc:606] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:42.324340  9371 raft_consensus.cc:614] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:42.327533  9490 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:42.326175 12991 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:03:42.332752  9341 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:42.332768 13012 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:42.333763  9341 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:03:42.334653 13062 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:42.333647 12991 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:42.338145  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:42.335232 13062 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:42.330503 13112 raft_consensus.cc:2243] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:42.346280  9341 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:42.347038 12948 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:42.347843 13054 consensus_queue.cc:1048] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:42.336565 12834 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:42.358474  9418 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:42.359397 12968 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:42.359737 13012 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:42.359907 12968 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:42.360489 12968 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:42.363552 12834 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:42.364101 12834 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:42.365130  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.344379 12963 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:42.366871 12836 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:42.367964  9377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:42.368618  9377 raft_consensus.cc:606] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:42.368979  9377 raft_consensus.cc:614] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:42.373939  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.339725 12991 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:42.343449 13062 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:42.379136  9341 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:42.331825 13111 tablet_copy_client.cc:323] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.66:45279
I20260709 13:03:42.387297  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:42.385327  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:42.380863 12991 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:42.394805 13035 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:42.373261 12932 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:03:42.397410 12932 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:42.397838 12932 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:42.398224 12932 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:42.399801 12836 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:42.382858 12785 consensus_queue.cc:1048] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:03:42.408597 13113 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:42.417140  9418 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:42.417335  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:42.427486  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 109991us
I20260709 13:03:42.418670 12863 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:42.393667 12948 consensus_queue.cc:1048] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:03:42.420909 12834 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:42.428010  9368 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
W20260709 13:03:42.441668  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 62432.2us
I20260709 13:03:42.429330 13035 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:42.448237  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.450043  9341 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:42.454144  9368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f322b7281d554c459bb8109ed249047b"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:42.456691  9368 raft_consensus.cc:606] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:42.455510 12834 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:42.457068  9368 raft_consensus.cc:614] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:42.458528 12785 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:42.460572 12785 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.462657 13103 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:42.464078  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:42.446863 13112 raft_consensus.cc:2272] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.460963 12785 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:42.468425 13112 ts_tablet_manager.cc:1916] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:42.469892 12934 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:42.441924 12845 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:42.471607  9521 raft_consensus.cc:1240] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:42.474618  9462 tablet_copy_service.cc:140] P d62c9d5a052b42ce8675f8438f846526: Received BeginTabletCopySession request for tablet 7f6a0746767b404997bb10c4d3ecd42c from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:45366)
I20260709 13:03:42.475235  9462 tablet_copy_service.cc:161] P d62c9d5a052b42ce8675f8438f846526: Beginning new tablet copy session on tablet 7f6a0746767b404997bb10c4d3ecd42c from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:45366: session id = b0812463215649c3b011d36e2f0400c9-7f6a0746767b404997bb10c4d3ecd42c
I20260709 13:03:42.476514 12982 consensus_queue.cc:1059] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:42.474395 12968 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:42.477831 12982 raft_consensus.cc:3055] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:42.478426 12982 raft_consensus.cc:740] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:42.479035 12968 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:42.479482 12982 consensus_queue.cc:260] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:42.481232  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.482359  9341 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:42.483866 13012 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:42.484192 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:42.484365 13012 raft_consensus.cc:697] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:42.482852  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:42.485308 12987 consensus_queue.cc:1048] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:42.485663 13012 consensus_queue.cc:237] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:42.487012  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:42.487675  9418 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:42.489050 12834 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:42.489487 12834 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:42.485983  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:42.489418  9418 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:42.490677  9341 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:42.494176 12987 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:42.495580 12987 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.496014 12987 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:42.494866  9341 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:42.495221 13035 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:42.495350 13062 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:42.471633 12863 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:42.490039 12834 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:42.502386  9418 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:42.508600 13062 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:42.497211 12991 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:42.509713 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:42.511555 12991 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:42.503736 13054 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:42.517673 13035 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:42.522856 12845 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:42.504587 13103 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:42.529891  9521 raft_consensus.cc:1240] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:42.531672 12932 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:42.532068 13080 consensus_queue.cc:1059] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:42.533047 12996 raft_consensus.cc:3055] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:42.524753 12845 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:03:42.534432 12996 raft_consensus.cc:740] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:42.500895 12982 raft_consensus.cc:3060] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:42.487675 12968 consensus_queue.cc:1059] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:03:42.565941  9446 raft_consensus.cc:1240] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:03:42.569238 12845 consensus_queue.cc:1059] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:42.569761  9444 raft_consensus.cc:1275] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:03:42.570155  9444 pending_rounds.cc:85] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 5
I20260709 13:03:42.570292 12845 raft_consensus.cc:3055] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:42.570729 12845 raft_consensus.cc:740] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:42.571669 12845 consensus_queue.cc:260] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:42.570377  9444 pending_rounds.cc:107] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:03:42.573174  9444 raft_consensus.cc:2889] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:42.579754  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 77445.7us
I20260709 13:03:42.580492  9418 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:42.597462  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 93086.6us
I20260709 13:03:42.579931 12845 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:42.553615 13120 consensus_queue.cc:1048] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:03:42.648717  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:42.649653  9448 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:42.629527 12932 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:42.662940  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 82500.7us
I20260709 13:03:42.598461 12996 consensus_queue.cc:260] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:42.606277 12836 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:03:42.669204  9368 raft_consensus.cc:1240] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:42.671869  9418 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:42.606493 12863 consensus_queue.cc:1059] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:03:42.709071  9448 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
W20260709 13:03:42.719339  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 88191.2us
I20260709 13:03:42.674644 12934 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:42.727458  9490 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:42.666069 13007 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:42.733150  9492 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:42.753295 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
W20260709 13:03:42.755558 13122 log.cc:927] Time spent T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:03:42.727509 13035 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:42.762104  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:42.757242 12785 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:42.763654  9490 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:42.765462 12785 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:42.770009 13002 consensus_meta.cc:287] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.002s
I20260709 13:03:42.770372  9462 tablet_copy_source_session.cc:215] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:42.770660 13002 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:42.774832 13111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f6a0746767b404997bb10c4d3ecd42c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:42.774636 13033 consensus_queue.cc:1059] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:42.776714  9492 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:42.778684  9492 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:03:42.761071  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 89330us
I20260709 13:03:42.782968  9418 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:42.731757 12968 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:42.800066 12848 raft_consensus.cc:3055] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:42.800688 12848 raft_consensus.cc:740] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:42.801553 13135 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:42.802317 13135 raft_consensus.cc:697] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:42.801827 12848 consensus_queue.cc:260] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:42.803391 13135 consensus_queue.cc:237] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:42.803956 12836 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:42.804522 12836 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.804975 12836 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:42.805528 13139 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:42.806257 13139 raft_consensus.cc:697] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:42.807327 13139 consensus_queue.cc:237] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:42.808269 13125 log.cc:927] Time spent T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:03:42.837738  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 213703us
W20260709 13:03:42.840793 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 110940us
W20260709 13:03:42.757298 13127 log.cc:927] Time spent T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:03:42.847854  9343 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:42.748128 12863 raft_consensus.cc:3055] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:42.790683 12963 raft_consensus.cc:2749] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:42.810037 12934 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:42.864265 13128 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:03:42.868898  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 86067.1us
I20260709 13:03:42.859918 13035 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:42.860970 13002 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:42.860419 12863 raft_consensus.cc:740] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:03:42.932632  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 61921.6us
I20260709 13:03:42.866904 12934 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:42.953104  9343 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:42.893778 13128 raft_consensus.cc:697] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:42.929420 13035 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:42.973549 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 88334.2us
I20260709 13:03:42.951009 12934 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:42.948124 12932 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
W20260709 13:03:43.005517  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 226859us
I20260709 13:03:42.951871 12991 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:03:43.007398  9492 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
W20260709 13:03:43.035391  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 271861us
I20260709 13:03:43.018010 13007 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:43.036463  9343 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:42.966542 13035 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:43.000562 13103 raft_consensus.cc:3055] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:03:43.009172 10027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:43.041884 13129 log.cc:927] Time spent T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:03:43.042412  9490 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:43.006937 12932 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.006701 13002 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.037480 13143 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:43.080583 12836 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.083081 12836 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:43.086407 13080 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.087249 13080 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:43.089824 13143 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.090358 13143 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:43.049805 13103 raft_consensus.cc:740] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:43.092367 13103 consensus_queue.cc:260] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:43.093083 13141 log.cc:927] Time spent T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:03:43.093609 13103 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:43.096522 12987 consensus_meta.cc:287] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.600s	user 0.013s	sys 0.001s
I20260709 13:03:43.097558 13128 consensus_queue.cc:237] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.097167 12987 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:43.102762 10024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.104403 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
W20260709 13:03:43.105599  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 98341.5us
W20260709 13:03:43.104631 12982 consensus_meta.cc:287] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9: Time spent flushing consensus metadata: real 0.561s	user 0.013s	sys 0.003s
I20260709 13:03:43.061059 13135 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:43.109203  9492 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
W20260709 13:03:43.112067 13151 log.cc:927] Time spent T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:03:43.114364 12834 consensus_meta.cc:287] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.599s	user 0.011s	sys 0.000s
I20260709 13:03:43.066995 12863 consensus_queue.cc:260] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.116130 13143 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.077068 12963 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:43.097615 12932 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:43.134048  9492 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:43.135972  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 93655.7us
I20260709 13:03:43.067270 13002 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:43.139856  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 132329us
W20260709 13:03:43.139000  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 129808us
I20260709 13:03:43.130184 12836 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:43.138666 13154 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.133024 12834 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:43.175662  9490 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:43.177038  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:43.177790 10070 raft_consensus.cc:2468] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
W20260709 13:03:43.178445 10026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:43.174975  9343 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.4.67:35929 timed out after 1.708s (SENT) [suppressed 43 similar messages]
I20260709 13:03:43.140434 12932 consensus_queue.cc:1059] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:03:43.161360 12863 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:43.163022 13152 log.cc:927] Time spent T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:03:43.165639 13145 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:43.189092  9492 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:43.199254 12963 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:43.192081 13035 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.210182  9492 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:43.160197 13161 consensus_queue.cc:1048] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:03:43.192380 13135 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:43.182862 12836 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:03:43.211068 13035 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:43.206328 13148 log.cc:927] Time spent T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.189s	user 0.000s	sys 0.002s
I20260709 13:03:43.222556  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:43.179407 13154 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.213822 13135 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.227993  9521 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 3.
I20260709 13:03:43.230428 13153 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:43.230964 13164 raft_consensus.cc:3055] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:03:43.231698 13155 log.cc:927] Time spent T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:03:43.232637 13002 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:43.233076 12963 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:43.236362 10027 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:43.214282 13080 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:43.240309 13168 raft_consensus.cc:2804] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:43.240828 13168 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.229125 12987 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:43.241256 13168 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:43.228093 12845 consensus_meta.cc:287] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.003s
W20260709 13:03:43.243397  9490 connection.cc:256] RPC call timeout handler was delayed by -1.9041762770000332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 13:03:43.245949 13156 log.cc:927] Time spent T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:03:43.264936 12848 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:43.265872 12834 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:43.237146 13164 raft_consensus.cc:740] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:43.276834 13164 consensus_queue.cc:260] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.278266 13164 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:43.237680 13135 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:43.279484  9491 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:43.280838 13153 raft_consensus.cc:2804] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:43.308518  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:43.300261 12996 raft_consensus.cc:3060] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:43.316486  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 106376us
I20260709 13:03:43.317452  9492 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:43.300663 13153 raft_consensus.cc:697] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:43.312793 13145 raft_consensus.cc:697] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:43.329737  9525 raft_consensus.cc:1275] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:43.330291 13154 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:43.333076 13111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44546 (request call id 200) took 1220 ms. Trace:
I20260709 13:03:43.333609 13111 rpcz_store.cc:276] 0709 13:03:42.121083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.121256 (+   173us) service_pool.cc:224] Handling call
0709 13:03:42.249510 (+128254us) ts_tablet_manager.cc:934] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
0709 13:03:42.773285 (+523775us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:03:42.841472 (+ 68187us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:42.841814 (+   342us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:03:43.332127 (+490313us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:03:43.332494 (+   367us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:43.332868 (+   374us) ts_tablet_manager.cc:989] Replica registered.
0709 13:03:43.332940 (+    72us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":21332,"tablet-copy.queue_time_us":107186,"thread_start_us":144896,"threads_started":2}
I20260709 13:03:43.335459 13111 tablet_copy_client.cc:806] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:43.336192 13111 tablet_copy_client.cc:670] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:43.341353  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:43.341100 13168 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:43.347402 13135 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.348982  9492 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:43.349519 13153 consensus_queue.cc:237] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:43.354472  9525 raft_consensus.cc:1275] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:03:43.354658  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:43.358274  9525 raft_consensus.cc:1275] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:03:43.324193 12845 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:43.362504  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:43.362828  9523 raft_consensus.cc:1275] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:43.363454  9520 raft_consensus.cc:1240] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:43.364589  9525 raft_consensus.cc:1240] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:43.364683  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:43.365744  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:43.365864  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:43.366473 13176 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:43.367230  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:43.368113 13145 consensus_queue.cc:237] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.369432  9526 raft_consensus.cc:1240] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:43.370452  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:43.371538  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:43.360075 12845 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.373476  9524 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:43.373730 12845 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:43.374428  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:43.377785  9492 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:43.379190  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:43.386221  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:43.361339 12934 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.388322  9519 raft_consensus.cc:1240] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:43.392256  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:43.393144  9371 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 2.
I20260709 13:03:43.381561  9520 raft_consensus.cc:1240] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:43.394320  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:43.394739  9520 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:03:43.395171  9373 raft_consensus.cc:2410] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:03:43.396121  9520 raft_consensus.cc:1240] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:43.397631  9520 raft_consensus.cc:1275] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:03:43.373775  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:43.398319  9518 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:43.398368  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:43.398947  9373 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:43.400451  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:43.400943  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:43.401254  9369 raft_consensus.cc:2393] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 11: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:43.393230  9374 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:43.382017  9522 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:03:43.402696  9522 pending_rounds.cc:85] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 6
I20260709 13:03:43.403017  9522 pending_rounds.cc:107] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:03:43.403291  9522 raft_consensus.cc:2889] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:43.383149 13112 ts_tablet_manager.cc:1929] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 13:03:43.404839 13112 log.cc:1199] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-1-root/wals/807906edc34d41589d9b860b72f70e16
I20260709 13:03:43.406363 13112 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51006 (request call id 69) took 1296 ms. Trace:
I20260709 13:03:43.406778 13112 rpcz_store.cc:276] 0709 13:03:42.151646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.168450 (+ 16804us) service_pool.cc:224] Handling call
0709 13:03:42.321207 (+152757us) ts_tablet_manager.cc:1151] Deleting tablet 807906edc34d41589d9b860b72f70e16
0709 13:03:42.321314 (+   107us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:03:42.766987 (+445673us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:43.383009 (+616022us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:43.406253 (+ 23244us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":147269,"thread_start_us":54793,"threads_started":1}
I20260709 13:03:43.380036  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:43.414620  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:43.415287  9374 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:03:43.428478 13176 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:43.428740  9368 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:03:43.427771  9373 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:03:43.439107  9525 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:43.440037  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:43.446635  9520 raft_consensus.cc:3055] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:43.447152  9520 raft_consensus.cc:740] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:43.443264  9374 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 4.
I20260709 13:03:43.449787 10027 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:43.450793 12848 raft_consensus.cc:2804] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:43.451534 12848 raft_consensus.cc:697] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 4 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:43.452723 12848 consensus_queue.cc:237] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:43.453101  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:43.461148  9343 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:43.445618 13002 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:03:43.470804 13135 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:43.464550  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:43.477456  9520 consensus_queue.cc:260] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.478701  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:43.462808  9526 raft_consensus.cc:2368] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 12. Current term is 13.
I20260709 13:03:43.496753  9343 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:43.501936  9343 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:43.507457 13054 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:43.508318 12932 consensus_queue.cc:1048] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:03:43.509377  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 639215us
I20260709 13:03:43.510561  9418 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:43.511835 13062 consensus_queue.cc:1048] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:43.512104 13133 consensus_queue.cc:1059] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:43.512918 13133 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:43.513576 13133 raft_consensus.cc:3055] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:43.514005 13133 raft_consensus.cc:740] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:43.487509 13002 consensus_queue.cc:1059] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:03:43.505237 13164 consensus_queue.cc:1048] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:03:43.519824 12834 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:43.520491 12834 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.523028 12834 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:43.523553 12834 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:43.524251 12968 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:43.525413  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.548223  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:43.549090  9444 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:43.479437 12934 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:43.529031 13103 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.529676 13131 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.493997 13145 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:43.514904 13002 consensus_queue.cc:1243] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:43.573558  9452 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:43.511835  9418 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:43.552090  9445 raft_consensus.cc:1240] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:43.560194  9446 raft_consensus.cc:1240] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:43.566499  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:43.575883  9447 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:43.531935 12845 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:43.580542  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 126097us
I20260709 13:03:43.586694  9450 raft_consensus.cc:1240] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 9. Current term is 10. Ops: []
W20260709 13:03:43.584937  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 142433us
W20260709 13:03:43.588353  9490 leader_election.cc:336] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.555s (SENT)
I20260709 13:03:43.589773  9490 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:43.584465  9492 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:03:43.587452  9418 raft_consensus.cc:2686] T 807906edc34d41589d9b860b72f70e16 P d62c9d5a052b42ce8675f8438f846526: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:03:43.594117  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 82361.4us
I20260709 13:03:43.590315  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:43.594980  9443 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:43.595191  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:43.595165  9444 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:43.596711  9418 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:43.602305  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:43.568981 12968 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.605129 10069 raft_consensus.cc:1240] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:43.602759 13140 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.606360 13140 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:43.609545 13140 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:43.582643 13172 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:43.614133 13111 tablet_copy_client.cc:538] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:43.614975 13144 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:43.615135 13143 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:43.615450 13144 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:43.615855 13144 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:43.563630 13134 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:43.619135  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:43.618225  9418 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:43.613298 12845 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:43.565958 12834 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.583029 13131 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.514961 13133 consensus_queue.cc:260] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.576424 13103 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.620458  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:03:43.621155  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 119282us
W20260709 13:03:43.674348  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 86014.3us
I20260709 13:03:43.686828  9444 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:43.697247 13172 consensus_queue.cc:1059] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:43.698624 12948 raft_consensus.cc:3055] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:03:43.698976  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.699101 12948 raft_consensus.cc:740] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:43.700759 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 43909.7us
I20260709 13:03:43.700421 12834 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:43.700110 12948 consensus_queue.cc:260] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.702807 13196 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:43.686328  9452 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 9.
I20260709 13:03:43.703227 13120 consensus_queue.cc:1048] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:43.702994 13133 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:43.714417  9451 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:03:43.715824 10025 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:43.724882  9521 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
W20260709 13:03:43.730561  9490 leader_election.cc:336] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.946s (SENT)
I20260709 13:03:43.618824 12968 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:43.733253  9444 raft_consensus.cc:2410] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:03:43.733429  9490 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:43.717758 13196 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.758766  9520 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:43.763064  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:43.763567  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.749989 13143 consensus_queue.cc:1059] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:03:43.766010 13143 raft_consensus.cc:3055] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:43.766393 13143 raft_consensus.cc:740] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:43.767159 13143 consensus_queue.cc:260] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.768527 13143 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:43.771811 13140 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.733032 13033 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:03:43.778841  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 160664us
I20260709 13:03:43.776479 12934 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:43.731310 12834 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.720106 13172 consensus_queue.cc:1059] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:03:43.772572 13140 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:43.779433 13033 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.786230  9343 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:43.788352  9451 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:43.777392 12948 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:43.717358 13134 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.775936 13196 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:43.791947  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 207586us
W20260709 13:03:43.797459  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 66925.7us
I20260709 13:03:43.797665 13189 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:43.799669  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:43.800575  9443 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
W20260709 13:03:43.801539  9490 leader_election.cc:336] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 2.068s (SENT)
I20260709 13:03:43.802727  9517 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:43.798030 12863 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:03:43.806299  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.798458 13033 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:43.810284 13194 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:43.811059 13194 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:43.811280 13131 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:43.811538 13194 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:43.812254  9260 catalog_manager.cc:5028] TS d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): tablet 807906edc34d41589d9b860b72f70e16 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:03:43.810295 12933 consensus_queue.cc:1048] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:03:43.808274 13062 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:03:43.803548 13179 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:03:43.822551  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:43.823704  9521 raft_consensus.cc:2393] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 8: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:43.857980  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:03:43.858116  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 48689.3us
I20260709 13:03:43.858695  9374 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:43.860142  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:43.788005 13012 consensus_queue.cc:1059] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:03:43.864845  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:43.804821 13035 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:43.865485  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 63972.7us
I20260709 13:03:43.890295  9418 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:43.892431  9418 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:43.867861  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:43.869410  9368 raft_consensus.cc:1240] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:43.869248 12968 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:43.869652  9369 raft_consensus.cc:1275] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:43.893390  9343 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:43.873886  9374 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:43.877444  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:43.878473 13134 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:43.879914 13111 tablet_bootstrap.cc:492] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:03:43.881747 13140 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:43.809186 13145 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:43.883589 13103 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:43.790181 12834 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.904603 13134 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:43.910804 13054 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:43.911393 13054 raft_consensus.cc:697] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:43.911803 12834 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:43.898308  9377 raft_consensus.cc:2368] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 9. Current term is 10.
I20260709 13:03:43.897878  9525 raft_consensus.cc:2393] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 13: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:43.808459 12991 consensus_queue.cc:1059] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.090s
I20260709 13:03:43.913720  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:43.914278  9525 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:43.900364  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:43.900353  9490 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:43.818496 12863 raft_consensus.cc:697] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:43.893296 13157 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.912344 13054 consensus_queue.cc:237] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.918519  9343 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:43.919960  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:43.893177 13131 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:43.905074 13145 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.893167 13198 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:43.896576 13197 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:43.897337 13035 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.939961  9452 raft_consensus.cc:1240] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:43.964130  9521 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:03:43.938994 13197 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.966241 13197 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:43.965797 12863 consensus_queue.cc:237] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.929639 13153 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:43.902740 12968 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:43.970626  9520 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:03:43.980177  9520 pending_rounds.cc:85] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 7
I20260709 13:03:43.980495  9520 pending_rounds.cc:107] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:03:43.980803  9520 raft_consensus.cc:2889] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:43.971218  9341 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
W20260709 13:03:43.972429  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 65653.3us
I20260709 13:03:43.973338  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:43.983111  9521 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:03:43.935974 13145 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:43.956830 13179 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:43.946630  9525 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:43.989378  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:43.992987  9343 leader_election.cc:400] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 12. Current term is 13.
I20260709 13:03:43.993491  9343 leader_election.cc:403] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:03:43.939710 13188 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:03:43.996201 12968 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:43.980700 13153 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.000778 13153 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:44.005074 13147 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:44.006296 13035 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:43.927131 13157 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:44.021832  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:44.022924  9520 raft_consensus.cc:2393] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 12: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:43.994544  9341 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:44.021922  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:44.031025  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 138654us
I20260709 13:03:44.034036  9418 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:44.039686  9521 raft_consensus.cc:2393] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 10: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
W20260709 13:03:44.041208  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 46794.1us
W20260709 13:03:44.048205  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.049459  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:44.050369  9525 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 12.
W20260709 13:03:44.020247 13139 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.975s	user 0.006s	sys 0.032s
I20260709 13:03:44.056222  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:44.061383 10027 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:44.062098  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:44.062940  9520 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:44.063354  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:44.063870  9445 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:03:43.968874 13198 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:44.069957  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:44.039840 13147 raft_consensus.cc:697] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:44.071389  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:44.072502  9445 raft_consensus.cc:2376] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10. Re-sending same reply.
I20260709 13:03:44.051486 13035 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:44.052309 13062 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:44.039324 13012 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 12. Current term is 13.
I20260709 13:03:44.077780  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:44.078260  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:44.060804 13139 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.006s	sys 0.033s
I20260709 13:03:44.082051  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:44.082202 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 175473us
I20260709 13:03:44.053237 13133 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:44.076930 13142 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.034s	user 0.010s	sys 0.024s
I20260709 13:03:44.051347 13144 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:44.089926 13142 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.047s	user 0.010s	sys 0.025s
I20260709 13:03:44.092597  9445 raft_consensus.cc:2410] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:03:44.092880  9525 raft_consensus.cc:1240] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:03:44.094981  9445 raft_consensus.cc:1217] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 5.4->[6.5-11.7]   Dedup: 6.5->[9.6-11.7]
I20260709 13:03:44.095598  9445 raft_consensus.cc:1240] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12. Ops: [6.5-11.7]
I20260709 13:03:44.069792 12968 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:44.069572 13131 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:44.052708 13033 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:44.083755 13103 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:44.104487  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:44.118810  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 75799.2us
I20260709 13:03:44.103220 13203 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:44.146081  9445 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:03:44.148691  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:44.087186 13035 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:44.103224 12968 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:44.152776  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 170262us
I20260709 13:03:44.121279 13144 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:44.107187 13131 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:44.115084 13103 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:44.184296  9447 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:03:44.186486  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:44.188237 13196 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:44.151090 13203 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:44.155993 13147 consensus_queue.cc:237] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:44.196542  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.199309  9445 raft_consensus.cc:2410] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:03:44.205224  9490 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:44.209882  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 87321.9us
W20260709 13:03:44.219748  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.224922  9490 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:44.219156  9418 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:44.227464  9418 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:44.239765  9418 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:44.179176 13194 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:44.184309 13157 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:44.240661 12834 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:44.224295 12932 consensus_queue.cc:1059] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:03:44.242530  9418 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:44.284468  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 46600.1us
I20260709 13:03:44.183818 13205 raft_consensus.cc:2804] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:44.237262 13189 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:44.290993  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 120606us
W20260709 13:03:44.304241 13200 log.cc:927] Time spent T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.120s	user 0.000s	sys 0.003s
I20260709 13:03:44.241037 13144 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:44.286731 12863 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:44.286926 13133 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:03:44.308002 13201 log.cc:927] Time spent T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.159s	user 0.000s	sys 0.004s
I20260709 13:03:44.324348 13144 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.309432 13205 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.331010 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:44.368335 10069 raft_consensus.cc:2468] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
W20260709 13:03:44.331518  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 46924.7us
I20260709 13:03:44.314051 13198 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:44.333223 13133 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:44.374272 13133 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:44.376670  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:44.377763  9520 raft_consensus.cc:2393] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 12: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:44.378779  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:44.379691  9520 raft_consensus.cc:2393] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 8: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:44.380563  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:44.357391 13219 raft_consensus.cc:3055] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:44.411914 13219 raft_consensus.cc:740] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:44.412840 13219 consensus_queue.cc:260] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:44.414086 13219 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:44.414925  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:44.415560  9443 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:03:44.416400  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:44.358170 13185 log.cc:927] Time spent T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.638s	user 0.004s	sys 0.004s
I20260709 13:03:44.356546  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:44.418627  9525 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:03:44.419389  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:44.382300 13197 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:44.420151  9521 raft_consensus.cc:2468] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 4.
I20260709 13:03:44.370726  9490 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:44.421784  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 51182.5us
I20260709 13:03:44.391098 13211 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.422480 12845 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:44.422616 13211 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:44.325086 13134 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:44.424603 13134 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.425091 13134 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:44.356504 13221 log.cc:927] Time spent T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:03:44.430017  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:44.431208  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:44.431653 13168 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 4 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:44.432216 13211 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:44.418045  9522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 2047) took 1049 ms. Trace:
I20260709 13:03:44.419466  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:44.433902  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:44.433113  9522 rpcz_store.cc:276] 0709 13:03:43.372219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.404150 (+ 31931us) service_pool.cc:224] Handling call
0709 13:03:43.404482 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:43.779577 (+375095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.779608 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:43.800019 (+ 20411us) log.cc:844] Serialized 26 byte log entry
0709 13:03:44.052354 (+252335us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:44.052396 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.417650 (+365254us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b540028a0d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:44.417697 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.417743 (+    46us) raft_consensus.cc:1685] finished
0709 13:03:44.417756 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.417987 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":165713,"raft.queue_time_us":172014,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":5481,"spinlock_wait_cycles":480546176,"thread_start_us":183295,"threads_started":1,"wal-append.queue_time_us":297413}
W20260709 13:03:44.434930 13202 log.cc:927] Time spent T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 13:03:44.420182  9518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 2046) took 1051 ms. Trace:
I20260709 13:03:44.432410  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:44.385095  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:44.438046  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:44.436707  9518 rpcz_store.cc:276] 0709 13:03:43.368524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.398987 (+ 30463us) service_pool.cc:224] Handling call
0709 13:03:43.399284 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:43.399501 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.399525 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:43.399993 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:03:43.481302 (+ 81309us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:43.580743 (+ 99441us) log.cc:844] Serialized 14 byte log entry
0709 13:03:43.768799 (+188056us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b1800380200. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb5833f7c0a 00007fb58cb37219 00007fb58347fa40 00007fb58347a4e4 00007fb58347a455 00007fb586562060 00007fb586574716 00007fb586585287 00007fb586585208
0709 13:03:43.774213 (+  5414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.774329 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.244633 (+470304us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:44.419959 (+175326us) raft_consensus.cc:1685] finished
0709 13:03:44.420000 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.420128 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29059,"prepare.queue_time_us":98695,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":195583,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":7423,"spinlock_wait_cycles":22693504,"thread_start_us":80896,"threads_started":1,"wal-append.queue_time_us":201576}
I20260709 13:03:44.438866  9452 raft_consensus.cc:2410] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:03:44.439210  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:44.439591  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:44.385283 13196 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:44.389410  9417 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:44.450788  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 61490.5us
I20260709 13:03:44.358418 13145 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:44.454289 13172 raft_consensus.cc:3055] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:44.454658 13145 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:44.421860 13197 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:44.454993 13172 raft_consensus.cc:740] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:44.440141  9452 raft_consensus.cc:3060] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.456019 13144 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:44.458376 13184 log.cc:927] Time spent T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.741s	user 0.001s	sys 0.000s
I20260709 13:03:44.441299 13131 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:44.431208  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:44.461774  9521 raft_consensus.cc:2393] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 4: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:44.465526  9452 raft_consensus.cc:2468] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 4.
I20260709 13:03:44.466281 13197 raft_consensus.cc:2764] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:03:44.465545  9490 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:44.470573  9490 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:44.472201 12836 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:44.473093  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:44.474291  9452 raft_consensus.cc:2393] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 13: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:44.472262  9490 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:44.478142  9372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 1576) took 1082 ms. Trace:
I20260709 13:03:44.478719  9372 rpcz_store.cc:276] 0709 13:03:43.395881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.396010 (+   129us) service_pool.cc:224] Handling call
0709 13:03:43.396819 (+   809us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:43.397493 (+   674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.397523 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:43.398109 (+   586us) log.cc:844] Serialized 52 byte log entry
0709 13:03:43.557723 (+159614us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:43.589328 (+ 31605us) log.cc:844] Serialized 14 byte log entry
0709 13:03:43.589638 (+   310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.589733 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.457498 (+867765us) spinlock_profiling.cc:243] Waited 8.76 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:44.477701 (+ 20203us) raft_consensus.cc:1685] finished
0709 13:03:44.477849 (+   148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.478041 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30656,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":1602,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":7673,"spinlock_wait_cycles":57383040,"thread_start_us":159239,"threads_started":1,"wal-append.queue_time_us":238315}
I20260709 13:03:44.481040 12845 consensus_queue.cc:1059] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:44.481792 12845 consensus_queue.cc:1243] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [LEADER]: Peer d62c9d5a052b42ce8675f8438f846526 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:44.481501 13134 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:44.484110 13196 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:44.485239 13002 raft_consensus.cc:3055] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:44.449563  9524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46894 (request call id 2038) took 1083 ms. Trace:
I20260709 13:03:44.472983  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:44.436700 13203 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:44.514133  9524 rpcz_store.cc:276] 0709 13:03:43.366252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.366821 (+   569us) service_pool.cc:224] Handling call
0709 13:03:44.449331 (+1082510us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b5400154fd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:44.449483 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11965184}
I20260709 13:03:44.472985 12836 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:44.484673 13196 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:44.446466  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.444213  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:44.538642  9450 raft_consensus.cc:2468] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 4.
I20260709 13:03:44.439756  9451 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:44.348240 13033 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:44.441308  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:44.498588  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:44.500205  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 257750us
I20260709 13:03:44.393537 13205 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:44.508092 10027 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
W20260709 13:03:44.558243 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 50288.8us
I20260709 13:03:44.539805  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:44.559203  9446 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:03:44.558415  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 250512us
I20260709 13:03:44.456142 13172 consensus_queue.cc:260] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:44.484563 13134 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:44.511535  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 199686us
W20260709 13:03:44.517143  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.495065 13035 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:44.534775  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:44.565589  9452 raft_consensus.cc:2393] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 8: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:44.546304  9526 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.513278 12968 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:44.560468  9443 raft_consensus.cc:2393] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 12: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
W20260709 13:03:44.567479  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.515846 13103 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:44.522176 13197 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.576630  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:44.570600 13203 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:44.584246 13203 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:44.586963 13197 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:44.589923  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:44.591123  9443 raft_consensus.cc:2393] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 10: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:44.592350  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:44.593037  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:44.589982 13197 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:44.594004  9450 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 8.
I20260709 13:03:44.595113  9443 raft_consensus.cc:2410] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:03:44.598546  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:44.604882  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:44.606379  9443 raft_consensus.cc:2368] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 9. Current term is 10.
I20260709 13:03:44.607928  9443 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:03:44.602701  9526 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 4.
I20260709 13:03:44.613969 13197 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:44.614913 13197 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:44.617900 13197 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:44.624408  9443 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:44.595495  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:44.515511 13002 raft_consensus.cc:740] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:44.632794  9450 raft_consensus.cc:2410] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:03:44.637789  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 67271.4us
I20260709 13:03:44.647368  9341 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:44.568956 13159 raft_consensus.cc:2804] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:44.522089 13144 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:44.648481  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 58232.6us
W20260709 13:03:44.631170 13153 consensus_meta.cc:287] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.630s	user 0.007s	sys 0.006s
I20260709 13:03:44.655864  9343 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:44.658100  9448 raft_consensus.cc:1240] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:44.652457  9451 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
W20260709 13:03:44.663558  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.563982 13035 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 13:03:44.666728  9447 raft_consensus.cc:1275] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:03:44.668322  9447 pending_rounds.cc:85] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 5
I20260709 13:03:44.668691  9447 pending_rounds.cc:107] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:03:44.666671  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:44.638566 12845 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:44.669677  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:44.673761  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:44.674057  9343 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:44.655599 13159 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.669236  9447 raft_consensus.cc:2889] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:44.670533  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:44.671432  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:44.676033  9374 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:44.676925  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:44.678803  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:44.679852  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:44.680874  9372 raft_consensus.cc:2393] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 11: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:44.654603 12991 consensus_queue.cc:1059] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:03:44.695933  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:44.671324 13035 consensus_queue.cc:1243] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 6d50f1c263264b21919230bee398022b log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:44.696913  9368 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:44.698973  9447 raft_consensus.cc:1240] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:03:44.702663  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:44.696201  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:44.672082 13194 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:44.711665  9374 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:03:44.674938 12933 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:44.713600  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 66305.2us
I20260709 13:03:44.678000 13159 raft_consensus.cc:3060] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:44.715775  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:44.715952  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:44.660583 13153 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:44.678725 13149 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:44.718935  9375 raft_consensus.cc:2368] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10.
I20260709 13:03:44.721421  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:44.728754  9372 raft_consensus.cc:2393] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 13: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:44.738870 13153 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:44.744196  9522 raft_consensus.cc:1240] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 14. Current term is 15. Ops: [14.6-14.6]
I20260709 13:03:44.744400  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:44.686919 13145 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:03:44.716259 13197 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.679399 13002 consensus_queue.cc:260] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:44.728680  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:44.758744  9377 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
W20260709 13:03:44.750969 13220 log.cc:927] Time spent T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
W20260709 13:03:44.761876  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 48601.7us
I20260709 13:03:44.721294 13120 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:03:44.750331 13206 log.cc:927] Time spent T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.582s	user 0.001s	sys 0.002s
I20260709 13:03:44.767139  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:03:44.751415 13231 log.cc:927] Time spent T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:03:44.768386  9446 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 11.
W20260709 13:03:44.772181 13229 log.cc:927] Time spent T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:03:44.774289  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:44.774762  9377 raft_consensus.cc:2393] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 10: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:44.776600  9446 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:44.764185 13164 raft_consensus.cc:3055] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:44.745106 13227 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:44.720572 12933 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:44.777815 13164 raft_consensus.cc:740] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:44.780299 13149 raft_consensus.cc:697] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:44.782552 13235 log.cc:927] Time spent T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:03:44.769381 13120 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:44.794183 13002 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:44.791215 13227 raft_consensus.cc:697] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:44.799787 13227 consensus_queue.cc:237] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:44.800345  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:44.794441 13196 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:44.764528 13197 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:44.802724  9369 raft_consensus.cc:2410] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:03:44.805910  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:44.807010  9377 raft_consensus.cc:2393] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 9: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:44.808609 13144 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:44.811887 13203 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:44.819139  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:44.820288  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.821269 10069 raft_consensus.cc:1275] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:03:44.821671 13149 consensus_queue.cc:237] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:44.822695 13007 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:44.827489 13007 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.801896 13120 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:44.830895  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:44.832508  9526 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
W20260709 13:03:44.833217  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 116000us
I20260709 13:03:44.834127  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:44.834731  9526 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:44.835372  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:44.835633  9418 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:44.831521 13007 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:44.836829  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:44.837021 13153 consensus_queue.cc:1048] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:44.837388  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:44.837534  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:44.837962  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:44.836865  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:44.839758  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:44.840512  9518 raft_consensus.cc:2393] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 10: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:44.843608 12933 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:44.845162 12836 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:44.845790 12836 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:44.848052 12836 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:44.849469  9373 raft_consensus.cc:1240] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:44.850149  9519 raft_consensus.cc:1275] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:44.851269 13197 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:44.851959 12948 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:44.852223 13197 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:44.853219 12933 consensus_queue.cc:1059] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:44.854312 12933 raft_consensus.cc:3055] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:44.854669 12933 raft_consensus.cc:740] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:44.825109 13133 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:44.855309  9492 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:44.855473 12933 consensus_queue.cc:260] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:44.856056 13234 log.cc:927] Time spent T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.083s	user 0.000s	sys 0.002s
I20260709 13:03:44.856215 13139 consensus_queue.cc:1048] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:44.858098  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:44.867502  9451 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:44.868592  9492 leader_election.cc:400] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 9. Current term is 10.
I20260709 13:03:44.863413  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:44.851366  9341 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:44.869062  9492 leader_election.cc:403] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:03:44.852766 13197 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:44.870922 13153 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:44.871196  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:44.872857  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:44.875906  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:44.876721  9520 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:44.881492  9341 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:44.884902 13203 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.885705 13203 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:44.892879 13203 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:44.895321  9368 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:44.896672  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:44.857070 13133 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:44.902864  9525 raft_consensus.cc:1240] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:44.895131 12863 consensus_queue.cc:1059] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:03:44.906263 13172 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:44.906461  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:44.909214 12933 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:44.909366  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:44.910128 13062 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:44.937678  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:44.938431  9374 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:44.911763 13054 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:44.912825  9370 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:44.921989  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:44.923074  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:44.873034 13154 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:44.878109 13197 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:44.932268  9520 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:44.933929  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:44.936169  9526 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:03:44.950886  9525 raft_consensus.cc:1240] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:44.936920  9451 raft_consensus.cc:2410] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 15 because replica has last-logged OpId of term: 14 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:03:44.941200  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:44.941856  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:44.940739  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:44.953949  9519 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:44.925578 13203 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.953905  9418 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:44.963582  9374 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 11.
I20260709 13:03:44.965067  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:44.966065  9374 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 9.
W20260709 13:03:44.937881 13209 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.010s	sys 0.017s
I20260709 13:03:44.958565  9341 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
W20260709 13:03:44.967165 13209 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.010s	sys 0.017s
I20260709 13:03:44.969202  9418 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:44.941664 13210 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:44.853235 13164 consensus_queue.cc:260] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:44.981140  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:44.981822  9519 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:03:44.982582  9418 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:44.976842 10027 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:44.989238 10027 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:44.990562  9418 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:44.993978  9418 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:44.995242  9451 raft_consensus.cc:1275] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:03:44.995716  9451 pending_rounds.cc:85] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 5
I20260709 13:03:44.946794 13062 raft_consensus.cc:697] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:44.996119  9451 pending_rounds.cc:107] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:03:44.996935  9418 leader_election.cc:400] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10.
I20260709 13:03:45.000066  9418 leader_election.cc:403] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:45.000028  9451 raft_consensus.cc:2889] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:44.934388 13205 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:44.995262  9373 raft_consensus.cc:1275] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:45.012410  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:44.980801 13133 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:44.980976 13054 raft_consensus.cc:697] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:44.993345 13143 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:44.992733 13144 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:44.996769 13196 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:45.043663  9418 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:44.998558 13194 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:44.958400 13159 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:45.050360  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:45.054490  9451 raft_consensus.cc:2393] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 11: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:44.999046 13035 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:03:45.038304 12968 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10.
I20260709 13:03:44.987985 13203 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:03:45.042169 13164 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:44.980382 13210 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:45.045459 13103 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:45.048810 13196 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:45.065032  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 57941.7us
I20260709 13:03:45.079162  9490 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:45.072798 13144 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:45.094274  9490 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:45.081496 13196 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:45.059270 13120 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:45.086964 13213 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:45.073199 13007 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:45.096374 13103 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:45.139519  9372 raft_consensus.cc:1240] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11. Ops: []
W20260709 13:03:45.142148 13246 log.cc:927] Time spent T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:03:45.145869 13245 log.cc:927] Time spent T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:03:45.109691 12968 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:45.165812  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 71639.6us
I20260709 13:03:45.085925 13157 consensus_queue.cc:1048] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:03:45.154793  9376 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:45.166862  9490 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:45.121027 13216 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:45.149745 13205 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:45.130282 13144 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.109366 13227 consensus_queue.cc:1048] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:03:45.133739 13150 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:45.173030 13216 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.134486 13213 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:45.181162 13216 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:45.183152 13213 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:45.183970 13255 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:45.184435 13255 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:45.173442 12968 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:45.185899 13241 log.cc:927] Time spent T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:03:45.187642 12968 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:45.179095  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:45.179097 13144 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:45.191730 13144 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:45.152943 13103 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:45.196805  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 52316.7us
I20260709 13:03:45.107412 13226 consensus_queue.cc:1059] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.193s
I20260709 13:03:45.202620  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:45.196182  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:45.192741 13197 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:45.185088 13255 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:45.207685  9449 raft_consensus.cc:2393] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 6: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:45.180378 13150 raft_consensus.cc:697] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 11 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:45.210423 13150 consensus_queue.cc:237] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:45.214231  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 47482.7us
I20260709 13:03:45.119230 12863 consensus_queue.cc:1059] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:03:45.215344  9452 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:03:45.221397  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:45.222669  9452 raft_consensus.cc:3060] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:45.220893  9341 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:45.223593  9444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 2490) took 1288 ms. Trace:
I20260709 13:03:45.225533  9490 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:45.224399  9444 rpcz_store.cc:276] 0709 13:03:43.934912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.935194 (+   282us) service_pool.cc:224] Handling call
0709 13:03:43.935629 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.935950 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:43.972328 (+ 36378us) log.cc:844] Serialized 14 byte log entry
0709 13:03:45.086521 (+1114193us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b1800057e80. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58345fe07 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b 00007fb586109d23 00007fb58610a23a 00007fb586574a2a
0709 13:03:45.223193 (+136672us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:45.223248 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:45.223293 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:45.223367 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:45.223527 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36214,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":103,"spinlock_wait_cycles":16247936,"thread_start_us":136329,"threads_started":1,"wal-append.queue_time_us":1239512}
I20260709 13:03:45.228346 13197 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:45.229250 13244 log.cc:927] Time spent T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:03:45.230398 13247 log.cc:927] Time spent T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
W20260709 13:03:45.231591 13248 log.cc:927] Time spent T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:03:45.099864 13062 consensus_queue.cc:237] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:45.209223 13103 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:45.234513  9444 raft_consensus.cc:1240] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:45.236150 13226 raft_consensus.cc:3055] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:45.236557 13179 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:45.236738 13226 raft_consensus.cc:740] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:45.237335 13179 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.237843 13179 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:45.237862 13226 consensus_queue.cc:260] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:45.239553 13226 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:45.240937 13153 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 9. Current term is 10.
I20260709 13:03:45.241317  9377 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 12.
I20260709 13:03:45.228406 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:45.110559 13054 consensus_queue.cc:237] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:45.244314 13164 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.248461 13012 consensus_queue.cc:1059] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:45.251748 13133 raft_consensus.cc:697] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:45.252899 13133 consensus_queue.cc:237] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:45.254525  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 276445us
W20260709 13:03:45.345059  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.242074 13134 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:03:45.352644  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 309051us
I20260709 13:03:45.403491  9418 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:45.412333  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.423656  9418 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:45.432039  9452 raft_consensus.cc:2468] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 5.
I20260709 13:03:45.434643 10025 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:45.438119 13007 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:45.439940  9418 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:45.357071 13143 raft_consensus.cc:697] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:45.351385 13164 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:03:45.459812 13184 log.cc:927] Time spent T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:03:45.485199  9445 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:03:45.457703 13159 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:45.486694  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 46850.1us
I20260709 13:03:45.499433  9450 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:45.470008 13144 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:45.508808  9418 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:45.439886 13266 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:45.467612 13007 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:45.478256  9452 raft_consensus.cc:1240] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:45.515628  9418 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:45.501976 13154 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.012s	sys 0.041s
I20260709 13:03:45.480752 13197 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:45.503875 13157 raft_consensus.cc:2804] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:45.509869 13210 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:45.507460 13250 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:45.506516 13263 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:45.523945  9418 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:45.533245  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:45.513378 13120 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:45.514990 13103 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:03:45.521826 13154 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.012s	sys 0.042s
I20260709 13:03:45.540071  9418 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:45.520537 13203 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:45.514467 13144 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:45.545089 13144 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:45.525336 12834 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:45.545256 13267 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:45.546554 13263 raft_consensus.cc:697] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:45.548024 13203 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:45.533304 13035 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:45.548112 13263 consensus_queue.cc:237] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:45.553308  9418 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:45.557729 13270 log.cc:927] Time spent T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:03:45.559211 13035 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:45.561722 12963 raft_consensus.cc:3055] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:45.562280 12963 raft_consensus.cc:740] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:45.563292 12963 consensus_queue.cc:260] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:45.565044  9418 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:45.625156  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:45.626665  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 62128.3us
I20260709 13:03:45.627456  9418 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:45.564808 12963 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:45.635771  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:45.638015  9450 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:45.560103 13179 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:45.641378 13179 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:45.565155 13143 consensus_queue.cc:237] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:45.647536 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:03:45.647984 13196 consensus_meta.cc:287] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.000s
I20260709 13:03:45.638244 13035 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:45.649629 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:45.649941 13196 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:45.652213  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:45.525840 13197 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:45.657119  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.658941 13197 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:45.659241 13230 log.cc:927] Time spent T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.891s	user 0.000s	sys 0.004s
I20260709 13:03:45.633692 13266 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:45.660830 13194 consensus_meta.cc:287] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.000s
I20260709 13:03:45.538648 13157 raft_consensus.cc:697] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 5 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:45.661314 13194 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:45.662276  9445 raft_consensus.cc:1275] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:45.664196 13134 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:45.559396 13164 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:45.664697 13134 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:45.652281 13196 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:45.669525  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:45.670426  9372 raft_consensus.cc:2393] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 11: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:45.648067 13255 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:45.680233  9522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 2060) took 1781 ms. Trace:
I20260709 13:03:45.680420  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:45.680784 13196 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:45.661841 13157 consensus_queue.cc:237] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:45.681422 13196 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:45.682579  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:45.680743  9522 rpcz_store.cc:276] 0709 13:03:43.898970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.436072 (+537102us) service_pool.cc:224] Handling call
0709 13:03:44.436385 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:44.754027 (+317642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:45.679907 (+925880us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b54000a6254. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:45.680158 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":699286400}
I20260709 13:03:45.684514  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:45.684942  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 60887.8us
I20260709 13:03:45.691818 13196 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:45.541599 13154 raft_consensus.cc:697] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:45.693917  9448 raft_consensus.cc:1275] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:03:45.694422  9444 raft_consensus.cc:1240] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:45.698705 13154 consensus_queue.cc:237] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:45.693967 13271 raft_consensus.cc:3055] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:45.701382 13271 raft_consensus.cc:740] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:45.702181 13271 consensus_queue.cc:260] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:45.703197 13271 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:45.096437  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:45.710255  9271 catalog_manager.cc:5697] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 4 to 5, leader changed from b0812463215649c3b011d36e2f0400c9 (127.8.4.68) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 5 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:45.711200 13209 consensus_queue.cc:1059] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:45.712524 13265 raft_consensus.cc:3055] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:45.712927 13265 raft_consensus.cc:740] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:45.714037 13265 consensus_queue.cc:260] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:45.715673 13265 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:45.722652 13255 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:45.725128 13216 consensus_meta.cc:287] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9: Time spent flushing consensus metadata: real 0.543s	user 0.010s	sys 0.001s
W20260709 13:03:45.725466  9449 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51016 (request call id 1538) took 1533 ms (client timeout 1640 ms). Trace:
I20260709 13:03:45.725800 13216 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:45.727084  9447 raft_consensus.cc:1275] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:03:45.694585  9448 pending_rounds.cc:85] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 5
I20260709 13:03:45.729327  9448 pending_rounds.cc:107] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 9.6
I20260709 13:03:45.729723  9448 raft_consensus.cc:2917] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Aborting config change with OpId 9.6: Aborted: Op aborted by new leader
I20260709 13:03:45.727253 10069 raft_consensus.cc:2368] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10.
W20260709 13:03:45.726050  9449 rpcz_store.cc:269] 0709 13:03:44.192462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.430990 (+238528us) service_pool.cc:224] Handling call
0709 13:03:45.725175 (+1294185us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b5400270954. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:45.725384 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1771193088}
I20260709 13:03:45.733507  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:45.730633  9447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 1555) took 1529 ms. Trace:
I20260709 13:03:45.740844  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:45.741330  9447 rpcz_store.cc:276] 0709 13:03:44.201103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.714846 (+513743us) service_pool.cc:224] Handling call
0709 13:03:45.726666 (+1011820us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:45.727580 (+   914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:45.730433 (+  2853us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400270950. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865698ad 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:45.730573 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2321614080}
I20260709 13:03:45.732105  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:45.743577  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:45.745532  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:45.746307  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:45.739230  9450 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:45.740391  9448 raft_consensus.cc:2889] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:45.759572  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:45.757818 13267 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.762748  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:45.772136  9449 raft_consensus.cc:1240] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:45.773898  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:45.780109  9376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52548 (request call id 1655) took 1108 ms. Trace:
I20260709 13:03:45.780685  9376 rpcz_store.cc:276] 0709 13:03:44.669116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.669316 (+   200us) service_pool.cc:224] Handling call
0709 13:03:45.776873 (+1107557us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b5400089654. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:45.776982 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":991054592}
I20260709 13:03:45.780375  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:45.782053  9524 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.015s	sys 0.025s
W20260709 13:03:45.782459  9524 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.015s	sys 0.025s
I20260709 13:03:45.782898  9374 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:45.790549  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:45.791503  9372 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:45.793202 12933 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:45.794106 12933 consensus_queue.cc:1243] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer d62c9d5a052b42ce8675f8438f846526 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:45.793884 13161 consensus_queue.cc:1059] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:45.757659 13134 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:45.794857 13226 raft_consensus.cc:3055] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:45.795497  9341 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:45.771289 13267 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:45.846387 13179 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:45.843668 13164 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.847608 13164 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:45.849884 13164 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:45.851830 13111 tablet_bootstrap.cc:492] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
W20260709 13:03:45.852242  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.856051 13239 log.cc:927] Time spent T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 1.086s	user 0.020s	sys 0.028s
W20260709 13:03:45.854288  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 58891.8us
I20260709 13:03:45.857476 13274 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:45.861907  9448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:58918 (request call id 5) took 7247 ms. Trace:
I20260709 13:03:45.865438  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:45.856755  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 631250us
I20260709 13:03:45.864751  9525 raft_consensus.cc:1275] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:45.869318  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:45.879549  9341 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:45.845347 13226 raft_consensus.cc:740] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:45.881872  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:45.885748  9490 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:45.890378  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.892608  9518 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:45.886732  9522 raft_consensus.cc:3060] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:45.883718  9448 rpcz_store.cc:276] 0709 13:03:38.605638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.608441 (+  2803us) service_pool.cc:224] Handling call
0709 13:03:38.652369 (+ 43928us) log.cc:844] Serialized 485 byte log entry
0709 13:03:39.984922 (+1332553us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b5400458e20. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5864e3142 00007fb5864c3eaa 00007fb5864cad53 00007fb5864cacd9 00007fb5864cac69 00007fb5864cac31 00007fb5864c9dfd 000000000038f354 000000000038f199 00007fb58347d475
0709 13:03:40.003661 (+ 18739us) spinlock_profiling.cc:243] Waited 6.55 ms on lock 0x7b18002066e0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58344b2a6 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5864eab26 00007fb5864e449a 00007fb5864e3714
0709 13:03:40.106584 (+102923us) spinlock_profiling.cc:243] Waited 8.43 ms on lock 0x7b5400458e20. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5864eab26 00007fb5864e449a 00007fb5864e3714 00007fb5864c3eaa 00007fb5864cad53 00007fb5864cacd9 00007fb5864cac69 00007fb5864cac31 00007fb5864c9dfd 000000000038f354
0709 13:03:40.375866 (+269282us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b5400458e20. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5864e3142 00007fb5864c3eaa 00007fb5864cad53 00007fb5864cacd9 00007fb5864cac69 00007fb5864cac31 00007fb5864c9dfd 000000000038f354 000000000038f199 00007fb58347d475
0709 13:03:45.781117 (+5405251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6712,"raft.queue_time_us":7787,"raft.run_cpu_time_us":14695,"raft.run_wall_time_us":4186450,"spinlock_wait_cycles":105074432,"thread_start_us":100287,"threads_started":1,"wal-append.queue_time_us":139938,"wal-append.run_cpu_time_us":3703,"wal-append.run_wall_time_us":1424772}
I20260709 13:03:45.900651  9521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 2066) took 1056 ms. Trace:
W20260709 13:03:45.891481  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 359513us
W20260709 13:03:45.915571  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.916146  9490 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:45.917932  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:45.917919  9490 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:03:45.919173  9520 raft_consensus.cc:2393] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 15: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:45.905877  9521 rpcz_store.cc:276] 0709 13:03:44.844053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.844185 (+   132us) service_pool.cc:224] Handling call
0709 13:03:44.844551 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:44.844895 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:44.844923 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:44.845491 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 13:03:44.948139 (+102648us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:45.177575 (+229436us) log.cc:844] Serialized 14 byte log entry
0709 13:03:45.215688 (+ 38113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:45.215908 (+   220us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:45.891795 (+675887us) spinlock_profiling.cc:243] Waited 8.13 ms on lock 0x7b18002c4be0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58347d3f3 00007fb58347f7c1 00007fb58347f779 00007fb58347f709 00007fb58347f6d1 00007fb58347e9cd 000000000038f354 000000000038f199 00007fb58346083a
0709 13:03:45.895572 (+  3777us) raft_consensus.cc:1685] finished
0709 13:03:45.900359 (+  4787us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:45.900578 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57752,"prepare.queue_time_us":133670,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":3964,"raft.queue_time_us":679050,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":278,"spinlock_wait_cycles":18704128,"thread_start_us":302453,"threads_started":2,"wal-append.queue_time_us":232848}
I20260709 13:03:45.924650  9520 pending_rounds.cc:85] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 4
I20260709 13:03:45.930227  9520 pending_rounds.cc:107] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:03:45.930611  9520 raft_consensus.cc:2889] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:45.930718  9490 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:45.932430  9490 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:45.932941  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:45.890799 13188 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:45.902717 13216 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:45.899865 13179 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:45.903385 12863 raft_consensus.cc:3055] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:45.934937  9449 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:45.955291  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:45.935653  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.956517  9521 raft_consensus.cc:2393] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 11: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:45.936429  9445 raft_consensus.cc:1240] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:45.937764  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:45.940093  9490 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:45.940672  9447 raft_consensus.cc:1240] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:45.884397 13139 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:45.962265  9490 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:45.953751  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:45.925325 13255 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:45.938297  9417 leader_election.cc:400] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Vote denied by peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623) with higher term. Message: Invalid argument: T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10.
I20260709 13:03:45.967175  9417 leader_election.cc:403] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:45.920606 13264 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:45.963734  9517 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:45.965839  9490 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:45.903513 13164 consensus_queue.cc:1059] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:03:45.886482 13268 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:03:45.988257 13134 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:45.903571 13149 consensus_queue.cc:1048] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:03:45.934248 12963 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:45.974871  9490 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:46.015352  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:46.016289  9490 leader_election.cc:400] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 9. Current term is 10.
I20260709 13:03:46.017566  9522 raft_consensus.cc:2468] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 5.
I20260709 13:03:45.975126  9450 raft_consensus.cc:1240] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:45.976624  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:46.018716  9445 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:03:45.977648 13288 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:03:45.981208 13264 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:45.966681 13179 raft_consensus.cc:697] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:45.892221 13226 consensus_queue.cc:260] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:45.954937 12836 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:45.971021 13139 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:45.985515 13274 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:45.973857 13153 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:45.973484  9443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 1541) took 1780 ms. Trace:
I20260709 13:03:46.037171  9443 rpcz_store.cc:276] 0709 13:03:44.193257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.632021 (+438764us) service_pool.cc:224] Handling call
0709 13:03:44.632407 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:44.638524 (+  6117us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:44.638560 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:44.659870 (+ 21310us) log.cc:844] Serialized 26 byte log entry
0709 13:03:44.753904 (+ 94034us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:44.753948 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.754087 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:45.855339 (+1101252us) spinlock_profiling.cc:243] Waited 6.75 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:45.957580 (+102241us) raft_consensus.cc:1685] finished
0709 13:03:45.957602 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:45.973410 (+ 15808us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":6023,"spinlock_wait_cycles":15532800,"thread_start_us":73996,"threads_started":1,"wal-append.queue_time_us":101337}
I20260709 13:03:46.038728  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:45.991745 10027 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:46.039366  9522 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:46.040302  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:45.998773  9447 raft_consensus.cc:1217] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 5.4->[6.5-12.8]   Dedup: 6.5->[9.6-12.8]
I20260709 13:03:46.041343  9447 pending_rounds.cc:85] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 5
I20260709 13:03:46.041795  9447 pending_rounds.cc:107] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:03:46.042079  9447 raft_consensus.cc:2889] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:45.951949 13254 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:46.001919  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:46.003083  9449 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
W20260709 13:03:46.043769  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 181119us
I20260709 13:03:46.046901  9526 raft_consensus.cc:2410] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:03:46.051960  9522 raft_consensus.cc:2393] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 10: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:46.018215  9490 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:45.955348 13250 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:45.955178 12863 raft_consensus.cc:740] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:46.095198  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:46.021224  9517 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:03:46.022837  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:46.024573  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:45.983733 13292 log.cc:927] Time spent T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:03:45.935225 12948 consensus_queue.cc:1059] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:03:45.989688 13111 tablet_bootstrap.cc:492] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:03:45.971302 13002 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:46.032580  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:45.895749 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 461214us
I20260709 13:03:46.059042 12996 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:46.111311  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:46.021106 12963 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:46.055939  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:03:46.056861 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 65194.7us
I20260709 13:03:46.055189  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:46.034102 13164 consensus_queue.cc:1243] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer d62c9d5a052b42ce8675f8438f846526 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:46.069861  9525 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:46.029681 13268 consensus_queue.cc:1059] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
W20260709 13:03:46.185207  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 85104.8us
W20260709 13:03:46.053941 13150 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.012s	sys 0.019s
I20260709 13:03:46.103660  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:46.104446  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:46.060637 13226 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:46.106441  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:46.020895 13255 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:03:46.108525  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 264495us
I20260709 13:03:46.109987  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:46.035698 13154 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:03:46.152942  9526 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
W20260709 13:03:46.152849  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 134725us
I20260709 13:03:46.096776 13274 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.059482 13120 consensus_queue.cc:1048] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:03:46.068173 13153 consensus_queue.cc:1059] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:03:46.192493 13222 consensus_queue.cc:1048] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:46.192734 13249 raft_consensus.cc:2764] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
W20260709 13:03:46.193904 13297 log.cc:927] Time spent T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:03:46.194864 13295 log.cc:927] Time spent T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:03:46.102829 13054 consensus_queue.cc:1059] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:03:46.148422 12963 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:46.101408 13250 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.232719  9341 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:46.286424  9490 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:46.235848  9372 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 10.
W20260709 13:03:46.189770 13258 log.cc:927] Time spent T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:03:46.187527 13189 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:46.191509 13111 ts_tablet_manager.cc:1403] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 2.312s	user 0.051s	sys 0.034s
W20260709 13:03:46.215372 13150 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.013s	sys 0.019s
I20260709 13:03:46.249718 13139 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:46.239034 13304 log.cc:927] Time spent T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:03:46.324103  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:46.352051  9526 raft_consensus.cc:2393] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 12: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:46.325930  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:46.354519 13255 raft_consensus.cc:3055] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:03:46.238137 13298 log.cc:927] Time spent T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:03:46.355029 13255 raft_consensus.cc:740] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:46.251380 13145 raft_consensus.cc:3055] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:46.356148 13145 raft_consensus.cc:740] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:46.250555 13257 raft_consensus.cc:3055] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:03:46.361717  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.362205  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 75936.2us
W20260709 13:03:46.340492  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 107912us
I20260709 13:03:46.344769  9518 raft_consensus.cc:2468] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 13.
I20260709 13:03:46.325407 13134 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.358834  9517 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:46.364530  9341 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:46.365447 10027 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:46.329403  9523 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:46.371520  9445 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:46.357132 13145 consensus_queue.cc:260] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.357383 13264 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:46.316973 13209 consensus_queue.cc:1059] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:03:46.203352 13179 consensus_queue.cc:237] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:46.376592  9323 auto_rebalancer.cc:629] Failed to schedule move for tablet 7f6a0746767b404997bb10c4d3ecd42c: Aborted: Op aborted by new leader
I20260709 13:03:46.377305 13145 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:46.361855 13139 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:46.378010 13267 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:46.376699  9490 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:46.346174 13007 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.345955 13133 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.316387 13274 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.396008  9445 raft_consensus.cc:1275] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:46.361501 13257 raft_consensus.cc:740] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:46.400041  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.400638  9451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 2512) took 1193 ms. Trace:
I20260709 13:03:46.361706 13254 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:46.401085  9451 rpcz_store.cc:276] 0709 13:03:45.206969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.518079 (+311110us) service_pool.cc:224] Handling call
0709 13:03:45.518531 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:45.523233 (+  4702us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:45.523265 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:45.523757 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:03:45.747353 (+223596us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:45.747421 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:45.747528 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:46.400399 (+652871us) raft_consensus.cc:1685] finished
0709 13:03:46.400425 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:46.400576 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10132,"raft.queue_time_us":4306,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":8502,"thread_start_us":142131,"threads_started":1,"wal-append.queue_time_us":365018}
I20260709 13:03:46.378993 13054 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.373725 13308 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:46.381265 13216 raft_consensus.cc:2804] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:46.378723 12991 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:46.379220 13153 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:46.410456  9490 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:46.383175 13012 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:46.355983 13255 consensus_queue.cc:260] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.391057 13147 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.406670 13133 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.423614 13302 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:03:46.426532  9524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 2078) took 1486 ms. Trace:
W20260709 13:03:46.427322 13271 consensus_meta.cc:287] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.724s	user 0.016s	sys 0.004s
I20260709 13:03:46.389142 13188 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:46.461076 13188 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.462651 13147 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.463374 13188 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:46.463953 13188 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:46.464576 13188 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:46.390786 13160 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:46.381934 13288 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623) with higher term. Message: Invalid argument: T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10.
I20260709 13:03:46.487383 13111 raft_consensus.cc:359] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9 [term 10 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.413323 13264 consensus_queue.cc:1048] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:03:46.444406 13216 raft_consensus.cc:697] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 13 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:46.418591 13054 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.491174 13216 consensus_queue.cc:237] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:46.492056  9443 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 10.
I20260709 13:03:46.453451 13153 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.471076 13257 consensus_queue.cc:260] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.494675 13257 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:46.494983  9369 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
W20260709 13:03:46.496089  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.454353 13219 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 13:03:46.499517 13310 log.cc:927] Time spent T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:03:46.502604 13274 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:46.504151 13250 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:46.401285 13007 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.405963 13154 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:46.378859 13134 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:46.456691  9524 rpcz_store.cc:276] 0709 13:03:44.941694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.941820 (+   126us) service_pool.cc:224] Handling call
0709 13:03:44.947101 (+  5281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:45.073239 (+126138us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:45.785314 (+712075us) log.cc:844] Serialized 14 byte log entry
0709 13:03:46.145924 (+360610us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:46.146408 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:03:46.153660 (+  7252us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:46.153707 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.153800 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:46.426248 (+272448us) raft_consensus.cc:1685] finished
0709 13:03:46.426279 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:46.426450 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":149141,"prepare.queue_time_us":112490,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":230968,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":55174,"thread_start_us":974169,"threads_started":3,"wal-append.queue_time_us":564844}
I20260709 13:03:46.479686 13133 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:46.481127 13160 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.466470 13188 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.509793  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:46.514178  9418 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:46.531349  9444 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:03:46.532019  9418 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:46.399427 13139 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.415266 12845 consensus_queue.cc:1059] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:03:46.535328 13160 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:46.535820 12845 raft_consensus.cc:3055] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:46.536193 12845 raft_consensus.cc:740] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:46.537680 13188 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:46.537318 12845 consensus_queue.cc:260] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.455354 12991 raft_consensus.cc:697] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:46.539212 12991 consensus_queue.cc:237] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.541440 13054 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:46.538415 13267 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:46.543738  9418 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:46.544669 13134 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:46.545287 13133 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:46.519850  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:46.546484  9446 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:46.524287  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:46.547209 13007 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:46.525080  9450 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:46.526523 13250 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:46.535360 13139 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:46.545020  9418 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:46.551259  9418 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:46.552933  9418 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:46.566047  9418 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:46.494949 13153 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:46.418118 13254 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.568511  9418 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:46.577934  9418 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:46.548689 13250 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.581423  9418 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:46.545295 13134 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:46.567884 13007 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:46.572197 13267 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:46.599289 13250 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:46.585594  9323 auto_rebalancer.cc:629] Failed to schedule move for tablet 060ae09cf899421ea6057ee5eca95814: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:46.605844  9444 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:46.611409  9341 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:46.609495  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:46.578984 13265 consensus_meta.cc:287] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.863s	user 0.013s	sys 0.005s
I20260709 13:03:46.568430 13288 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:46.572309 13133 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:46.597322 13254 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:46.620283  9371 raft_consensus.cc:2410] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:03:46.621801  9341 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:46.601289 13314 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:46.606003 13007 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:46.606093 13267 raft_consensus.cc:697] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:46.646484 13267 consensus_queue.cc:237] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.610195 13111 raft_consensus.cc:740] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:03:46.644711  9448 raft_consensus.cc:1240] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:46.632954 13265 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:46.627025 13271 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:46.619377 13288 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:46.600971 12963 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.675887 13254 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:46.678956 13254 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.668812 13265 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.680156 13265 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:46.649327 13160 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:03:46.682938 13254 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:46.636264 13257 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:03:46.670836 13271 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.671375 13288 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:46.676324 13250 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:46.665681 13054 consensus_queue.cc:1059] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:03:46.659030 13314 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:03:46.692833 13271 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:46.691771 13209 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:46.711654  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 301292us
I20260709 13:03:46.703382 13134 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:46.706234 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:46.684494 13111 consensus_queue.cc:260] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:03:46.701234 13250 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.709607 13209 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.734294 12963 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:46.735378 13209 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:46.732667 13250 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:46.737380 13120 raft_consensus.cc:3055] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:46.737821 13120 raft_consensus.cc:740] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:46.738667 13120 consensus_queue.cc:260] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.739723 13120 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:46.719969 13254 consensus_queue.cc:1048] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:03:46.747182  9369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52548 (request call id 1687) took 1015 ms. Trace:
I20260709 13:03:46.747745  9369 rpcz_store.cc:276] 0709 13:03:45.732149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.732351 (+   202us) service_pool.cc:224] Handling call
0709 13:03:46.746939 (+1014588us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b54001b0154. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:46.747102 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1641081600}
I20260709 13:03:46.751097 13280 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:46.751889 13280 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.753499 13062 raft_consensus.cc:3055] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:46.753942 13062 raft_consensus.cc:740] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:46.754171 13111 ts_tablet_manager.cc:1434] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.397s	user 0.010s	sys 0.001s
W20260709 13:03:46.754765  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.754875 13062 consensus_queue.cc:260] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.759155  9371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52548 (request call id 1688) took 1026 ms. Trace:
I20260709 13:03:46.759624  9371 rpcz_store.cc:276] 0709 13:03:45.732437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.732558 (+   121us) service_pool.cc:224] Handling call
0709 13:03:46.758939 (+1026381us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b540021c854. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:46.759085 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1976892800}
I20260709 13:03:46.761988 13147 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:46.762068 10025 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:46.762799  9462 tablet_copy_service.cc:342] P d62c9d5a052b42ce8675f8438f846526: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-7f6a0746767b404997bb10c4d3ecd42c received from {username='slave'} at 127.0.0.1:45366
I20260709 13:03:46.763330  9462 tablet_copy_service.cc:434] P d62c9d5a052b42ce8675f8438f846526: ending tablet copy session b0812463215649c3b011d36e2f0400c9-7f6a0746767b404997bb10c4d3ecd42c on tablet 7f6a0746767b404997bb10c4d3ecd42c with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:03:46.767947 13140 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:46.768594 13140 raft_consensus.cc:697] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 10 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:46.768858  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:46.769482 13140 consensus_queue.cc:237] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:46.756667 13062 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:46.776188  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.754194 13280 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:46.794659  9517 raft_consensus.cc:1240] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:46.797991  9524 raft_consensus.cc:1240] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:46.799937  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:46.801192  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:46.801519  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:46.799679  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:46.802215  9520 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:03:46.802230  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:46.803296  9519 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:46.804375  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:46.805783  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:46.806658  9520 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:46.807529  9519 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:03:46.814076  9521 raft_consensus.cc:1275] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:46.802153  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:46.817262  9524 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:46.798794 13268 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.795105 13254 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:46.825160  9518 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
W20260709 13:03:46.846076  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 261163us
I20260709 13:03:46.871232  9518 pending_rounds.cc:85] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 6
I20260709 13:03:46.866473  9524 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:03:46.866330 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:46.872272  9418 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:46.872661  9518 pending_rounds.cc:107] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:03:46.873132  9518 raft_consensus.cc:2889] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:46.870306 13226 consensus_meta.cc:287] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.621s	user 0.018s	sys 0.001s
W20260709 13:03:46.877426  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 126794us
W20260709 13:03:46.878006  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.860127 13316 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:46.882783  9418 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:46.886080  9418 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:46.866628 13268 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.888531  9418 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:46.862680 13254 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:46.932257  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.936259  9343 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:46.936897 13268 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:46.939528 12933 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:46.940136 12933 raft_consensus.cc:697] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:46.940711  9526 raft_consensus.cc:1275] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:46.946211 13255 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:46.947122 13326 log.cc:927] Time spent T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:03:46.948628 13318 log.cc:927] Time spent T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:03:46.891389 13133 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:46.885625 13319 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:46.895143 13007 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:46.890166 13316 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:46.966403 12933 consensus_queue.cc:237] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.968178 13316 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:46.970124 13327 log.cc:927] Time spent T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:03:46.970261 13134 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:46.970865 13134 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:46.966917 13133 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.920522 13315 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:46.978688 13226 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:03:46.980835  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:46.989714  9447 raft_consensus.cc:2468] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 6.
I20260709 13:03:46.921126 12991 consensus_queue.cc:1048] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:03:46.997255 10025 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:46.999883  9343 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:03:46.929867 13265 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.980173 13007 raft_consensus.cc:697] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:47.002147  9343 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:47.010712 13324 log.cc:927] Time spent T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:03:47.012094 13271 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:46.990046 13288 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:47.040762 13288 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:47.002156 13291 raft_consensus.cc:2804] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:47.041925 13291 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:47.026592  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:47.042315  9450 raft_consensus.cc:1240] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:47.004756 13172 raft_consensus.cc:2804] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:47.043506 13172 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:47.043920 13172 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:47.035897  9343 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:47.038972 13271 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:47.052634  9522 raft_consensus.cc:1275] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:46.985854 13133 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:47.042389 13291 raft_consensus.cc:3060] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:47.054001 13333 log.cc:927] Time spent T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:03:47.049432 12991 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:47.001926 13145 consensus_queue.cc:1059] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:03:47.074641  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:47.075237  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:47.059492 13271 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:47.083256  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:47.049922 13257 consensus_queue.cc:1048] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:03:47.084491  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:47.084779  9451 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:47.086479  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:47.087430  9447 raft_consensus.cc:2393] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 14: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:47.094018  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:47.095256  9449 raft_consensus.cc:2393] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 12: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:47.113554  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:47.114353  9444 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:47.117650 13012 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:47.118237 13012 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:47.124715  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:47.077662 12991 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.135288  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:47.140650  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:47.147804  9447 raft_consensus.cc:2393] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 10: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:47.093324 12863 consensus_queue.cc:260] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:47.158237 12863 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:47.134758 12991 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:47.170156 13265 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:47.137470 13228 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.171918 13228 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:47.092283 12996 consensus_queue.cc:1048] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:03:47.174726 13228 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:47.181998  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:47.183799  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:47.135969 13007 consensus_queue.cc:237] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:47.187753 12845 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:47.189700  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.193404  9523 raft_consensus.cc:1275] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:47.191682  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:47.205682  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:47.209311  9443 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:47.220204  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:47.221414  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:47.223959  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:47.219547  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:47.194955 12836 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.233304  9444 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:03:47.223469 13002 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:47.142923 13271 consensus_queue.cc:1059] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:03:47.256772  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:47.258107  9444 raft_consensus.cc:2393] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 15: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:47.217502 13140 consensus_queue.cc:1048] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:03:47.245397 13340 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.262223  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:47.254379 13226 raft_consensus.cc:3055] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:47.245750 12836 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:47.259925 13254 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:47.282558  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 246753us
W20260709 13:03:47.296151 13322 log.cc:927] Time spent T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.566s	user 0.001s	sys 0.003s
I20260709 13:03:47.298163  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:47.299453  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:47.300561  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:47.305606 13321 log.cc:927] Time spent T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e: Append to log took a long time: real 0.581s	user 0.003s	sys 0.000s
I20260709 13:03:47.251943 13002 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:47.307569  9490 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:47.316548  9418 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:47.317354  9452 raft_consensus.cc:1217] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 10.5->[12.6-12.6]   Dedup: 12.6->[]
I20260709 13:03:47.318148  9452 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:03:47.313344  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:47.318917  9525 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:47.321218  9490 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:47.322690  9418 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:47.323729  9518 raft_consensus.cc:2410] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 12 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:03:47.279204 13226 raft_consensus.cc:740] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:47.325301  9490 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:47.328900  9520 raft_consensus.cc:2410] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:03:47.329871  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:47.330713  9521 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:03:47.333122  9418 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:47.283097 13133 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:47.304668 12991 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:47.347854  9525 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:03:47.276515 13340 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:47.339140 13062 consensus_meta.cc:287] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.562s	user 0.013s	sys 0.000s
W20260709 13:03:47.340544 13267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.011s	sys 0.016s
I20260709 13:03:47.328238 13320 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:47.339874 13329 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:47.334291 13317 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:47.353943 12863 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:47.381605 13267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.011s	sys 0.016s
I20260709 13:03:47.324414 13342 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:03:47.358090 13133 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:47.423602  9443 raft_consensus.cc:1275] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:47.358251 13249 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:03:47.387485 13329 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:47.353711 13345 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:03:47.358961 13134 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:47.459422 13002 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:47.451869 13216 consensus_queue.cc:1048] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:03:47.462543 13149 raft_consensus.cc:3055] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:47.462996 13149 raft_consensus.cc:740] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:47.463766 13149 consensus_queue.cc:260] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:47.466681 13255 consensus_meta.cc:287] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.000s
I20260709 13:03:47.469112 13291 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:47.472007 13291 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:47.456333 13329 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:47.476922  9452 raft_consensus.cc:1275] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:47.477448 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:47.493527  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:03:47.498594  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 207707us
W20260709 13:03:47.500670  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.478852 12991 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:47.503829  9449 raft_consensus.cc:1240] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:47.505250  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:47.519279  9452 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:47.503232  9517 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:47.427887 13226 consensus_queue.cc:260] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:47.534278  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:47.555234  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 55775.5us
I20260709 13:03:47.536460 10027 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:47.558482  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.560050  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:47.561461  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:47.562242  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:47.564436  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:47.565152  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:47.569496  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:47.570569  9369 raft_consensus.cc:2368] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11.
I20260709 13:03:47.573729  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:47.574501  9375 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:03:47.590021  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:47.592108 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 55791.4us
I20260709 13:03:47.594789  9452 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:47.597364  9341 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:47.605607  9377 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:47.607560  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:47.609239  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:47.610345  9371 raft_consensus.cc:2368] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13.
I20260709 13:03:47.612141  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:47.615006  9368 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13. Ops: []
W20260709 13:03:47.627386  9275 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43240 (request call id 180) took 24470 ms (client timeout 15000 ms). Trace:
W20260709 13:03:47.598505 13120 consensus_meta.cc:287] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.858s	user 0.010s	sys 0.007s
I20260709 13:03:47.572113 13062 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:47.571796 13347 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:47.639542 13340 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:47.640784 13134 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:47.645844 13354 log.cc:927] Time spent T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:03:47.600641 13150 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:47.650117 12836 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:47.651736  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 54435.9us
I20260709 13:03:47.651126 13217 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:47.662743  9374 raft_consensus.cc:3060] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:47.677846  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 337724us
I20260709 13:03:47.619208 13226 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:47.669533  9376 raft_consensus.cc:1275] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:47.680457  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:47.621426 13209 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:47.678915  9490 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:47.628057  9275 rpcz_store.cc:269] 0709 13:03:23.144022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.144497 (+   475us) service_pool.cc:224] Handling call
0709 13:03:47.613910 (+24469413us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:42.451861 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:42.452447 (+   586us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:42.452485 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:03:42.452496 (+    11us) tablet.cc:662] Decoding operations
0709 13:03:42.453317 (+   821us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:42.453410 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:42.453444 (+    34us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:03:42.455331 (+  1887us) tablet.cc:701] Row locks acquired
0709 13:03:42.455379 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:03:42.455581 (+   202us) write_op.cc:270] Start()
0709 13:03:42.455717 (+   136us) write_op.cc:276] Timestamp: P: 1783602222455510 usec, L: 0
0709 13:03:42.455738 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:03:42.517498 (+ 61760us) log.cc:844] Serialized 3186 byte log entry
0709 13:03:43.042240 (+524742us) op_driver.cc:464] REPLICATION: finished
0709 13:03:44.008506 (+966266us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb5834600ac 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb589fa0ef0
0709 13:03:44.165118 (+156612us) write_op.cc:301] APPLY: starting
0709 13:03:44.172790 (+  7672us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:44.237499 (+ 64709us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:44.244720 (+  7221us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:44.601836 (+357116us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:44.602284 (+   448us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:03:44.602329 (+    45us) write_op.cc:312] APPLY: finished
0709 13:03:44.602807 (+   478us) log.cc:844] Serialized 65 byte log entry
0709 13:03:44.717885 (+115078us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:44.731814 (+ 13929us) write_op.cc:454] Released schema lock
0709 13:03:44.741084 (+  9270us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:44.743347 (+  2263us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:44.743380 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":900926,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":1080669,"apply.run_cpu_time_us":26214,"apply.run_wall_time_us":595532,"num_ops":8,"prepare.queue_time_us":37852,"prepare.run_cpu_time_us":31672,"prepare.run_wall_time_us":175304,"raft.queue_time_us":211030,"raft.run_cpu_time_us":36649,"raft.run_wall_time_us":1129839,"replication_time_us":524264,"spinlock_wait_cycles":9885568,"thread_start_us":1320157,"threads_started":5,"wal-append.queue_time_us":263609,"wal-append.run_cpu_time_us":6357,"wal-append.run_wall_time_us":2225856}]]}
I20260709 13:03:47.691206  9490 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:47.599931 13224 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
W20260709 13:03:47.676020 13352 log.cc:927] Time spent T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:03:47.662199 13160 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.713135 10069 raft_consensus.cc:1240] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 6. Current term is 7. Ops: []
W20260709 13:03:47.710505  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 377440us
I20260709 13:03:47.715981  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:47.686550 13346 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:47.700760 13255 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:47.676084 13012 consensus_meta.cc:287] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.555s	user 0.006s	sys 0.006s
I20260709 13:03:47.721653  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:47.663477 13062 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:47.706782 13271 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:47.699314  9374 raft_consensus.cc:1275] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:47.731159  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:47.710839 13120 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.672804 13347 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:47.712806 12836 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:47.710531 13257 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:47.710595 13134 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:47.723143 13172 consensus_meta.cc:287] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.679s	user 0.009s	sys 0.004s
I20260709 13:03:47.737912  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:47.739425  9490 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:47.741340  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:47.766857  9526 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:47.743079  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:47.767853  9518 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:47.694084 13209 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:47.690186 13217 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:47.740887  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:47.749747  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:47.713047 13160 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:47.722412 13002 consensus_queue.cc:1059] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:03:47.772390  9492 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:47.775633  9370 raft_consensus.cc:2376] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8. Re-sending same reply.
I20260709 13:03:47.783245  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:47.784375  9443 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
W20260709 13:03:47.786898  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 46077.9us
I20260709 13:03:47.787943  9418 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:47.792865  9492 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:47.795102  9492 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:47.797502  9525 raft_consensus.cc:1240] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:03:47.805379  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:47.806336  9518 raft_consensus.cc:2376] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13. Re-sending same reply.
I20260709 13:03:47.807638  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:47.808709  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:47.809676  9525 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:03:47.789913  9418 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:47.732105 13012 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:47.830248  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:47.832262  9447 raft_consensus.cc:1275] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:03:47.837597  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:47.841813  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:47.842460  9524 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:03:47.727913 13346 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:47.843055  9525 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:03:47.774065 13255 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:47.850936  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:47.758472 13120 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:47.852638  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 57625.8us
I20260709 13:03:47.863261  9492 leader_election.cc:400] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11.
I20260709 13:03:47.863675  9492 leader_election.cc:403] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:47.812420 13254 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:47.812201 13320 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:47.865945  9377 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:47.781113 13224 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:47.863440  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:47.763402 13257 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:47.871068  9526 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:03:47.888003  9525 raft_consensus.cc:1240] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:03:47.771095 13172 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:47.774735 13134 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:47.765072 13317 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:47.885998  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:47.904243  9370 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
W20260709 13:03:47.889901  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 100075us
I20260709 13:03:47.909220  9418 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:47.760401 13271 raft_consensus.cc:697] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:47.858002 13002 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:47.894811 13340 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.895169 13353 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.863445  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:47.943064  9518 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:47.858223 13216 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:47.861683 13255 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:47.901446  9374 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:03:47.862957 13366 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:47.865340 13319 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:03:47.924505  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 249391us
I20260709 13:03:47.930624  9524 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:47.865413 13367 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.942776 13320 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.944964  9418 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:47.871316 13133 raft_consensus.cc:697] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 12 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:47.948722  9375 raft_consensus.cc:1240] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:47.948468  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:47.962361  9518 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:47.889257 13315 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:47.967209 13255 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:47.999513  9370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:48.064687  9370 raft_consensus.cc:606] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:48.065269  9370 raft_consensus.cc:614] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:03:47.984884 13355 log.cc:927] Time spent T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 13:03:47.937929 13271 consensus_queue.cc:237] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:47.894131 13224 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:47.933621 13317 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:48.060480  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 115603us
I20260709 13:03:47.966325 13216 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:48.007179 13150 consensus_queue.cc:1048] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 13:03:47.991974 13254 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11.
I20260709 13:03:47.985306 13002 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.066295  9371 raft_consensus.cc:1240] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14. Ops: []
W20260709 13:03:48.066565 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 162776us
I20260709 13:03:47.947958 13340 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:48.012887 12845 consensus_meta.cc:287] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.824s	user 0.010s	sys 0.006s
W20260709 13:03:48.069306  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 206199us
I20260709 13:03:48.168368  9492 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:48.013398  9323 auto_rebalancer.cc:629] Failed to schedule move for tablet 1e9721df2c264fa2bc26de02ce5bbe1a: Illegal state: Replica 925acbe78db14db3b9e4cfc857717947 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:47.962051 13353 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.011894  9341 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:48.116369  9370 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:48.014086 13372 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:48.159231  9418 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:48.009718 13371 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:48.188352 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:03:48.069653 13351 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
I20260709 13:03:48.179853  9492 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:47.995600 13366 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.198275  9492 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:48.135457 13373 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:48.202883  9418 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.4.65:37547 timed out after 1.758s (SENT) [suppressed 8 similar messages]
I20260709 13:03:48.092434 13378 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:03:48.172056 13362 log.cc:927] Time spent T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.390s	user 0.001s	sys 0.001s
I20260709 13:03:48.006311 13367 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:48.135226 13365 log.cc:927] Time spent T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.393s	user 0.000s	sys 0.001s
I20260709 13:03:48.168401 13315 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:48.161446 13370 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:48.163141 13347 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:03:48.064792 13356 log.cc:927] Time spent T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.337s	user 0.001s	sys 0.000s
I20260709 13:03:48.213227  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:48.210815 13377 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:03:48.199546 13357 log.cc:927] Time spent T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
I20260709 13:03:48.185995 13209 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:48.188493 13371 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.161164 12933 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:03:48.215061 13346 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.198797 13372 raft_consensus.cc:697] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:48.177523 13002 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.206992 13378 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.201601 13375 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:48.206147 13012 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.010799 13320 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.216380 13120 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.220564 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:03:48.234827 13368 log.cc:927] Time spent T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.360s	user 0.000s	sys 0.002s
I20260709 13:03:48.225945 13257 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:48.241195 13209 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:48.250036 12845 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:48.256278  9451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 1566) took 1169 ms. Trace:
I20260709 13:03:48.233937 13371 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:48.210772 13316 consensus_queue.cc:1048] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:03:48.206707 13133 consensus_queue.cc:237] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.258554  9522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52502 (request call id 623) took 1063 ms. Trace:
I20260709 13:03:48.258733 13012 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:48.263708  9524 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:48.237334 13386 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:03:48.252348  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 49215.9us
W20260709 13:03:48.265357  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 67169.7us
I20260709 13:03:48.285126  9492 leader_election.cc:400] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13.
I20260709 13:03:48.258340 13384 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:48.246344 13134 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.288823 13375 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:48.292649 13391 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.292750 13375 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.293324 13391 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.295490 13375 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:48.257928 13374 log.cc:927] Time spent T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
W20260709 13:03:48.297305 13369 log.cc:927] Time spent T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
W20260709 13:03:48.305747 13387 log.cc:927] Time spent T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:03:48.245409 13378 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:48.306629 13002 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:48.307231  9448 raft_consensus.cc:1240] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:48.308871  9448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 2545) took 1620 ms. Trace:
I20260709 13:03:48.227190 13370 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:48.285516  9492 leader_election.cc:403] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:03:48.272526 13361 log.cc:927] Time spent T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 13:03:48.309266  9448 rpcz_store.cc:276] 0709 13:03:46.688315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.688472 (+   157us) service_pool.cc:224] Handling call
0709 13:03:46.688777 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.307673 (+1618896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.308647 (+   974us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b540024f9d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:48.308812 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3721483648}
W20260709 13:03:48.265854  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 254044us
I20260709 13:03:48.311915  9341 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:48.313047 13394 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:48.313635 13394 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.314014 13394 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:48.314378  9445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 1564) took 1230 ms. Trace:
I20260709 13:03:48.314889  9445 rpcz_store.cc:276] 0709 13:03:47.084404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.088855 (+  4451us) service_pool.cc:224] Handling call
0709 13:03:47.089212 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:47.122021 (+ 32809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:47.122069 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:47.135806 (+ 13737us) log.cc:844] Serialized 26 byte log entry
0709 13:03:47.677579 (+541773us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:47.702743 (+ 25164us) log.cc:844] Serialized 14 byte log entry
0709 13:03:47.704110 (+  1367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.704271 (+   161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:48.314162 (+609891us) raft_consensus.cc:1685] finished
0709 13:03:48.314186 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.314316 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35583,"prepare.queue_time_us":28578,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":203233,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":24998,"thread_start_us":439152,"threads_started":1,"wal-append.queue_time_us":700365}
I20260709 13:03:48.211027 13373 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.317905 13366 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:48.318686 13373 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.320779 13353 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.321557 13224 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.321301 13372 consensus_queue.cc:237] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.322685 13216 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.323931  9446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 1567) took 1231 ms. Trace:
I20260709 13:03:48.325052 13317 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:48.224613 13315 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.324329  9446 rpcz_store.cc:276] 0709 13:03:47.092910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.093098 (+   188us) service_pool.cc:224] Handling call
0709 13:03:47.093458 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:47.122678 (+ 29220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:47.122708 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:47.123134 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:03:47.330113 (+206979us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b18002e7bc0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58345fe07 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b 00007fb586109d23 00007fb58610a0d1 00007fb586525a0f
0709 13:03:47.495523 (+165410us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:47.525670 (+ 30147us) log.cc:844] Serialized 14 byte log entry
0709 13:03:47.525925 (+   255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.527336 (+  1411us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:48.323627 (+796291us) raft_consensus.cc:1685] finished
0709 13:03:48.323735 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.323874 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72050,"prepare.queue_time_us":23788,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":30899,"raft.queue_time_us":240928,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":15690,"spinlock_wait_cycles":27904256,"thread_start_us":165193,"threads_started":1,"wal-append.queue_time_us":558675}
I20260709 13:03:48.271267 13385 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:48.327319 13385 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:48.327507 13315 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.327813 13385 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:48.328987 13367 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.329885 13340 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.271488 13209 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.330695  9523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1719) took 1018 ms. Trace:
I20260709 13:03:48.333081  9523 rpcz_store.cc:276] 0709 13:03:47.312168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.312303 (+   135us) service_pool.cc:224] Handling call
0709 13:03:47.312635 (+   332us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:47.313102 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:47.313146 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:47.333873 (+ 20727us) log.cc:844] Serialized 52 byte log entry
0709 13:03:47.694782 (+360909us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:47.694845 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.694940 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:48.330450 (+635510us) raft_consensus.cc:1685] finished
0709 13:03:48.330484 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.330634 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3387,"raft.queue_time_us":1539,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":6836,"thread_start_us":310969,"threads_started":1,"wal-append.queue_time_us":455967}
I20260709 13:03:48.334437 13209 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.335258 13257 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.335788 13257 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:48.336422 13265 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.336978 13265 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.338301 13257 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:48.338866 13209 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.314445 13320 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:48.339478 13209 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:48.340565  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 55620.8us
I20260709 13:03:48.341377  9492 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:48.341645 13209 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.341933 12863 raft_consensus.cc:3055] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:48.342387 12863 raft_consensus.cc:740] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:48.342746  9449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 2553) took 1230 ms. Trace:
I20260709 13:03:48.342890  9492 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:48.343145  9449 rpcz_store.cc:276] 0709 13:03:47.112251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.126748 (+ 14497us) service_pool.cc:224] Handling call
0709 13:03:47.127123 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:47.518309 (+391186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.342529 (+824220us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b5400158bd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:48.342687 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":865686272}
I20260709 13:03:48.343242 12863 consensus_queue.cc:260] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:48.344265  9492 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:48.317900 13381 consensus_queue.cc:1048] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:03:48.343842 13268 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13.
W20260709 13:03:48.345204 12836 consensus_meta.cc:287] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.585s	user 0.006s	sys 0.006s
I20260709 13:03:48.346642 12836 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:48.295547 13391 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.291987 12845 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:03:48.260950  9451 rpcz_store.cc:276] 0709 13:03:47.087393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.089741 (+  2348us) service_pool.cc:224] Handling call
0709 13:03:47.090116 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:47.176979 (+ 86863us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:47.177382 (+   403us) log.cc:844] Serialized 14 byte log entry
0709 13:03:47.738285 (+560903us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:47.746341 (+  8056us) log.cc:844] Serialized 26 byte log entry
0709 13:03:47.746516 (+   175us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:47.746567 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.746659 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:48.256065 (+509406us) raft_consensus.cc:1685] finished
0709 13:03:48.256087 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.256221 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53485,"prepare.queue_time_us":1260,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":331550,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":12127,"thread_start_us":560273,"threads_started":2,"wal-append.queue_time_us":449278}
I20260709 13:03:48.349794  9517 raft_consensus.cc:1275] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:03:48.350124  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:48.351593  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:48.276718  9522 rpcz_store.cc:276] 0709 13:03:47.194787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.195426 (+   639us) service_pool.cc:224] Handling call
0709 13:03:47.195789 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:47.196217 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:47.196265 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:47.214651 (+ 18386us) log.cc:844] Serialized 26 byte log entry
0709 13:03:47.493186 (+278535us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:47.493248 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.493369 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:48.258284 (+764915us) raft_consensus.cc:1685] finished
0709 13:03:48.258314 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.258487 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1038,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":19615,"thread_start_us":242103,"threads_started":1,"wal-append.queue_time_us":438711}
I20260709 13:03:48.354200  9492 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:48.328744  9271 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 76) took 5883 ms. Trace:
I20260709 13:03:48.359478  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:48.359825  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:48.360770  9522 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:48.362088  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:48.364615  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:48.365727  9520 raft_consensus.cc:1275] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:48.366500  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:48.362865  9518 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:03:48.367446  9517 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:03:48.367916  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:48.372153  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:48.372824  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:48.377544  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:48.378114  9448 raft_consensus.cc:2410] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:03:48.379916  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:48.380950  9445 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
W20260709 13:03:48.337353 13329 consensus_meta.cc:287] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.862s	user 0.006s	sys 0.007s
I20260709 13:03:48.358037  9271 rpcz_store.cc:276] 0709 13:03:42.459000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.459713 (+   713us) service_pool.cc:224] Handling call
0709 13:03:42.622431 (+162718us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b540016e4d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d4090 00007fb586572f3a 00007fb58c3291cc 00007fb58c42737e 00007fb58a8e82a4 00007fb58a8e8232 00007fb58a8e8161 00007fb58a8e80dc 00007fb58a8e7392 00007fb5848a548c 00007fb5848a48c6
0709 13:03:48.328677 (+5706246us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:46.202538 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:46.427775 (+225237us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:46.427815 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:03:46.427835 (+    20us) tablet.cc:662] Decoding operations
0709 13:03:46.453690 (+ 25855us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:46.460663 (+  6973us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:46.460736 (+    73us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:03:46.461097 (+   361us) tablet.cc:701] Row locks acquired
0709 13:03:46.461128 (+    31us) write_op.cc:260] PREPARE: finished
0709 13:03:46.461366 (+   238us) write_op.cc:270] Start()
0709 13:03:46.461538 (+   172us) write_op.cc:276] Timestamp: P: 1783602226461295 usec, L: 0
0709 13:03:46.461575 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:03:46.462832 (+  1257us) log.cc:844] Serialized 527 byte log entry
0709 13:03:47.248513 (+785681us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:47.752745 (+504232us) op_driver.cc:464] REPLICATION: finished
0709 13:03:48.192764 (+440019us) write_op.cc:301] APPLY: starting
0709 13:03:48.204240 (+ 11476us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:48.216106 (+ 11866us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:48.217876 (+  1770us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:48.284990 (+ 67114us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:48.314616 (+ 29626us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:03:48.314706 (+    90us) write_op.cc:312] APPLY: finished
0709 13:03:48.314936 (+   230us) log.cc:844] Serialized 23 byte log entry
0709 13:03:48.315158 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:48.315250 (+    92us) write_op.cc:454] Released schema lock
0709 13:03:48.315292 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:48.315706 (+   414us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:48.315734 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":154377,"reported_tablets":2,"spinlock_wait_cycles":339325696,"child_traces":[["op",{"apply.queue_time_us":401483,"apply.run_cpu_time_us":2288,"apply.run_wall_time_us":134223,"num_ops":1,"prepare.queue_time_us":376444,"prepare.run_cpu_time_us":29085,"prepare.run_wall_time_us":503881,"raft.queue_time_us":430290,"raft.run_cpu_time_us":11108,"raft.run_wall_time_us":320105,"replication_time_us":1290979,"spinlock_wait_cycles":75619200,"thread_start_us":1122737,"threads_started":4,"wal-append.queue_time_us":261696}]]}
W20260709 13:03:48.413223  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 59238.2us
I20260709 13:03:48.451472  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:48.453492  9492 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:48.344698 12863 raft_consensus.cc:3060] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:48.427423  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 54146us
I20260709 13:03:48.405663  9451 raft_consensus.cc:1275] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:48.463456  9490 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:48.346160 13217 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.473315  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:48.364053 13386 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:48.339494 13265 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.481904  9449 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:03:48.490356  9449 pending_rounds.cc:85] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 4
I20260709 13:03:48.365964 13377 raft_consensus.cc:697] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:48.380228 13317 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:48.490686  9449 pending_rounds.cc:107] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:03:48.491961  9449 raft_consensus.cc:2889] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:48.492233 13403 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:48.396968 13226 consensus_meta.cc:287] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.707s	user 0.011s	sys 0.001s
I20260709 13:03:48.492838 13403 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.495047 13391 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.495654 13391 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.451188 13002 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:48.451181 13375 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:48.475400  9492 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:48.503350  9491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.006s	sys 0.012s
I20260709 13:03:48.378857 13012 raft_consensus.cc:697] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:48.500466 12845 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:03:48.519182  9491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.006s	sys 0.012s
I20260709 13:03:48.520234  9376 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:03:48.526578  9449 raft_consensus.cc:1275] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:48.452723 13329 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:48.521890 13179 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.005s	sys 0.012s
I20260709 13:03:48.517709 13400 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:48.521291 13386 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:48.481719 13371 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.528967 12845 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:48.563849  9447 raft_consensus.cc:1240] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:48.517910 13375 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.566020  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:48.548803 13179 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.006s	sys 0.012s
I20260709 13:03:48.570556  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:48.578878  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:48.564880 12845 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:48.580881  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:48.564136 13372 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.583691 13372 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.573519 13062 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:48.587088 13404 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.587795 13404 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.590646 13370 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:48.595912  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:48.601424  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:48.606014  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:48.606740  9448 raft_consensus.cc:2393] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 12: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:48.610496  9519 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:03:48.599987 13370 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:48.611706 13370 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.614439 13370 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.618368  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:48.618793  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:48.619360  9526 raft_consensus.cc:2393] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 15: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:48.621534  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:48.623466  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:48.623932  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:48.624380  9448 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:03:48.624794  9526 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:03:48.626191  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:48.627513  9448 raft_consensus.cc:2410] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:03:48.627333  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:48.620533 12863 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:48.629065  9377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 1620) took 1022 ms. Trace:
W20260709 13:03:48.629868 13407 log.cc:927] Time spent T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:03:48.632347 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:48.632767 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:48.633445 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:48.634809  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:48.635826  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:48.636277  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:48.637334  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:48.638502 13371 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.638800  9375 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:03:48.661104  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:48.639519  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:48.643064  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:48.644309 13385 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.592446 13404 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:48.580052 13012 consensus_queue.cc:237] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.647765  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:48.636603 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:48.650166  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:48.651077  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:48.599727 13363 log.cc:927] Time spent T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.791s	user 0.005s	sys 0.000s
I20260709 13:03:48.593395 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:48.659881 13320 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:48.600997 13329 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.661193  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:48.671240  9370 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:03:48.673532  9369 raft_consensus.cc:2410] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:03:48.673619  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:48.660020 12863 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:48.696338 13385 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:48.580526 13377 consensus_queue.cc:237] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:48.687884  9373 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:48.702095 13394 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:48.653167 13378 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.705338 12845 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.707288 13378 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.707369 12845 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:48.700611 12863 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:48.710881  9444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 1579) took 1455 ms. Trace:
I20260709 13:03:48.714727 13375 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:48.678992 13255 consensus_meta.cc:287] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.506s	user 0.013s	sys 0.000s
I20260709 13:03:48.718959 13255 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.664398  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:48.656172  9377 rpcz_store.cc:276] 0709 13:03:47.606916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.620039 (+ 13123us) service_pool.cc:224] Handling call
0709 13:03:47.620500 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:47.876987 (+256487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.628782 (+751795us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b540037a0d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:48.628985 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":563832576}
I20260709 13:03:48.722226  9447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 2565) took 1199 ms. Trace:
I20260709 13:03:48.722858  9520 raft_consensus.cc:2410] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:03:48.678941  9525 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
W20260709 13:03:48.683234  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 335678us
I20260709 13:03:48.711374  9444 rpcz_store.cc:276] 0709 13:03:47.255960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.258928 (+  2968us) service_pool.cc:224] Handling call
0709 13:03:47.277410 (+ 18482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:47.277815 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:47.277845 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:47.282664 (+  4819us) log.cc:844] Serialized 26 byte log entry
0709 13:03:47.517242 (+234578us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:47.577603 (+ 60361us) log.cc:844] Serialized 14 byte log entry
0709 13:03:47.861614 (+284011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.861779 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:48.572487 (+710708us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:48.710477 (+137990us) raft_consensus.cc:1685] finished
0709 13:03:48.710657 (+   180us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.710805 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25111,"prepare.queue_time_us":59774,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":256279,"raft.run_cpu_time_us":384,"raft.run_wall_time_us":36715,"spinlock_wait_cycles":47113600,"thread_start_us":503501,"threads_started":2,"wal-append.queue_time_us":436701}
I20260709 13:03:48.684183  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:48.658654  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:48.726749 13172 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:03:48.725561  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.727798 13329 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:48.728421 13329 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.729238 13160 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.730445 13329 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.734875  9450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 1559) took 1660 ms. Trace:
I20260709 13:03:48.735332  9450 rpcz_store.cc:276] 0709 13:03:47.074522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.075162 (+   640us) service_pool.cc:224] Handling call
0709 13:03:47.075478 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:47.099285 (+ 23807us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:47.099685 (+   400us) log.cc:844] Serialized 14 byte log entry
0709 13:03:48.007568 (+907883us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:48.007819 (+   251us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:48.007957 (+   138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.734579 (+726622us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b5400230d54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:48.734659 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.734806 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36399,"prepare.queue_time_us":750,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":206902,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":38543,"spinlock_wait_cycles":54062464,"thread_start_us":893856,"threads_started":2,"wal-append.queue_time_us":617042}
W20260709 13:03:48.739681  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:48.740226  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.745043 13372 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.714757  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:48.750651  9452 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
I20260709 13:03:48.722657  9447 rpcz_store.cc:276] 0709 13:03:47.522922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.840019 (+317097us) service_pool.cc:224] Handling call
0709 13:03:47.849335 (+  9316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.564356 (+715021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.721922 (+157566us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b54001590d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:48.722157 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1642677504}
I20260709 13:03:48.754485  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:48.755223  9525 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 5.
I20260709 13:03:48.755528  9448 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:48.704696 13394 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:48.767166 12991 consensus_queue.cc:1059] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:03:48.772116 13345 consensus_queue.cc:1048] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:48.779361  9343 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:48.783063  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:48.783713  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:48.784489  9519 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:03:48.785213  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:48.785490  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:48.785750  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:48.786279  9518 raft_consensus.cc:2393] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 13: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:48.786039  9523 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:48.787144  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:48.787721  9517 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:03:48.793285  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:48.793339  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:48.790988  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:48.794939  9448 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:48.795620  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:48.796437  9418 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:48.801544  9449 raft_consensus.cc:2393] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 15: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:48.804406  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:48.804971  9418 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:48.792142 13255 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:48.801810 13375 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:48.799785 13372 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:48.803603 13394 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:48.819566  9524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 2113) took 1016 ms. Trace:
I20260709 13:03:48.820467  9524 rpcz_store.cc:276] 0709 13:03:47.803322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.993376 (+190054us) service_pool.cc:224] Handling call
0709 13:03:48.059043 (+ 65667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.278627 (+219584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.819225 (+540598us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b540028a5d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:48.819478 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":469828992}
I20260709 13:03:48.830219 13375 raft_consensus.cc:697] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 12 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:48.831326 13375 consensus_queue.cc:237] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.826628 13385 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:48.834724 13385 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:48.835314  9521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 2105) took 1035 ms. Trace:
I20260709 13:03:48.837708 13385 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:48.835706  9521 rpcz_store.cc:276] 0709 13:03:47.800094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.800685 (+   591us) service_pool.cc:224] Handling call
0709 13:03:47.840550 (+ 39865us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:47.996553 (+156003us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:47.996603 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:48.013975 (+ 17372us) log.cc:844] Serialized 26 byte log entry
0709 13:03:48.288837 (+274862us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:48.543839 (+255002us) log.cc:844] Serialized 14 byte log entry
0709 13:03:48.649225 (+105386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.834736 (+185511us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b5400289bd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:48.834791 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:48.834844 (+    53us) raft_consensus.cc:1685] finished
0709 13:03:48.834947 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.835154 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4560,"prepare.queue_time_us":312972,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":210282,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":16384,"spinlock_wait_cycles":292949888,"thread_start_us":339982,"threads_started":3,"wal-append.queue_time_us":408206}
I20260709 13:03:48.839510  9418 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:48.841450  9418 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:48.821973  9343 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:48.807884 13371 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:03:48.855073  9418 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:48.812386 13172 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:03:48.845098 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:48.847018 13367 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:48.844928 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:48.875401 13391 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:48.877058  9376 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52548 (request call id 1701) took 1206 ms (client timeout 1531 ms). Trace:
W20260709 13:03:48.877503  9376 rpcz_store.cc:269] 0709 13:03:47.670498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.680128 (+  9630us) service_pool.cc:224] Handling call
0709 13:03:48.876852 (+1196724us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b5400384d54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:48.876977 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1874880384}
I20260709 13:03:48.880360 13120 raft_consensus.cc:3055] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:48.880815 13120 raft_consensus.cc:740] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:48.881662 13120 consensus_queue.cc:260] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.882923 13120 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:48.821480 13372 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.892436 13372 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.896085 13403 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.846663 13377 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:48.846828 13329 raft_consensus.cc:2749] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:48.865513  9490 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:48.909729  9519 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
W20260709 13:03:48.910017  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 44609.5us
I20260709 13:03:48.901374  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:48.916746  9368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36e88678fcd042e78609b17fe3521242"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:48.919198  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:48.920773  9374 raft_consensus.cc:2376] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12. Re-sending same reply.
I20260709 13:03:48.923759  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:48.926275  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:48.928607  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:48.931174  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:48.909386 13377 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.870358 13367 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:48.945767  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:48.936092  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:48.921535 13386 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:48.900427  9418 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:48.950969  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 141049us
I20260709 13:03:48.940128  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:48.944455  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:48.937448  9445 raft_consensus.cc:1240] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:03:48.921736 13345 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.925802 13249 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:48.953083  9377 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:48.924108 13140 consensus_queue.cc:1048] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:03:48.954581 13386 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.970485 13386 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:48.971040 13389 log.cc:927] Time spent T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.723s	user 0.003s	sys 0.000s
I20260709 13:03:48.972400  9443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45366 (request call id 622) took 1498 ms. Trace:
I20260709 13:03:48.957268 13342 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:48.945636 13377 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:48.957389 13345 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.976979 13345 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:48.948251 13367 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:48.972831  9443 rpcz_store.cc:276] 0709 13:03:47.473982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.785351 (+311369us) service_pool.cc:224] Handling call
0709 13:03:47.785842 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:47.786404 (+   562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:47.786463 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:47.813628 (+ 27165us) log.cc:844] Serialized 26 byte log entry
0709 13:03:48.159851 (+346223us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:48.159894 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.159974 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:48.970480 (+810506us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:48.972102 (+  1622us) raft_consensus.cc:1685] finished
0709 13:03:48.972122 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.972337 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":418,"raft.queue_time_us":156970,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":40858,"spinlock_wait_cycles":10089344,"thread_start_us":295529,"threads_started":1,"wal-append.queue_time_us":383964}
I20260709 13:03:48.980688 13149 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:48.957662 13249 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:48.984158  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.984367 13249 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:48.968001 13317 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.986032 13317 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:48.977923  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:03:48.954165  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 53849.2us
W20260709 13:03:48.989495  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.992728  9523 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:03:48.996413  9341 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:48.952088  9343 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:49.006783  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:49.014773  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 62776.3us
I20260709 13:03:49.016667  9343 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:49.020787  9377 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:03:49.001427 13395 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:49.022940  9341 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:49.020423  9418 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:48.998361 13217 consensus_queue.cc:1059] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:03:49.029095  9343 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:49.001924 13172 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:03:48.997068 13288 consensus_queue.cc:1059] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:03:49.017256 13360 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:03:49.068650  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 45801.1us
I20260709 13:03:49.002182 13342 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 13:03:49.075026  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 46041.7us
I20260709 13:03:49.022253 13391 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:49.093811  9370 raft_consensus.cc:1275] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:49.067685 13394 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:49.133296 13394 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:49.134037 13394 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:49.136158 13377 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:49.127807 13372 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:49.129480 13422 log.cc:927] Time spent T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 13:03:49.129729 13317 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:49.060214 13314 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:49.119865 13342 consensus_queue.cc:1243] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:49.115952 13381 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:49.028146 13401 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:49.026180 13370 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.129s
I20260709 13:03:49.094293 13395 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:49.025919 13358 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:03:49.117847 13360 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:49.163144  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 47338.6us
W20260709 13:03:49.118324  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 59705us
W20260709 13:03:49.166466  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:49.166980  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 51673.7us
I20260709 13:03:49.186654  9341 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:49.188503  9418 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:49.158190 13392 consensus_queue.cc:1059] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:03:49.193930  9418 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:49.198153  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:49.155105 13372 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:49.201889  9521 raft_consensus.cc:1275] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:49.203357  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:49.205197  9418 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:49.205540  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:49.191989 13360 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:49.193316 13314 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:49.223707  9418 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:49.202626 13380 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:49.201598 13415 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.217669  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:49.218034 13249 consensus_queue.cc:1059] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:49.230892  9525 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:49.213254  9520 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
I20260709 13:03:49.213407  9521 raft_consensus.cc:1240] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:49.225139 13342 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:49.233439 13342 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.235561 13342 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:49.237175 13288 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:49.238039 13288 raft_consensus.cc:697] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 12 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:49.239151 13288 consensus_queue.cc:237] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:49.195399 13179 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:03:49.242985 13394 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:49.192674 13381 consensus_queue.cc:1059] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:03:49.215270 13291 raft_consensus.cc:3055] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:49.167806 13401 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:49.208807 13375 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:49.194165  9341 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:49.230119 13391 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:49.258698  9368 raft_consensus.cc:606] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:49.245703 13291 raft_consensus.cc:740] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
W20260709 13:03:49.261327  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 67255.5us
I20260709 13:03:49.269037  9368 raft_consensus.cc:614] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:49.228709  9418 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:49.272663 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 336513us
I20260709 13:03:49.283838  9369 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
W20260709 13:03:49.284838  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 56197us
I20260709 13:03:49.285849  9418 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:49.286533  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:49.287168  9521 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:49.288165  9341 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:49.287179  9418 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:49.293141  9524 raft_consensus.cc:1240] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:49.294610 13371 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:49.295029 13372 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:49.298455 13378 raft_consensus.cc:3055] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:49.298971 13378 raft_consensus.cc:740] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:49.299906 13378 consensus_queue.cc:260] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:49.258798 13377 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:49.259370 13380 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:49.312213  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:49.312445  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:49.302628 13378 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:49.312767  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:49.313330  9377 raft_consensus.cc:2393] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 12: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:49.302246 13391 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:49.314906  9525 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:49.304379 13012 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:49.317067  9341 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:49.256286 13415 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:49.309996 13371 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:49.325304 13291 consensus_queue.cc:260] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:49.326740 13291 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:49.317974  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:49.320158  9374 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:49.304443 13381 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:49.320695  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:49.386783  9520 raft_consensus.cc:2376] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11. Re-sending same reply.
I20260709 13:03:49.321936 13394 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:49.374245  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 58399.3us
I20260709 13:03:49.391808  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:49.380151  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 63233.7us
I20260709 13:03:49.381407  9525 raft_consensus.cc:1240] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
W20260709 13:03:49.382527 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 64846.8us
I20260709 13:03:49.385341 13401 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:49.392731  9520 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:49.395354  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:49.396003  9451 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:49.397584  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:49.403375  9341 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:49.405248  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:49.406248  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:49.406623  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:49.385479 13380 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:49.389154 13371 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:49.386307 13393 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:49.398635 13428 log.cc:927] Time spent T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.070s	user 0.006s	sys 0.004s
I20260709 13:03:49.484431  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:49.456375  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:49.410491  9369 raft_consensus.cc:2393] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 5: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:49.460992  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:49.405447  9341 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:49.474964  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:49.406073 13394 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:49.394784 13391 consensus_queue.cc:1048] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:03:49.489934  9518 raft_consensus.cc:1275] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:49.477345  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:49.478590  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:49.479871  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:49.483402  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:49.490222 13371 raft_consensus.cc:697] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:03:49.496068  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 90679us
W20260709 13:03:49.504835  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:49.485790 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 321349us
I20260709 13:03:49.510119  9490 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:49.430334 13386 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:49.514194  9341 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:49.508773  9418 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:49.516949 13054 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:49.516733 13346 consensus_queue.cc:1059] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:49.517484 13054 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:49.518110 13054 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:49.529759  9343 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:49.523722  9492 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:49.531210  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:49.531968 13120 consensus_meta.cc:287] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.649s	user 0.008s	sys 0.012s
I20260709 13:03:49.504300 13415 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:49.534749 13314 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:49.538319 13314 raft_consensus.cc:697] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:49.539280  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:49.539628 13314 consensus_queue.cc:237] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:49.535562  9492 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:49.522286 10027 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:49.511335 12863 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.546446  9521 raft_consensus.cc:1240] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:49.548264  9526 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:49.549538  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:49.553575  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:49.554514  9374 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:03:49.521944 13359 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:49.533504 13367 consensus_meta.cc:287] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.555s	user 0.023s	sys 0.002s
I20260709 13:03:49.564169  9343 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:49.522882 13255 raft_consensus.cc:2804] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:49.564906 13054 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:49.569280  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:49.574069  9492 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:49.575603 13217 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:03:49.577783 13345 raft_consensus.cc:3055] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:49.582060 13371 consensus_queue.cc:237] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:49.541169 13385 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:49.585367 13386 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:49.614432  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:49.615190  9518 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:49.585981 13436 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:49.490303 13393 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:49.601722  9343 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:49.589787 13403 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:49.590533 13359 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:49.692833  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 67736.7us
I20260709 13:03:49.693065  9375 raft_consensus.cc:1240] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12. Ops: []
W20260709 13:03:49.660171  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:49.609351 13438 log.cc:927] Time spent T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.063s	user 0.000s	sys 0.004s
W20260709 13:03:49.605449 13433 log.cc:927] Time spent T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.368s	user 0.000s	sys 0.009s
I20260709 13:03:49.699019 13054 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:49.604516 13255 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:49.609066 13394 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:49.661195 13437 log.cc:927] Time spent T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.267s	user 0.000s	sys 0.004s
I20260709 13:03:49.605824 13367 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:49.701952 13359 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:49.710363 13179 consensus_queue.cc:1059] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:03:49.613236 13345 raft_consensus.cc:740] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:49.590180 12863 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:49.689855 13403 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:49.627877 13436 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:49.711431  9343 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:49.710439 13160 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:49.802301  9520 raft_consensus.cc:1275] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:03:49.803925  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 92604.9us
I20260709 13:03:49.712602 13255 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:49.805472 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 283253us
I20260709 13:03:49.816126  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:49.811386  9343 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:49.821593  9370 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:03:49.811405  9518 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
I20260709 13:03:49.826997  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:49.827814  9520 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:03:49.830579 13179 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:49.834860 13179 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:49.835048 13439 log.cc:927] Time spent T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:03:49.835412 13179 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:49.801076 13403 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:49.815951 13358 consensus_queue.cc:1059] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:03:49.837404 13358 raft_consensus.cc:3055] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:49.837961 13358 raft_consensus.cc:740] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:49.838855 13358 consensus_queue.cc:260] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:49.840196 13358 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:49.851460 13367 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:49.853262 13179 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:49.868728  9518 raft_consensus.cc:1240] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:49.871183 13288 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:49.871495 13386 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.871814 13288 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:49.872133 13386 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:49.872498 13179 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:49.809831 13436 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:49.801738 13160 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.798089 13394 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:49.856052 13393 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:49.807480 13320 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.813786 13381 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:03:49.892452  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 376288us
I20260709 13:03:49.874615 13404 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:49.881495  9526 raft_consensus.cc:1275] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:49.906262 13386 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:49.884263 13160 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:49.881834 13366 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:49.902410 13360 consensus_meta.cc:287] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.642s	user 0.012s	sys 0.000s
W20260709 13:03:49.909926 13291 consensus_meta.cc:287] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9: Time spent flushing consensus metadata: real 0.583s	user 0.005s	sys 0.014s
I20260709 13:03:49.927699 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:49.933408 10070 raft_consensus.cc:2468] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 7.
I20260709 13:03:49.935171  9491 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
W20260709 13:03:49.937388  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 401766us
W20260709 13:03:49.908265 13342 consensus_meta.cc:287] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.672s	user 0.020s	sys 0.001s
I20260709 13:03:49.902397 13391 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.897302 13249 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:49.939442  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:49.908283 13381 raft_consensus.cc:697] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:49.889577 13394 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:49.941360 13342 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:49.879989 13345 consensus_queue.cc:260] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:49.943301 13378 consensus_meta.cc:287] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.002s
I20260709 13:03:49.907840 13404 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:49.955688  9452 raft_consensus.cc:1275] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:49.960692  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:49.946944 13391 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:49.961959 12863 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:49.962900  9444 raft_consensus.cc:1240] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:49.965948  9443 raft_consensus.cc:1240] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:03:49.944706 13386 raft_consensus.cc:2804] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:49.968575  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:49.961393  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:03:49.968173 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 148964us
I20260709 13:03:49.895388 13320 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:49.973687  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:49.924978 13366 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:49.962936 13391 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:49.931751 13360 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:49.978298  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 152582us
I20260709 13:03:49.967903 12845 raft_consensus.cc:3055] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:49.969097 13386 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.996584 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:49.978482 13345 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:50.012568 10070 raft_consensus.cc:2393] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 7: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:03:49.986474 12845 raft_consensus.cc:740] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:49.996062 13386 raft_consensus.cc:3060] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:49.998370 13288 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:03:50.036155 13445 log.cc:927] Time spent T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:03:50.046011 13404 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:50.037367 13444 log.cc:927] Time spent T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:03:50.047339 13394 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:50.048532 13342 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:50.050092 13359 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:50.042512 13360 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:50.038901 13366 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:50.053964  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 74232.9us
I20260709 13:03:50.015815 13391 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:50.060467  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 74128.6us
I20260709 13:03:50.068241 13012 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:50.068845 13012 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:49.995579 13381 consensus_queue.cc:237] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:50.073768  9446 raft_consensus.cc:2393] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 12: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:50.073203 12845 consensus_queue.cc:260] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:50.074420 12845 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:50.078122 13320 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:50.063274 13391 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:50.080013 13360 consensus_queue.cc:1048] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:50.085265 13345 consensus_queue.cc:1059] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:50.086616 13449 raft_consensus.cc:3055] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:50.087029 13449 raft_consensus.cc:740] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:50.087932 13449 consensus_queue.cc:260] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:50.089072  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 149890us
W20260709 13:03:50.092332  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.093313  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:50.093710  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:50.097361  9518 raft_consensus.cc:1275] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:50.100972  9492 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:50.103477  9522 raft_consensus.cc:1240] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:03:50.103650  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:50.104290  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.096637  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:50.109038  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:50.109712  9522 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:50.117862  9492 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:50.080842 13391 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:50.133436  9446 raft_consensus.cc:1275] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:03:50.145866  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.142203  9492 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:50.151049  9492 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:50.161407  9372 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:50.161792  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:50.162681  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:50.163446  9372 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:03:50.164757  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:50.117906 13395 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:50.169780  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:50.170389  9524 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:03:50.132087 13449 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:50.144361 13452 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:50.192957  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:50.147692 13385 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:50.186771  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:50.175554  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:50.208210 13458 log.cc:927] Time spent T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:03:50.256143  9524 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:50.168613 13366 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:50.177551  9522 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:03:50.268996 13456 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:50.269418  9518 raft_consensus.cc:1275] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:50.269740 13456 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:50.271709 13403 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:50.274338 13403 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:50.276098 13401 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:50.277060 13401 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:50.296012 13436 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:50.299000 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:50.178547 13404 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:50.324849  9524 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
W20260709 13:03:50.403280  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 252365us
I20260709 13:03:50.405038  9492 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:50.400377 13255 consensus_meta.cc:287] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.572s	user 0.013s	sys 0.000s
W20260709 13:03:50.416399  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.311115 13401 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:03:50.414597  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 226149us
I20260709 13:03:50.419917  9443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 1596) took 1028 ms. Trace:
I20260709 13:03:50.423056  9443 rpcz_store.cc:276] 0709 13:03:49.391824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.392113 (+   289us) service_pool.cc:224] Handling call
0709 13:03:49.392467 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:49.966391 (+573924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.419494 (+453103us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b5400220e54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:50.419822 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1318319488}
I20260709 13:03:50.380721 13452 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:50.400482 13385 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:50.412889 12845 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:50.478971 13459 log.cc:927] Time spent T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:03:50.480180 13317 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.480360  9373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50568 (request call id 527) took 1571 ms. Trace:
I20260709 13:03:50.480823  9373 rpcz_store.cc:276] 0709 13:03:48.908718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.912967 (+  4249us) service_pool.cc:224] Handling call
0709 13:03:48.913365 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:48.955784 (+ 42419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:48.955831 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:49.946412 (+990581us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b2c0001afe8. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb584e63a11 00007fb584e73372 00007fb5865a5a01 00007fb58656a43a 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2
0709 13:03:49.946815 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 13:03:50.116364 (+169549us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:50.116403 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.116963 (+   560us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:50.480002 (+363039us) raft_consensus.cc:1685] finished
0709 13:03:50.480025 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:50.480299 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41934,"raft.queue_time_us":42824,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":95,"spinlock_wait_cycles":72679680,"thread_start_us":142354,"threads_started":1,"wal-append.queue_time_us":238740}
I20260709 13:03:50.485762 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:50.480788 13317 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:50.491396 13317 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:50.492230 13317 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:50.492852 13317 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:50.496975 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:50.497449 13461 consensus_queue.cc:1048] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:50.498876 13317 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:50.499502 13317 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:50.500321 13317 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:50.501802 13012 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:50.503252 13317 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:50.504211 13012 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:50.506078  9371 raft_consensus.cc:1240] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:50.506559 13149 raft_consensus.cc:3055] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:50.506927 13149 raft_consensus.cc:740] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:50.507439  9374 raft_consensus.cc:1240] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:50.509464  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:50.400242 13160 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:50.515357  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:50.527436  9370 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:50.518249  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.528597  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:50.508839  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.530155 13403 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:50.530725 13403 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:50.543277  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:50.547178  9372 pending_rounds.cc:85] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947: Aborting all ops after (but not including) 6
I20260709 13:03:50.544427  9373 raft_consensus.cc:1240] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:03:50.546221  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:50.547399  9443 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:50.550269  9372 pending_rounds.cc:107] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:03:50.550868  9372 raft_consensus.cc:2889] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:50.555483  9374 raft_consensus.cc:1275] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:50.561224  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:50.562449  9371 raft_consensus.cc:1240] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:03:50.422127 13255 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:50.565127  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 157080us
I20260709 13:03:50.568475  9492 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:50.569955 12845 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.569979 13172 consensus_queue.cc:1048] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:50.570549 12845 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:50.572795 13172 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.577888  9492 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:50.581243  9370 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
I20260709 13:03:50.443195  9343 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:50.531774 13401 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:50.599228  9368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:52636 (request call id 49) took 1658 ms. Trace:
I20260709 13:03:50.451524 13452 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:50.457924 13385 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:50.603636  9368 rpcz_store.cc:276] 0709 13:03:48.915928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.916592 (+   664us) service_pool.cc:224] Handling call
0709 13:03:50.573789 (+1657197us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54000456d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb586564853 00007fb58b53260a 00007fb584ab87d4 00007fb584ab8762 00007fb584ab8691 00007fb584ab860c 00007fb584ab78c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:50.573960 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":784470784}
I20260709 13:03:50.538939 13314 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:50.586077 13359 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:50.611538  9443 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 16.
I20260709 13:03:50.573546 13172 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:50.631341 13377 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.639539 13468 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:03:50.663873  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 97266.5us
I20260709 13:03:50.613857 13401 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:50.651659 13474 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:50.678884  9341 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:50.665743 13468 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.678735 12845 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:50.712131 13466 log.cc:927] Time spent T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:03:50.714316 13467 log.cc:927] Time spent T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260709 13:03:50.717516 13460 log.cc:927] Time spent T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
W20260709 13:03:50.718425 13469 log.cc:927] Time spent T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:03:50.722734 13430 log.cc:927] Time spent T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 1.481s	user 0.008s	sys 0.000s
I20260709 13:03:50.723832  9521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 2140) took 1435 ms. Trace:
W20260709 13:03:50.748399  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 305281us
I20260709 13:03:50.664785 13377 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:50.758951  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:50.680564 13473 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:50.691299 13468 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:50.686407 13436 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:50.666290 13314 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:50.768049 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 129216us
I20260709 13:03:50.785982 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:50.776224  9521 rpcz_store.cc:276] 0709 13:03:49.288152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.288948 (+   796us) service_pool.cc:224] Handling call
0709 13:03:49.289261 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:49.547098 (+257837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.723459 (+1176361us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54004966d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:50.723753 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":590863232}
W20260709 13:03:50.722800 13462 log.cc:927] Time spent T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:03:50.779230  9443 raft_consensus.cc:2468] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 6.
I20260709 13:03:50.792281  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:50.793962  9524 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:50.815410  9343 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:50.819345  9524 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 6.
I20260709 13:03:50.793331 13476 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:50.809116 13451 log.cc:927] Time spent T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.768s	user 0.003s	sys 0.000s
I20260709 13:03:50.785914 13403 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:50.792024 13160 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:50.833086  9343 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:50.859476  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.813313 13255 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:50.812831 13481 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.860335  9343 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:50.796353 12845 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:50.809638 13404 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:50.811792 13314 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:50.814247 13320 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:50.807354 13483 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:50.821439 13342 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:50.905212  9343 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:50.863605 13386 consensus_meta.cc:287] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.807s	user 0.013s	sys 0.000s
I20260709 13:03:50.860239 13479 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:50.839035 13463 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:50.863214 13473 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:50.913406 13469 log.cc:927] Time spent T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:50.901355 13371 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:50.904398 13359 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:50.925792 13472 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.926519 13172 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:50.972635 13472 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:50.975437 13472 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:50.976195 13456 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:03:50.935190  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.978240 13314 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:50.978811 13314 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:50.979283 13377 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:50.978924 13149 consensus_queue.cc:260] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:50.980031 13149 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:50.939352  9375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 1644) took 1467 ms. Trace:
I20260709 13:03:50.940129 13347 raft_consensus.cc:3055] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:50.981359 13485 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:50.981616 13347 raft_consensus.cc:740] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:50.982174 13480 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:50.982029 13485 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:50.981393  9375 rpcz_store.cc:276] 0709 13:03:49.471968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.540606 (+ 68638us) service_pool.cc:224] Handling call
0709 13:03:49.540891 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:49.693856 (+152965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.939029 (+1245173us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54000c0154. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:50.939276 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340334976}
I20260709 13:03:50.983958  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:50.984390 13485 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:50.984913 13479 raft_consensus.cc:697] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:50.984979 13483 raft_consensus.cc:697] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:50.987097  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:50.987705 13479 consensus_queue.cc:237] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:50.988086  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:50.987852 13483 consensus_queue.cc:237] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:50.983881  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 53445.3us
I20260709 13:03:50.949991  9520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46902 (request call id 1754) took 1134 ms. Trace:
I20260709 13:03:50.998811  9520 rpcz_store.cc:276] 0709 13:03:49.815561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.815792 (+   231us) service_pool.cc:224] Handling call
0709 13:03:50.949699 (+1133907us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b5400496bd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:50.949898 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24594816}
I20260709 13:03:51.000170  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:50.920693 13320 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:50.929489 13463 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:50.964377  9522 raft_consensus.cc:1240] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:50.965371  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:50.967401 13449 consensus_meta.cc:287] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.777s	user 0.011s	sys 0.000s
I20260709 13:03:50.968091 13401 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:50.970186  9377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 1632) took 1583 ms. Trace:
I20260709 13:03:51.003329  9492 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:50.911441 12845 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:50.928452 13342 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:50.861159 13476 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:50.914252 13160 consensus_queue.cc:1048] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:03:50.982726 13480 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:50.990653 13314 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:50.991019 13371 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:50.981415 13461 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:50.928253 13386 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:50.907303 13481 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:50.993301  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:50.994694  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:50.935077 13482 log.cc:927] Time spent T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:03:50.996905 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 230854us
I20260709 13:03:50.989341 13456 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:51.001576  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:51.002717 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 211883us
I20260709 13:03:50.911938 13477 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:51.006620  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:51.058897 10070 raft_consensus.cc:1240] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:51.005064  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:51.019052 13359 raft_consensus.cc:697] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:51.070293  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.008410  9375 raft_consensus.cc:1240] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:50.996482 13255 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:50.998291 13366 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:51.005198  9377 rpcz_store.cc:276] 0709 13:03:49.386634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.389830 (+  3196us) service_pool.cc:224] Handling call
0709 13:03:49.390213 (+   383us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:49.495676 (+105463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:49.495707 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:49.496283 (+   576us) log.cc:844] Serialized 52 byte log entry
0709 13:03:49.951420 (+455137us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:49.976192 (+ 24772us) log.cc:844] Serialized 14 byte log entry
0709 13:03:50.064377 (+ 88185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.503208 (+438831us) spinlock_profiling.cc:243] Waited 96.2 ms on lock 0x7b5400385254. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:50.503284 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:50.808440 (+305156us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:50.969877 (+161437us) raft_consensus.cc:1685] finished
0709 13:03:50.969910 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:50.970107 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29299,"prepare.queue_time_us":25598,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":71424,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":4366,"spinlock_wait_cycles":231520512,"thread_start_us":486877,"threads_started":2,"wal-append.queue_time_us":508527}
I20260709 13:03:51.002197 13404 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:51.022895  9523 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:51.089856 10025 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:51.021394  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 342541us
I20260709 13:03:51.015516 13254 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:51.017256 13403 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.003757 13474 raft_consensus.cc:697] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:51.062695  9526 raft_consensus.cc:2393] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 in current term 8: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:51.024310 13314 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.061787  9522 raft_consensus.cc:2393] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 11: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:51.017710 13401 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:51.009186  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:51.009440  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:51.074175  9370 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:03:51.074923 13488 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.137728  9368 raft_consensus.cc:2410] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:03:51.078258  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:03:51.088191  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.028968 13461 raft_consensus.cc:697] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:51.089933  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:51.080335 13377 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:51.133987  9371 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:51.131314  9523 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:03:51.088902 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:03:51.133462  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 56449.6us
I20260709 13:03:51.069088 13456 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.144357 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:51.138007 13403 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.154544 13320 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:51.121855 13501 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:51.155035 13342 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:51.097289 13366 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.096329 13471 consensus_queue.cc:1059] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:03:51.106577 13404 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.156618 13386 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:51.157753 13476 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:51.144680 13478 log.cc:927] Time spent T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:51.158301 13359 consensus_queue.cc:237] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.148243 13465 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:51.148454 13394 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:51.160893 13454 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.201829 13501 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.195048 10061 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:03:51.165639 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:51.166105 13481 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:51.166684 13498 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:51.146646 13488 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.170545 13485 consensus_queue.cc:1059] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:51.171626 13385 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:51.172118 13360 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:51.172928 13415 consensus_queue.cc:1059] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:03:51.177695 13490 log.cc:927] Time spent T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:03:51.178328 13249 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:03:51.181573 13494 log.cc:927] Time spent T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:03:51.183362  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:51.185657 12863 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.176697 13347 consensus_queue.cc:260] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.185953 13474 consensus_queue.cc:237] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.187166  9517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 2161) took 1082 ms. Trace:
I20260709 13:03:51.088560 13255 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:51.205025  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 196261us
I20260709 13:03:51.144832 13401 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:51.100276 13477 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.140749 13314 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.197767 13499 raft_consensus.cc:2804] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:51.224900 13342 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:51.188642 13377 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.276696 13450 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.332577  9523 raft_consensus.cc:1240] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:51.326730 12863 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:51.324901 13249 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.338456 13347 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:51.326143 12845 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:51.283138 13501 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:51.355279 13450 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.358793 13377 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:51.359304 13377 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.359758 13377 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.326915 13509 consensus_queue.cc:1059] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:03:51.365110 13317 raft_consensus.cc:3055] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:51.365536 13317 raft_consensus.cc:740] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:03:51.366099 13502 log.cc:927] Time spent T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:03:51.366338 13501 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.366415 13317 consensus_queue.cc:260] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.367911 13317 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:51.368038 13496 log.cc:927] Time spent T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
I20260709 13:03:51.368947 13501 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:51.283713 13465 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.345700 13499 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.311033 13360 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.303066 13461 consensus_queue.cc:237] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.302194 13498 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.285073 13454 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.349630 13371 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:51.415118 13450 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:51.439889 13499 raft_consensus.cc:3060] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:51.425662 13254 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:51.440852 13254 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:51.435997 13366 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:51.438300 13255 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:51.423415 13345 raft_consensus.cc:3055] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:51.413195 13249 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:51.415701 13488 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:51.391712 13401 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:51.422535 13377 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:51.370826 13518 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:51.440979 13217 raft_consensus.cc:3055] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:51.448570 13217 raft_consensus.cc:740] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:51.449365 13217 consensus_queue.cc:260] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:51.450481 13454 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:51.441339 13385 raft_consensus.cc:3055] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:51.393955 13314 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:51.443686 13452 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:51.419037 13463 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:51.442845 13404 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:51.451268 13385 raft_consensus.cc:740] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:51.445978 13518 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.454640 13498 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:51.454229 13385 consensus_queue.cc:260] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.455561 13518 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:51.456851 13385 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:51.456923 13254 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.368080 13477 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:51.463102 13254 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:51.391170 13403 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:51.442092 13345 raft_consensus.cc:740] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:51.392728 13480 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:51.450593 13217 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:51.467474 13360 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:51.384204 13508 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:51.468379 13508 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.470822 13508 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:51.391180 13468 consensus_meta.cc:287] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.000s
I20260709 13:03:51.471669 13468 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.471910 13345 consensus_queue.cc:260] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.473369 13345 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:51.474092 13468 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:51.410408 12863 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:51.283524 13394 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.466172 13465 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:51.391912 13456 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:51.352810 13342 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.483172 13394 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:51.483559 13499 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:51.485622 13499 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:51.283151  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:51.521083  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.521476  9374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1737) took 1005 ms. Trace:
I20260709 13:03:51.521575  9369 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
W20260709 13:03:51.522884  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.219512  9371 raft_consensus.cc:2410] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:03:51.522487  9374 rpcz_store.cc:276] 0709 13:03:50.516127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.557111 (+ 40984us) service_pool.cc:224] Handling call
0709 13:03:50.605649 (+ 48538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:50.682775 (+ 77126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:50.682827 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:50.683490 (+   663us) log.cc:844] Serialized 26 byte log entry
0709 13:03:50.822628 (+139138us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:50.822692 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.822786 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:51.520197 (+697411us) raft_consensus.cc:1685] finished
0709 13:03:51.520316 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:51.521080 (+   764us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6582,"raft.queue_time_us":87017,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":26071,"thread_start_us":208708,"threads_started":2,"wal-append.queue_time_us":324311}
I20260709 13:03:51.527623  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:51.527205  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:51.530208  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:51.196301  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:51.532569  9369 raft_consensus.cc:2393] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 13: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:51.534191  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:51.535317  9373 raft_consensus.cc:2393] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 14: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:51.540940  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:51.543546  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:51.327167  9517 rpcz_store.cc:276] 0709 13:03:50.105210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.109144 (+  3934us) service_pool.cc:224] Handling call
0709 13:03:50.951475 (+842331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:50.952057 (+   582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:50.952086 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:50.952826 (+   740us) log.cc:844] Serialized 52 byte log entry
0709 13:03:51.105477 (+152651us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:51.105544 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:51.105666 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:51.185190 (+ 79524us) raft_consensus.cc:1685] finished
0709 13:03:51.185226 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:51.186832 (+  1606us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b5400496bd0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865698ad 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:51.187090 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":132,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"spinlock_wait_cycles":1936064896,"thread_start_us":152107,"threads_started":1,"wal-append.queue_time_us":230371}
I20260709 13:03:51.355245 10027 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:51.530400  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:51.550529  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:51.534227  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.587097  9520 raft_consensus.cc:2368] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14.
I20260709 13:03:51.593128 13508 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:51.593744  9525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1746) took 2131 ms. Trace:
I20260709 13:03:51.594182 13518 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:51.595193 13519 consensus_queue.cc:1059] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:51.596779 13314 consensus_queue.cc:1059] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:51.598187 13377 consensus_queue.cc:1048] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:51.591675 13012 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.611503 13371 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:51.611913 13392 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:51.612352  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:51.612636 13371 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.614785  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:51.616101 13371 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:51.618670 12863 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:51.619280 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:51.619792 12863 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.621652 13012 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.604373  9525 rpcz_store.cc:276] 0709 13:03:49.462607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.467077 (+  4470us) service_pool.cc:224] Handling call
0709 13:03:49.467530 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:49.468291 (+   761us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:49.481069 (+ 12778us) log.cc:844] Serialized 14 byte log entry
0709 13:03:50.086761 (+605692us) spinlock_profiling.cc:243] Waited 8.27 ms on lock 0x7b1800372160. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58347d3f3 00007fb58347f7c1 00007fb58347f779 00007fb58347f709 00007fb58347f6d1 00007fb58347e9cd 000000000038f354 000000000038f199 00007fb58346083a
0709 13:03:50.729808 (+643047us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b1800372160. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58345fe07 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b 00007fb586109d23 00007fb58610a23a 00007fb586574a2a
0709 13:03:51.003293 (+273485us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:51.012946 (+  9653us) log.cc:844] Serialized 26 byte log entry
0709 13:03:51.013166 (+   220us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:51.013203 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:51.013321 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:51.367529 (+354208us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:03:51.593072 (+225543us) raft_consensus.cc:1685] finished
0709 13:03:51.593125 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:51.593461 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46,"prepare.queue_time_us":15504,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":11407,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":5418,"spinlock_wait_cycles":58041728,"thread_start_us":265142,"threads_started":1,"wal-append.queue_time_us":1570758}
I20260709 13:03:51.623062 13314 consensus_queue.cc:1243] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:51.623696  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:51.623860 13314 raft_consensus.cc:3055] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:51.624338 13314 raft_consensus.cc:740] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:51.624744  9525 raft_consensus.cc:2393] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 11: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:51.622483  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:51.657632  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:51.661651  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:51.660622  9272 catalog_manager.cc:5697] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 6 to 10, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 10 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:51.663174  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:51.664089  9525 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:51.626156 13314 consensus_queue.cc:260] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:51.666692 13314 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:51.628213 13519 raft_consensus.cc:3055] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:51.629269 12863 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:51.629493 13508 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.669269 13519 raft_consensus.cc:740] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:51.670814 13519 consensus_queue.cc:260] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.671976 13508 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:51.608950  9523 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:51.635370 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 280212us
I20260709 13:03:51.635555  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:51.679308  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.636200 13518 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.586064 13403 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:51.637199 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:51.684289 13518 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:51.638948  9418 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:51.644093 13479 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.685577  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:51.686630 13479 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.687331  9520 raft_consensus.cc:2410] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:03:51.689812 13479 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:51.632671 13342 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:51.653257 13392 raft_consensus.cc:697] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 6 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:51.691253  9373 raft_consensus.cc:2410] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:03:51.691884 13392 consensus_queue.cc:237] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:51.654742 13456 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:51.693231  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 54645.3us
I20260709 13:03:51.693686 13456 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.694691  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:51.696491  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:51.685423 13403 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.696786 13401 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:51.697330 13342 consensus_queue.cc:1059] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:51.698277  9526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52502 (request call id 641) took 1726 ms. Trace:
I20260709 13:03:51.555688 13120 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:03:51.700939 13456 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:51.616381  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:51.715624  9526 rpcz_store.cc:276] 0709 13:03:49.971674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.971803 (+   129us) service_pool.cc:224] Handling call
0709 13:03:51.697793 (+1725990us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001554d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:51.698036 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2498902912}
I20260709 13:03:51.701123 13519 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:51.551192  9342 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:51.556346 13385 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.692461 13012 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:51.640625  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:51.706990  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:51.635635  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:51.731081  9521 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
W20260709 13:03:51.731343 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 87496.9us
I20260709 13:03:51.696939  9418 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:51.698208 13518 consensus_queue.cc:1059] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:51.664748  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:51.731969  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:51.712754  9523 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 16.
I20260709 13:03:51.731901  9372 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:03:51.734042  9452 raft_consensus.cc:3060] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:03:51.735941  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:51.741323 13012 raft_consensus.cc:2804] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:51.741864 13012 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.742300 13012 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:51.742895 13403 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:51.640630  9377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:51.745478  9377 raft_consensus.cc:606] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:51.745934  9377 raft_consensus.cc:614] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:51.746336  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:51.747305  9517 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:51.728312 13401 raft_consensus.cc:697] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:51.750227 13401 consensus_queue.cc:237] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.751363  9517 raft_consensus.cc:1240] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:51.751248  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:51.738947 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:51.754119 10061 raft_consensus.cc:2393] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 8: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
W20260709 13:03:51.756315  9375 consensus_meta.cc:287] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.007s
W20260709 13:03:51.739125  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 206661us
I20260709 13:03:51.757839  9519 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:51.756984  9375 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
W20260709 13:03:51.761770 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 43596.8us
I20260709 13:03:51.766666  9272 catalog_manager.cc:5697] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:51.768198 13012 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:51.769150  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:51.770102  9371 raft_consensus.cc:2393] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 12: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:51.731029 13385 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.774770  9521 raft_consensus.cc:1240] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:51.779321 13403 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:51.780391 13403 raft_consensus.cc:697] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:51.781358 13120 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:51.781641 13403 consensus_queue.cc:237] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:51.777894  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 81101.3us
I20260709 13:03:51.793138  9521 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:03:51.790164  9452 raft_consensus.cc:2468] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 8.
I20260709 13:03:51.784976  9492 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
W20260709 13:03:51.800274  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.799685  9525 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
I20260709 13:03:51.784926 13120 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:51.805882  9449 raft_consensus.cc:1240] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
W20260709 13:03:51.809492  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.814316 13012 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:03:51.826625  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 55809.6us
I20260709 13:03:51.829243 13456 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:51.831167 13371 raft_consensus.cc:3055] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:51.831794 13371 raft_consensus.cc:740] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:51.831894  9418 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:51.834767 13510 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:51.834980  9418 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:51.835342 13510 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:51.835798 13510 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:51.809593 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:51.839690 13527 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:51.843263 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:03:51.826709  9272 catalog_manager.cc:5697] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:51.846820 10061 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:51.847733 10025 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:51.863523 13483 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.863806 13371 consensus_queue.cc:260] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.865458 13510 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:51.874440 13510 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:51.862859  9272 catalog_manager.cc:5697] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 7 to 8, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 8 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:51.876969  9272 catalog_manager.cc:5697] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 10 to 11, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 11 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:51.865751 13371 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:51.884635  9517 raft_consensus.cc:1240] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
W20260709 13:03:51.895160  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.895695  9375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:51.896507  9375 raft_consensus.cc:606] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:51.896919  9375 raft_consensus.cc:614] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:51.901453  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:51.864519 13483 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:51.919938  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:51.925104  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 54584.9us
I20260709 13:03:51.931646  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:51.933682  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:51.938236  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:51.939106  9449 raft_consensus.cc:2393] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 8: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:03:51.939625  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:51.944109  9375 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:51.958997  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:51.962499  9372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:51.963201 13486 raft_consensus.cc:2804] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:51.963932 13486 raft_consensus.cc:697] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 8 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:03:51.965126  9372 raft_consensus.cc:606] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:51.965698  9372 raft_consensus.cc:614] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:03:51.965803  9323 auto_rebalancer.cc:629] Failed to schedule move for tablet 36e88678fcd042e78609b17fe3521242: Illegal state: Replica 925acbe78db14db3b9e4cfc857717947 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:51.967569  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:03:51.969192 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 158571us
I20260709 13:03:51.975380  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:51.977226  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:51.977561  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:51.977044  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:51.978554  9450 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:03:51.977569  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:51.980279 13483 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:51.965173 13486 consensus_queue.cc:237] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:51.982025  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:51.982941  9447 raft_consensus.cc:2393] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:51.978593  9272 catalog_manager.cc:5697] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 7 to 8, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 8 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:51.986740 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 197908us
I20260709 13:03:52.020279  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.021201  9374 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:52.021404  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.020888  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.021317  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.040400  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:52.039989  9272 catalog_manager.cc:5697] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 8 to 9, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 9 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.043327  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.068288 13508 raft_consensus.cc:3055] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:52.068928 13508 raft_consensus.cc:740] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:52.070379 13508 consensus_queue.cc:260] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:52.072268 13508 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:52.085769  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:52.086547  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.088758  9445 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:03:52.089394  9445 pending_rounds.cc:85] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 6
I20260709 13:03:52.089737  9445 pending_rounds.cc:107] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:03:52.090106  9445 raft_consensus.cc:2889] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:52.094347  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:52.102118 13377 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:52.103094 13377 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:52.105731  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.113482  9375 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
I20260709 13:03:52.116088  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.124166  9376 raft_consensus.cc:1240] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:52.146235  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.149585 13483 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:03:52.158023  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.166827  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:52.172276  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.177616  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:52.187451  9376 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:52.178786  9446 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:03:52.189061  9369 raft_consensus.cc:2393] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 11: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
W20260709 13:03:52.192178  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:52.192927  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.190052  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.165324 13385 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:52.223613  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.225930  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.221633  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.228161  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:52.230680  9449 raft_consensus.cc:2393] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 8: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:03:52.209470 13456 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:52.238071  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.239365  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.239432  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.242861  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:52.250489  9323 auto_rebalancer.cc:629] Failed to schedule move for tablet 620e7847d47845ad93329cf9a3a07dba: Illegal state: Replica 6d50f1c263264b21919230bee398022b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:52.254458  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.254289  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.256301  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.256736  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.257828  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.257498  9447 raft_consensus.cc:1275] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:03:52.253788  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.257495  9445 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
W20260709 13:03:52.259438 13538 log.cc:927] Time spent T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.208s	user 0.001s	sys 0.001s
I20260709 13:03:52.259785  9444 raft_consensus.cc:2410] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:03:52.260479  9372 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:03:52.260867  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.262135 13012 consensus_queue.cc:1059] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:52.264254 13479 raft_consensus.cc:3055] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:52.264600  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.208402 13483 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:52.262297  9343 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:52.242210 13386 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.273511  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.273447  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:52.274878  9450 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:52.273572  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.275931  9451 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:03:52.277899  9371 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:03:52.283063  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.287246  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.245249 13377 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:52.293607  9369 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:52.264653 13479 raft_consensus.cc:740] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:52.293092  9444 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:03:52.273450 13461 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:52.285501 13519 consensus_meta.cc:287] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.557s	user 0.010s	sys 0.005s
I20260709 13:03:52.302614  9368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50568 (request call id 537) took 1223 ms. Trace:
I20260709 13:03:52.305481  9445 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:03:52.289027 13345 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.267359 13456 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:52.327003  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.329357  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:52.331976  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 69760.5us
I20260709 13:03:52.310658  9368 rpcz_store.cc:276] 0709 13:03:51.058161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.655253 (+597092us) service_pool.cc:224] Handling call
0709 13:03:51.655830 (+   577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:51.809542 (+153712us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:51.931690 (+122148us) log.cc:844] Serialized 14 byte log entry
0709 13:03:52.222429 (+290739us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:52.222484 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:52.222529 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:52.281476 (+ 58947us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54000febd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:03:52.281542 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:52.281725 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5810,"prepare.queue_time_us":203961,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":2669,"raft.queue_time_us":5604,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":4685,"spinlock_wait_cycles":298316672,"thread_start_us":377354,"threads_started":2}
I20260709 13:03:52.350266 13217 raft_consensus.cc:2749] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:52.350378 13479 consensus_queue.cc:260] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:52.336854  9272 catalog_manager.cc:5697] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 3 to 9, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 9 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.355659 13479 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:52.294188 13386 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:52.361338  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.353279  9343 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:52.364881 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 349451us
W20260709 13:03:52.372418  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.334172 13345 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:52.356760  9272 catalog_manager.cc:5697] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 9 to 10, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 10 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:52.379760 13217 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:52.381183  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.361387 10061 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:52.384985  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.350850 13461 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:52.384171 13385 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.407078  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:52.414680  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 68121.2us
I20260709 13:03:52.416082  9272 catalog_manager.cc:5697] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 8 to 9, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 9 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:52.435449 13483 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:52.440812 13461 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:52.442276  9376 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
W20260709 13:03:52.448724  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.415066 13385 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:52.454523  9343 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:52.457569  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.457065 13342 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:52.459614 13540 log.cc:927] Time spent T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:03:52.459347 13342 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:52.461212  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.461333 13456 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:52.462037 13456 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.462669 13456 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:52.465502  9323 auto_rebalancer.cc:629] Failed to schedule move for tablet 7201bcdf8f724879b727639e6e67e31e: Illegal state: Replica 925acbe78db14db3b9e4cfc857717947 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:52.470250 13217 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:52.471941 13456 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:52.473471 13345 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:52.474920  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.465483  9272 catalog_manager.cc:5697] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 5 to 6, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 6 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:52.476097  9450 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
I20260709 13:03:52.479676  9343 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:52.479426  9272 catalog_manager.cc:5697] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 8 to 9, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 9 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.484702 13385 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:52.486241 13386 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:52.486832  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:52.487560  9449 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:52.487753  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.489142  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.490041  9451 raft_consensus.cc:2393] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 8: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:03:52.491552  9452 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:52.482731 13483 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:52.495258  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:52.498016  9343 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:52.494877  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.501070  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.502189  9443 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:03:52.501674  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.511806 13217 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:52.512323 13217 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:52.510304  9272 catalog_manager.cc:5697] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 7 to 8, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 8 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.512737 13217 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:52.513923  9272 catalog_manager.cc:5697] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:52.519369  9450 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
W20260709 13:03:52.521447 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 139131us
I20260709 13:03:52.549706  9342 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:03:52.550776  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.551584  9523 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:03:52.555416  9445 raft_consensus.cc:2393] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:52.558796  9375 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:03:52.561296 13012 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:52.555370 13120 raft_consensus.cc:2804] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:52.565505 13120 raft_consensus.cc:697] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:03:52.566557  9323 auto_rebalancer.cc:629] Failed to schedule move for tablet 001ad880018f49e5bec36246253efa0f: Illegal state: Replica 6d50f1c263264b21919230bee398022b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:52.569046  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.571843 13342 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:52.576475 13120 consensus_queue.cc:237] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:52.578040  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.578261 13499 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:52.580045 13499 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:52.603803 13549 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.604488 13549 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:52.606529  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.606890 13549 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:52.608582  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.608667  9343 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:52.609038  9418 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:52.608827  9451 raft_consensus.cc:1275] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:03:52.610452 13483 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:52.610772  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.611716  9445 raft_consensus.cc:2410] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:03:52.609910  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.611903 13521 consensus_queue.cc:1048] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:52.612573  9448 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:03:52.610865 13483 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.613281 13483 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:52.616628 13342 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:52.616942  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.618094 13527 consensus_queue.cc:1048] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:52.620450  9418 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:52.621934  9418 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:52.612591  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.632071 13527 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:52.633985  9449 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:03:52.632826 13342 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:52.638849  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.650862 13527 consensus_queue.cc:1048] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:52.649390  9341 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:52.653223 13479 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:52.653906 13479 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.654392 13479 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:52.652699  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 50120.6us
I20260709 13:03:52.660006  9418 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:52.661158 13527 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:52.669886  9341 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:52.670766 13549 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:52.673032  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.685972 13549 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:52.673580  9343 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:52.689620 13012 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:52.690099 13012 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:52.690233 13549 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:52.690615 13012 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:52.692028 13120 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:52.693862  9341 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:52.679080  9418 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:52.698549 13527 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:52.700235  9418 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:52.700855 13012 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:52.701273 13527 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:52.648447 13217 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:52.702093 13527 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:52.702805 13461 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:52.703377 13527 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:52.656531 13483 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:52.724834 13527 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:52.725797 13556 log.cc:927] Time spent T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:03:52.728209 13527 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:52.730516 13483 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:52.752740 13217 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:52.758442  9418 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:52.762755 13012 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:52.765606 13479 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:52.773344 13342 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:52.774129  9522 raft_consensus.cc:1275] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:03:52.774235  9418 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:52.775350 13342 raft_consensus.cc:2749] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:52.775792  9418 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:52.776216 13550 consensus_queue.cc:1048] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:52.776880 13342 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:52.779199  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:52.755404 13217 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:52.787700 13342 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:52.788468  9418 leader_election.cc:400] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14.
I20260709 13:03:52.790371  9418 leader_election.cc:403] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:03:52.768669 13479 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:52.749255 13527 consensus_queue.cc:1059] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 13:03:52.821628  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 66019.4us
I20260709 13:03:52.821924 13519 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14.
I20260709 13:03:52.824046  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:52.838373  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.839069  9375 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:03:52.839535  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.839762  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.840351  9371 raft_consensus.cc:2393] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 12: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:52.841238  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.841637  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.841279  9369 raft_consensus.cc:1240] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:52.842564  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.846907  9490 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:52.848412 13549 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:03:52.850845  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 143925us
I20260709 13:03:52.841990  9375 raft_consensus.cc:2393] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 16: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:52.841715  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.851886  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:52.852999  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:52.855027  9523 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:03:52.853049 13549 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:52.856495 13549 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:52.857741  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.858340  9373 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:52.858821 13549 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:52.860579 13342 raft_consensus.cc:3055] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:52.856633 13479 consensus_queue.cc:1059] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:52.853773  9341 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:52.862278 13342 raft_consensus.cc:740] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:52.866547 13342 consensus_queue.cc:260] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:52.873740 13342 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:52.867566  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.869325  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:52.883108  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:52.884192  9517 raft_consensus.cc:2393] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 9: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:52.869551  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:52.886188  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:52.886802  9521 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:03:52.887725  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:52.870398  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:52.890285  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:52.890815  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.891355  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:52.891439  9448 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:03:52.871490  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:52.871744  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:52.872318  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:52.893527  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.894203  9448 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:52.893527  9526 raft_consensus.cc:2393] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 16: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:52.872504  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:52.865399  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:52.895936  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.896341  9523 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:03:52.873834  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:52.897508  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.898195  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:52.899557  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.900637  9418 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:52.901599 13342 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:52.902364  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.902676  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.903404  9370 raft_consensus.cc:2368] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 14. Current term is 15.
I20260709 13:03:52.905400  9370 raft_consensus.cc:1240] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:52.907833  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:52.913872  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.892834  9525 raft_consensus.cc:1275] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:52.915859  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.888834  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:52.917428  9521 raft_consensus.cc:2393] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 11: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:52.927733  9376 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:03:52.950099  9418 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:52.951257  9418 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:52.952898  9418 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:52.953789  9369 raft_consensus.cc:1240] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:03:52.953187 13342 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:52.955314 13342 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.955453  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.955720 13342 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:52.957450  9369 raft_consensus.cc:1240] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:52.959141  9369 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:52.953332 13527 raft_consensus.cc:2749] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:52.960427  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:52.962081 13508 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:52.962486 13508 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:52.962858 13508 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:52.963469  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:52.972373  9376 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:52.972584  9525 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:03:52.973305  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 108457us
I20260709 13:03:52.969152  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:52.975226  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 111545us
W20260709 13:03:52.978048  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 124332us
I20260709 13:03:52.977262  9521 raft_consensus.cc:2410] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:03:52.977258  9418 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:52.986198 13519 consensus_queue.cc:1048] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:52.986518  9523 raft_consensus.cc:1275] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:03:52.987625  9492 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:52.989756 13385 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:52.990993 13567 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:52.992125 13566 raft_consensus.cc:3055] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:52.992602 13566 raft_consensus.cc:740] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:52.992919 13519 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:52.993423 13566 consensus_queue.cc:260] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:52.993717  9341 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:52.994971 13527 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:52.995471 13527 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:52.995683  9341 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:52.995864 13570 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:52.996372 13570 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.996745 13570 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:52.997023  9341 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:53.000015 13483 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:53.000075 13012 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:53.000694 13479 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:53.001583  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:53.001609 13519 consensus_queue.cc:1048] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:53.003592  9490 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:53.005198  9490 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:53.006657  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:53.006753 13386 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:53.007381  9448 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:53.007705 13386 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:52.995904 13527 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:53.010406  9492 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:53.012993 13385 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:53.013944 13566 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:52.993777 13562 consensus_queue.cc:1048] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:03:53.016095  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:53.019944  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:53.029232  9490 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:53.037500  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:53.039300  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:53.042079  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:53.041939  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:53.043323  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:53.046366  9448 raft_consensus.cc:1240] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 13. Current term is 14. Ops: []
W20260709 13:03:53.049366  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 44471.9us
I20260709 13:03:53.050122  9521 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:53.058673  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 52058.5us
I20260709 13:03:53.059904  9418 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:53.061478 13385 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:53.062565 13401 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:53.066406  9418 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:53.062582  9490 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:53.071015  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 60675.9us
I20260709 13:03:53.077302 13403 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:53.078228 13385 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:53.086562  9492 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:53.049518 13570 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.108492  9490 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:53.090536 13479 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.099257 13386 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:03:53.123854  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 61655.2us
W20260709 13:03:53.126489  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 47038.2us
I20260709 13:03:53.149389  9418 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:53.152079  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 43672.7us
I20260709 13:03:53.152887  9490 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:53.124897 13386 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:53.204886 13386 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:53.207770 13571 log.cc:927] Time spent T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:03:53.213482  9341 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:53.216874  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 64036.3us
I20260709 13:03:53.127018 13483 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.239852  9492 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:53.155005 13519 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:53.125038 13479 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:53.248878  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 96725.4us
W20260709 13:03:53.247124  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 97784.8us
I20260709 13:03:53.253804  9418 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:53.230767 13461 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:53.256793  9492 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:53.258363 13549 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:53.258540 13403 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:53.242256 13483 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.256122 13461 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.243252 13342 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:53.281296  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.300935  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:53.305907  9418 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
W20260709 13:03:53.303623  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 50592.9us
I20260709 13:03:53.325958 13574 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:53.326480 13401 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:53.326506 13574 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.327050 13401 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.327162 13574 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:53.327499 13401 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:53.333999  9492 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:53.300664 13461 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:53.347388  9418 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:53.353330 13574 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:53.355362 13385 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:53.356283 13385 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:53.356695 13574 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:53.389695 13574 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:53.390345 13574 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.390894 13574 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:53.273211 13508 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.325255 13403 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:53.375384 13582 consensus_queue.cc:1059] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:03:53.360549 13479 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:53.409979  9521 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:03:53.417099  9451 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:53.374544 13385 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:03:53.424544  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 77251.8us
I20260709 13:03:53.398000 13527 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.389673 13386 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.421411 13403 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:53.423086 13385 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:53.426244 13578 log.cc:927] Time spent T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:03:53.454946 13342 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:53.456562 13595 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.425979  9418 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:53.489857  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 64334.1us
I20260709 13:03:53.490710  9418 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:53.493880  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 159939us
I20260709 13:03:53.498198  9492 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:03:53.489020  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 227405us
I20260709 13:03:53.509047 13593 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:53.522589 13593 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:53.522980 13593 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:53.532843  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:53.557226  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 56066.8us
I20260709 13:03:53.526384  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:53.560014  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:53.564746  9376 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:53.561221  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:53.561570  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:53.533241  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:53.560431  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:53.567646  9377 raft_consensus.cc:2393] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 12: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:53.560839  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:53.567901  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:53.569222  9372 raft_consensus.cc:2393] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 14: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:53.569777  9368 raft_consensus.cc:2393] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 12: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:53.507725 13342 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:53.510535 13592 log.cc:927] Time spent T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:03:53.571300  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 80676.2us
I20260709 13:03:53.573333  9492 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:53.575112  9418 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:53.509102 13403 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:53.518206 13386 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:53.576380 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 256693us
I20260709 13:03:53.496071 13595 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.577315  9418 leader_election.cc:400] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 14. Current term is 15.
I20260709 13:03:53.517627 13483 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:53.557156 13217 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.517168 13461 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.566176 13508 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:53.584972  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 367292us
I20260709 13:03:53.580734  9418 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:53.584013 13386 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:53.595768 13386 raft_consensus.cc:697] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:53.510531 13401 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.605731  9490 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:03:53.591363 13566 consensus_meta.cc:287] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.577s	user 0.013s	sys 0.000s
I20260709 13:03:53.608974  9418 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:53.516943 13589 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:03:53.611431  9418 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:53.611954 13508 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:53.622134 13508 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:53.622607 13508 raft_consensus.cc:697] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:53.623519 13508 consensus_queue.cc:237] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.597661 13342 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:53.614173 13601 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.627454 13342 consensus_queue.cc:1059] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:53.627357 13601 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.628146 13342 consensus_queue.cc:1243] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:53.614277 13602 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:53.614708  9490 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:53.630771 13602 raft_consensus.cc:3055] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:53.630916  9490 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:53.631268 13602 raft_consensus.cc:740] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:53.629841 13601 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:53.589398 13595 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:53.599483 13217 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.609443 13549 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:53.605698 13386 consensus_queue.cc:237] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.638309  9451 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
W20260709 13:03:53.619210  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 113108us
I20260709 13:03:53.602499 13403 consensus_queue.cc:1059] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:03:53.626648 13461 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:53.648243  9375 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
W20260709 13:03:53.654575  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 81949.6us
I20260709 13:03:53.666368  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:53.667304  9445 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:03:53.647509 13217 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:53.678443  9444 raft_consensus.cc:1275] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:03:53.678937  9444 pending_rounds.cc:85] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 6
I20260709 13:03:53.679275  9444 pending_rounds.cc:107] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:03:53.679562  9444 raft_consensus.cc:2889] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:53.681380 13570 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:53.682279 13567 raft_consensus.cc:3055] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:53.682821 13567 raft_consensus.cc:740] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:53.669224  9492 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:53.671765  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:53.693744  9446 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:53.672569  9447 raft_consensus.cc:1275] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:03:53.694427  9447 pending_rounds.cc:85] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 7
I20260709 13:03:53.694790  9447 pending_rounds.cc:107] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:03:53.695073  9447 raft_consensus.cc:2889] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:53.685319  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 63944.5us
I20260709 13:03:53.697736  9418 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:03:53.701360  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 46513.2us
I20260709 13:03:53.702886  9492 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:53.706532  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:53.684645 13574 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.673367 13549 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:53.707388  9445 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
I20260709 13:03:53.715427  9418 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:53.708433 13527 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:53.712879 13403 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:53.724696  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 93875.3us
I20260709 13:03:53.727455 13600 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:53.727937 13600 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:53.739055  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:53.741125  9376 raft_consensus.cc:2393] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:53.722934 13589 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:53.747984  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:53.715416 13593 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.740952 13600 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:53.751856 13401 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:53.749495 13589 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.763759 13589 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:53.743803 13527 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:03:53.766300  9490 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:53.767752  9490 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:53.768970  9490 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:53.787288  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:53.792083  9444 raft_consensus.cc:2393] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 10: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:53.769188 13549 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:53.794559  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 50000.1us
I20260709 13:03:53.769186 13574 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:53.792128 13607 consensus_queue.cc:1059] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:03:53.796574 13386 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:53.803599 13595 raft_consensus.cc:3055] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:53.783286 13605 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:53.823413 13605 raft_consensus.cc:697] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:53.824734 13605 consensus_queue.cc:237] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.829568 13593 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:53.769470 13611 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:53.811237  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:53.809900  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:53.815150  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:53.822081 13386 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:53.811143 13595 raft_consensus.cc:740] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:53.836155  9444 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:53.842921  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:53.843528  9371 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:53.844097  9369 raft_consensus.cc:2393] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 15: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:53.839938  9341 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:53.849951  9492 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:03:53.853823  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 103307us
I20260709 13:03:53.855708  9341 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:53.837976 13403 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:53.858585  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:53.859563  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:53.857311  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:53.867050  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:53.868418  9521 raft_consensus.cc:2368] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 14. Current term is 15.
I20260709 13:03:53.872135  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:53.873091  9377 raft_consensus.cc:2393] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 10: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:53.873530 13602 consensus_queue.cc:260] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.874151 13519 raft_consensus.cc:3055] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:53.874588 13519 raft_consensus.cc:740] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:53.874861 13602 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:53.875526 13519 consensus_queue.cc:260] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.876684 13519 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:53.877236 13606 consensus_queue.cc:1048] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:53.851897 13596 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:53.880309 13596 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.880524 10061 raft_consensus.cc:1275] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:53.880698 13596 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:53.886801  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:03:53.887534  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.781533 13567 consensus_queue.cc:260] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.888836 13567 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:53.887694  9372 raft_consensus.cc:2368] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 14. Current term is 15.
I20260709 13:03:53.858194  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:53.896147  9369 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:53.896160  9371 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
I20260709 13:03:53.900518  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:53.901238  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:53.902056  9525 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:03:53.857311 13549 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:53.902817 13549 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.903149 13549 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:53.903319  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:53.904227  9519 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:03:53.905579  9418 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:53.906466 13401 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:53.906970 13401 raft_consensus.cc:697] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:53.907811 13401 consensus_queue.cc:237] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.908898  9369 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
I20260709 13:03:53.853461 13562 consensus_queue.cc:1048] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:03:53.916209  9446 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:03:53.916702  9418 leader_election.cc:400] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 14. Current term is 15.
I20260709 13:03:53.918143  9418 leader_election.cc:403] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:03:53.919770 13606 consensus_queue.cc:1048] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:53.920205 13385 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.921661  9522 raft_consensus.cc:1240] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 11. Current term is 12. Ops: []
W20260709 13:03:53.922045  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.926401  9492 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:53.840991 13595 consensus_queue.cc:260] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.946446 13385 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:53.949506  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:53.952159  9341 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:03:53.961714  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 192800us
I20260709 13:03:53.961781  9418 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:53.951386 13527 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 14. Current term is 15.
I20260709 13:03:53.927031 13607 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:03:53.977852  9418 leader_election.cc:400] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 14. Current term is 15.
I20260709 13:03:53.959149 13217 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:53.981804  9521 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:03:53.980232  9418 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:53.983317  9341 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:53.990126 13614 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:53.990813 13614 raft_consensus.cc:697] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:53.991814 13614 consensus_queue.cc:237] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.993443 13217 raft_consensus.cc:697] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:53.994474 13217 consensus_queue.cc:237] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.977181 13570 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:53.950755 13596 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:53.977394 13595 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:53.982241 13403 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:03:54.018458  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 55862.8us
I20260709 13:03:54.003002 13483 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:54.003204 13527 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:54.037843  9490 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:54.041904  9490 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:54.042240  9370 raft_consensus.cc:2368] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 12. Current term is 13.
I20260709 13:03:54.029511 13483 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.029870 13527 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:54.051187  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 63572.2us
I20260709 13:03:53.982829 13600 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.057904  9418 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:54.052886 13483 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:54.056622  9490 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:54.059799  9517 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:54.052356 13527 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:54.061821 13619 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:54.039268 13611 consensus_queue.cc:1059] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:03:54.064534 13611 raft_consensus.cc:3055] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:54.065121 13611 raft_consensus.cc:740] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:54.066004 13611 consensus_queue.cc:260] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.067368 13611 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:54.064471 13617 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:54.068567 13617 raft_consensus.cc:697] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 12 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:54.054430 13610 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:54.069553 13617 consensus_queue.cc:237] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.070446 13610 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.072635 13610 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:54.041947 13605 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:03:54.073455  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:54.088862  9525 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:54.056197 13385 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:54.101310  9517 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
W20260709 13:03:54.102613  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 46069.1us
I20260709 13:03:54.104291  9490 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:54.110383 13386 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:54.110731  9490 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:54.107362 13403 raft_consensus.cc:697] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:54.111603 13386 raft_consensus.cc:2749] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:54.112044  9490 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:54.116410 13403 consensus_queue.cc:237] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.120504 13596 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:54.109095 13589 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.123858 13589 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:54.126411 13549 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.130523  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:54.131070  9373 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:54.100406 13614 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:54.112686 13385 raft_consensus.cc:697] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:54.167749  9372 raft_consensus.cc:1240] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:03:54.170178  9373 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:03:54.178200 13385 consensus_queue.cc:237] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.181541 13600 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:54.185961  9492 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:54.186401 13602 consensus_queue.cc:1059] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:54.191835  9418 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:54.194092 13342 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:54.194687 13342 raft_consensus.cc:697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:54.195608 13342 consensus_queue.cc:237] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:54.196542 13618 log.cc:927] Time spent T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:03:54.198873  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:54.143203 13589 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:54.199682  9373 raft_consensus.cc:2368] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 14. Current term is 15.
I20260709 13:03:54.203238 13570 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:54.203758 13570 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:54.203796 13549 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:54.216629  9492 leader_election.cc:400] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 14. Current term is 15.
I20260709 13:03:54.217108  9492 leader_election.cc:403] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:03:54.219112  9524 raft_consensus.cc:1240] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:54.216943 13600 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:54.220780 13562 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.222734 13562 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.222919  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:54.223664  9372 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:54.226156  9341 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:54.227614 13596 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:54.228119 13596 raft_consensus.cc:697] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:54.228978 13596 consensus_queue.cc:237] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.222136 13589 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 14. Current term is 15.
I20260709 13:03:54.234532 13519 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.235051 13519 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.236954 13519 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:54.243072  9372 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:54.243036 13519 consensus_queue.cc:1059] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:54.258559  9373 raft_consensus.cc:1240] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:54.247180  9418 leader_election.cc:400] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 12. Current term is 13.
I20260709 13:03:54.247730  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:54.261610  9323 auto_rebalancer.cc:629] Failed to schedule move for tablet 522dd78118a14f5783e99d5dc43c9308: Illegal state: Replica 925acbe78db14db3b9e4cfc857717947 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
W20260709 13:03:54.327647  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 215660us
W20260709 13:03:54.339316  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 92357.3us
I20260709 13:03:54.341260  9490 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:54.342923  9490 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:54.213649 13217 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.220788 13600 raft_consensus.cc:697] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:54.259835  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:54.344337  9450 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:03:54.339386  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:54.252724  9492 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:54.224989 13562 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:54.339365  9522 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:03:54.214008 13527 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:54.350167  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 97526.4us
I20260709 13:03:54.350625  9490 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:54.349766  9418 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:54.256369  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:54.354939  9341 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:54.333966 13595 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.250350 13519 consensus_queue.cc:1243] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 6d50f1c263264b21919230bee398022b log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:54.346827 13589 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:54.374606  9452 raft_consensus.cc:1240] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:03:54.352464 13217 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.359854 13386 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:54.360145 13549 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:54.386361  9490 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:54.365921 13605 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:54.351275 13607 consensus_queue.cc:1059] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:03:54.369812 13596 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:54.397400  9490 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:54.400538 13589 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:54.401211 13589 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:54.401705 13589 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:54.389473 13120 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:54.406970 13120 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.371403 13595 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.410315 13527 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:54.411358 13595 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:54.410652  9271 catalog_manager.cc:5697] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 9 to 13, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 13 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.412463 13386 raft_consensus.cc:697] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:54.412669 13600 consensus_queue.cc:237] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.413043  9271 catalog_manager.cc:5697] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.413827 13386 consensus_queue.cc:237] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.414819  9271 catalog_manager.cc:5697] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.360035 13483 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:54.418768  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.418959 13483 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:54.419332 13607 raft_consensus.cc:3055] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:54.419761 13607 raft_consensus.cc:740] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:54.421518 13596 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.421983 13596 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:54.422456  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:54.423586  9521 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:54.425594  9490 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:54.416515  9271 catalog_manager.cc:5697] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.429198  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:54.431808  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:54.432768  9372 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:03:54.434779  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:54.440688  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:54.441784  9452 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:03:54.444271  9373 raft_consensus.cc:1275] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:54.436175 13567 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.445752 13610 consensus_queue.cc:1048] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:54.446339 13567 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.392117 13549 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.457237 13549 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:54.450135 13570 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.464382 13570 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:54.465195  9370 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:54.465721 13120 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:54.449863 13595 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:54.466723 13595 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:54.467842  9323 auto_rebalancer.cc:629] Failed to schedule move for tablet 99c4416401f2427a9f7e68b64ec6915e: Illegal state: Replica d62c9d5a052b42ce8675f8438f846526 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:54.468529 13612 raft_consensus.cc:3055] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:54.468943 13612 raft_consensus.cc:740] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:54.469844 13612 consensus_queue.cc:260] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.471052 13612 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:54.472697 13567 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:54.467093 13595 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:54.478435 13605 consensus_queue.cc:1059] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:54.472911 13217 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:54.481822 13596 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:54.484017  9343 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.4.67:35929 timed out after 1.505s (SENT) [suppressed 9 similar messages]
I20260709 13:03:54.475467  9452 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:03:54.449111  9521 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:03:54.443276  9271 catalog_manager.cc:5697] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.440750 13614 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:54.420644 13607 consensus_queue.cc:260] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.452584  9490 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:54.491986  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:54.499858  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:54.506269  9418 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:54.507375  9525 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:03:54.507440  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 49935.3us
I20260709 13:03:54.509202  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:54.436650 13385 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:54.514567  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:54.515846  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:54.516587  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:54.516865  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:54.518049  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:54.518460  9370 raft_consensus.cc:1240] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
W20260709 13:03:54.520661  9323 auto_rebalancer.cc:629] Failed to schedule move for tablet 31f9d5965eae4c788eb6a40e856cadc7: Illegal state: Replica d62c9d5a052b42ce8675f8438f846526 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } }
W20260709 13:03:54.518389  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 79920.3us
I20260709 13:03:54.519610  9451 raft_consensus.cc:2393] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 15: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:54.511152 13610 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:54.523711  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:54.524616  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:54.526238  9447 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:54.528206  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:54.521896 13611 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:03:54.538515 13596 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:54.491123 13614 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.540009 13614 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:54.549515  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:54.550328  9451 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:54.512413 13527 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:54.558284  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:54.559837  9451 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:03:54.564251  9450 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:03:54.566277 13483 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:54.568302 13483 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.570434 13610 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:54.570595  9370 raft_consensus.cc:1240] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:54.570680 13483 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:54.571036 13610 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:54.575111  9272 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43244 (request call id 186) took 21805 ms (client timeout 15000 ms). Trace:
I20260709 13:03:54.566856  9341 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:54.578241  9341 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:54.579110 13120 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:54.579697 13120 raft_consensus.cc:697] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:54.579581 13595 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.520915 13630 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:54.581636  9449 raft_consensus.cc:1240] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:54.546006 13607 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:54.583498  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:54.584347 13527 raft_consensus.cc:697] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:54.744066  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:54.746120  9524 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:54.745792 13614 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.747860  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:54.748492  9451 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:54.756111 13630 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:54.756673 13630 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:54.757121  9517 raft_consensus.cc:1240] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:54.723951 13386 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:54.758908 13386 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.761646 13611 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:54.580672 13120 consensus_queue.cc:237] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.713673  9435 tablet_service.cc:1558] Processing DeleteTablet for tablet 7260766fbe5c43b1aab09346a89d9ac6 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:51006
I20260709 13:03:54.714008  9441 tablet_service.cc:1558] Processing DeleteTablet for tablet 807906edc34d41589d9b860b72f70e16 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:51006
I20260709 13:03:54.715615  9434 tablet_service.cc:1558] Processing DeleteTablet for tablet 45a4f94c156249adab9c2b1ffb00ac46 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:51006
I20260709 13:03:54.716225 13619 raft_consensus.cc:3055] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:54.765245 13619 raft_consensus.cc:740] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:54.766381 13619 consensus_queue.cc:260] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.767606 13619 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:54.770088  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.712002 13589 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.716984 13610 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:54.575670  9272 rpcz_store.cc:269] 0709 13:03:32.769442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.769709 (+   267us) service_pool.cc:224] Handling call
0709 13:03:54.574972 (+21805263us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:52.712777 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:52.769092 (+ 56315us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:52.769158 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:03:52.769199 (+    41us) tablet.cc:662] Decoding operations
0709 13:03:52.770679 (+  1480us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:52.770771 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:52.770805 (+    34us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:03:52.772196 (+  1391us) tablet.cc:701] Row locks acquired
0709 13:03:52.772244 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:03:52.772457 (+   213us) write_op.cc:270] Start()
0709 13:03:52.772618 (+   161us) write_op.cc:276] Timestamp: P: 1783602232772380 usec, L: 0
0709 13:03:52.772640 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:03:52.789367 (+ 16727us) log.cc:844] Serialized 5456 byte log entry
0709 13:03:53.269070 (+479703us) op_driver.cc:464] REPLICATION: finished
0709 13:03:53.611966 (+342896us) write_op.cc:301] APPLY: starting
0709 13:03:53.612077 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:53.612394 (+   317us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:53.612582 (+   188us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:53.672434 (+ 59852us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:53.678101 (+  5667us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:03:53.678168 (+    67us) write_op.cc:312] APPLY: finished
0709 13:03:53.681439 (+  3271us) log.cc:844] Serialized 101 byte log entry
0709 13:03:53.681630 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:53.681785 (+   155us) write_op.cc:454] Released schema lock
0709 13:03:53.681864 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:53.682295 (+   431us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:53.682326 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":287,"reported_tablets":50,"spinlock_wait_cycles":29952,"child_traces":[["op",{"apply.queue_time_us":340719,"apply.run_cpu_time_us":5304,"apply.run_wall_time_us":70321,"num_ops":14,"prepare.queue_time_us":11219,"prepare.run_cpu_time_us":60723,"prepare.run_wall_time_us":269514,"raft.queue_time_us":166063,"raft.run_cpu_time_us":12433,"raft.run_wall_time_us":358365,"replication_time_us":479318,"thread_start_us":557130,"threads_started":4,"wal-append.queue_time_us":227184}]]}
I20260709 13:03:54.720286 13549 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:54.721510  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 237499us
I20260709 13:03:54.721957  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:54.553105  9452 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:54.596534 13596 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:54.713929 13595 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:54.732458 13602 consensus_queue.cc:1059] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:54.740396 13617 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.778996 13596 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:54.779713 13596 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:54.780475 13595 raft_consensus.cc:3055] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:54.780875 13595 raft_consensus.cc:740] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:54.781051 13385 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:54.725734  9448 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
I20260709 13:03:54.761693  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:54.779345 13617 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.525378 13582 consensus_queue.cc:1059] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:03:54.786007 13567 raft_consensus.cc:3055] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:54.786408 13567 raft_consensus.cc:740] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:54.781828 13595 consensus_queue.cc:260] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.787395 13595 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:54.787217 13567 consensus_queue.cc:260] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.788446 13567 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:54.781641 13385 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.715533  9341 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:54.740274  9445 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:03:54.793079 13386 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:54.796098  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 80691us
I20260709 13:03:54.801604  9517 raft_consensus.cc:1275] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:54.802901  9450 raft_consensus.cc:2410] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:03:54.799429  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:54.796661  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:54.804133  9372 raft_consensus.cc:2393] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 12: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:54.806804  9525 raft_consensus.cc:1275] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:03:54.807286  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:54.807932  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:54.808435  9525 raft_consensus.cc:1240] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:54.809718  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:54.809823  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:54.810576  9525 raft_consensus.cc:2393] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 10: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:54.811563  9524 raft_consensus.cc:2393] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 12: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:54.812367  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:54.814255  9520 raft_consensus.cc:1240] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:54.816056  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:54.816640  9521 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:54.818737 13649 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:54.819306 13649 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.811498 13602 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:54.821841 13386 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.811197 13600 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:54.822460 13386 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.822683 13600 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.829783 13385 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:54.826316 13649 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:54.824951 13600 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:54.824916 13386 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:54.830193 13479 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:03:54.825382  9444 raft_consensus.cc:2410] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:03:54.845328  9521 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:03:54.845096 13612 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:54.842307 13596 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.827315  9526 raft_consensus.cc:1275] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:54.837838  9369 raft_consensus.cc:1275] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:54.851383  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:54.853801  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:54.856351  9451 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:03:54.858865  9447 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:03:54.862991  9372 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:03:54.865458  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:54.867837  9323 auto_rebalancer.cc:629] Failed to schedule move for tablet 2d995bd1db654f5db92b8452f148c18a: Illegal state: Replica d62c9d5a052b42ce8675f8438f846526 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:54.870206  9524 raft_consensus.cc:2393] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 9: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:54.876050  9451 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:54.802677 13345 raft_consensus.cc:2804] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:54.879128  9370 raft_consensus.cc:1275] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:54.880039  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:54.880658  9519 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:54.882073  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:54.884545  9372 raft_consensus.cc:2368] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13.
I20260709 13:03:54.882408 13386 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:54.887444 13650 log.cc:927] Time spent T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:03:54.887713 13386 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.883909  9522 raft_consensus.cc:1275] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:54.894091  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:54.894845  9520 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:54.895015  9373 raft_consensus.cc:1240] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:54.896891 13611 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:54.897078  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:54.897987  9374 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:03:54.827297 13549 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:54.899932  9418 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:54.900972  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:54.902365  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:54.902650 13403 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:54.903395  9376 raft_consensus.cc:2393] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 12: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:54.903398 13403 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.903728  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:54.904074 13403 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:54.904356  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:54.905489  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:54.783051 13527 consensus_queue.cc:237] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.907727  9520 raft_consensus.cc:2410] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:03:54.909937  9372 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:54.911761 13508 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:54.917869 13630 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.838833 13589 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:54.919073 13549 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.921049  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:54.935129  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:54.922566  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.923090  9451 raft_consensus.cc:1240] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:54.867507 13614 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:54.932909  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:54.938189  9519 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:03:54.883697 13345 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.941350  9492 leader_election.cc:400] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13.
I20260709 13:03:54.941887  9492 leader_election.cc:403] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:03:54.884696 13617 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:54.946954  9520 raft_consensus.cc:1240] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:03:54.947080  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:54.962648  9522 raft_consensus.cc:2393] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 15: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:54.964705 13614 consensus_queue.cc:1059] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:54.966169 13614 raft_consensus.cc:3055] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:54.966697 13614 raft_consensus.cc:740] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:54.968149 13614 consensus_queue.cc:260] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.969929 13614 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:54.972380 13386 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:54.974982 13596 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:54.895848 13612 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:03:54.980997 13602 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:54.962109 13403 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.958331 13619 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:54.940732 13549 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:54.938865 13385 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:03:54.946446 13345 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:55.006101  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 125993us
I20260709 13:03:55.007259  9373 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:55.028597  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:55.029475  9519 raft_consensus.cc:2393] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 12: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:55.027853  9341 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:55.079140  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:55.080690  9519 raft_consensus.cc:2410] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:03:55.083088  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:55.037500 13600 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:03:55.050609  9260 catalog_manager.cc:5028] TS d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): tablet 7260766fbe5c43b1aab09346a89d9ac6 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:03:55.087585  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:55.073820 13120 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:55.099529  9522 raft_consensus.cc:1240] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:55.101760  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:55.117206  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:55.120798  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:55.121625  9525 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
W20260709 13:03:55.126173  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:55.094355  9260 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 57224.3us
I20260709 13:03:55.108419 13120 raft_consensus.cc:697] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:55.136369  9260 catalog_manager.cc:5028] TS d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): tablet 45a4f94c156249adab9c2b1ffb00ac46 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:03:55.136973 13630 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:55.137324  9260 catalog_manager.cc:5028] TS d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): tablet 807906edc34d41589d9b860b72f70e16 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:03:55.139424  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:55.141299  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:55.141405  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:55.142165 13619 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13.
I20260709 13:03:55.140690  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:55.142474  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:55.143103  9523 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:55.143491  9525 raft_consensus.cc:1275] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:55.144421  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:55.145500  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:55.146059  9525 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:03:55.146819  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:55.142388  9522 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:55.163097  9525 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:55.162961 13345 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:55.165940 13345 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:55.166839  9519 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 16.
I20260709 13:03:55.169759 13403 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:55.171308  9517 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:03:55.174464  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:55.175361  9522 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
W20260709 13:03:55.176779 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 126721us
I20260709 13:03:55.176568  9418 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:55.176316  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:55.179373  9522 raft_consensus.cc:2393] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 12: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:55.171216  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:55.190768  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 162982us
I20260709 13:03:55.198607  9523 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:03:55.231040  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:55.181818 13403 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:55.238560  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:55.244221  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:55.246986  9451 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:55.247327  9444 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:03:55.266440  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:55.267251  9445 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:03:55.230544 13345 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:03:55.281438  9519 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:55.282330  9451 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:03:55.256137 13527 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.263207 13403 raft_consensus.cc:697] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:55.301707  9521 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:55.332568 13607 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:55.332954 13654 log.cc:927] Time spent T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:03:55.333259 13607 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:55.334249 13660 log.cc:927] Time spent T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:03:55.335466 13607 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:55.337280 13662 log.cc:927] Time spent T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:03:55.282608 13120 consensus_queue.cc:237] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:55.339184 13659 log.cc:927] Time spent T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:03:55.341475 13657 log.cc:927] Time spent T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:03:55.346664  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:55.346464 13403 consensus_queue.cc:237] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:55.301311 13527 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:55.352159 13527 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:55.366384 13549 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:55.370995  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:55.371682  9520 raft_consensus.cc:2376] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12. Re-sending same reply.
I20260709 13:03:55.371584  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:55.373425  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:55.374194  9517 raft_consensus.cc:2393] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 12: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:55.374469  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:55.375193  9522 raft_consensus.cc:2393] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 9: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:55.375063  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:55.265861 13483 consensus_queue.cc:1059] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:03:55.378549  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:55.379377  9418 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:55.380442  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:55.381561 13607 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:55.386502  9445 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:55.387236  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:55.389446  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:55.390154 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 87733.5us
I20260709 13:03:55.392728  9525 raft_consensus.cc:2410] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:03:55.399034  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:55.399928  9525 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:55.400617  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:55.400933  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:55.403402  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:55.406294  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:55.416800  9451 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:03:55.416838  9517 raft_consensus.cc:2393] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 12: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:55.406877  9445 raft_consensus.cc:1240] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:55.407335  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:55.408655  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:55.406854  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:55.406607  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:55.422405  9449 raft_consensus.cc:2368] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13.
I20260709 13:03:55.415321  9526 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:03:55.423543  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:55.424399  9445 raft_consensus.cc:2393] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 13: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:55.425398  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:55.426697  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:55.427311  9447 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:03:55.428506  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:55.429590  9447 raft_consensus.cc:2393] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 12: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:55.431325  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:55.434597  9447 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:03:55.435204  9447 pending_rounds.cc:85] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 6
I20260709 13:03:55.435478  9447 pending_rounds.cc:107] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:03:55.435791  9447 raft_consensus.cc:2889] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:55.457309  9418 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:55.464159 13508 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:55.464907 13508 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.465483 13508 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:55.498805  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:55.499670  9445 raft_consensus.cc:2393] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 10: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:55.502995  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:55.504118  9376 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:03:55.503306  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:55.505715  9372 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:03:55.508647  9418 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:55.510646 13567 raft_consensus.cc:3055] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:55.532858  9524 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
W20260709 13:03:55.531431  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 247276us
I20260709 13:03:55.531936 13611 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:55.535962 13567 raft_consensus.cc:740] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:55.546859 13611 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.552662  9525 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:03:55.566699  9341 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:55.610086  9341 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:55.595494 13611 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:55.619692 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 98471.2us
W20260709 13:03:55.621469  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 106197us
W20260709 13:03:55.618101  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 109565us
I20260709 13:03:55.612918 13483 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:55.616921 13120 raft_consensus.cc:2804] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:55.577628 13596 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:03:55.639146  9520 raft_consensus.cc:1275] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:03:55.640570 13483 raft_consensus.cc:697] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:55.600790 13567 consensus_queue.cc:260] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:55.645542  9490 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:55.642614 13120 raft_consensus.cc:697] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:55.682621 13567 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:55.725296  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:55.784089  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 138770us
I20260709 13:03:55.784830  9490 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:55.686026 13527 consensus_queue.cc:1048] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:03:55.682693 13483 consensus_queue.cc:237] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:55.785861 13612 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.783722 13607 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.796363  9446 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:03:55.803846  9446 raft_consensus.cc:606] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
W20260709 13:03:55.804970 13681 log.cc:927] Time spent T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:03:55.817371 13692 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:55.818399 13692 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:03:55.823745  9343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.025s	sys 0.048s
W20260709 13:03:55.824193  9343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.025s	sys 0.048s
W20260709 13:03:55.824729  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.791973 13120 consensus_queue.cc:237] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:55.841315 13607 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:55.843936 13607 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:55.856647  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:55.858863  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 74081.9us
I20260709 13:03:55.859961  9490 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:55.867799  9490 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:55.803181 13612 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:55.869747 13692 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:55.896531  9446 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:03:55.888691 13582 consensus_queue.cc:1059] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:03:55.897207  9446 raft_consensus.cc:606] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:55.898717  9446 raft_consensus.cc:614] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:55.855051 13508 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:55.868661 13570 consensus_queue.cc:1048] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:03:55.870687 13677 consensus_queue.cc:1059] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:03:55.903410  9490 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:55.909934  9490 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:55.919215 13612 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:55.907580 13692 consensus_queue.cc:1059] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:03:55.903913 13693 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:55.926915  9446 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:03:55.927767  9446 raft_consensus.cc:606] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:55.928164  9446 raft_consensus.cc:614] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:55.939738  9446 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:03:55.940383  9446 raft_consensus.cc:606] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:55.940757  9446 raft_consensus.cc:614] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:55.942523 13697 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:55.943862  9446 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7a866663507456b9442af6c42748c5f"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:03:55.944840  9446 raft_consensus.cc:606] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:55.945250  9446 raft_consensus.cc:614] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:55.946370  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:55.964679  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:55.958606  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:55.953455 13596 raft_consensus.cc:3055] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:03:55.969085  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 59214us
I20260709 13:03:55.972836  9490 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:55.976902 13614 raft_consensus.cc:2764] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:03:55.993937 13483 raft_consensus.cc:3055] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:55.994493 13483 raft_consensus.cc:740] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:55.995455 13483 consensus_queue.cc:260] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:55.996109 13649 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:56.006008  9373 raft_consensus.cc:1275] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:03:56.006500  9373 pending_rounds.cc:85] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947: Aborting all ops after (but not including) 6
I20260709 13:03:56.006752  9373 pending_rounds.cc:107] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:03:56.007017  9373 raft_consensus.cc:2889] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:56.007086 13611 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:55.969555 13596 raft_consensus.cc:740] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:56.009943 13596 consensus_queue.cc:260] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.011494 13596 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:56.007088  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:56.019260 13682 log.cc:927] Time spent T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.336s	user 0.002s	sys 0.001s
I20260709 13:03:56.022408  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:56.023168  9368 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:03:55.996838 13483 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:56.026785  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:56.027525  9374 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
W20260709 13:03:56.040707  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:56.042393 13678 log.cc:927] Time spent T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.489s	user 0.004s	sys 0.004s
I20260709 13:03:56.048553 13508 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:56.057468 13697 raft_consensus.cc:697] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:56.058812 13697 consensus_queue.cc:237] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.068125  9521 raft_consensus.cc:1275] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:56.071072 13619 raft_consensus.cc:3055] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:56.071568 13619 raft_consensus.cc:740] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:56.071786  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:56.072429  9520 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:56.072544 13619 consensus_queue.cc:260] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.073714 13619 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:56.088747 13693 raft_consensus.cc:697] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 9 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:56.089701  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:56.090458  9370 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:56.090366 13693 consensus_queue.cc:237] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:56.093577  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 203443us
I20260709 13:03:56.097406  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:56.101397  9370 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:03:56.102572  9271 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 77) took 7378 ms. Trace:
I20260709 13:03:56.103629  9370 raft_consensus.cc:1275] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:56.106009 13611 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:56.111323  9343 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:56.112335  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:56.113030  9370 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:56.119472 13602 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:56.120093 13602 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.122439 13602 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:56.128235 13607 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:56.128811 13607 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.131006 13607 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:56.131731 13403 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:56.132284 13403 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.134864 13403 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:56.139542  9418 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
W20260709 13:03:56.139849  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 167516us
I20260709 13:03:56.140856  9490 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:56.141855  9370 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:03:56.142872  9490 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:56.143662 13697 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:56.102973  9271 rpcz_store.cc:276] 0709 13:03:48.724332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.724487 (+   155us) service_pool.cc:224] Handling call
0709 13:03:56.102487 (+7378000us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:54.776364 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:54.776912 (+   548us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:54.776955 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:03:54.776972 (+    17us) tablet.cc:662] Decoding operations
0709 13:03:54.777699 (+   727us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:54.777775 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:54.777800 (+    25us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:03:54.867584 (+ 89784us) tablet.cc:701] Row locks acquired
0709 13:03:54.867604 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:03:54.896235 (+ 28631us) write_op.cc:270] Start()
0709 13:03:54.929246 (+ 33011us) write_op.cc:276] Timestamp: P: 1783602234891114 usec, L: 0
0709 13:03:54.929281 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:03:54.978564 (+ 49283us) log.cc:844] Serialized 2024 byte log entry
0709 13:03:55.633594 (+655030us) op_driver.cc:464] REPLICATION: finished
0709 13:03:55.865371 (+231777us) write_op.cc:301] APPLY: starting
0709 13:03:55.865493 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:55.865720 (+   227us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:55.865871 (+   151us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:55.920054 (+ 54183us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:55.920266 (+   212us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:03:55.920317 (+    51us) write_op.cc:312] APPLY: finished
0709 13:03:55.920946 (+   629us) log.cc:844] Serialized 47 byte log entry
0709 13:03:55.921182 (+   236us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:55.921323 (+   141us) write_op.cc:454] Released schema lock
0709 13:03:55.921377 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:55.921939 (+   562us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:55.921978 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":214241,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":229041,"apply.run_cpu_time_us":4008,"apply.run_wall_time_us":56539,"num_ops":5,"prepare.queue_time_us":28723,"prepare.run_cpu_time_us":22307,"prepare.run_wall_time_us":318446,"raft.queue_time_us":269409,"raft.run_cpu_time_us":52631,"raft.run_wall_time_us":241289,"replication_time_us":686818,"thread_start_us":540092,"threads_started":4,"wal-append.queue_time_us":202003}]]}
I20260709 13:03:56.148504 13617 consensus_queue.cc:1048] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:56.151515  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
W20260709 13:03:56.156613  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 45360.8us
I20260709 13:03:56.158846  9490 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:56.159049  9520 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:03:56.159403  9343 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:56.162611  9490 leader_election.cc:400] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13.
I20260709 13:03:56.163872  9490 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:56.166386 13403 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:56.166708  9490 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:56.167021 13403 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.167733 13403 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:56.168264  9418 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:56.169428 13602 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:56.170197 13602 raft_consensus.cc:697] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:56.171452 13602 consensus_queue.cc:237] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.175441  9274 catalog_manager.cc:5697] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 9 to 10, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 10 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.177656  9274 catalog_manager.cc:5697] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.179376 13699 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:56.179603  9274 catalog_manager.cc:5697] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.184908  9490 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:56.181382  9274 catalog_manager.cc:5697] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.186554  9343 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:56.190429 13707 raft_consensus.cc:2764] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:03:56.190620 13693 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:56.191668 13703 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:56.193655 13697 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:56.190470 13483 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:56.196874 13702 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:03:56.183697 13619 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:56.193750 13699 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:56.203749  9490 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:56.161319 13508 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:56.204870 13702 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:56.205291 13508 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.205690 13508 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:56.210011  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:56.211092  9521 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:03:56.211294  9520 raft_consensus.cc:2376] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 16. Re-sending same reply.
I20260709 13:03:56.212383  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:56.213624  9418 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:56.215569  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:56.216127  9521 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:56.216717  9343 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:56.218302  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:56.219518  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:56.220993  9519 raft_consensus.cc:2393] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 15: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:56.220069  9274 catalog_manager.cc:5697] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 9 to 14, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 14 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.222543  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:56.225028 13611 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:56.223588  9274 catalog_manager.cc:5697] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 9 to 14, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 14 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.225562 13617 consensus_queue.cc:1048] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:56.225834 13611 raft_consensus.cc:697] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:56.226980 13611 consensus_queue.cc:237] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.227242  9274 catalog_manager.cc:5697] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.230039  9274 catalog_manager.cc:5697] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 10 to 11, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 11 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.231432  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:56.231575 13596 consensus_queue.cc:1048] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:56.232666  9274 catalog_manager.cc:5697] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 8 to 10, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 10 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.235059  9274 catalog_manager.cc:5697] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 11 to 12, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 12 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:56.239257  9521 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:03:56.240067  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:56.241194  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:56.242257  9521 raft_consensus.cc:2393] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 16: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:56.243711  9343 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:56.244730  9370 raft_consensus.cc:2393] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 16: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:56.248132  9446 raft_consensus.cc:1240] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:56.248194  9447 raft_consensus.cc:1275] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:03:56.246824  9343 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:56.248903  9274 catalog_manager.cc:5697] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 8 to 9, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 9 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.254835  9443 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:56.254989  9343 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:56.257273  9274 catalog_manager.cc:5697] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 5 to 8, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 8 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.254479 13582 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:56.261720 13596 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:56.262761 13607 consensus_queue.cc:1048] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:56.251348 13483 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:56.251222 13699 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:56.265939 13595 raft_consensus.cc:993] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:03:56.266803 13595 raft_consensus.cc:1081] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:03:56.269147 13702 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:56.269706 13702 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.272601 13702 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:56.277292 13698 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:56.278394 13699 raft_consensus.cc:697] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:56.279805 13675 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:56.300793 13693 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:03:56.282198  9343 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:56.301057 13697 consensus_queue.cc:1059] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:03:56.311764  9274 catalog_manager.cc:5697] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.306586 13699 consensus_queue.cc:237] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.313265  9524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46902
I20260709 13:03:56.315254 13667 raft_consensus.cc:2764] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:03:56.314936  9274 catalog_manager.cc:5697] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:56.299628 13619 consensus_queue.cc:1048] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:03:56.318583  9274 catalog_manager.cc:5697] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 9 to 10, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 10 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:56.319767 13697 raft_consensus.cc:3055] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:56.320406 13697 raft_consensus.cc:740] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:56.320751  9274 catalog_manager.cc:5697] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.321640 13697 consensus_queue.cc:260] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.323182  9274 catalog_manager.cc:5697] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 10 to 11, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 11 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:56.314561  9524 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:56.324934  9524 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:56.323732 13697 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:56.324980  9274 catalog_manager.cc:5697] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 9 to 12, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 12 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:56.330390  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 48309us
I20260709 13:03:56.331629  9343 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:56.332502 13667 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:56.334728  9343 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:56.335953 13667 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:56.336334  9274 catalog_manager.cc:5697] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 7 to 10, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 10 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.337203  9418 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:56.337857  9343 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:56.341622 13602 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:56.341341  9274 catalog_manager.cc:5697] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 7 to 10, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 10 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.342726 13667 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:56.344604  9418 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:56.364141 13607 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:56.365231 13702 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:56.288583 13508 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.346145  9343 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:56.365850 13702 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.367314 13508 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:56.324620 13403 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.368067 13702 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:56.368357  9451 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:56.368500  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:56.376268 13667 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:56.352444 13582 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:56.353886 13714 log.cc:927] Time spent T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:03:56.408432  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.366916  9343 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:56.409317  9446 raft_consensus.cc:1240] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:03:56.415762  9524 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:56.425769  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 55679.3us
I20260709 13:03:56.427214  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:56.410301 13619 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:56.429724  9451 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:03:56.429802 13619 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.343122  9274 catalog_manager.cc:5697] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 10 to 11, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 11 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.437420  9449 raft_consensus.cc:1275] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:56.443109  9490 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:56.444464  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:56.451478  9368 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:56.443486  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:03:56.453485  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 86622.1us
I20260709 13:03:56.460071  9524 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:56.463027  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:56.465129  9375 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:56.465302  9372 raft_consensus.cc:1275] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:03:56.467377  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:56.469285  9274 catalog_manager.cc:5697] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 3 to 8, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 8 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:56.470603  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:56.471421  9323 auto_rebalancer.cc:629] Failed to schedule move for tablet 31f9d5965eae4c788eb6a40e856cadc7: Illegal state: Replica d62c9d5a052b42ce8675f8438f846526 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } }
I20260709 13:03:56.474180  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:56.476954  9372 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:56.478755  9520 raft_consensus.cc:1240] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:56.474861  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:56.437592 13508 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:56.482841  9373 raft_consensus.cc:2393] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 13: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:56.432631 13619 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:56.484275  9274 catalog_manager.cc:5697] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 7 to 8, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 8 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.489427  9274 catalog_manager.cc:5697] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 8 to 9, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 9 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.499643  9525 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:56.466234 13693 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:56.496228  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:56.502156  9520 raft_consensus.cc:2410] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:03:56.502975  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:56.503943  9374 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:56.479771 13345 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:56.507761  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:56.459432 13702 consensus_queue.cc:1059] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:03:56.498732  9274 catalog_manager.cc:5697] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 6 to 7, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 7 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.485778 13649 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:56.525282 13649 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.528017 13649 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:56.486527 13602 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.529713 13602 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.468581 13570 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:03:56.524505 13595 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.494146 13692 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:56.548223  9520 raft_consensus.cc:1275] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:56.549887  9522 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:56.554231 13602 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:56.556613 13582 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.508373 13693 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:56.558245  9274 catalog_manager.cc:5697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 5 to 8, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 8 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.482672 13707 consensus_queue.cc:1059] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:03:56.486059 13673 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:03:56.560604 13693 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:56.598587 13403 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:56.579669  9492 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:56.544420 13612 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.610896  9274 catalog_manager.cc:5697] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.613492  9368 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:03:56.614717  9369 raft_consensus.cc:1240] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:03:56.541049 13683 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:56.613549  9374 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:56.578151 13649 raft_consensus.cc:3055] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:56.551218 13703 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:56.627549  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 48007.5us
I20260709 13:03:56.557387 13582 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.557659 13595 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.561355 13692 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.617990 13612 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.641552 13688 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:56.641794 13697 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:56.635290 13649 raft_consensus.cc:740] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:56.621567 13683 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.686632 13582 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:56.651240 13703 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.687770 13647 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:03:56.688380 13720 log.cc:927] Time spent T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:03:56.686682 13612 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:56.691565 13619 raft_consensus.cc:3055] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:56.691996 13692 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:56.693827 13693 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.658649 13700 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:56.745591 13700 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.748543 13700 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:56.717190  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 222263us
I20260709 13:03:56.736161 13619 raft_consensus.cc:740] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:56.744518 13693 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:56.771423  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:56.774318  9446 raft_consensus.cc:3055] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:56.774667  9446 raft_consensus.cc:740] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:56.771538  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:56.770282  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:56.708089 13688 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.775456  9446 consensus_queue.cc:260] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.790521  9446 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:56.815241 13508 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:56.828262  9451 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:56.833527  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:56.792161 13649 consensus_queue.cc:260] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.857709  9446 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:56.859014  9418 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:56.844043  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:03:56.870294  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 231153us
I20260709 13:03:56.870730  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:56.873718  9492 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:56.799322 13619 consensus_queue.cc:260] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:56.892771  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:56.894662  9521 raft_consensus.cc:2410] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:03:56.896368  9490 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:56.901821  9444 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:56.905828  9520 raft_consensus.cc:1275] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:56.870100 13403 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:56.869903 13649 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:56.893719 13595 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:56.940783  9374 raft_consensus.cc:1240] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:56.941978  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:56.942602  9368 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:03:56.938467  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:56.904230 13702 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:56.943235  9369 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:56.954241  9370 raft_consensus.cc:1275] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:03:56.943792  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:56.945889  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:56.947250  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:56.956537  9374 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:03:56.888540 13693 consensus_queue.cc:1048] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:03:56.921674 13619 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:56.988202  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.998888 13595 consensus_queue.cc:1048] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:57.001128  9377 raft_consensus.cc:1275] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:56.938129 13683 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:57.023566  9369 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 17.
W20260709 13:03:57.079375 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 188657us
I20260709 13:03:57.002102 13734 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.086759  9492 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:57.034622 13704 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:57.013211 13703 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:57.025467 13630 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:57.097927  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 169572us
W20260709 13:03:57.100440  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 104717us
I20260709 13:03:57.103063  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:57.106616  9523 raft_consensus.cc:1275] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
W20260709 13:03:57.107964 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 155187us
I20260709 13:03:57.111349  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:57.025328 13345 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:03:57.114383  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:57.126305  9323 auto_rebalancer.cc:629] Failed to schedule move for tablet 0e30c155cba64357ae275b3366772777: Illegal state: Replica d62c9d5a052b42ce8675f8438f846526 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:57.095424 13508 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.115578  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:57.112424 13700 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:57.098284 13704 raft_consensus.cc:697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:57.121115 13595 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:57.146370 13617 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:03:57.147480 13733 log.cc:927] Time spent T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:03:57.148339 13725 log.cc:927] Time spent T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:03:57.126313 13688 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:57.108029 13630 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:57.172289  9323 auto_rebalancer.cc:629] Failed to schedule move for tablet ffaf31f504f540dc957e0b558c940f79: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:57.139104 13611 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:57.095252 13734 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:57.107678 13403 raft_consensus.cc:697] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:57.158912 13595 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.239219 13595 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:57.186575 13750 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:57.182962 13611 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:57.248417 13611 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:57.187839 13738 log.cc:927] Time spent T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:57.189159 13734 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:57.140723 13508 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:57.251777 13508 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:57.169081 13617 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:57.254751 13617 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:57.175784 13602 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:57.256098 13602 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:57.259235 13602 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:57.220418  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.236449 13630 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:57.261861 13403 consensus_queue.cc:237] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:57.265476  9443 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:57.135895  9418 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:57.237638 13704 consensus_queue.cc:237] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:57.282022  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 146197us
W20260709 13:03:57.286319 13732 log.cc:927] Time spent T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.167s	user 0.004s	sys 0.000s
W20260709 13:03:57.302443 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 147783us
I20260709 13:03:57.309544  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:57.309898  9369 raft_consensus.cc:1275] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:57.312075  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:57.312831  9369 raft_consensus.cc:2393] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 13: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:03:57.312865  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:57.314024  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:57.285197 13611 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:57.317674  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:57.319669  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:57.321692  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:03:57.322798  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.323503  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:57.295236 13483 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:03:57.331492  9377 raft_consensus.cc:1275] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:57.329613  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:57.316143 13611 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.311190 13602 consensus_queue.cc:1048] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:03:57.332106 13724 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:57.325897 13756 consensus_queue.cc:1048] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:03:57.348441 13345 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:57.344548 13602 consensus_queue.cc:1243] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:57.367596  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:57.368924  9526 raft_consensus.cc:2393] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 10: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:57.352998  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:57.353281  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:57.369988  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:57.370143  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:57.354569  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:57.357507  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:57.371685  9445 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
I20260709 13:03:57.335045 13611 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:57.358598  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:57.360464  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:57.361397  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:57.374091  9525 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:03:57.361847  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:57.365931  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:57.375638  9519 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:03:57.366566  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:57.376705  9373 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:57.367596  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:57.352859  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:57.380564  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:57.388592  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:03:57.490410  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 92465us
W20260709 13:03:57.493196 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 90168.4us
W20260709 13:03:57.493445 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 83097.8us
I20260709 13:03:57.385599 13724 raft_consensus.cc:697] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:03:57.495559  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 94353.7us
I20260709 13:03:57.501137  9449 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
W20260709 13:03:57.576373 13721 log.cc:927] Time spent T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.174s	user 0.004s	sys 0.008s
I20260709 13:03:57.396060 13595 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:57.567662 13726 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.563859 13723 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:03:57.625368  9443 raft_consensus.cc:1240] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:57.601169 13508 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:57.578632 13673 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:03:57.614030 13345 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:03:57.667867 13753 consensus_queue.cc:1048] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
W20260709 13:03:57.670352 13760 log.cc:927] Time spent T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:03:57.672346 13759 log.cc:927] Time spent T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:03:57.675151 13697 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.675814 13697 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:57.678295 13697 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:57.683110 13595 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:57.613538 13726 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:57.697641 13649 consensus_meta.cc:287] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.762s	user 0.011s	sys 0.002s
I20260709 13:03:57.641794 13508 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:57.663436 13724 consensus_queue.cc:237] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:57.701906  9517 raft_consensus.cc:2410] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:03:57.693245 13726 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:57.744443 13649 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:57.763860  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 125593us
I20260709 13:03:57.765800  9448 raft_consensus.cc:1240] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:03:57.768922  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 131038us
I20260709 13:03:57.781350  9343 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:57.789152 13483 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:57.764559 13649 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:57.803437  9526 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:57.807128 13649 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:57.822078 13508 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:57.824015 13619 consensus_meta.cc:287] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.837s	user 0.013s	sys 0.000s
W20260709 13:03:57.827179  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.845604  9492 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:57.851285 13649 consensus_queue.cc:1048] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:57.852777  9447 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:03:57.854718 13697 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:57.864045  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.848920 13611 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:57.872304  9450 raft_consensus.cc:1240] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:57.843150 13619 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.873870 13619 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:57.877655 13673 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.871483 13611 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:57.876822 13619 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:57.889108  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:57.889524  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:57.889894  9369 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:03:57.883662 13752 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.883953 13673 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:57.919178  9517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46902 (request call id 1861) took 1092 ms. Trace:
I20260709 13:03:57.928479  9517 rpcz_store.cc:276] 0709 13:03:56.826421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:56.826561 (+   140us) service_pool.cc:224] Handling call
0709 13:03:57.918670 (+1092109us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b5400240754. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:03:57.918900 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1934424320}
W20260709 13:03:57.928689  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 313255us
I20260709 13:03:57.940150 13673 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:57.942541  9418 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:57.929574 13752 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:57.946374 13752 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:57.929494 13772 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:03:57.950578  9418 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:57.952531 13602 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:57.952968 13602 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:57.953394 13602 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:57.969857  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:57.970693  9447 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:03:57.976814 13602 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:57.978056  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 130026us
I20260709 13:03:57.981134 13596 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:57.981726 13596 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:57.983999 13596 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:03:57.990147  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 61013.2us
I20260709 13:03:57.997990  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:57.999068  9444 raft_consensus.cc:2393] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 15: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:58.002178 13649 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:58.002974 13649 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:03:58.004899  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 54391.1us
I20260709 13:03:58.005470 13649 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:58.007028  9490 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:58.008556  9490 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:58.009083 13786 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:58.009449 13619 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:58.011075  9490 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:58.011358 13602 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:58.012106 13619 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:58.013720  9323 auto_rebalancer.cc:629] Failed to schedule move for tablet a3b5c7847cbc42538f7f07cceeb9c125: Illegal state: Replica d62c9d5a052b42ce8675f8438f846526 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:03:58.013788  9490 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:58.014999 13649 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:58.015915 13649 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.016412 13649 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:58.019073  9372 pending_rounds.cc:85] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947: Aborting all ops after (but not including) 4
I20260709 13:03:58.019460  9372 pending_rounds.cc:107] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:03:58.019758  9372 raft_consensus.cc:2889] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:58.022460  9490 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:58.023553 13619 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:58.034183 13611 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:58.035717 13786 consensus_queue.cc:1048] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:58.036721 13611 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:58.037757 13611 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:58.040673  9341 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:58.041441  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:58.042102  9370 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:58.047677 13611 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:58.025067  9490 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:58.050618  9370 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:58.052898  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:58.056241 13704 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:58.056748 13667 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:58.057202 13667 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.057562 13667 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:58.059284 13649 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:58.061898  9490 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:58.062422 13611 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:58.062789 13704 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:58.053049  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:58.063705  9370 raft_consensus.cc:2410] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:03:58.064551 13704 raft_consensus.cc:697] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:58.068531  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:58.069540  9526 raft_consensus.cc:2410] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:03:58.070379  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:58.071406  9492 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:03:58.072955  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:58.075162  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:58.075737  9526 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
I20260709 13:03:58.074239  9517 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:03:58.078752  9372 raft_consensus.cc:1240] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 9. Current term is 10. Ops: [8.5-9.6]
I20260709 13:03:58.071108 13619 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:58.081506 13619 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:03:58.087598  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:58.087954  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:58.088671  9526 raft_consensus.cc:2393] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 13: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:58.089332  9373 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:58.089599  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:58.090174  9368 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:58.090701  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:58.090312  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:58.091248  9372 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 17.
I20260709 13:03:58.093796  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:58.094595  9522 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:03:58.065544 13704 consensus_queue.cc:237] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:58.098754  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:58.099488  9444 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:03:58.101369  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:58.102005  9444 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:03:58.102890  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:58.104508  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:58.108047  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:58.076592 13697 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:58.111120 13697 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.111511 13697 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:58.112519  9418 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:58.112651  9343 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:58.113772 13699 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:58.117156  9418 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:58.118577  9368 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:03:58.114159 13699 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:03:58.121295 13688 consensus_queue.cc:1059] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:58.121795 13699 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:58.122783  9377 raft_consensus.cc:1240] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:03:58.104578 13667 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:58.131781 13602 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:58.132493 13602 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:58.133128 13602 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:58.133505 13667 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:58.134600  9370 raft_consensus.cc:2368] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14.
I20260709 13:03:58.137275 13786 consensus_queue.cc:1059] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:58.124166 13611 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:58.138852 13786 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:03:58.139601 13786 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:58.146833 13786 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:58.141162  9450 raft_consensus.cc:1240] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:58.141409  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:58.150187  9444 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:03:58.140549 13649 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:58.150210  9418 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:58.155256 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:03:58.158272 13611 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:58.166323  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:58.166713  9444 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
I20260709 13:03:58.170428 13607 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:58.174124 13607 raft_consensus.cc:697] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:58.175112 13607 consensus_queue.cc:237] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:58.154134 13619 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:03:58.165867 13786 raft_consensus.cc:3055] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:58.191895 13756 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:58.192116 13699 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:58.196868  9418 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:58.203959  9271 catalog_manager.cc:5697] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 5 to 6, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 6 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:58.212076  9418 leader_election.cc:400] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14.
I20260709 13:03:58.212551  9418 leader_election.cc:403] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:58.203091 13786 raft_consensus.cc:740] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:58.217279 13611 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14.
I20260709 13:03:58.220278  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:58.206367  9341 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:58.222762  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:58.230566  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:58.219954 13756 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:58.229969 13772 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:58.233731 13772 raft_consensus.cc:697] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:58.198546 13676 consensus_queue.cc:1059] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:03:58.237349  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:58.238775  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:58.239773  9447 raft_consensus.cc:2393] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 15: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:03:58.241588  9418 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:58.206306 13777 consensus_queue.cc:1059] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:03:58.251240  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:58.251921  9526 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:58.255908 13595 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:58.234474 13756 raft_consensus.cc:697] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:58.258265  9490 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:58.260507 13723 raft_consensus.cc:3055] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:58.270728  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:58.271327  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:58.272295 13723 raft_consensus.cc:740] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:58.274611 13723 consensus_queue.cc:260] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:58.276165 13723 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:58.231644 13786 consensus_queue.cc:260] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:58.279218  9368 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:03:58.280804  9418 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:58.282311  9418 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:03:58.277740 13786 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:58.299571 13756 consensus_queue.cc:237] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:58.300872 13403 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:58.266880 13801 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:58.303182 13801 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.303574 13801 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:58.236918 13772 consensus_queue.cc:237] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:58.312337 13773 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:58.317762 13752 raft_consensus.cc:3055] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:58.318290 13752 raft_consensus.cc:740] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:58.319156 13752 consensus_queue.cc:260] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:58.320616 13752 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:58.281466 13699 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:58.259361 13697 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:58.328536 13697 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:58.330351  9525 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:03:58.331105  9525 pending_rounds.cc:85] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 6
I20260709 13:03:58.331542  9525 pending_rounds.cc:107] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:03:58.331845  9525 raft_consensus.cc:2889] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:58.337774  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.341728  9526 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
W20260709 13:03:58.345378  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 59650.9us
I20260709 13:03:58.285099 13508 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:58.359282  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:58.362418  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:58.368093  9444 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:58.384848  9450 raft_consensus.cc:1240] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:58.406574  9444 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:03:58.365363 13602 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:58.387931 13611 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 13:03:58.435230  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.439805  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:58.440522  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:58.441946  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:58.429237 13688 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.446916  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:58.449831  9372 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:03:58.452008  9490 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:58.434675 13483 consensus_queue.cc:1059] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:03:58.454521 13602 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:58.457746  9525 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:03:58.458171  9525 pending_rounds.cc:85] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 8
I20260709 13:03:58.458381  9525 pending_rounds.cc:107] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:03:58.458608  9525 raft_consensus.cc:2889] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:58.459451 13801 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:58.461295  9524 raft_consensus.cc:2368] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 15. Current term is 16.
I20260709 13:03:58.463222  9372 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:03:58.463634  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:03:58.464547  9518 raft_consensus.cc:2393] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 10: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:03:58.468040  9370 raft_consensus.cc:2410] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:03:58.471691  9444 raft_consensus.cc:1275] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:58.473784  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:58.468124 13688 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:58.478188 13688 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:58.484990  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:58.481581  9492 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:58.496747 13704 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:58.495733  9492 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:58.508699  9492 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:58.481403 13786 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:58.526118  9343 leader_election.cc:400] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 15. Current term is 16.
I20260709 13:03:58.526703  9343 leader_election.cc:403] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:03:58.528038 13727 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:58.516499 13619 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:58.539420 13786 raft_consensus.cc:697] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:58.540488 13786 consensus_queue.cc:237] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:58.492273 13688 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:03:58.519557 13704 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:58.573817 13704 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.574271 13704 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:58.580184 13803 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.595804  9369 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:03:58.580989 13803 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:58.602187 13803 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:58.611189  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 90391.1us
I20260709 13:03:58.612504  9492 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:58.614089  9492 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:03:58.616340 13803 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:58.644898  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:58.645803  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:58.646601  9373 raft_consensus.cc:2410] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:03:58.647320  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:58.650542 13737 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.651155 13737 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:58.624431 13619 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:58.674132  9492 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:58.681646  9490 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:58.687907 13801 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:58.688345 13727 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 15. Current term is 16.
I20260709 13:03:58.679584 13582 raft_consensus.cc:3055] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:58.691067 13582 raft_consensus.cc:740] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:58.692132 13582 consensus_queue.cc:260] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:58.696236  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:58.697130  9445 raft_consensus.cc:2410] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:03:58.697685  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:58.698326  9450 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:58.701270  9377 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
I20260709 13:03:58.704167  9446 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:58.707975  9418 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:03:58.709908 13737 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:03:58.679657 13602 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:03:58.695163 13619 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:58.726372  9520 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:03:58.727932  9450 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
I20260709 13:03:58.733243  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:03:58.735237 13723 raft_consensus.cc:3055] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:58.735728 13723 raft_consensus.cc:740] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:03:58.730439 13403 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:58.737766 13403 raft_consensus.cc:697] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:03:58.738960 13403 consensus_queue.cc:237] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:03:58.736601 13723 consensus_queue.cc:260] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:58.745150 13704 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:58.746306 13723 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:58.749063  9525 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:03:58.754317  9490 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:58.755417 13803 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:58.757951  9490 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:03:58.762759  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:03:58.775698  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:58.776541  9446 raft_consensus.cc:2410] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:03:58.765470 13752 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:58.785459  9341 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:03:58.772490 13697 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:58.770141 13803 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:03:58.782889 13816 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:03:58.789907 13667 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:58.813318 13697 raft_consensus.cc:697] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:03:58.814522 13697 consensus_queue.cc:237] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:58.770381 13811 consensus_queue.cc:1059] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:03:58.817754 13811 raft_consensus.cc:3055] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:58.818228 13811 raft_consensus.cc:740] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:03:58.822503  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:58.857571  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.861249 13582 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:58.865793 13752 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:03:58.866415 13752 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:58.865854 13811 consensus_queue.cc:260] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:03:58.870380 13811 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:58.871197  9377 raft_consensus.cc:1275] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:58.866900  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:58.879928  9271 catalog_manager.cc:5697] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 4 to 6, leader changed from b0812463215649c3b011d36e2f0400c9 (127.8.4.68) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 6 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:03:58.883419  9271 catalog_manager.cc:5697] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:58.899709  9369 raft_consensus.cc:1275] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:58.901315  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:03:58.916899  9450 raft_consensus.cc:1240] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:58.933243  9377 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:58.935527  9525 raft_consensus.cc:1275] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:03:58.936321  9525 pending_rounds.cc:85] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 6
I20260709 13:03:58.936705  9525 pending_rounds.cc:107] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:03:58.937328  9525 raft_consensus.cc:2889] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:58.948103  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:03:58.949895  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:03:58.950920  9450 raft_consensus.cc:2410] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:03:58.875288 13752 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:03:58.875960 13704 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:03:58.980888  9274 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43240 (request call id 181) took 16410 ms (client timeout 15000 ms). Trace:
I20260709 13:03:58.963806 13773 consensus_queue.cc:1048] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:03:58.974622 13810 consensus_queue.cc:1048] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:03:58.991902  9373 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:03:58.981853  9274 rpcz_store.cc:269] 0709 13:03:42.569828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.570028 (+   200us) service_pool.cc:224] Handling call
0709 13:03:58.980587 (+16410559us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:57.142728 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:57.186974 (+ 44246us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:57.187010 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:03:57.187028 (+    18us) tablet.cc:662] Decoding operations
0709 13:03:57.210966 (+ 23938us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:57.211043 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:57.211070 (+    27us) tablet.cc:685] Acquiring locks for 27 operations
0709 13:03:57.216199 (+  5129us) tablet.cc:701] Row locks acquired
0709 13:03:57.216217 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:03:57.216429 (+   212us) write_op.cc:270] Start()
0709 13:03:57.216562 (+   133us) write_op.cc:276] Timestamp: P: 1783602237216360 usec, L: 0
0709 13:03:57.216584 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:03:57.365777 (+149193us) log.cc:844] Serialized 10379 byte log entry
0709 13:03:57.988308 (+622531us) op_driver.cc:464] REPLICATION: finished
0709 13:03:58.088124 (+ 99816us) write_op.cc:301] APPLY: starting
0709 13:03:58.088213 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:58.088684 (+   471us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:58.088820 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:58.094906 (+  6086us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:58.095243 (+   337us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=27
0709 13:03:58.095293 (+    50us) write_op.cc:312] APPLY: finished
0709 13:03:58.095729 (+   436us) log.cc:844] Serialized 182 byte log entry
0709 13:03:58.101519 (+  5790us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:58.101741 (+   222us) write_op.cc:454] Released schema lock
0709 13:03:58.101811 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:58.113328 (+ 11517us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:58.113364 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3452,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":99557,"apply.run_cpu_time_us":4804,"apply.run_wall_time_us":25161,"num_ops":27,"prepare.queue_time_us":400207,"prepare.run_cpu_time_us":33723,"prepare.run_wall_time_us":511971,"raft.queue_time_us":209211,"raft.run_cpu_time_us":16750,"raft.run_wall_time_us":106498,"replication_time_us":771571,"thread_start_us":771782,"threads_started":4,"wal-append.queue_time_us":389576}]]}
I20260709 13:03:58.977466 13619 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
W20260709 13:03:59.049499 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 91923.6us
I20260709 13:03:59.009617 13704 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:03:59.069204  9447 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 13:03:59.073527 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 105578us
I20260709 13:03:59.088948  9373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e30c155cba64357ae275b3366772777"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:59.089673  9373 raft_consensus.cc:606] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:59.089964  9373 raft_consensus.cc:614] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:59.078521 13758 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:03:59.111910  9369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36e88678fcd042e78609b17fe3521242"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:59.112933  9369 raft_consensus.cc:606] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:59.113540  9369 raft_consensus.cc:614] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:03:59.125478  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 129966us
I20260709 13:03:59.131837 13756 consensus_queue.cc:1048] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:03:59.137282  9522 raft_consensus.cc:1275] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:03:59.137773  9522 pending_rounds.cc:85] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 5
I20260709 13:03:59.138015  9522 pending_rounds.cc:107] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:03:59.138267  9522 raft_consensus.cc:2889] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:59.140583  9368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:59.145656  9368 raft_consensus.cc:606] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
W20260709 13:03:59.149706 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 68216us
I20260709 13:03:59.156876 13809 consensus_queue.cc:1048] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:59.157168  9368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:59.157905  9368 raft_consensus.cc:606] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:59.158244  9368 raft_consensus.cc:614] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:59.169909  9368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:03:59.170675  9368 raft_consensus.cc:606] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:03:59.171159  9368 raft_consensus.cc:614] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:59.173237  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:59.175671  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:03:59.317754 13834 log.cc:927] Time spent T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:04:00.364001 13833 log.cc:927] Time spent T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 1.023s	user 0.000s	sys 0.000s
W20260709 13:04:00.413205 13752 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.041s	user 0.064s	sys 0.175s
W20260709 13:04:00.750896 10026 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.000s	sys 0.024s
W20260709 13:04:00.751459 10026 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.000s	sys 0.025s
W20260709 13:04:00.758297 13840 log.cc:927] Time spent T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.225s	user 0.000s	sys 0.000s
W20260709 13:04:00.671861 13752 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.278s	user 0.065s	sys 0.176s
W20260709 13:04:01.240562 13842 log.cc:927] Time spent T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:04:01.347039 13838 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.319s	user 0.000s	sys 0.011s
W20260709 13:04:01.347642 13838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.320s	user 0.000s	sys 0.011s
W20260709 13:04:01.431918 10024 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.683s	user 0.010s	sys 0.029s
W20260709 13:04:01.432514 10024 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.684s	user 0.010s	sys 0.029s
W20260709 13:04:01.434358 10025 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.699s	user 0.001s	sys 0.041s
W20260709 13:04:01.434821 10025 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.699s	user 0.001s	sys 0.041s
W20260709 13:04:01.439416 10026 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.004s	sys 0.005s
W20260709 13:04:01.439949 10026 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.004s	sys 0.005s
I20260709 13:04:01.501758 13849 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:01.503728 13849 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:01.514272 13849 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:02.027348 13820 log.cc:927] Time spent T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 2.973s	user 0.009s	sys 0.023s
I20260709 13:04:02.243727  9518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1916) took 3101 ms. Trace:
W20260709 13:04:02.246919  9522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.077s	user 0.014s	sys 0.045s
W20260709 13:04:02.249941  9522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.080s	user 0.015s	sys 0.046s
I20260709 13:04:02.252373  9522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 1917) took 3083 ms. Trace:
I20260709 13:04:02.253057  9518 rpcz_store.cc:276] 0709 13:03:59.142365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.143755 (+  1390us) service_pool.cc:224] Handling call
0709 13:03:59.149666 (+  5911us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:59.149975 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:59.149992 (+    17us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:59.151990 (+  1998us) log.cc:844] Serialized 26 byte log entry
0709 13:03:59.155271 (+  3281us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:59.155299 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.155349 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:02.242898 (+3087549us) raft_consensus.cc:1685] finished
0709 13:04:02.242981 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.243374 (+   393us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":6503,"thread_start_us":2967,"threads_started":1,"wal-append.queue_time_us":3334,"wal-append.run_cpu_time_us":9726,"wal-append.run_wall_time_us":1204437}
I20260709 13:04:02.252992  9522 rpcz_store.cc:276] 0709 13:03:59.168514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.168643 (+   129us) service_pool.cc:224] Handling call
0709 13:03:59.168939 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:59.169344 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:03:59.169375 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:59.169787 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 13:04:02.251233 (+3081446us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:02.251378 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.251654 (+   276us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:02.251724 (+    70us) raft_consensus.cc:1685] finished
0709 13:04:02.251762 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.252209 (+   447us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":942,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":82,"thread_start_us":3080383,"threads_started":1,"wal-append.queue_time_us":174260,"wal-append.run_cpu_time_us":1848,"wal-append.run_wall_time_us":1019537}
I20260709 13:04:02.313499  9520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52502 (request call id 763) took 3084 ms. Trace:
I20260709 13:04:02.314666  9520 rpcz_store.cc:276] 0709 13:03:59.229136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.229292 (+   156us) service_pool.cc:224] Handling call
0709 13:04:02.312131 (+3082839us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:02.312735 (+   604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:02.312771 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:02.312857 (+    86us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:02.312929 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.313037 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.313236 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:02.373353 13856 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:02.375455 13856 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:02.380926 13856 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:02.384119  9373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 1779) took 3285 ms. Trace:
I20260709 13:04:02.384815  9373 rpcz_store.cc:276] 0709 13:03:59.098908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.099391 (+   483us) service_pool.cc:224] Handling call
0709 13:03:59.099714 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:59.107191 (+  7477us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:59.107224 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:59.107641 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:03:59.211066 (+103425us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:59.211119 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.211183 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:02.383401 (+3172218us) raft_consensus.cc:1685] finished
0709 13:04:02.383446 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.383819 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7047,"raft.queue_time_us":7260,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":9327,"spinlock_wait_cycles":1197824,"thread_start_us":102616,"threads_started":1,"wal-append.queue_time_us":219127,"wal-append.run_cpu_time_us":4028,"wal-append.run_wall_time_us":2390056}
I20260709 13:04:02.398530 13857 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:02.400141 13857 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.413960 13859 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:02.421301 13345 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:02.422544 13345 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.425701 13860 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:02.426594 13858 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:02.433480 13860 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:02.434301 13856 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:02.415659 13859 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.455996 13859 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.434180 13858 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.437927 13856 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.461838 13857 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.463790  9264 maintenance_manager.cc:419] P f3fb61137daa445d9297d2162e98e24e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033713
I20260709 13:04:02.456794 13859 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:02.465358 13860 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:02.465997 13859 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.469069 13345 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.472436 13858 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.473940 13858 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:02.475340 13858 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.469784 13859 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.474002 13864 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:02.480227 13862 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:02.480407 13864 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.482681 13861 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:02.483209 13858 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.469970 13856 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.483964 13858 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:02.479789 13345 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:02.483664 13864 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.483773 13861 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:02.487390 13345 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.480430 13865 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:02.490470 13865 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.494061 13345 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.479610 13860 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:02.496513 13865 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.496328 13860 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:02.485268 13858 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:02.498719  9445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 1731) took 3552 ms. Trace:
I20260709 13:04:02.499540 13858 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:02.481245 13862 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.505084 13859 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.506177 13859 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:02.511443  9443 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.283s	user 0.018s	sys 0.020s
I20260709 13:04:02.514761 13345 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:02.515599 13345 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.517309 13778 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:02.518553 13778 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.505187 13864 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:02.521292 13864 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:02.529452  9443 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.301s	user 0.019s	sys 0.021s
I20260709 13:04:02.500178  9445 rpcz_store.cc:276] 0709 13:03:58.945945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.947080 (+  1135us) service_pool.cc:224] Handling call
0709 13:03:58.947364 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:58.964681 (+ 17317us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:58.964732 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:02.221977 (+3257245us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b18001c00c0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58344b2a6 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb584e63a11 00007fb584e73372 00007fb5865a5a01 00007fb58656a43a
0709 13:04:02.399908 (+177931us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b2c00010c48. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb584e63a11 00007fb584e73372 00007fb5865a5a01 00007fb58656a43a 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2
0709 13:04:02.400989 (+  1081us) log.cc:844] Serialized 26 byte log entry
0709 13:04:02.451334 (+ 50345us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:02.457558 (+  6224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.476236 (+ 18678us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:02.477704 (+  1468us) raft_consensus.cc:1685] finished
0709 13:04:02.477719 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.498444 (+ 20725us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26035,"raft.queue_time_us":27439,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":11415,"spinlock_wait_cycles":75421312,"thread_start_us":46926,"threads_started":1,"wal-append.queue_time_us":59388}
I20260709 13:04:02.537245  9443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51012 (request call id 2866) took 3316 ms. Trace:
I20260709 13:04:02.537880 13345 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.539472 13861 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:02.537727  9443 rpcz_store.cc:276] 0709 13:03:59.220571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.226505 (+  5934us) service_pool.cc:224] Handling call
0709 13:03:59.226896 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:59.227273 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:59.227303 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:59.227759 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:04:02.536569 (+3308810us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:02.536644 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.536744 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:02.536794 (+    50us) raft_consensus.cc:1685] finished
0709 13:04:02.536810 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.537060 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":981,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":56337,"thread_start_us":3303828,"threads_started":1,"wal-append.queue_time_us":801816,"wal-append.run_cpu_time_us":3466,"wal-append.run_wall_time_us":1614938}
I20260709 13:04:02.541919 13860 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:02.542068 13862 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.548460 13859 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.549427 13856 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:02.549728 13345 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.550449 13345 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:02.550401 13856 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.556133 13856 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.562420  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:02.563406 13345 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:02.576078 13869 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:02.578423 13869 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.583106 13778 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.584275 13869 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.546576 13858 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.591377 13858 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.601751 13866 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.603283 13727 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.603483 13856 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:02.603888 13778 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.604871 13778 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.604420 13727 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.605949 13777 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:02.607012 13777 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.608785 13778 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.610829 13777 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.604535 13856 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:02.621680 13778 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:02.623106 13778 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.626817 13778 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.631886 13856 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:02.633402 13866 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.640208 13866 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:02.610708  9369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.414s	user 0.026s	sys 0.022s
W20260709 13:04:02.642015  9369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.450s	user 0.027s	sys 0.023s
I20260709 13:04:02.643190 13865 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:02.643533  9369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1886) took 3505 ms. Trace:
I20260709 13:04:02.632959 13869 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:02.646838 13865 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.642869 13858 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.647233 13869 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.608790 13727 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.660930 13869 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.644217  9369 rpcz_store.cc:276] 0709 13:03:59.138582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.143518 (+  4936us) service_pool.cc:224] Handling call
0709 13:03:59.144124 (+   606us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:59.144494 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:59.144522 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:59.153938 (+  9416us) log.cc:844] Serialized 26 byte log entry
0709 13:04:02.642871 (+3488933us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:02.642955 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.643138 (+   183us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:02.643198 (+    60us) raft_consensus.cc:1685] finished
0709 13:04:02.643215 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.643450 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4846,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":3931,"thread_start_us":3450820,"threads_started":1,"wal-append.queue_time_us":161763,"wal-append.run_cpu_time_us":3638,"wal-append.run_wall_time_us":1028396}
I20260709 13:04:02.665936 13773 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:04:02.665689 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 58301.3us
I20260709 13:04:02.666863 13773 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.676036 13870 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:02.677066 13870 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:02.674341 13869 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:02.687639 13773 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.688647 13773 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:02.689586 13773 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.680721 13870 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:02.691576 13870 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:02.692456 13870 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.694924 13870 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.695520 13870 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:02.690490 13869 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.698953 13869 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.699625 13869 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:02.696154 13870 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.702710 13773 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.703333 13870 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.700562 13869 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:02.709528 13873 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:02.718746 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 50508.1us
I20260709 13:04:02.711002 13876 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:02.724551 13870 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:02.728482 13870 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.730839 13870 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.731380 13870 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.731878 13870 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.743197 13869 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:02.743897 13869 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:02.753250 13403 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:02.754419 13403 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:02.744539 13869 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.759757 13869 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.765616 13870 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.726492 13773 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:02.769636 13877 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:02.770426 13877 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.773468 13877 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.761443 13873 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.776683 13873 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.778234 13403 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:02.787806 13877 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:02.767704 13876 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.791697  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:02.792416 13876 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.788748 13877 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.814045 13879 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:02.821722 13879 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.814154 13876 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:02.827189 13876 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.816340 13403 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:02.787425 13873 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:02.829450 13403 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.829677 13873 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.789515 13878 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:02.794094 13773 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.835994 13773 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.814877 13870 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:04:02.832228  9377 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.676s	user 0.021s	sys 0.027s
W20260709 13:04:02.838454  9377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.683s	user 0.022s	sys 0.027s
I20260709 13:04:02.836953 13870 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:02.839497 13857 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:02.833249 13873 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.840123 13857 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.834152 13878 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:02.843353  9377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 1780) took 3724 ms. Trace:
I20260709 13:04:02.824100 13877 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.825103 13879 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.856280 13878 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:02.850203 13869 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:02.862756 13869 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:02.844043  9377 rpcz_store.cc:276] 0709 13:03:59.118837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.118986 (+   149us) service_pool.cc:224] Handling call
0709 13:03:59.119353 (+   367us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:59.119710 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:59.119744 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:59.120941 (+  1197us) log.cc:844] Serialized 52 byte log entry
0709 13:04:02.839118 (+3718177us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:02.839327 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.841265 (+  1938us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:02.841313 (+    48us) raft_consensus.cc:1685] finished
0709 13:04:02.841324 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.843293 (+  1969us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1550,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":3656,"thread_start_us":3683223,"threads_started":1,"wal-append.queue_time_us":147064,"wal-append.run_cpu_time_us":2783,"wal-append.run_wall_time_us":1053816}
I20260709 13:04:02.875960  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:02.867795 13403 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.881912  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:02.876355 13878 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:02.885903 13829 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:02.886408 13878 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.886736 13829 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:02.890331  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:02.888957 13878 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.894445 13595 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:02.895221 13595 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:02.897769 13876 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.893880  9377 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:04:02.902078  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:02.881814 13879 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:02.904072  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:02.872869 13877 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:02.905064 13877 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.904863 13879 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.910000  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:02.913537  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:02.917759  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:02.918619  9450 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:04:02.922744  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:02.927027 13857 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.888933 13829 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:02.916757 13864 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.909349 13403 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:02.929659 13403 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.937319 13595 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:02.934628 13879 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.943328 13878 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:02.909099 13870 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:02.944020 13878 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.949458  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:02.943856 13879 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:02.956633  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:02.958318  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:02.958845  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:02.959806  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:02.961580  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:02.960762  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:02.958348 13869 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:02.967051 13619 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:02.973826 13619 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:02.968348  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:02.979101  9451 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:04:02.979880 13403 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.967504 13697 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:02.980559 13878 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.961359 13877 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.967872 13803 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:02.969866  9271 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 78) took 6761 ms. Trace:
I20260709 13:04:02.984251 13803 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:02.984032  9271 rpcz_store.cc:276] 0709 13:03:56.208485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:56.208742 (+   257us) service_pool.cc:224] Handling call
0709 13:04:02.969590 (+6760848us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:59.157022 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:59.157648 (+   626us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:59.157685 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:03:59.157706 (+    21us) tablet.cc:662] Decoding operations
0709 13:03:59.158268 (+   562us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:59.158375 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:59.158404 (+    29us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:03:59.158764 (+   360us) tablet.cc:701] Row locks acquired
0709 13:03:59.158786 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:03:59.158937 (+   151us) write_op.cc:270] Start()
0709 13:03:59.175859 (+ 16922us) write_op.cc:276] Timestamp: P: 1783602239158886 usec, L: 0
0709 13:03:59.176405 (+   546us) op_driver.cc:348] REPLICATION: starting
0709 13:03:59.207991 (+ 31586us) log.cc:844] Serialized 1275 byte log entry
0709 13:04:01.347614 (+2139623us) op_driver.cc:464] REPLICATION: finished
0709 13:04:01.502852 (+155238us) write_op.cc:301] APPLY: starting
0709 13:04:01.507785 (+  4933us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:01.507994 (+   209us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:01.508187 (+   193us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:01.508749 (+   562us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:01.509047 (+   298us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:04:01.509117 (+    70us) write_op.cc:312] APPLY: finished
0709 13:04:01.509418 (+   301us) log.cc:844] Serialized 35 byte log entry
0709 13:04:01.515491 (+  6073us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:01.515656 (+   165us) write_op.cc:454] Released schema lock
0709 13:04:01.515728 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:01.516266 (+   538us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:01.516304 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":654238,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":154936,"apply.run_cpu_time_us":2969,"apply.run_wall_time_us":13370,"num_ops":3,"prepare.queue_time_us":206619,"prepare.run_cpu_time_us":38824,"prepare.run_wall_time_us":194852,"raft.queue_time_us":1319703,"raft.run_cpu_time_us":2164,"raft.run_wall_time_us":153588,"replication_time_us":2170972,"thread_start_us":1765385,"threads_started":4,"wal-append.queue_time_us":816854,"wal-append.run_cpu_time_us":14045,"wal-append.run_wall_time_us":2485723}]]}
I20260709 13:04:02.981144  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:03.002715 13697 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.005223 13879 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.007362 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:03.007993 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:03.008792 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:03.009245 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:03.009646 13879 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:02.982789  9450 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:04:03.018376  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.018477 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:03.019246  9377 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 17.
I20260709 13:04:03.020385 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:03.020509 13649 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:03.021328 13649 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.022127 13697 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.023797 13649 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.026506  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.027374  9377 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:04:02.966885 13688 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:03.038455  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.039261  9369 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 17.
I20260709 13:04:03.028939  9418 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:03.051570  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:03.052572  9443 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:04:03.053051  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:03.051659 13880 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.053910  9451 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 18.
I20260709 13:04:03.054217 13880 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.055001  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:03.056378  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:03.056726 13880 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.057485 13752 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.057778  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:03.058399  9448 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
I20260709 13:04:03.058269 13752 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.060483 13752 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.061208  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:03.062296  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:03.063289 13688 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:03.064268  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:03.064329 13649 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:03.065076  9452 raft_consensus.cc:2468] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:04:03.065613 13883 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.074229 13697 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:03.074120 13403 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:03.073091 13883 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.086452 13870 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.082796 13752 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:03.087317 13884 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:03.121109 13810 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:03.121315 13884 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.121856 13810 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.123365 13865 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:03.090528 13799 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.124262 13810 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:03.124595 13799 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.095018 13704 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.090783 13756 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.103037 13403 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:03.102721 13697 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:03.129858 13403 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:03.131734 13697 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:03.113726 13870 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.136317 13870 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:03.117647  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:03.118533 13752 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:03.118763 13649 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:03.127671 13803 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.128717 13704 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.108956 13883 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.128705 13756 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.127655  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:03.146329 13619 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:03.063767 13877 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.150959 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:03.228423 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:04:03.236526  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 108933us
I20260709 13:04:03.242911  9418 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:03.245317 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:03.127540 13799 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.227895 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:03.248783 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:03.250803  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:03.255470  9452 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:04:03.117660 13688 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:03.260560  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:03.240703 13870 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:03.266993 13870 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.267387 13870 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:03.184335 13810 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.256978 13869 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:03.274355  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:03.263432 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:03.249648 13697 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.266027 13884 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.247718 13877 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.270750 13879 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:03.277613 13799 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.284394 13704 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.284557 13619 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.296746 13649 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:03.281636 13803 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.285244 13889 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:03.285494 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:03.277818 13869 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.271950 13880 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:03.285970 13697 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.288885 13688 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.288923 13883 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.227319  9275 catalog_manager.cc:5697] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 8 to 10, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 10 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:03.296175  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:03.310811 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:03.284861 13882 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:03.312178 13619 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.313628 13704 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.295188 13888 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.316512  9450 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:04:03.317118 13884 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:03.292963 13879 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.318113 13756 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:03.296175 13799 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.319245 13891 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.318136 13877 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:03.339280  9447 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:04:03.330617 13869 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:03.332072 13649 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:03.354401  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.346010 13879 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:03.349346 13803 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:03.360188  9547 debug-util.cc:398] Leaking SignalData structure 0x7b0800378520 after lost signal to thread 8212
W20260709 13:04:03.361486  9547 debug-util.cc:398] Leaking SignalData structure 0x7b080030a780 after lost signal to thread 9309
W20260709 13:04:03.363040  9547 debug-util.cc:398] Leaking SignalData structure 0x7b08003bf1c0 after lost signal to thread 9401
W20260709 13:04:03.363343  9547 debug-util.cc:398] Leaking SignalData structure 0x7b0800390c20 after lost signal to thread 9402
W20260709 13:04:03.364625  9547 debug-util.cc:398] Leaking SignalData structure 0x7b0800254f00 after lost signal to thread 9476
I20260709 13:04:03.365144 13888 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.365496 13891 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.366832  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:03.367167  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.367460 13884 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:03.368533  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:03.368892  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:03.369591  9445 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 16.
I20260709 13:04:03.351722 13883 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:03.368577  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:03.368541 13649 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.373479  9446 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:04:03.373833  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:03.374439  9448 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 16.
I20260709 13:04:03.375963 13752 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:03.354326  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.378515 13619 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.372798  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:03.379032 13891 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.382844 13803 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:03.364931  9547 debug-util.cc:398] Leaking SignalData structure 0x7b0800284c20 after lost signal to thread 9477
W20260709 13:04:03.386605  9547 debug-util.cc:398] Leaking SignalData structure 0x7b0800109c20 after lost signal to thread 9550
W20260709 13:04:03.386950  9547 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0a60 after lost signal to thread 9551
W20260709 13:04:03.388149  9547 debug-util.cc:398] Leaking SignalData structure 0x7b08002ce500 after lost signal to thread 10094
I20260709 13:04:03.400386  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.401582  9374 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:04:03.365407  9275 catalog_manager.cc:5697] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:03.351081 13896 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.341379 13810 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.350903 13887 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:03.409461  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.406993  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.410228  9369 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:04:03.397238 13688 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.414951  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.385205 13704 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.417830  9275 catalog_manager.cc:5697] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 9 to 10, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 10 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:03.419813 13704 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.422824  9417 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:03.423216 13688 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.399365 13403 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:03.423925  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 95360.4us
I20260709 13:04:03.424750  9450 raft_consensus.cc:2393] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 14: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:03.424415  9275 catalog_manager.cc:5697] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:03.422734  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.428265  9374 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:04:03.431504  9275 catalog_manager.cc:5697] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:03.432188 13403 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:03.357463 13889 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.433148 13403 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:03.435340 13889 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.435985 13887 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.440653 13887 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:03.478679  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 56198us
I20260709 13:04:03.479154  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.354444 13882 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.449944  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.495858 13810 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:03.503751  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.448227 13891 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.446203 13893 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.495050  9372 raft_consensus.cc:1275] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:04:03.392067 13880 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:03.504868 13891 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.446321 13896 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.476486 13803 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:03.404294 13879 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.508962  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.442343 13619 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.422772 13888 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.541765  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.511137  9341 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:04:03.524019 13704 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.545112  9373 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:04:03.448227 13752 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:03.551815  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:04:03.551767  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 72136.1us
I20260709 13:04:03.508962 13889 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:03.508733 13887 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.557847 13803 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.558171 13887 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.560086 13880 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:03.555263  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.558224 13704 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.508391 13894 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:03.560158 13803 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.556622 13888 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.557891 13889 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.567171 13896 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.567932 13884 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:03.568112 13799 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.568511 13704 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.569754 13891 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.572655  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.573490 13883 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:03.574141  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.574271 13649 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.574996  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.575290 13697 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.575412  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.582330 13888 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.554440 13866 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:03.601497 13866 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:03.578266 13880 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:03.601964 13866 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:03.602198 13880 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.603099 13888 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.597687 13894 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.583770  9372 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:04:03.590936  9517 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 4.
I20260709 13:04:03.605348 13894 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.564865 13887 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.545586 13893 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:03.607039 13889 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.607589 13893 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.600621  9526 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
W20260709 13:04:03.592131  9490 connection.cc:256] RPC call timeout handler was delayed by -1.7382472740000594s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
W20260709 13:04:03.608314  9490 connection.cc:256] RPC call timeout handler was delayed by -1.735547274000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
I20260709 13:04:03.609650  9490 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:03.600656  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.594255  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.598258  9519 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:04:03.611878  9369 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:04:03.610930  9518 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:04:03.587779 13896 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.586580 13803 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.620230  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.621361  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.623525  9369 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:04:03.619450 13880 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.589612 13619 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.641058  9275 catalog_manager.cc:5697] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:03.599630 13752 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:03.645566  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.643448  9341 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:03.649791  9522 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
I20260709 13:04:03.632987 13900 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:03.653668  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.654616 13880 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.655146 13752 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:03.653671 13865 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:03.659178  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:04:03.661634  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 52158.5us
I20260709 13:04:03.702100  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.702711  9275 catalog_manager.cc:5697] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 11 to 12, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 12 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:03.660748 13866 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:03.682036  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.682665  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.683372  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.683497  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.683638  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.684516  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.684554  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.685515  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.685990  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.690234 13882 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:03.693331  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 46977.2us
I20260709 13:04:03.694366 13879 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:03.639981 13896 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.695793 13870 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.638192 13803 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.702405  9524 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 6.
I20260709 13:04:03.705143  9518 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:04:03.725875  9490 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:03.726172  9526 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
I20260709 13:04:03.727891  9525 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:04:03.733215  9517 raft_consensus.cc:2393] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 17: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:03.727030  9523 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:04:03.701965 13865 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:03.738065  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.738606  9444 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 17.
I20260709 13:04:03.740602  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.741287  9518 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:04:03.742574  9275 catalog_manager.cc:5697] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:03.743408 13619 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.748509  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.749212  9526 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:04:03.744778  9275 catalog_manager.cc:5697] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 10 to 11, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 11 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:03.738850  9525 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:04:03.751987  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.739699 13865 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:03.725180 13880 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.765261  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.765514 13880 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.765974  9520 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 8.
I20260709 13:04:03.767053  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:04:03.770658 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 59192.1us
W20260709 13:04:03.770661  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 129732us
I20260709 13:04:03.768838  9521 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:04:03.779110  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.779505  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.780004  9370 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:04:03.779919  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:03.780911  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.781544  9372 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:04:03.771955  9519 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 18.
I20260709 13:04:03.784515 13619 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:04:03.786911  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.787494  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.788734  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.788904  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.790068 13866 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:03.790500  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.790063  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.793936 13869 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.798460 13896 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.805537  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.793988  9275 catalog_manager.cc:5697] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 8 to 10, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 10 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:03.812937  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.814579  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.817553 13803 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:03.829388  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.830296  9275 catalog_manager.cc:5697] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 8 to 13, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 13 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:03.796707 13869 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:03.843601  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.835804  9341 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:03.845477 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
W20260709 13:04:03.847957  9323 auto_rebalancer.cc:629] Failed to schedule move for tablet a8c41deeda674b9b8d27e72d70e96e79: Illegal state: Replica d62c9d5a052b42ce8675f8438f846526 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:03.849431  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.857415  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.859362  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.861958  9519 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:04:03.861637 10027 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:03.865242  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.865795  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.867105  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.867807  9519 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:04:03.868251 13870 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:03.860306 13906 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:03.873039  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.874528  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.874657  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.876088  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.876942  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.877390  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.878306  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.879626  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.873250 13906 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:03.876039  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.882078  9341 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:03.890544  9341 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:03.884914 13906 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:03.892014 13864 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:03.892472 13864 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:03.892843 13864 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:03.892047 13684 raft_consensus.cc:2804] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:03.895146 13684 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:03.895705 13684 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:03.913448  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.915603  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.913590  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.917762  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:03.918383  9369 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:03.949394  9369 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:04:03.961179  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.961046  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.959718  9341 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:03.943861 13866 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:03.972893  9492 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:03.973228 13866 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:03.973662 13866 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:03.973932 13897 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:03.974349 13897 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:03.974771 13897 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:03.977300  9323 auto_rebalancer.cc:629] Failed to schedule move for tablet ffaf31f504f540dc957e0b558c940f79: Illegal state: Replica 925acbe78db14db3b9e4cfc857717947 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:03.965894  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.966209  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.967283  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.967523  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.980428  9492 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:03.987592 13884 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:03.987732  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.988170 13884 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:03.988615 13884 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:03.988858  9368 raft_consensus.cc:2410] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:04:03.989874  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.990103 13865 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:03.991269  9373 raft_consensus.cc:1240] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:03.991331  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.993314  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.995031  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.995790  9370 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:04:03.997174  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.998044  9370 raft_consensus.cc:2410] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:04:03.999034  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:03.999936  9370 raft_consensus.cc:2410] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 17 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:04:04.006600 13865 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:04.007256  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:04.007956  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:04.008602  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:04.009678 13900 consensus_queue.cc:1048] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:04.009910 13857 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:04.011011  9492 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:04.018929  9418 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:04.025452  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:04.031119 13884 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:04.058099  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 98485.3us
I20260709 13:04:04.016324 13684 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:04.058947  9341 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
W20260709 13:04:04.059890  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 48963.2us
I20260709 13:04:04.061566  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:04.062299  9373 raft_consensus.cc:1240] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:04.066044  9341 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:04.067608  9418 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:04.071633  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:04.073086  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:03.944070 13906 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:04.053260 13864 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:04.078121 13864 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:04.082224  9418 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:04.086617  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.053987 13857 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.100276  9418 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:04.014792 13866 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:04.061398 13870 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:04:04.111801 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 48411.4us
I20260709 13:04:04.064044 13904 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:04.115751  9371 raft_consensus.cc:2393] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 12: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
W20260709 13:04:04.115077  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 49114.8us
I20260709 13:04:04.113492  9418 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:04.120434  9418 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:04.118716  9341 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:04.098359 13869 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:04.125998  9492 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:04.126816  9341 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:04.100025 13857 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:04.133445  9373 consensus_queue.cc:237] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:04.101361 13810 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:04.059808 13897 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:04.136955  9369 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:04.136358  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.143240  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.112076 13870 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:04.152437  9492 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:04.121737 13904 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:04.153396  9519 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:04:04.111501 13864 raft_consensus.cc:2804] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:04.173925 13864 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:04.174561 13864 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:04.177160  9369 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 19.
I20260709 13:04:04.177421  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.184010  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.125047 13877 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:04.185987 13877 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:04.186604 13877 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:04.190335 13619 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:04.191110 13619 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:04.191666 13619 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:04.125392 13878 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:04.194851 13878 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:04.195504 13878 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:04.165547 13911 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:04.197309 13911 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:04.197983 13911 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:04.166561 13897 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:04.202900 13866 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:04.135001 13829 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:04.206640 13904 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:04.170341 13865 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:04.208036 13865 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.208628 13865 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:04.172003  9376 raft_consensus.cc:1240] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:04.122926 13403 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:04:04.218971 13906 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:04.153074 13803 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:04.222463  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.222854 13803 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:04.223474 13803 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:04.220788  9369 raft_consensus.cc:1240] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 11. Current term is 12. Ops: []
W20260709 13:04:04.237365  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 99882us
I20260709 13:04:04.241231  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.244177  9374 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 17.
I20260709 13:04:04.195122 13684 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:04.164270 13870 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:04.262715  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.265142  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.262509 13884 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:04.279884  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.280802  9525 raft_consensus.cc:2393] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 18: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:04.281322  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.293660  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.295068  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.296527  9520 raft_consensus.cc:1240] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:04.296973  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.300396  9418 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:04.303001  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.307097  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.307111  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.308573  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.307555  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.312454  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.314163  9522 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:04:04.304795 13879 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:04.316573  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.323918  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.328137  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.317622  9418 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:04.329108  9521 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:04:04.333427  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:04:04.340963 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 224376us
I20260709 13:04:04.347107  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.333652 13403 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:04.343012  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:04.354745  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.358354  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:04.359447  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:04.327772 13879 raft_consensus.cc:697] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:04.362576  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.366987  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:04.328598 13904 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:04.366997  9518 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 17.
I20260709 13:04:04.368916  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.375108  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.354131 13403 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.389853  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:04.390406  9519 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:04.382844 13403 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:04.388972  9526 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
I20260709 13:04:04.351999 13688 consensus_queue.cc:1059] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:04:04.409670 13884 raft_consensus.cc:3055] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:04.410025 13869 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:04.410626 13869 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:04.380965 13810 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:04.414515  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.400298 13911 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:04.397353  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.374426 13922 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:04.458339 10064 raft_consensus.cc:1240] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:04.394461 13900 consensus_queue.cc:1059] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:04:04.459669 13900 raft_consensus.cc:3055] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:04.459972  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.461565  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:04.461628  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.462855  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.462925  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:04.463668  9523 raft_consensus.cc:2393] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 14: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:04.464193  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:04.464356 13403 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:04.415124 13915 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:04.460049 13900 raft_consensus.cc:740] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:04.466944 13904 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:04.457876  9343 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.4.67:35929 timed out after 1.541s (SENT) [suppressed 12 similar messages]
W20260709 13:04:04.499495 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 115351us
I20260709 13:04:04.463697 13879 consensus_queue.cc:237] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:04.464555  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.502678 13845 consensus_queue.cc:1059] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:04.503150  9521 raft_consensus.cc:2410] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:04:04.464998  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.504258 13929 raft_consensus.cc:3055] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:04.470633  9520 raft_consensus.cc:1240] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:04.504675 13929 raft_consensus.cc:740] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:04:04.469620  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.470613 13911 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:04.387756 13878 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:04.505892 13929 consensus_queue.cc:260] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:04.507510 13878 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:04.508982 13878 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:04.509550 13878 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:04.518805 10027 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:04.410077 13884 raft_consensus.cc:740] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:04:04.497581  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 370895us
I20260709 13:04:04.522140  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:04.524641  9520 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:04.522665  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:04.415182 13869 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:04.412612 13865 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:04.520450 13920 log.cc:927] Time spent T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.126s	user 0.004s	sys 0.000s
I20260709 13:04:04.536334  9341 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:04.485311 13688 consensus_queue.cc:1059] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:04:04.468765 13877 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:04.543021  9341 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:04.516304 13857 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:04.540831 13810 raft_consensus.cc:697] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:04.543783 13930 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:04:04.629463 13927 log.cc:927] Time spent T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:04:04.558650 13916 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:04.600062 13900 consensus_queue.cc:260] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:04.630780  9375 raft_consensus.cc:2393] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 15: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:04.600275  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:04:04.571671  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 220349us
I20260709 13:04:04.627346  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:04.625265  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:04.635123  9520 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
I20260709 13:04:04.632879  9341 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:04.638247  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:04.671597  9526 raft_consensus.cc:2393] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 17: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:04.674968  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:04.677604  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:04.677899  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:04.678838  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:04.679311  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:04.574312 13923 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:04.683588  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:04.591431 13930 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.627669 13857 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:04.695931  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:04.697999  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:04.635689 13897 raft_consensus.cc:3055] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:04.637900 13878 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:04.628453 13619 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:04.591017 13870 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:04.594415 13924 consensus_queue.cc:1059] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.133s
I20260709 13:04:04.700441  9368 raft_consensus.cc:1240] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:04.761796  9443 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:04.703042  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:04:04.723253  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.681133 13906 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:04.594515 13864 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:04.725440  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:04.690115 13922 raft_consensus.cc:697] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 19 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:04.700687  9452 raft_consensus.cc:2393] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 11: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:04.791218  9525 raft_consensus.cc:1240] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:04.777427  9519 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 19.
I20260709 13:04:04.672633 13929 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:04.689715 13923 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:04.789551  9447 raft_consensus.cc:2393] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 15: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:04.595257 13884 consensus_queue.cc:260] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:04.724263 13928 log.cc:927] Time spent T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
W20260709 13:04:04.796794 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 156035us
I20260709 13:04:04.793854 13923 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:04.798537 13932 log.cc:927] Time spent T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:04:04.622978 13810 consensus_queue.cc:237] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:04.821941  9444 raft_consensus.cc:2393] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 12: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:04.779419 13906 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.773885 13897 raft_consensus.cc:740] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:04.696388 13930 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:04.723811 13877 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:04.815882  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.722887 13403 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:04.778364 13900 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:04.801226 13922 consensus_queue.cc:237] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:04.829329  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:04.837888  9371 raft_consensus.cc:1240] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 4. Current term is 5. Ops: []
W20260709 13:04:04.838439  9490 connection.cc:256] RPC call timeout handler was delayed by -2.0569424889999937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 13:04:04.839010  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 243041us
I20260709 13:04:04.842962  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:04.848521  9446 raft_consensus.cc:2393] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 13: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:04.835592 13906 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:04.854830  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:04.858175  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:04.844647 13884 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:04.864408 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:04:04.866127  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 58934.7us
I20260709 13:04:04.868381  9446 raft_consensus.cc:1275] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:04:04.868631  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:04.846149 13865 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:04.871310  9451 raft_consensus.cc:1240] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:04.873971 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:04.879288 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:04.880332  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:04.881491  9451 raft_consensus.cc:2368] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 14. Current term is 15.
I20260709 13:04:04.879304  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:04.883484  9444 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:04:04.883898 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:04.885721 13897 consensus_queue.cc:260] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:04.886955 13897 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:04.889441 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:04:04.893584 13803 consensus_meta.cc:287] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.670s	user 0.010s	sys 0.005s
I20260709 13:04:04.894351 13803 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:04.897301  9524 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:04:04.865302 13915 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:04.901739 13915 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:04.905993 13864 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:04.906994 13930 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:04.909832  9370 raft_consensus.cc:1240] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:04:04.910988 13870 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:04.916026 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:04.917309  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:04.917238  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:04.918112  9448 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:04:04.925892 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:04.926926  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:04.927255  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:04.927582  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:04.928231  9443 raft_consensus.cc:2368] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13.
I20260709 13:04:04.929332  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:04.929692  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:04.929775  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:04.928239  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:04:04.931728  9342 consensus_peers.cc:597] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 99c4416401f2427a9f7e68b64ec6915e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:04.932446 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:04.931602 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:04.933637  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:04.931109  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:04.934649  9449 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:04:04.932438  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:04.941382  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:04.935482  9491 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:04.942288  9443 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:04:04.935024 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:04.948740 10067 raft_consensus.cc:2393] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 7: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:04:04.957751  9491 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:04.962389  9491 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:04.964766  9491 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:04.969980  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:04.970016  9341 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:04.978207  9343 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:04.959190 13930 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:04.960728 13803 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:04.976701 13688 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:05.023030  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:05.025547  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:05.026417  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:05.026970 13857 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:05.027041  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:05.027797 13688 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:05.028815  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:05.029673  9445 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:04:05.029779  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:05.030365  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:05.031220  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:05.031579  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:05.031811  9446 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:04:05.022044 13924 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:05.030457  9444 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:04:04.960594 13900 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:04:05.033797  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:05.028106  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:05.038640  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:04.998793 13925 raft_consensus.cc:3055] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:05.005668 13904 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:05.045225  9343 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.009344 13884 raft_consensus.cc:2749] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:05.049685  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 197222us
I20260709 13:04:05.050725  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:05.052804  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:05.054270  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:05.037134 13619 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:05.040599 13918 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:04:05.065501  9343 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.071225  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:05.126681  9443 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:05.126919  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 61504.1us
I20260709 13:04:05.127403 13918 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:05.072427  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:05.072733 13864 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:05.078276  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:05.078377  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:05.128180  9343 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:05.077307  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:05.078323  9450 raft_consensus.cc:1240] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:05.079144  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:05.079558 13923 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.046691 13925 raft_consensus.cc:740] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:05.090675  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:05.091436  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:05.095516  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:05.132820  9525 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:05.133037 13857 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:05.133610  9448 raft_consensus.cc:1240] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:05.131242  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:05.134915  9524 raft_consensus.cc:2393] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 15: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:05.135062  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:05.135756  9444 raft_consensus.cc:2368] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 14. Current term is 15.
I20260709 13:04:05.136399 13864 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:05.136844 13864 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:05.136912 13923 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:05.065382 13940 consensus_queue.cc:1059] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:04:05.135845  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:05.138023  9446 raft_consensus.cc:2368] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13.
I20260709 13:04:05.138204 13925 consensus_queue.cc:260] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:05.139431 13940 raft_consensus.cc:3055] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:05.140007 13925 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:05.140784  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:04.992967 13915 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.144378 13915 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:05.099108  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:05.101394  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:05.106230  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:05.145711  9371 raft_consensus.cc:2393] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 13: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:05.110929  9368 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:04:05.149381  9443 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 17.
I20260709 13:04:05.151330  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:05.151981  9443 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:05.132784  9451 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:04:05.123771  9418 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
W20260709 13:04:05.126667  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 161988us
I20260709 13:04:05.129335  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:05.146090  9375 raft_consensus.cc:2393] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 11: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:05.132061  9343 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.154410  9491 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:05.149902  9341 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.146126  9372 raft_consensus.cc:2393] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 12: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:05.151885  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:05.111049 13906 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.155779  9447 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:05.157614  9341 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:05.158337  9418 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.162863  9418 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.163198  9343 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.164258  9418 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:05.165366  9343 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.166014  9418 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.167446  9418 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.169425  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:05.170305  9491 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:05.171571  9343 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.172770  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:05.174072  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:05.174095  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:05.174844  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:05.175171  9524 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:05.175964  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:05.176332  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:05.177331  9519 raft_consensus.cc:2393] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 17: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:05.174409  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:05.184813  9343 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.186843  9343 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.192943  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:05.194268  9343 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.139982 13940 raft_consensus.cc:740] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:04:05.195073  9490 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.196331  9526 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:04:05.161329 13922 raft_consensus.cc:2804] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:05.158550 13915 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:05.207047 13919 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:04:05.207895 13954 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:05.181435 13866 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:05.191784 13878 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:05.209333 13878 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:05.209749 13878 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:05.210613 13906 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:05.181879 13877 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:05.167304 13939 raft_consensus.cc:2749] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:05.193732  9522 raft_consensus.cc:2376] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 19. Re-sending same reply.
I20260709 13:04:05.169920 13923 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:05.182078 13879 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:05.201259 13947 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:05.201908 13948 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:05.197964 13619 consensus_queue.cc:1059] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:04:05.204909 13952 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:05.232308 13958 ts_tablet_manager.cc:933] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
I20260709 13:04:05.222083 13915 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:05.205114 13940 consensus_queue.cc:260] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:05.190097 13930 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:05.226401 13864 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.219122  9343 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.220515  9443 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 17.
I20260709 13:04:05.221042  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:05.222517  9490 leader_election.cc:400] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 14. Current term is 15.
I20260709 13:04:05.248014  9490 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.216749 13922 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:05.223124 13949 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:05.196213 13810 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:05.197940 13897 consensus_queue.cc:1048] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:04:05.224056 13923 raft_consensus.cc:697] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:05.227263 13957 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:05.249349  9490 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.249506  9524 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:04:05.217883 13877 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:05.251230  9343 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.222357 13879 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:05.190040  9418 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.255867  9490 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.237762 13619 raft_consensus.cc:3055] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:05.258080  9490 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.262270  9370 raft_consensus.cc:1240] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:05.262390  9490 leader_election.cc:400] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13.
I20260709 13:04:05.260006  9343 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:05.260226  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 70282.8us
I20260709 13:04:05.250835 13906 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:05.251763 13922 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:05.268811  9418 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.263309  9490 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.251672 13810 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:05.280012  9447 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
I20260709 13:04:05.281741 13955 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:05.282275 13955 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:05.282693 13955 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:05.284909 10024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.270563 13870 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:05.285789 13870 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:05.286192 13870 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:05.264546 13884 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:05.259219 13954 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:05.259219 13904 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:05.261621 13923 consensus_queue.cc:237] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.292467 13878 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.294070 13940 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:05.260679 13619 raft_consensus.cc:740] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:05.295264 13878 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:05.259527 13866 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:05.295693 13619 consensus_queue.cc:260] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.304387 13619 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:05.257491 13877 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:05.303030 13870 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.259301 13879 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:05.316666 13403 raft_consensus.cc:2804] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:05.258605 13957 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:05.317224 13403 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:05.317395 13957 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:05.317759 13403 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:05.319685  9525 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:04:05.311950  9341 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:04:05.324853  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 61604.3us
I20260709 13:04:05.328176  9490 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.330941 13904 raft_consensus.cc:2749] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:05.312749 13810 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:05.278991 13924 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:05.337108 13897 consensus_queue.cc:1059] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:05.338276 13897 raft_consensus.cc:3055] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:05.338652 13897 raft_consensus.cc:740] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:05.339511 13897 consensus_queue.cc:260] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.346273  9341 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:05.352972 13864 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:05.354472 13864 raft_consensus.cc:2955] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index -1 to 9, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:05.355744 13906 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:05.356520 13906 raft_consensus.cc:697] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:05.357448 13906 consensus_queue.cc:237] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.358089 13403 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.361311 13870 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:05.349360 13924 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:05.348215 13954 consensus_queue.cc:1059] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:04:05.378153 13403 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:05.378223 13954 raft_consensus.cc:3055] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:05.379627 13954 raft_consensus.cc:740] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:05.380532 13954 consensus_queue.cc:260] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.381376  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:05.381878 13954 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:05.363567 13897 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:05.399699  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:05.409981  9370 raft_consensus.cc:2368] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13.
W20260709 13:04:05.410077  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 141358us
I20260709 13:04:05.410910  9368 raft_consensus.cc:1240] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:05.411062  9418 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.412061  9371 raft_consensus.cc:1240] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:05.413481  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 85791.8us
I20260709 13:04:05.414506  9490 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.415488  9418 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:05.416488  9490 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.412005 13904 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:05.412312 13924 raft_consensus.cc:697] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:05.422189 13924 consensus_queue.cc:237] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.412744  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:05.427361 13878 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:05.427927 13878 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:05.428421 13878 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:05.432693 13884 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:05.433180  9372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:05.434266  9492 leader_election.cc:400] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13.
I20260709 13:04:05.434631  9492 leader_election.cc:403] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:04:05.436206 13900 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13.
I20260709 13:04:05.436247 13904 consensus_queue.cc:1059] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:05.437157 13904 consensus_queue.cc:1243] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:04:05.437721 13900 raft_consensus.cc:3055] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:05.438113 13900 raft_consensus.cc:740] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:05.438375 13949 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:05.439239 13900 consensus_queue.cc:260] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.438371 13922 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.440544 13900 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:05.443418 13963 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:05.445854  9452 raft_consensus.cc:1240] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:05.449193 13688 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:05.450340 13958 tablet_copy_client.cc:323] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.65:37547
I20260709 13:04:05.452266 13957 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.455165  9387 tablet_copy_service.cc:140] P 925acbe78db14db3b9e4cfc857717947: Received BeginTabletCopySession request for tablet 99c4416401f2427a9f7e68b64ec6915e from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:50568)
I20260709 13:04:05.459239  9372 raft_consensus.cc:606] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.463042  9372 raft_consensus.cc:614] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:05.463096  9387 tablet_copy_service.cc:161] P 925acbe78db14db3b9e4cfc857717947: Beginning new tablet copy session on tablet 99c4416401f2427a9f7e68b64ec6915e from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:50568: session id = b0812463215649c3b011d36e2f0400c9-99c4416401f2427a9f7e68b64ec6915e
I20260709 13:04:05.367317  9443 raft_consensus.cc:2955] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index -1 to 9, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:05.461575 13922 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:05.428188 13952 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:05.468837  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:05.471321  9418 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.471590  9490 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.476279 13963 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:05.464475 13957 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:05.476310 13947 consensus_queue.cc:1059] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:05.478312 13947 raft_consensus.cc:3055] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:05.452692 13877 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.478778 13879 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.479516  9450 raft_consensus.cc:1240] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:05.479952  9445 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:05.482513 13955 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.478750 13947 raft_consensus.cc:740] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:05.485355 13879 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:05.488292  9490 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.487728  9418 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.491679  9372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:05.491911  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:05.496095  9418 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:05.497442 13403 raft_consensus.cc:2749] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:05.499145  9418 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.499573  9490 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.500638  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.497457 13897 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:05.500900  9490 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.508795 13897 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:05.484503 13947 consensus_queue.cc:260] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.513996 13897 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:05.501875 13957 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:05.498087 13963 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:05.501869 13939 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:05.517390  9490 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.519544  9490 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.506067 13952 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:05.501938 13923 consensus_queue.cc:1059] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:04:05.522104 13923 raft_consensus.cc:3055] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:05.522464 13923 raft_consensus.cc:740] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:05.523316 13923 consensus_queue.cc:260] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.505928 13949 consensus_queue.cc:1059] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:04:05.505584 13403 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:05.527613  9490 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.501678 13870 consensus_queue.cc:1059] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:04:05.512933 13688 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:05.490694 13810 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.533833 13688 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:05.532325 13904 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:05.535815  9445 raft_consensus.cc:1240] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:05.536391  9450 raft_consensus.cc:1240] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:05.536507 13810 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:05.533663 13947 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:05.531997 13870 raft_consensus.cc:3055] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:05.538117 13870 raft_consensus.cc:740] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:05.538414 13948 consensus_queue.cc:1059] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:05.539000 13870 consensus_queue.cc:260] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.539532 13948 consensus_queue.cc:1059] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:05.540366 13870 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:05.540696 13906 raft_consensus.cc:3055] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:05.541097 13906 raft_consensus.cc:740] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:05.520980 13952 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:05.542122 13906 consensus_queue.cc:260] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.542482 13952 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:05.543387 13906 raft_consensus.cc:3060] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:05.541179 13918 raft_consensus.cc:3055] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:05.529639 13619 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:05.526046 13915 raft_consensus.cc:3055] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:05.529839 13923 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:05.545508 13918 raft_consensus.cc:740] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:05.551112 13918 consensus_queue.cc:260] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.545684 13915 raft_consensus.cc:740] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:05.553784 13915 consensus_queue.cc:260] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.555047 13915 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:05.555471 13939 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:05.555306 13878 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:05.559478  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.533048  9490 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.562963  9272 catalog_manager.cc:5697] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 7 to 11, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 11 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.567673  9272 catalog_manager.cc:5697] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 10 to 12, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 12 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.570164 13918 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:05.570690  9272 catalog_manager.cc:5697] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 13 to 16, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 16 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:05.545344 13955 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:05.577489  9272 catalog_manager.cc:5697] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.579190 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:60188 (request call id 16) took 1585 ms. Trace:
I20260709 13:04:05.580163  9272 catalog_manager.cc:5697] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 9 to 13, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 13 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:05.581532  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 48649.7us
I20260709 13:04:05.582505  9490 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:05.582803  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 82248.5us
I20260709 13:04:05.583570  9418 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.583572  9490 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.585052  9418 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.585243  9490 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.590330  9375 raft_consensus.cc:1240] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:05.591485  9418 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.592456  9372 raft_consensus.cc:606] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.593945  9490 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.596527  9418 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.599762  9490 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.597961  9272 catalog_manager.cc:5697] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 13 to 15, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 15 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.586148 13619 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:05.584615 13955 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:05.601560  9490 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.601612  9418 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.600567 13688 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:05.601904 13922 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:05.589735 13939 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:05.604823  9275 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43252 (request call id 170) took 16635 ms (client timeout 15000 ms). Trace:
I20260709 13:04:05.592547 13810 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:04:05.621670  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.589426 13904 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:05.622927  9418 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:04:05.625581  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.623370  9490 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.627229  9272 catalog_manager.cc:5697] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 12 to 13, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 13 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:05.626554 13619 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:05.629343 13879 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:05.604480 13884 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:05.630107 13619 consensus_queue.cc:1059] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:05.630988 13884 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:05.631386 13619 consensus_queue.cc:1243] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:04:05.631625 13884 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:05.602231 13957 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:05.632704 13957 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:05.633492 13957 raft_consensus.cc:3055] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:05.633973 13957 raft_consensus.cc:740] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:05.635106 13957 consensus_queue.cc:260] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:05.621999  9275 rpcz_store.cc:269] 0709 13:03:48.965832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.965968 (+   136us) service_pool.cc:224] Handling call
0709 13:04:05.600943 (+16634975us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:04.266597 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:04.267415 (+   818us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:04.267478 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:04:04.267507 (+    29us) tablet.cc:662] Decoding operations
0709 13:04:04.309540 (+ 42033us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:04.321466 (+ 11926us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:04.323000 (+  1534us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:04:04.404679 (+ 81679us) tablet.cc:701] Row locks acquired
0709 13:04:04.404759 (+    80us) write_op.cc:260] PREPARE: finished
0709 13:04:04.404961 (+   202us) write_op.cc:270] Start()
0709 13:04:04.405148 (+   187us) write_op.cc:276] Timestamp: P: 1783602244404894 usec, L: 0
0709 13:04:04.405191 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:04:04.406176 (+   985us) log.cc:844] Serialized 4323 byte log entry
0709 13:04:05.018186 (+612010us) op_driver.cc:464] REPLICATION: finished
0709 13:04:05.215659 (+197473us) write_op.cc:301] APPLY: starting
0709 13:04:05.215776 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:05.223607 (+  7831us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:05.223736 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:05.228663 (+  4927us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:05.229131 (+   468us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 13:04:05.229256 (+   125us) write_op.cc:312] APPLY: finished
0709 13:04:05.229650 (+   394us) log.cc:844] Serialized 83 byte log entry
0709 13:04:05.229850 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:05.229983 (+   133us) write_op.cc:454] Released schema lock
0709 13:04:05.230055 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:05.230480 (+   425us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:05.230507 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":193992,"apply.run_cpu_time_us":4464,"apply.run_wall_time_us":14837,"num_ops":11,"prepare.queue_time_us":289551,"prepare.run_cpu_time_us":36822,"prepare.run_wall_time_us":411692,"raft.queue_time_us":149573,"raft.run_cpu_time_us":19495,"raft.run_wall_time_us":153657,"replication_time_us":598851,"thread_start_us":554100,"threads_started":4,"wal-append.queue_time_us":286857}]]}
I20260709 13:04:05.636324 13941 consensus_queue.cc:1059] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:04:05.604984 13897 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.637521 13941 raft_consensus.cc:3055] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:05.637964 13941 raft_consensus.cc:740] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:05.639003 13941 consensus_queue.cc:260] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.591958 13403 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:04:05.660705 13879 raft_consensus.cc:697] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:05.618319 13688 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:05.579780 13864 rpcz_store.cc:276] 0709 13:04:03.993621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.065755 (+ 72134us) service_pool.cc:224] Handling call
0709 13:04:04.305549 (+239794us) log.cc:844] Serialized 485 byte log entry
0709 13:04:05.579050 (+1273501us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3208,"raft.queue_time_us":3177,"raft.run_cpu_time_us":2194,"raft.run_wall_time_us":55208,"spinlock_wait_cycles":194816,"thread_start_us":181817,"threads_started":1,"wal-append.queue_time_us":187307}
I20260709 13:04:05.676384  9418 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.683033  9272 catalog_manager.cc:5697] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:05.621680 13955 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:05.696318 13403 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:05.639092 13897 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:05.700073  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 76813.5us
I20260709 13:04:05.699921  9418 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.703402  9490 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.704784  9490 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.624691 13963 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:05.704668  9418 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:05.706338  9490 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.684029 13941 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:05.692564 13688 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:05.709259 13939 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:05.717943  9372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:05.713828 13897 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:05.719273  9418 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:05.714447 13966 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:05.718667  9372 raft_consensus.cc:606] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
W20260709 13:04:05.722785  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 98550.6us
I20260709 13:04:05.715629  9490 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.730307  9387 tablet_copy_source_session.cc:215] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:05.708472  9272 catalog_manager.cc:5697] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 11 to 14, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 14 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
W20260709 13:04:05.732085  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:05.732776  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:05.733232  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.650328 13964 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:05.737186  9343 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.700129 13955 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:05.695957 13877 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:05.714903 13952 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:05.740562  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.707296 13810 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:05.735976  9450 raft_consensus.cc:1240] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:05.707010 13904 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:05.721760 13403 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:05.661852 13922 consensus_queue.cc:1059] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:04:05.746403 13403 raft_consensus.cc:697] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:05.746115  9272 catalog_manager.cc:5697] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 12 to 13, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 13 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.744324  9343 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.759140  9450 raft_consensus.cc:1240] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:05.761955  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:05.736462 13619 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:05.767678  9272 catalog_manager.cc:5697] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 6 to 13. New cstate: current_term: 13 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
W20260709 13:04:05.775238  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 54631.8us
I20260709 13:04:05.754976 13918 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:05.761039 13957 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:05.778502 13403 consensus_queue.cc:237] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:05.779570  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.779910  9272 catalog_manager.cc:5697] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:05.764655 13878 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:05.760222 13915 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:05.804340  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:05.737821 13968 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:04:05.776010 13919 consensus_queue.cc:1059] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:04:05.741788 13948 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:04:05.797384 13947 consensus_queue.cc:1059] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:04:05.753388 13884 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.813814  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:05.813522  9272 catalog_manager.cc:5697] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 11 to 13, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 13 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.814759  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:05.815519  9523 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 17.
I20260709 13:04:05.815838 13884 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:05.798581  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:05.799875  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:05.801198  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:05.802140  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:05.803416  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:05.817394  9522 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:04:05.817626  9520 raft_consensus.cc:2368] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 18. Current term is 19.
I20260709 13:04:05.746366 13879 consensus_queue.cc:237] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.818410  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:05.816737  9524 raft_consensus.cc:2393] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 13: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:05.818672  9521 raft_consensus.cc:2393] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 15: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:05.820094  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:05.795814  9450 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:05.816735  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:05.821707  9522 raft_consensus.cc:2393] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 13: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:05.824529 13947 consensus_queue.cc:1059] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:05.825692 13947 raft_consensus.cc:3055] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:05.826064 13947 raft_consensus.cc:740] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:05.826507 13906 raft_consensus.cc:3055] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:05.826970 13906 raft_consensus.cc:740] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:05.827028 13947 consensus_queue.cc:260] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.828480 13947 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:05.804378  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:05.822193  9523 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:04:05.806557  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:05.829200 13919 raft_consensus.cc:3055] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:05.829797 13919 raft_consensus.cc:740] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:05.830736 13919 consensus_queue.cc:260] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.832018 13919 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:05.811383 13958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99c4416401f2427a9f7e68b64ec6915e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.821102  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:05.834345  9520 raft_consensus.cc:2410] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:04:05.815346  9272 catalog_manager.cc:5697] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 11 to 14, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 14 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:05.817049  9518 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:04:05.828052 13906 consensus_queue.cc:260] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.805593  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:05.873502  9517 raft_consensus.cc:2393] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 14: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:05.875034  9272 catalog_manager.cc:5697] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 10 to 11, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 11 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.829237  9519 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
W20260709 13:04:05.877136  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.879987  9519 raft_consensus.cc:1240] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:05.880509  9343 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:05.881716  9519 raft_consensus.cc:1240] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:05.882488  9343 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.786420  9372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:05.883657  9372 raft_consensus.cc:606] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:05.885804 13948 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:05.886646 13948 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:05.887079 13948 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:05.887454 13948 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:05.889436  9517 raft_consensus.cc:1240] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:05.889729  9372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:05.890350  9372 raft_consensus.cc:606] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:05.890699  9372 raft_consensus.cc:614] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:05.892093  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:05.894062  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:05.895687 13906 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:05.899366  9445 raft_consensus.cc:1275] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:04:05.901540 13923 consensus_queue.cc:1048] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:05.886127  9519 raft_consensus.cc:1240] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:05.903184  9343 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:05.903940  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.905104  9343 leader_election.cc:400] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 18. Current term is 19.
I20260709 13:04:05.904913 13915 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:05.901793 13688 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.803785  9418 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.847672  9375 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:04:05.908206  9343 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.802919 13619 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:05.775745 13939 raft_consensus.cc:697] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:05.795840 13952 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:05.857867  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:05.858554  9518 raft_consensus.cc:1240] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:05.860773 13955 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.861392  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:05.865183  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:05.867266  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:05.915057  9522 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:05.867794  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:05.810293  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:05.916293  9523 raft_consensus.cc:2393] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 14: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:05.916370  9525 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
W20260709 13:04:05.908797  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 105147us
I20260709 13:04:05.909824  9343 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:05.876942  9272 catalog_manager.cc:5697] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 10 to 11, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 11 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.919536  9418 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.919809 13918 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:05.921890  9418 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:05.923472  9445 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:04:05.921401  9272 catalog_manager.cc:5697] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 11 to 14, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 14 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:05.922667 13969 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:05.920385  9343 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:05.928484  9519 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:05.929100  9521 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:05.911885 13915 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:05.931581  9518 raft_consensus.cc:1275] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:04:05.931977  9518 pending_rounds.cc:85] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 9
I20260709 13:04:05.932814 13949 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:05.936153 13810 raft_consensus.cc:3055] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:05.936669 13810 raft_consensus.cc:740] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:05.910148 13970 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:05.941438  9520 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
I20260709 13:04:05.944715  9525 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:04:05.926622 13941 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:05.927559 13918 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:05.949249 13918 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:05.949569 13918 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:05.951295 13684 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.951872 13684 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:05.932205  9518 pending_rounds.cc:107] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:04:05.953243  9518 raft_consensus.cc:2889] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:05.912225 13619 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.955191 13684 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:05.955798  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:05.956496  9443 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 11.
I20260709 13:04:05.956938 13619 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:05.956774 13939 consensus_queue.cc:237] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.958020 10025 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:05.959151 13684 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:05.959677 13684 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.960134 13684 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:05.961398 13955 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:05.937929 13915 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:05.961733 13810 consensus_queue.cc:260] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.962348 13915 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:05.963244 13810 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:05.969249  9526 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
I20260709 13:04:05.970340 13684 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:05.974529  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:05.974774  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:05.975328  9371 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 12.
I20260709 13:04:05.975358  9443 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:04:05.976435  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.976554  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:04:05.977036  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.977185  9375 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:05.982905  9443 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 13.
I20260709 13:04:05.984278  9375 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 13.
I20260709 13:04:05.984975 10025 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:05.986464 13940 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:05.987003 13940 raft_consensus.cc:697] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 13 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:04:05.988184 13915 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:05.989854 13688 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:05.990626  9272 catalog_manager.cc:5697] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 12 to 15, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 15 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:05.992398  9272 catalog_manager.cc:5697] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 10 to 13, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 13 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:05.994004  9272 catalog_manager.cc:5697] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.995031  9452 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:04:05.995536 13940 consensus_queue.cc:237] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:05.999205 13923 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:05.983492 13684 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:06.005406  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.005817 13918 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:05.995536  9272 catalog_manager.cc:5697] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 8 to 10, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 10 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
W20260709 13:04:06.012887  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 73240.4us
I20260709 13:04:06.012962  9272 catalog_manager.cc:5697] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 9 to 14, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 14 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:06.015244  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 71020.9us
I20260709 13:04:06.004475  9524 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 17.
I20260709 13:04:06.016753  9343 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:06.019183  9522 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 18.
I20260709 13:04:06.022683  9272 catalog_manager.cc:5697] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:06.027819  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.028410  9418 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:06.039862 13918 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:06.021386 13923 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:06.006807 13948 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:06.048511  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:06.055346 13948 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:06.063037  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:06.066876 13915 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:06.067480  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:06.068809  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:06.069104  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:04:06.070382  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.070732 13969 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:06.072613 13403 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:06.073606  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:06.015527  9517 raft_consensus.cc:2955] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index -1 to 9, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:06.030272  9272 catalog_manager.cc:5697] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.076207  9272 catalog_manager.cc:5697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 8 to 11, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 11 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:06.087193  9490 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:06.088712  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 44765.7us
I20260709 13:04:06.094758  9490 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:06.097383 13688 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:06.097946  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:06.098582 13688 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:06.099028  9526 raft_consensus.cc:2393] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 12: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:06.100888  9490 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:06.125936  9490 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:06.128710  9490 leader_election.cc:400] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 14. Current term is 15.
I20260709 13:04:06.127549  9272 catalog_manager.cc:5697] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 14 to 17, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 17 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:06.129179  9490 leader_election.cc:403] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:04:06.130630  9490 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:06.132136 13957 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:06.136706  9490 leader_election.cc:400] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13.
I20260709 13:04:06.142220 13919 consensus_queue.cc:1059] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:06.144531  9490 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:06.145418 13957 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:06.148069  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:06.148522  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:06.149933  9490 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:06.150864 13957 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:06.152668  9490 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:06.154142 13619 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 14. Current term is 15.
I20260709 13:04:06.162035  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:06.162438  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:06.164327  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:06.134665 13923 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:06.168470  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:06.186435  9522 raft_consensus.cc:2393] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 14: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:06.187157  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:06.170811  9375 raft_consensus.cc:2468] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:04:06.174201  9370 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 17. Current term is 18. Ops: []
I20260709 13:04:06.189738  9519 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:04:06.175659  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:06.154584 13955 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:06.195824  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:06.125244 13688 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:06.196295  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:06.178269  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:06.179735  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:06.180181  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:06.167398 13957 raft_consensus.cc:2804] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:06.177148  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:06.212885  9520 raft_consensus.cc:2393] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 13: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:06.212724  9451 raft_consensus.cc:1217] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 12.8->[14.9-16.10]   Dedup: 14.9->[16.10-16.10]
I20260709 13:04:06.195240  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:06.202119  9518 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 17. Current term is 18. Ops: []
I20260709 13:04:06.213896  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:06.182847  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:06.203666  9524 raft_consensus.cc:2393] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 16: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:06.204561  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:06.222572  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:06.168258 13949 raft_consensus.cc:3055] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:06.213388  9451 raft_consensus.cc:1240] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 16. Current term is 17. Ops: [14.9-16.10]
I20260709 13:04:06.214815  9343 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:06.215212  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:06.217427  9376 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:04:06.226840  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:06.224817  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:06.228323  9377 raft_consensus.cc:2393] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 13: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:06.224114  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:06.223104  9374 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
I20260709 13:04:06.219470  9418 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:06.231122  9343 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:06.234998 13922 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:06.236380  9418 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:06.168038 13924 consensus_queue.cc:1059] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:04:06.243039  9418 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:04:06.254926  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.257263  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:06.258498  9418 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:06.210851 13957 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:06.265595  9369 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:04:06.224442 13949 raft_consensus.cc:740] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:06.214646 13923 consensus_queue.cc:1059] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:04:06.256134 13922 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:06.295897  9490 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:06.310917  9368 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:04:06.313055  9490 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:06.314280 13952 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:06.315343 13952 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:06.315507  9490 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:06.316849 13884 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:06.280936 13957 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:06.298817 13949 consensus_queue.cc:260] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:06.271276 13982 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:06.300101 13923 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:06.301590  9447 raft_consensus.cc:1240] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 16. Current term is 17. Ops: []
W20260709 13:04:06.305568  9323 auto_rebalancer.cc:629] Failed to schedule move for tablet b77c45e065544a6cb4ff451f91a27cd1: Illegal state: Replica d62c9d5a052b42ce8675f8438f846526 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:06.292028 13864 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:06.297513 13963 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:04:06.280500 13971 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:06.256584 13939 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:06.338133 13968 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:06.337693 13982 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:06.375469 13968 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:06.376207 13982 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:06.347107 13925 raft_consensus.cc:993] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:06.377352 13925 raft_consensus.cc:1081] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:06.365458 13964 consensus_queue.cc:1059] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:06.376356 13915 raft_consensus.cc:993] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:06.294705 13919 consensus_queue.cc:1059] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
W20260709 13:04:06.353710 13978 log.cc:927] Time spent T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:04:06.339056 13924 raft_consensus.cc:3055] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:04:06.384102  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 150020us
I20260709 13:04:06.398686 13925 raft_consensus.cc:1081] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:06.420986  9343 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:06.427772 13986 consensus_queue.cc:1048] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:06.429823 13986 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:06.430310 13986 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:06.430776 13986 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:06.436404  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 121011us
I20260709 13:04:06.436993  9343 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:06.443586  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:06.444223  9368 raft_consensus.cc:1240] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:06.440896  9492 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:06.449662  9369 raft_consensus.cc:1240] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:06.448575  9418 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:04:06.401185 13924 raft_consensus.cc:740] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:06.453172  9370 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:04:06.454145  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:06.462343  9492 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:06.447360 13884 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.476061  9376 raft_consensus.cc:1240] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:06.479266  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:06.482664 13984 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.483233 13984 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:06.484458  9372 raft_consensus.cc:2468] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:04:06.485591 13984 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:04:06.486948 13810 consensus_meta.cc:287] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.523s	user 0.015s	sys 0.006s
I20260709 13:04:06.489313  9377 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:06.491746 13915 raft_consensus.cc:3055] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:06.492228 13915 raft_consensus.cc:740] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:06.450012 13985 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:06.475488  9524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46894
I20260709 13:04:06.497835  9524 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:06.498184  9524 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:06.452308 13949 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:06.497301 13985 raft_consensus.cc:697] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 18 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:06.494947 13915 consensus_queue.cc:260] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:06.513960 13983 raft_consensus.cc:3055] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:06.477464 13952 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:06.477945 13619 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:04:06.552699  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 185624us
I20260709 13:04:06.490432 13963 raft_consensus.cc:2804] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:06.515951  9524 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:06.586247  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 137762us
W20260709 13:04:06.589576 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 219433us
I20260709 13:04:06.494138 13884 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:06.533056 13983 raft_consensus.cc:740] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:06.600194  9443 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51012
I20260709 13:04:06.600768  9443 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:06.601177  9443 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:06.598037  9524 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:06.605973  9418 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:04:06.579864 13952 raft_consensus.cc:697] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:06.613605  9418 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:06.579064 13958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44540 (request call id 414) took 1560 ms. Trace:
I20260709 13:04:06.593312 13915 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:06.586790 13963 raft_consensus.cc:697] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:06.624002 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:06.604851 13968 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:06.643349 10067 raft_consensus.cc:2468] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:04:06.553900 13924 consensus_queue.cc:260] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:06.626022 13922 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:06.651674  9418 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
W20260709 13:04:06.701038  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 49426.3us
I20260709 13:04:06.632633  9443 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:06.663782  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.701800  9418 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:04:06.617928 13941 consensus_queue.cc:1059] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
W20260709 13:04:06.710789  9371 consensus_meta.cc:287] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.548s	user 0.017s	sys 0.007s
I20260709 13:04:06.713251  9371 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:04:06.716447 13403 consensus_queue.cc:1059] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:06.721695  9443 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 18 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:06.651441 13998 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:06.701757 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:06.701462 13955 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.712065 13969 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:06.714432 13997 raft_consensus.cc:2804] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:06.703478 13968 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:04:06.635653 13985 consensus_queue.cc:237] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:06.765826  9417 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:06.729660 13941 raft_consensus.cc:3055] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:04:06.787410  9373 consensus_meta.cc:287] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.555s	user 0.005s	sys 0.007s
I20260709 13:04:06.792485  9373 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:04:06.766896 10068 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:04:06.795198  9342 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
W20260709 13:04:06.805027  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 99254us
I20260709 13:04:06.799034  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:06.809195  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:06.810328  9377 raft_consensus.cc:2393] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 16: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:06.814711  9343 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:06.800477  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:06.817050  9492 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:06.819123  9522 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:06.774423 13969 raft_consensus.cc:697] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:06.820269  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:06.816164  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:06.700162 13983 consensus_queue.cc:260] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:06.823644  9517 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:04:06.823844  9377 raft_consensus.cc:3055] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:06.737119 13957 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:06.825693  9377 raft_consensus.cc:740] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:06.826341  9521 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:04:06.796581 13810 raft_consensus.cc:2804] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:06.757454 13955 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:06.827817  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:06.790741 13997 raft_consensus.cc:697] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:06.624186 13958 rpcz_store.cc:276] 0709 13:04:04.995239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:05.009338 (+ 14099us) service_pool.cc:224] Handling call
0709 13:04:05.239377 (+230039us) ts_tablet_manager.cc:934] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
0709 13:04:05.806675 (+567298us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:04:05.966632 (+159957us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:06.012588 (+ 45956us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:04:06.496474 (+483886us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:04:06.496835 (+   361us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:06.531326 (+ 34491us) ts_tablet_manager.cc:989] Replica registered.
0709 13:04:06.555069 (+ 23743us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":43832,"tablet-copy.queue_time_us":185982,"thread_start_us":160290,"threads_started":2}
I20260709 13:04:06.819186 13925 raft_consensus.cc:2804] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:06.732508 13952 consensus_queue.cc:237] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:06.839087  9376 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:04:06.790073 13941 raft_consensus.cc:740] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:06.820453 13688 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:04:06.858377  9443 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:06.777227 13963 consensus_queue.cc:237] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:06.850634  9418 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:04:06.835912 13810 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:06.824148 13947 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:06.830456  9377 consensus_queue.cc:260] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:06.872074  9377 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:06.851523 13988 log.cc:927] Time spent T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
W20260709 13:04:06.859293  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.824676 13970 consensus_queue.cc:1059] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:04:06.847517 13922 raft_consensus.cc:697] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:06.852309 13925 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.876565 13925 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:06.876848 13922 consensus_queue.cc:237] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:06.880162  9452 raft_consensus.cc:1217] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 10.8->[11.9-13.10]   Dedup: 13.10->[]
I20260709 13:04:06.880796  9452 raft_consensus.cc:1240] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 13. Current term is 14. Ops: [11.9-13.10]
I20260709 13:04:06.852455 13884 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:06.865612 13941 consensus_queue.cc:260] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:06.869449 14012 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:04:06.859967 14001 log.cc:927] Time spent T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.088s	user 0.003s	sys 0.000s
I20260709 13:04:06.872480 13810 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:06.890631  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.883261 14008 consensus_queue.cc:1059] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:04:06.886122 13970 raft_consensus.cc:2804] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:06.886354 13939 raft_consensus.cc:3055] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:06.886837  9418 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:04:06.886155 14009 raft_consensus.cc:3055] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:06.888317 13983 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:06.897370  9443 raft_consensus.cc:1240] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 17. Current term is 18. Ops: []
I20260709 13:04:06.857311 13968 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 13:04:06.904376 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 297116us
I20260709 13:04:06.881690 13958 tablet_copy_client.cc:806] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:06.916688  9517 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:06.921314  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:06.922351  9369 raft_consensus.cc:2393] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 5: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:06.923987  9526 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:04:06.926565  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:06.927201  9375 raft_consensus.cc:3055] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:06.927512  9375 raft_consensus.cc:740] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:06.928223  9375 consensus_queue.cc:260] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:06.929315  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:06.900333 13947 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.930094  9375 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:06.931069  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:06.934598  9443 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:04:06.930198  9526 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:06.902272 13939 raft_consensus.cc:740] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:06.937803  9375 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 18.
I20260709 13:04:06.904403 14009 raft_consensus.cc:740] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:06.907528 13941 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:06.919720 13982 consensus_meta.cc:287] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.543s	user 0.012s	sys 0.004s
I20260709 13:04:06.950959 13982 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:06.953223  9374 raft_consensus.cc:1240] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14. Ops: []
W20260709 13:04:06.954264 13971 consensus_meta.cc:287] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.577s	user 0.005s	sys 0.008s
I20260709 13:04:06.954823 13971 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:06.938427  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 111744us
I20260709 13:04:06.944458  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:06.958554  9444 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:06.960718  9372 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:04:06.962598  9526 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 18.
I20260709 13:04:06.933302 13970 raft_consensus.cc:697] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:06.974313 13982 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:06.979974 13810 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:06.982544 13925 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:06.989872  9444 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:04:06.956975 14008 raft_consensus.cc:2804] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:06.873406 13969 consensus_queue.cc:237] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:06.993311 13925 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:06.942546 13997 consensus_queue.cc:237] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:06.968320 13958 tablet_copy_client.cc:670] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
W20260709 13:04:07.010952 14005 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 13:04:07.011260 13975 log.cc:927] Time spent T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.575s	user 0.000s	sys 0.005s
I20260709 13:04:06.941954 13947 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:07.039377  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 102755us
W20260709 13:04:07.042591  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 135101us
W20260709 13:04:07.048429  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 53784us
I20260709 13:04:07.051910  9343 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:07.028967 13957 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:07.034529 13906 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.059595  9444 raft_consensus.cc:1240] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:07.035686 14008 raft_consensus.cc:697] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:07.066064  9343 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:07.078567  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:07.053583 13955 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:07.091195 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 234976us
I20260709 13:04:07.072912 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:07.094602  9492 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:07.075840 13983 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:07.050603 13922 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:04:07.030993 13939 consensus_queue.cc:260] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:07.100456  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 59081.5us
I20260709 13:04:07.098003 13955 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:07.107049 13955 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.107489 13955 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:07.094606 10068 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:07.090958 13982 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:07.081310 13906 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.114460 13810 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:07.117254 14008 consensus_queue.cc:237] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.121495 13403 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:07.132994 13996 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.133670 13996 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.134090 13906 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:07.134568  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:07.107734 13947 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:07.127452  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:07.140754  9377 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:04:07.053092 14009 consensus_queue.cc:260] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.142588  9368 raft_consensus.cc:2393] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 9: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:07.135254  9370 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:04:07.151266 14022 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:07.151948 14022 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.156018  9492 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:07.157368  9492 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:07.129196 13939 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:07.168311 13884 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:07.169530 14011 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
W20260709 13:04:07.252151  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.254391 13996 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:07.171253 13957 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:04:07.255415 13986 consensus_meta.cc:287] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.824s	user 0.009s	sys 0.006s
I20260709 13:04:07.257032 13884 raft_consensus.cc:697] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 9 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:07.257375 14022 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:07.296033 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 262659us
I20260709 13:04:07.095314 13970 consensus_queue.cc:237] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:07.304302  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 200324us
I20260709 13:04:07.314747 13922 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.315794 13922 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.318923 13922 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:07.320501 13968 raft_consensus.cc:3055] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:07.320904  9418 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:04:07.324762  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.326601  9377 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 18 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:04:07.331274  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:07.332459  9377 raft_consensus.cc:2393] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 5: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:07.336848  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:07.338052  9524 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:04:07.340708  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:07.341241 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:07.344178  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:07.341918  9377 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:04:07.345784  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:07.346484  9446 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
I20260709 13:04:07.322852 14015 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:07.349409  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:07.300621 13957 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.304973 14009 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:07.320968 13968 raft_consensus.cc:740] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:07.355541  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:07.362532  9444 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:04:07.350893 13922 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:07.366437 14028 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.366359 13922 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.366621 13968 consensus_queue.cc:260] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.367079 14028 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.302562 13986 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.357192 13688 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.359091 13957 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:07.361660 14015 raft_consensus.cc:697] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 18 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:04:07.381884 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 282850us
I20260709 13:04:07.376144  9341 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:07.400424 13996 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:07.400988 13996 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.401470 13996 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:07.409336  9371 raft_consensus.cc:2393] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 16: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:07.411146  9341 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:04:07.421049  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.398207 13688 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.416443 13948 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:07.376994 13884 consensus_queue.cc:237] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.441176 13906 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:07.443583 14033 log.cc:927] Time spent T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 13:04:07.456789  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 47446.3us
W20260709 13:04:07.462041 14027 log.cc:927] Time spent T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:04:07.439476 13948 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.478891  9418 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:07.479843 13870 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:07.480397 13870 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.480751 13870 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:07.482234 14024 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:07.378363 14014 consensus_queue.cc:1059] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:04:07.487538  9377 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:04:07.464684 14030 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:04:07.492270  9517 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:04:07.492491  9521 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:07.482969 14024 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.484714 13948 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:07.486276 14035 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.510691  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:07.454622 13906 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.497128 14041 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:07.543308 13947 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.514294 13969 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:04:07.543967 13906 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:07.546778 14016 log.cc:927] Time spent T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.579s	user 0.002s	sys 0.000s
I20260709 13:04:07.547156 13688 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:07.548606 13986 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:07.527096 14035 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:07.466387 14015 consensus_queue.cc:237] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.535643 14046 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:07.573954 14046 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.576308 14024 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:07.576556 14046 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:07.577373 14039 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:07.585575 10067 raft_consensus.cc:2468] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:04:07.577993 14039 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.590116 10068 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:04:07.592226  9342 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:07.572134 13688 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:07.593443 13986 raft_consensus.cc:2804] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:07.593526 13688 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.594501 13986 raft_consensus.cc:697] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:04:07.595497  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 82107us
I20260709 13:04:07.597502  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:07.598153  9448 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:04:07.610066  9341 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:07.563524 14041 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.614590  9452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 1786) took 1422 ms. Trace:
I20260709 13:04:07.615520 14041 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:07.595739 13986 consensus_queue.cc:237] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:07.615093  9452 rpcz_store.cc:276] 0709 13:04:06.189075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.189558 (+   483us) service_pool.cc:224] Handling call
0709 13:04:06.880040 (+690482us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:06.883041 (+  3001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:07.611203 (+728162us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b54001f9fd0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865698ad 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:04:07.611404 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1534832768}
I20260709 13:04:07.596133 13688 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:07.657222  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:07.653112  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:07.667987  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:07.671432  9525 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:07.671900  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:07.672539 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:07.673193 10068 raft_consensus.cc:2468] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:04:07.674685  9524 raft_consensus.cc:1240] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:07.565594 13947 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.675555  9523 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:04:07.672574  9448 raft_consensus.cc:2468] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 5.
I20260709 13:04:07.645501  9452 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:04:07.682787  9452 pending_rounds.cc:85] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 10
I20260709 13:04:07.683142  9452 pending_rounds.cc:107] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:04:07.683467  9452 raft_consensus.cc:2889] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:07.683214  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:07.684924  9517 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
I20260709 13:04:07.688832  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:07.697548  9519 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:04:07.704248  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:07.676425  9342 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:07.653712  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:07.729357  9521 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:07.700567  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:07.730684  9519 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:04:07.636197 14046 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.746935  9343 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:07.677187 13955 consensus_meta.cc:287] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.557s	user 0.010s	sys 0.002s
I20260709 13:04:07.639521 14022 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:07.640443 14041 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:07.644883 14031 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:07.648447 14035 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:07.816529  9525 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
W20260709 13:04:07.890291  9373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52548 (request call id 1976) took 1610 ms (client timeout 2116 ms). Trace:
I20260709 13:04:07.770071 13918 raft_consensus.cc:2804] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:04:07.890856  9373 rpcz_store.cc:269] 0709 13:04:06.179714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.179940 (+   226us) service_pool.cc:224] Handling call
0709 13:04:07.789714 (+1609774us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b54000609d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:04:07.789834 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74068736}
W20260709 13:04:07.904577  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.786962 13915 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:07.923133  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 165313us
W20260709 13:04:07.924901  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 248536us
I20260709 13:04:07.756413 13996 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.776623 14046 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.899674 13918 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.779096 13955 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.938941  9343 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:07.940662 14048 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:07.941440 14048 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.941649 13870 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.944058 13870 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:07.944404 14050 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:07.945122 14050 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:07.948182 14053 log.cc:927] Time spent T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 13:04:07.902667 13884 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:07.949676 13884 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:07.793870 14041 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:07.951900 13884 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:07.912299 13984 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.912627 14039 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:07.926155 14005 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 13:04:07.955652  9416 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.8.4.126:34725, user_credentials={real_user=slave}} blocked reactor thread for 98948.2us
I20260709 13:04:07.958384 13998 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:07.958994 13998 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:07.959730 13957 consensus_meta.cc:287] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.562s	user 0.006s	sys 0.004s
I20260709 13:04:07.794520 14031 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:07.937673 13918 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:07.971146 13948 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.972910 13947 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:07.783095 14022 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.960307 13957 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.991909  9374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1983) took 1537 ms. Trace:
I20260709 13:04:07.953604 13984 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:07.993840  9374 rpcz_store.cc:276] 0709 13:04:06.451375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.451496 (+   121us) service_pool.cc:224] Handling call
0709 13:04:06.451760 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.953664 (+501904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:07.988822 (+1035158us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b5400384d54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:04:07.989003 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1152779008}
I20260709 13:04:07.988933 14022 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:07.967746 14063 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:08.029214  9521 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:04:08.039413  9372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52562 (request call id 1846) took 1239 ms. Trace:
I20260709 13:04:08.039952  9372 rpcz_store.cc:276] 0709 13:04:06.799563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.800115 (+   552us) service_pool.cc:224] Handling call
0709 13:04:08.039196 (+1239081us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5400060ed4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:04:08.039338 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294272256}
I20260709 13:04:08.042620 14031 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:08.033665 13948 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:08.054117 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:08.057410 14066 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:04:08.066696  9376 raft_consensus.cc:1240] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:08.066591  9371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52562 (request call id 1845) took 1268 ms. Trace:
I20260709 13:04:08.067706  9371 rpcz_store.cc:276] 0709 13:04:06.798493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.798684 (+   191us) service_pool.cc:224] Handling call
0709 13:04:08.066353 (+1267669us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b5400045bd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:04:08.066525 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1386712448}
W20260709 13:04:08.070276  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 79380.7us
I20260709 13:04:08.051060 13998 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:08.071213  9343 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:08.077559  9417 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:08.079203  9343 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:08.081866 14051 log.cc:927] Time spent T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:04:08.084013 13968 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:08.086004 14039 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.086673 14039 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.089226 13870 raft_consensus.cc:2804] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:08.089838 13870 raft_consensus.cc:697] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:08.090929 13870 consensus_queue.cc:237] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:04:08.091687 14060 log.cc:927] Time spent T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:04:08.093204 13955 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:08.080792 13996 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:08.103056  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:08.103754  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:08.103747  9521 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:04:08.104439  9525 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:08.108050  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:08.108683  9524 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:04:08.110591  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:08.111228  9524 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:08.111253  9521 raft_consensus.cc:1275] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:08.112361 14014 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:08.112633 14039 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:08.113055 14014 raft_consensus.cc:697] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:08.115226 14028 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:08.079322 13986 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:04:08.117694 13984 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:08.122035 13957 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:08.095094 13955 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:08.147056  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:08.147974  9371 raft_consensus.cc:2393] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 13: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:08.149410  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:08.153559  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:08.154378  9371 raft_consensus.cc:2393] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 5: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:08.156816  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:08.157114 10068 raft_consensus.cc:1275] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:08.151667 14054 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:08.157675  9374 raft_consensus.cc:2393] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 14: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:08.163436  9343 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:08.164762 13947 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:08.165236 13947 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.165613 13947 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:08.165675 13918 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:08.171404 14050 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:08.174477  9376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1985) took 1254 ms. Trace:
I20260709 13:04:08.174930  9376 rpcz_store.cc:276] 0709 13:04:06.920255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.921134 (+   879us) service_pool.cc:224] Handling call
0709 13:04:08.066487 (+1145353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:08.067299 (+   812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:08.174291 (+106992us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400045bd0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5865698ad 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:04:08.174421 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2633108864}
I20260709 13:04:08.175992 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:08.176626 10067 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:08.152220 13955 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:08.179116 13955 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:08.180359  9368 raft_consensus.cc:1240] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:08.181829  9343 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:04:08.174191 13947 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.184216 13947 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:08.184713 13983 raft_consensus.cc:2804] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:08.185173 13983 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:08.185591 13983 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:08.185387 13982 consensus_queue.cc:1048] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:08.189360  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:08.157737 14054 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.190104  9519 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:08.192163 14031 consensus_queue.cc:1048] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:08.199539  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:08.200515  9522 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
I20260709 13:04:08.160938 14028 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.209821 14028 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.212255 14028 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:08.218825 14014 consensus_queue.cc:237] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.226481 13984 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.227226 13984 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.239782 13984 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:08.252025 13918 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:08.257723 13955 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.258621 13955 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.267021 14022 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.279743 13968 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.308199 13957 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:08.310988 14050 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:08.425793 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:08.311702  9492 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:08.319053 13955 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:08.324427 10067 raft_consensus.cc:2468] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 6.
I20260709 13:04:08.327075  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:08.330029 13984 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:08.331610  9369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1992) took 1403 ms. Trace:
I20260709 13:04:08.332852  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:08.335141  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:08.337380  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:04:08.338865 14062 log.cc:927] Time spent T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.321s	user 0.006s	sys 0.003s
I20260709 13:04:08.339440  9372 raft_consensus.cc:1275] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:08.339344 13947 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.340435  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:08.323931 13983 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:08.341768  9525 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:04:08.343410  9524 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
I20260709 13:04:08.344908  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:08.348469  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:08.348922  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:08.348551  9343 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:08.350693  9368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 1997) took 1007 ms. Trace:
I20260709 13:04:08.359365 14048 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:08.363368 14041 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:08.363911  9519 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
I20260709 13:04:08.364446 14028 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:08.364928 13969 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:08.374482 14046 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:08.377923 13970 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:08.379901 13922 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:08.340890  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:08.389242 13958 tablet_copy_client.cc:538] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:08.399513 13999 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.407913 13924 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:08.408633 13403 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:08.545433 13403 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.411405 13688 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.411741 14065 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.412849 14056 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.525573 13955 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:08.470469  9342 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
W20260709 13:04:08.512836 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 83313us
I20260709 13:04:08.514076  9377 raft_consensus.cc:2393] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 14: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
W20260709 13:04:08.514555  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 166421us
I20260709 13:04:08.516227  9373 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:08.515347  9369 rpcz_store.cc:276] 0709 13:04:06.927721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.927824 (+   103us) service_pool.cc:224] Handling call
0709 13:04:06.928106 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:07.057041 (+128935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:07.057078 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:07.074996 (+ 17918us) log.cc:844] Serialized 26 byte log entry
0709 13:04:07.426327 (+351331us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:07.426374 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:08.330673 (+904299us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54003796d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:04:08.331147 (+   474us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:08.331225 (+    78us) raft_consensus.cc:1685] finished
0709 13:04:08.331242 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:08.331539 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":537,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":14985,"spinlock_wait_cycles":295456128,"thread_start_us":329987,"threads_started":1,"wal-append.queue_time_us":355381}
I20260709 13:04:08.517763  9371 raft_consensus.cc:2393] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 13: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:08.517995  9375 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
W20260709 13:04:08.564185  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 93799.8us
I20260709 13:04:08.517763  9368 rpcz_store.cc:276] 0709 13:04:07.342991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:07.343435 (+   444us) service_pool.cc:224] Handling call
0709 13:04:07.356783 (+ 13348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:08.180939 (+824156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:08.350439 (+169500us) spinlock_profiling.cc:243] Waited 823 ms on lock 0x7b54000465d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:04:08.350631 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1893517696}
W20260709 13:04:08.527993 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 62595.6us
W20260709 13:04:08.533969 14074 log.cc:927] Time spent T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.101s	user 0.005s	sys 0.000s
I20260709 13:04:08.430786 13968 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.544200  9374 raft_consensus.cc:1240] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:08.586377  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:08.587333  9517 raft_consensus.cc:2393] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 15: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:08.430675 13994 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:08.602037  9375 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:08.512521 13877 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.629240  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:08.479120 14014 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:08.528676 14000 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:08.525925 13947 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:08.470724  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 159138us
I20260709 13:04:08.511796 14066 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:08.521904 13984 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:08.574234  9519 raft_consensus.cc:1240] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:08.653944  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:08.654587  9519 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:04:08.655725  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:08.575242  9373 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:04:08.578325  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:08.574311  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:08.656981  9524 raft_consensus.cc:2393] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 12: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:08.657110  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:08.657869  9520 raft_consensus.cc:2393] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 12: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:08.657982  9524 raft_consensus.cc:3060] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:08.658895 14058 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:08.659638 14058 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.660384  9520 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:08.425669 13957 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:08.546522 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:04:08.613368  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.618075 14031 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.618884 14054 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:08.539706 13969 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:08.563674 14065 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.620324 13994 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.622020  9525 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:08.623767 13884 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.582156 13948 raft_consensus.cc:2804] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:08.542300 14046 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:08.464707 14050 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.555408 14048 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.634421  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:04:08.639623  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 61617.1us
I20260709 13:04:08.641880 13403 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:08.536509 14028 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:08.552167 13999 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.604224 13955 raft_consensus.cc:697] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:08.705210 13955 consensus_queue.cc:237] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.706370  9520 raft_consensus.cc:1275] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:08.707293 13994 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:08.593815  9343 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:08.661779 14066 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.709025  9370 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:08.709764 13864 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:08.710322 13864 raft_consensus.cc:697] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:04:08.707978  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 114241us
I20260709 13:04:08.711161  9343 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:08.711289 13864 consensus_queue.cc:237] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.712061  9343 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:08.688459 14031 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.713527 14046 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.715291 14065 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:08.663865 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 100320us
I20260709 13:04:08.543254 13970 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:08.631188 13922 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.673738  9524 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:04:08.674015  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.563879 13688 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.649048 14000 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.638782 13877 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:08.702857 13984 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:08.703373  9518 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 16.
I20260709 13:04:08.703830 14022 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:08.584543 14056 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.705673 14058 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:08.663568  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 972717us
I20260709 13:04:08.663077  9492 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:08.754714  9376 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:04:08.651854 14014 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:08.761382  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 49394.5us
I20260709 13:04:08.762585  9525 raft_consensus.cc:1275] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:04:08.769511 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:08.782245 13877 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:08.830350  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:08.788998  9370 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:04:08.803220  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:08.796391  9275 catalog_manager.cc:5697] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:08.832022  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:08.805909  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:04:08.789799  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 126808us
I20260709 13:04:08.834450  9443 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:08.809893  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:08.802346  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:08.792426  9526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46894 (request call id 2457) took 1141 ms. Trace:
I20260709 13:04:08.819897  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:08.820127  9369 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:04:08.820811  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:08.838191  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:08.838583  9373 raft_consensus.cc:2368] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 12. Current term is 13.
I20260709 13:04:08.838850  9446 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:04:08.759331 13948 raft_consensus.cc:697] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:08.822501  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:08.822804 14022 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.762640 14070 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:08.802897  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:08.785969 13999 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:08.855652  9443 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:04:08.828862  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:08.698985 13884 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.829617  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:08.827056  9517 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:04:08.805670  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:08.832108  9447 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:04:08.820147  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:08.846025 13994 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.769914 13915 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:08.845495  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:08.869578  9525 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:08.846246  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:08.837319  9526 rpcz_store.cc:276] 0709 13:04:07.650799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:07.651138 (+   339us) service_pool.cc:224] Handling call
0709 13:04:07.651620 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:07.732058 (+ 80438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:07.732103 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:07.751339 (+ 19236us) log.cc:844] Serialized 26 byte log entry
0709 13:04:08.386195 (+634856us) spinlock_profiling.cc:243] Waited 902 us on lock 0x7b1800048e80. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58345fe07 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b 00007fb586109d23 00007fb58610a0d1 00007fb586525a0f
0709 13:04:08.535094 (+148899us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:08.535159 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:08.535232 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:08.792061 (+256829us) raft_consensus.cc:1685] finished
0709 13:04:08.792084 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:08.792336 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79913,"raft.queue_time_us":95541,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":25433,"spinlock_wait_cycles":2075008,"thread_start_us":148366,"threads_started":1,"wal-append.queue_time_us":1038455}
I20260709 13:04:08.839651  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:08.848289  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:08.848719  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:08.779052 14000 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:08.851261  9445 raft_consensus.cc:2393] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 15: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
W20260709 13:04:08.852119 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 283841us
I20260709 13:04:08.828049 13403 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:08.829433 14014 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:08.878068  9520 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:04:08.784996 14056 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:08.878104  9522 raft_consensus.cc:2393] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 13: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:08.878683 14056 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:08.879235 14056 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.851205  9342 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:08.826840 14058 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:08.757704 14048 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.890811 14048 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:08.894248 14078 log.cc:927] Time spent T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.372s	user 0.006s	sys 0.000s
I20260709 13:04:08.895364 13877 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.895957 13877 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.895236  9263 maintenance_manager.cc:643] P f3fb61137daa445d9297d2162e98e24e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 6.198s	user 0.209s	sys 0.031s Metrics: {"bytes_written":29651,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":195721,"dirs.run_cpu_time_us":581,"dirs.run_wall_time_us":38139,"drs_written":1,"lbm_read_time_us":526,"lbm_reads_lt_1ms":4,"lbm_write_time_us":203886,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":8,"lbm_writes_lt_1ms":25,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":146130,"threads_started":1,"update_count":20}
I20260709 13:04:08.840906  9492 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9
W20260709 13:04:08.927600  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 86807.6us
I20260709 13:04:08.770000 13922 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.850709 14041 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:08.882797  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:08.941709  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:08.897231 13957 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:08.842691 13870 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:04:08.897543 13948 consensus_queue.cc:237] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:08.898252 13877 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:08.898793 13884 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:08.899241 14031 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:08.900457 13970 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:08.901758 14046 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:08.902359 13986 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:08.902522 13688 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:08.858469 14070 raft_consensus.cc:697] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:08.857659 14022 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.903517 14050 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:08.884368 13915 raft_consensus.cc:697] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:08.864547 13983 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:08.885838 13968 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:08.905326 13969 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:08.876168 13994 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:08.852340 14065 consensus_queue.cc:1048] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:04:08.876468 14028 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:08.882544 14066 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:08.906792 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:08.907310 14056 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:08.904444 14075 log.cc:927] Time spent T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:04:08.913332 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:08.863088  9375 raft_consensus.cc:1275] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:04:08.914543  9524 raft_consensus.cc:1275] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:08.924525 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:08.886572 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:08.943871  9492 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:08.945080  9525 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:04:08.945290  9369 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:04:08.960443  9377 raft_consensus.cc:1275] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:08.964260  9264 maintenance_manager.cc:419] P f3fb61137daa445d9297d2162e98e24e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9424 bytes on disk
I20260709 13:04:08.966245  9446 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
W20260709 13:04:09.020222  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 193543us
I20260709 13:04:08.965111  9452 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:04:08.947758 14048 raft_consensus.cc:2804] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:04:08.971736 13952 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.985s	user 0.033s	sys 0.037s
I20260709 13:04:09.001714  9371 raft_consensus.cc:2393] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 14: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:08.973649 13970 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.957963 14041 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:09.016355  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 72555.9us
I20260709 13:04:09.035761  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:04:09.091454  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 52576.3us
I20260709 13:04:09.022188  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:09.014470 14028 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.026769  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:09.026161  9342 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:09.004127 14050 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:09.101348  9369 raft_consensus.cc:2393] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 12: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
W20260709 13:04:09.027910 13952 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.041s	user 0.034s	sys 0.038s
I20260709 13:04:09.102161  9263 maintenance_manager.cc:643] P f3fb61137daa445d9297d2162e98e24e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.081s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":478,"lbm_reads_lt_1ms":4}
I20260709 13:04:09.016860 13969 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:04:09.108419  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 82350.6us
W20260709 13:04:09.108502  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 80563.3us
I20260709 13:04:09.020278 14056 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:09.023708 14048 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:09.002374 13942 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 13:04:09.113143  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:09.120889  9369 raft_consensus.cc:2393] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 11: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:09.028820  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:09.122097  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:09.123632  9369 raft_consensus.cc:2410] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 13:04:09.114029 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 128326us
I20260709 13:04:08.999819 13915 consensus_queue.cc:237] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.102586 13955 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:09.121086  9343 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:09.129562  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:09.130227  9369 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:04:09.112852 13983 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:09.098690 13970 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.143091  9492 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:09.119855 14048 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:09.114502 14056 raft_consensus.cc:697] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:09.108772 14028 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.109990 14050 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.115180 13969 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:09.141104 13984 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:09.152395 13952 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:09.110194 14070 consensus_queue.cc:237] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.171991 14087 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:09.134693 13955 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:09.180491  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 70331.7us
I20260709 13:04:09.149078 13968 consensus_queue.cc:1059] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:04:09.181840  9418 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:09.191051 14028 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:09.193791 14056 consensus_queue.cc:237] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.192512 14087 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.206028 13955 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:09.206100 14087 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:09.174808 13952 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:09.176648 13984 raft_consensus.cc:697] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:09.210323  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:04:09.216323  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.216724  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:09.217644  9369 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:04:09.206175  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:09.218830  9371 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:04:09.214053  9372 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:04:09.220690  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:09.221431  9375 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:04:09.181756 13922 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:09.228209  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:09.229274  9375 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:04:09.231434 14086 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:09.231957 14086 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.232333 14086 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:09.232659  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:09.233474  9376 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
W20260709 13:04:09.234055 14090 log.cc:927] Time spent T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:04:09.234881  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:09.237461  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:09.238396  9375 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 19.
I20260709 13:04:09.243541  9376 raft_consensus.cc:2393] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 11: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:09.246412  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:09.248559  9376 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
W20260709 13:04:09.231982 14082 log.cc:927] Time spent T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:04:09.249760  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:09.212669 13952 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:09.250661 14041 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:09.248494  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:09.228161 13983 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:09.257496  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.250226 13958 tablet_bootstrap.cc:492] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
W20260709 13:04:09.255272 14084 log.cc:927] Time spent T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:04:09.267405  9375 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:04:09.269985  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 88230.7us
I20260709 13:04:09.273591 14050 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:09.273741 13969 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:09.261191 13983 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.287582 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:09.281248 13969 consensus_queue.cc:1048] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:04:09.284484 13968 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:04:09.296352 13983 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:09.284415 13877 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:04:09.298470 14058 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:09.258754 14000 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.304989  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:09.280580 14096 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.308982  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:09.321161  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:09.324774  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:09.325546  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:09.308344  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:09.326296  9518 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:04:09.326948  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:09.327867  9525 raft_consensus.cc:2393] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 13: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:09.328677  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:09.260808 13984 consensus_queue.cc:237] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.326774 14094 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:09.344962 13907 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.005s	sys 0.010s
I20260709 13:04:09.321857 13969 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:04:09.349797  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:09.350335 14000 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:09.351059  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:09.351799  9374 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:04:09.330442 14096 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.355844 14096 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:09.356590 14094 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.359052 14094 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:09.352711  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:09.361984  9374 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
W20260709 13:04:09.347507 13907 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.005s	sys 0.010s
I20260709 13:04:09.370064  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:09.372781  9374 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:04:09.377458 13970 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:09.374794  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:09.386132 13994 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:09.390424  9490 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.754s (SENT) [suppressed 21 similar messages]
W20260709 13:04:09.402127 13924 consensus_meta.cc:287] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.846s	user 0.013s	sys 0.000s
I20260709 13:04:09.403043  9376 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:04:09.408102  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:09.429342  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:09.430528  9374 raft_consensus.cc:2393] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 13: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:09.440513  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:09.452338  9371 raft_consensus.cc:1240] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:09.458666 14022 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:09.464643 14103 log.cc:927] Time spent T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.116s	user 0.004s	sys 0.000s
W20260709 13:04:09.480810  9418 connection.cc:256] RPC call timeout handler was delayed by -1.3325190320000502s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2116s for a response
I20260709 13:04:09.406795 14086 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.488459  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:09.489347  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.490199  9444 raft_consensus.cc:2393] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 13: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:09.490090  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.490483  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.491227  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.492134  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.469759 14002 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.497654  9368 raft_consensus.cc:1240] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:04:09.546322  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.547102  9448 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
W20260709 13:04:09.548909  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 55197.9us
I20260709 13:04:09.487030 14087 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.555176  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:09.556569  9449 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:09.493374 14094 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.496330 14070 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:09.562096 14099 log.cc:927] Time spent T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:04:09.564834  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.496304 14091 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:09.566151  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:09.577577  9448 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:09.570603  9446 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:04:09.550848 14064 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.587661  9446 raft_consensus.cc:1275] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:09.594352  9341 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:09.602267  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.601171 13924 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:09.610512  9452 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:04:09.558715 14002 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.551003 14022 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:04:09.616123  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.616408  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.562851 14087 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.614130  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.619484  9341 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:04:09.574447 14094 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.585424 14091 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.622282 14086 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:09.622973 14107 log.cc:927] Time spent T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:04:09.626471 14048 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:09.631412 13952 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.576959 14070 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.645519  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.646997  9449 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:04:09.648103  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.648644  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.649595  9523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 2024) took 1075 ms. Trace:
I20260709 13:04:09.651858  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.658594  9447 raft_consensus.cc:3055] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:09.676168  9447 raft_consensus.cc:740] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:09.677312  9447 consensus_queue.cc:260] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.678282  9447 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:09.682513  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:09.683276  9445 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:04:09.644663 13924 raft_consensus.cc:2764] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:04:09.670167  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.662830  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.595836 14064 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:09.684902  9520 raft_consensus.cc:1240] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:09.686861  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.659484  9448 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:04:09.687692  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.694428  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.696131  9341 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:09.692083  9452 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:04:09.694084  9451 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:04:09.698843  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.700063  9451 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:04:09.700481  9447 raft_consensus.cc:1275] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:04:09.704598 13947 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:09.704962 14087 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:09.705813  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.708055  9443 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:04:09.710485 14094 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:09.712586 13952 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:09.674273  9523 rpcz_store.cc:276] 0709 13:04:08.574529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.575058 (+   529us) service_pool.cc:224] Handling call
0709 13:04:08.576338 (+  1280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:08.775641 (+199303us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:04:09.016916 (+241275us) log.cc:844] Serialized 14 byte log entry
0709 13:04:09.139514 (+122598us) log.cc:844] Serialized 14 byte log entry
0709 13:04:09.139750 (+   236us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:09.139812 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:09.139909 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:09.389574 (+249665us) spinlock_profiling.cc:243] Waited 6.32 ms on lock 0x7b18002fab80. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58347d522 00007fb58347f7c1 00007fb58347f779 00007fb58347f709 00007fb58347f6d1 00007fb58347e9cd 000000000038f354 000000000038f199 00007fb58346083a
0709 13:04:09.649326 (+259752us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b5400240754. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:04:09.649404 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:09.649536 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10225,"prepare.queue_time_us":16031,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":17013,"spinlock_wait_cycles":488590208,"thread_start_us":346945,"threads_started":2,"wal-append.queue_time_us":141898}
I20260709 13:04:09.718830 14091 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:09.719513 14110 log.cc:927] Time spent T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.104s	user 0.000s	sys 0.004s
I20260709 13:04:09.720440 14048 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:09.725867  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.735771  9445 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
I20260709 13:04:09.737305  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.738209  9451 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:04:09.739317  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.744204  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.743698  9341 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:09.745278  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.757861  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.737558 13948 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:09.766641  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:09.759052  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.773408  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.774492  9451 raft_consensus.cc:2376] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12. Re-sending same reply.
I20260709 13:04:09.766733  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.737748 14064 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:09.771225  9341 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:09.776552 13947 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:09.784052 13947 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.784515 13947 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:09.779533  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.781672  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.783113  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.786883  9445 raft_consensus.cc:2393] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 11: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:09.788136  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.788305  9418 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:04:09.786574  9451 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:04:09.789680  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.790753  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.792378  9341 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:09.795251 13970 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:09.794238 13915 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:09.822093  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:09.823163  9525 raft_consensus.cc:1240] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:09.827613  9418 leader_election.cc:400] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 12. Current term is 13.
I20260709 13:04:09.824970  9452 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:09.827991  9418 leader_election.cc:403] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:09.832403  9448 raft_consensus.cc:2393] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 15: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:09.828250 13915 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.835062 13915 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:09.835338 14086 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:09.839546 13970 raft_consensus.cc:697] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:09.823760 14011 consensus_queue.cc:1059] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:04:09.823808 14091 consensus_queue.cc:1059] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:04:09.822988 13924 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:09.844974  9418 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:09.841382 14095 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 12. Current term is 13.
I20260709 13:04:09.883322  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:09.877499 13877 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:09.879127 13924 raft_consensus.cc:697] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:09.897538  9418 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:09.855084 14017 consensus_queue.cc:1059] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:04:09.896194 13877 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:09.906360  9418 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:09.908914  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46902 (request call id 2038) took 1282 ms. Trace:
I20260709 13:04:09.909459  9519 rpcz_store.cc:276] 0709 13:04:08.622404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.655327 (+ 32923us) service_pool.cc:224] Handling call
0709 13:04:09.904893 (+1249566us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b540028a5d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:04:09.905091 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":838183168}
I20260709 13:04:09.901484 14086 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:09.912753 13924 consensus_queue.cc:237] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.922736  9452 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:09.927999 14087 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:09.928721 14087 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:09.931245 14087 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:09.931814 14087 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:09.932178 13877 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:09.933917 13952 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:09.934587 13952 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:09.935343  9418 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:09.936404 14092 raft_consensus.cc:3055] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:09.936839 14092 raft_consensus.cc:740] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:09.898595 13970 consensus_queue.cc:237] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.939168 13877 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:09.937608 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:09.940625 13870 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:09.938256 14086 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.942727 14086 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:09.909051 13968 consensus_queue.cc:1048] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:04:09.900624 14091 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:04:09.947398 14113 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:09.948035 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:09.948058 14113 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:09.950811 14113 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:09.951639 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:09.952320 10068 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:04:09.937780 14092 consensus_queue.cc:260] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.954931 14092 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:09.956032 14086 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.936982 13952 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:09.938558  9418 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:09.968386  9491 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:09.960798  9418 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:09.981173 13403 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:09.981655 13403 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.982235 13403 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:09.932284 14087 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:09.980873  9418 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:09.989187  9418 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:09.993867  9418 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:09.983628 14091 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:09.984556 13952 raft_consensus.cc:2804] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:09.995785 14111 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:10.005772  9526 raft_consensus.cc:1275] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:04:10.009045 14112 consensus_queue.cc:1059] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:04:10.004658 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:09.995500 13968 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:09.983913 14086 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:10.001583 14094 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:10.027559  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:10.028611  9524 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
W20260709 13:04:10.018464 14028 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:04:10.035614  9490 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:10.022317 13968 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.036382 13968 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:10.038611 14113 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:10.039072 14113 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:10.039440 14113 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:10.015379 13952 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:10.040674 13952 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:10.016434 14091 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.938948 14081 raft_consensus.cc:3055] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:10.044986 13403 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:10.047256  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:10.048059  9526 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
W20260709 13:04:10.041917 13984 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.009s	sys 0.012s
I20260709 13:04:10.049054  9490 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:10.058969  9524 raft_consensus.cc:1240] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:04:10.055116  9490 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:10.046343 14091 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:10.062975  9490 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:10.060292 13403 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:10.064906  9445 raft_consensus.cc:3055] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:10.065346  9445 raft_consensus.cc:740] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:10.067246 13688 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:10.061831 14047 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.062332 14054 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:10.069514 14054 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.070448 14054 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:10.071973  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:10.072631  9518 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:04:10.047925 14081 raft_consensus.cc:740] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:04:10.081313  9518 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
W20260709 13:04:10.058156 13984 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.009s	sys 0.018s
I20260709 13:04:10.084892 14041 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:10.094534 14081 consensus_queue.cc:260] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:10.098481 14081 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:10.094794 13915 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:10.095293  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:10.044145 13947 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:10.121592 14087 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:10.101830  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:10.130612  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:10.135092  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:10.137461  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:10.138749  9523 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:10.101387  9490 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:10.102579  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:10.142805  9372 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:10.104761  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:10.108917  9517 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46902 (request call id 2034) took 1515 ms (client timeout 1928 ms). Trace:
I20260709 13:04:10.151259  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:10.152345  9375 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:04:10.152587 13907 raft_consensus.cc:3055] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:10.153340 13907 raft_consensus.cc:740] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:04:10.155025  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:04:10.145639  9517 rpcz_store.cc:269] 0709 13:04:08.594060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.634013 (+ 39953us) service_pool.cc:224] Handling call
0709 13:04:10.108645 (+1474632us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b540028a0d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:04:10.108837 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299174272}
I20260709 13:04:10.053381 14056 consensus_queue.cc:1048] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:04:10.066179  9445 consensus_queue.cc:260] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:10.166333  9445 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:10.101425  9370 raft_consensus.cc:1275] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:04:10.168329  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:10.169116  9370 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:10.068449 14047 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:04:10.157511  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:10.146750  9341 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:10.155378  9492 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:10.172868  9492 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:10.178521  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:04:10.208199  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:10.208276  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 61632.7us
W20260709 13:04:10.225718  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 124417us
I20260709 13:04:10.226445  9372 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
I20260709 13:04:10.228945  9370 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
I20260709 13:04:10.240908  9492 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:10.232178  9445 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:04:10.242782  9445 pending_rounds.cc:85] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 7
I20260709 13:04:10.243076  9445 pending_rounds.cc:107] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:04:10.243443  9445 raft_consensus.cc:2889] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:10.243152  9492 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:10.234870  9374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 1878) took 1101 ms. Trace:
I20260709 13:04:10.231127  9490 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:10.244845  9374 rpcz_store.cc:276] 0709 13:04:09.133833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.449576 (+315743us) service_pool.cc:224] Handling call
0709 13:04:09.449935 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:09.467750 (+ 17815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:09.467784 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:09.472268 (+  4484us) log.cc:844] Serialized 26 byte log entry
0709 13:04:10.093146 (+620878us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b18000eb8a0. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58345fe07 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b 00007fb586109d23 00007fb58610a0d1 00007fb586525a0f
0709 13:04:10.233366 (+140220us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:10.233431 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:10.233531 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:10.234435 (+   904us) raft_consensus.cc:1685] finished
0709 13:04:10.234462 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:10.234802 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85426,"raft.queue_time_us":19567,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":5654,"spinlock_wait_cycles":6225664,"thread_start_us":139868,"threads_started":1,"wal-append.queue_time_us":736422}
I20260709 13:04:10.248697  9343 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:10.250711 13968 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:10.236624 13947 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:10.258708  9343 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:10.260708  9517 raft_consensus.cc:1240] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:10.262377  9490 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:10.263319  9517 raft_consensus.cc:1240] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:10.219400 14087 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:10.221648 14096 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:10.264029 14112 consensus_queue.cc:1243] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:04:10.278399 14047 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:10.288404  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:10.164589 13984 consensus_queue.cc:1048] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:04:10.236404 14065 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:10.154371 13907 consensus_queue.cc:260] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:10.269421 14022 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:10.255395 14046 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:04:10.323827  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 66107.8us
W20260709 13:04:10.325793  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 67165.3us
W20260709 13:04:10.340646  9342 consensus_peers.cc:597] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:10.340533 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:10.352545  9492 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:10.235633 14041 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:10.272869 13968 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:10.271375 13955 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:10.369926  9342 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:10.370925  9343 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:10.350732 14066 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.351715 14002 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:10.349977 14087 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:10.349943 14096 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.353960 14065 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:10.366866 14046 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:04:10.404963 10026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:10.369740 14041 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:10.371255 14064 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:10.384574 14056 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:10.379406 13955 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.389262 14087 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:10.410367 13952 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:10.389325 13947 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:10.397878 14065 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:10.417392  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 65076.1us
I20260709 13:04:10.386253 13915 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:10.397852 14096 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:10.396382 14002 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:10.413398 14041 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:10.405644 14046 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:10.388654 14066 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:10.427774 14139 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:04:10.428175  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 57372.5us
I20260709 13:04:10.430922 13952 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:10.431721 14056 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:10.417434 13955 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:10.403496 14113 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:10.459576  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 73998.6us
I20260709 13:04:10.426841  9492 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:10.471459  9523 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
I20260709 13:04:10.475983  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:10.477056  9375 raft_consensus.cc:2376] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13. Re-sending same reply.
W20260709 13:04:10.481261  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 219074us
I20260709 13:04:10.463786 13906 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:10.473063 14048 raft_consensus.cc:2764] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:04:10.464069 13968 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:10.458055 14056 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:10.495968  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:10.485682  9490 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:10.460331 13947 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.437868 14002 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:10.484093  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:10.481494 14141 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:10.508846  9452 raft_consensus.cc:3055] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:10.521062  9452 raft_consensus.cc:740] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:10.522589  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:10.509429  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:10.518661  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:10.523648  9443 raft_consensus.cc:2393] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 14: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:10.523586  9372 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:04:10.524686  9375 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 6.
I20260709 13:04:10.524726  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:10.525669  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:10.525856  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:10.480515 13952 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:10.509290  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:10.526846  9447 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:10.503968 14056 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:10.529580  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:10.461115 14139 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:10.567574  9372 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:10.578409  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:10.579730  9375 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:04:10.580969  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:10.538808  9447 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
I20260709 13:04:10.528882 13952 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:10.518985 13947 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:10.522408  9452 consensus_queue.cc:260] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:10.582990  9452 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:10.572422 14140 log.cc:927] Time spent T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.055s	user 0.001s	sys 0.001s
I20260709 13:04:10.592087  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:10.527737 14141 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:10.594148  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:10.502888 13968 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:10.520282 14143 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:04:10.612563  9372 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:04:10.618492 14096 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:10.622225 14066 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:10.586203 13952 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:10.607820  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 122242us
I20260709 13:04:10.609661  9375 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:10.628268  9372 raft_consensus.cc:1275] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:04:10.626538  9341 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:10.629707  9490 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:10.633558  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:10.643544  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:10.645964  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:10.604001  9452 raft_consensus.cc:1275] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:04:10.647682  9452 pending_rounds.cc:85] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 6
I20260709 13:04:10.647979  9452 pending_rounds.cc:107] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:04:10.649693  9452 raft_consensus.cc:2889] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:10.653308  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:10.658823 14139 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:10.661404 14139 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:10.661842 14002 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:10.658906 13968 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:10.662029 14139 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:10.663718 14081 consensus_meta.cc:287] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.001s
I20260709 13:04:10.664628 14113 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:10.665346 14139 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:10.641139 14153 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:10.630336 14046 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:10.660169 14149 log.cc:927] Time spent T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:04:10.638309 13948 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:10.683514 14139 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:10.685163  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:10.694413 14041 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:10.694887 14046 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:10.691061 14153 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:10.706488 13958 tablet_bootstrap.cc:492] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:10.707644 13958 tablet_bootstrap.cc:492] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:04:10.708487 13958 ts_tablet_manager.cc:1403] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 1.500s	user 0.047s	sys 0.016s
I20260709 13:04:10.717162 14056 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:10.719372 13947 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:10.722582 14091 consensus_meta.cc:287] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.000s
I20260709 13:04:10.723184 14041 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:10.726863 14092 consensus_meta.cc:287] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.772s	user 0.013s	sys 0.002s
I20260709 13:04:10.681890 14002 consensus_queue.cc:1048] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:04:10.691571 13948 raft_consensus.cc:697] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:10.765992  9447 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 16.
I20260709 13:04:10.723217 14091 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:10.684254 14139 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:10.738072 13952 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:10.769420 14041 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:04:10.841612  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 212001us
I20260709 13:04:10.791292 14056 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 20 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:10.846130  9490 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:10.840008 14054 consensus_meta.cc:287] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.769s	user 0.011s	sys 0.004s
I20260709 13:04:10.830809 14035 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:10.848511  9490 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:10.842733 14115 log.cc:927] Time spent T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 1.239s	user 0.008s	sys 0.000s
I20260709 13:04:10.844412 14153 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:10.873072 14141 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:10.844484 14041 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:10.848805 13948 consensus_queue.cc:237] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:10.882146 14091 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:10.882797 14041 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:10.876753 14156 log.cc:927] Time spent T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:04:10.872195 14035 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:10.884366 13952 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:10.874421 14159 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:10.880452 13958 raft_consensus.cc:359] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:10.885360 13958 raft_consensus.cc:740] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:04:10.885783 14159 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.886404 14159 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:10.888527 14159 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:10.847601 13955 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:10.889999 13958 consensus_queue.cc:260] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:10.889483 14035 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:10.891397 13955 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:10.870669 14153 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:10.892851 13958 ts_tablet_manager.cc:1434] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.169s	user 0.008s	sys 0.000s
I20260709 13:04:10.875231  9490 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:10.895107 13955 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:10.896564 13955 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:10.848228 14158 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:10.848892 14056 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:10.905941  9522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 2052) took 1591 ms. Trace:
I20260709 13:04:10.906455  9368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 2008) took 2085 ms. Trace:
I20260709 13:04:10.906833  9368 rpcz_store.cc:276] 0709 13:04:08.820718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.821093 (+   375us) service_pool.cc:224] Handling call
0709 13:04:08.821367 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:09.498129 (+676762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:10.906205 (+1408076us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b540021d254. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:04:10.906397 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1554550144}
I20260709 13:04:10.906373  9522 rpcz_store.cc:276] 0709 13:04:09.314153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.436069 (+121916us) service_pool.cc:224] Handling call
0709 13:04:09.436567 (+   498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:09.470390 (+ 33823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:09.470437 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:09.480955 (+ 10518us) log.cc:844] Serialized 26 byte log entry
0709 13:04:09.592643 (+111688us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:09.592701 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:09.592776 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:10.687440 (+1094664us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:04:10.905596 (+218156us) raft_consensus.cc:1685] finished
0709 13:04:10.905618 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:10.905865 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6262,"raft.queue_time_us":34916,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":9296,"spinlock_wait_cycles":6925184,"thread_start_us":40515,"threads_started":1,"wal-append.queue_time_us":106876}
I20260709 13:04:10.909149  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:10.913571  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:10.914907  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:10.915331  9523 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:10.909962  9522 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:04:10.917127  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:10.917331  9376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52562 (request call id 1865) took 1824 ms. Trace:
I20260709 13:04:10.918645  9376 rpcz_store.cc:276] 0709 13:04:09.092780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.249490 (+156710us) service_pool.cc:224] Handling call
0709 13:04:10.917180 (+1667690us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b540021d754. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:04:10.917278 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347054976}
I20260709 13:04:10.922070  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:10.922726  9522 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:04:10.923542  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:10.868918 14054 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:10.904174 14158 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:10.930557 14158 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:10.937304  9523 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
I20260709 13:04:10.938491  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:10.939910  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:10.897291 14065 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:10.958281 10068 raft_consensus.cc:1217] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.8->[10.9-10.9]   Dedup: 10.9->[]
I20260709 13:04:10.958987 14054 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:10.961172  9517 raft_consensus.cc:1240] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:10.961871 14065 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:10.965584 14137 log.cc:927] Time spent T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.702s	user 0.002s	sys 0.001s
I20260709 13:04:10.968060  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:10.973369  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:10.974053  9523 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:10.975965 14139 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:10.980685 14087 consensus_meta.cc:287] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.002s
I20260709 13:04:10.981181 14087 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:10.983394 14087 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:10.985544  9518 raft_consensus.cc:2393] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 15: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:10.988031  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:10.988965  9443 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
W20260709 13:04:10.995642  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.000901  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:11.001922  9445 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:04:11.001056  9341 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:11.004916  9341 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:11.006016 14066 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:11.007467 14066 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.007885 14066 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:11.012504  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52502 (request call id 841) took 1065 ms. Trace:
I20260709 13:04:11.005558  9523 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
W20260709 13:04:11.021739 10026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.029300  9519 rpcz_store.cc:276] 0709 13:04:09.946886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.947086 (+   200us) service_pool.cc:224] Handling call
0709 13:04:09.947351 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:09.949686 (+  2335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:09.949716 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:09.949760 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:09.949792 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:11.012201 (+1062409us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b5400313dd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:04:11.012258 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:11.012429 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4942592}
I20260709 13:04:11.031976  9519 raft_consensus.cc:1275] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:04:11.048869  9523 raft_consensus.cc:1240] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:11.053711  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:11.054561  9518 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 16.
I20260709 13:04:11.054847  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:11.063133  9526 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:04:11.050817 13919 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:11.040427 14091 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:11.067974  9519 raft_consensus.cc:1275] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:04:11.091368  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 150696us
W20260709 13:04:11.093029 10024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.094487  9492 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:11.097524  9492 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:11.084478  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:11.098914  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:11.109236  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:11.108599  9492 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:04:11.114828  9492 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:11.070223 10068 raft_consensus.cc:1240] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:11.084084 14056 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:11.120975  9492 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:11.082147 14070 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:11.072877 13906 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:11.073532 13919 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:11.073046 13968 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:11.106591 14113 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:11.125284  9492 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:11.156210 14113 raft_consensus.cc:697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:11.156025 13968 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:11.156965  9492 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:11.157184 14113 consensus_queue.cc:237] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:11.158264  9492 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:11.129297 13688 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:11.159212 14158 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:11.159425 14065 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:11.159693 13688 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:11.160157 13688 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:11.117712 13884 raft_consensus.cc:2749] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:11.124312 13906 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:11.162118 14148 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:11.162955 14148 raft_consensus.cc:697] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:11.165314 14161 consensus_queue.cc:1059] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:11.165314 14065 consensus_queue.cc:1048] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:11.082460 14091 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:11.166285  9522 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:04:11.122712 14087 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:11.167543 14087 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:11.168092 14087 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:11.164057 14148 consensus_queue.cc:237] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:11.171933 10064 raft_consensus.cc:1275] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:11.158627 13968 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:11.121870 14139 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:04:11.152683  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.155261 13919 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:11.109040  9387 tablet_copy_service.cc:342] P 925acbe78db14db3b9e4cfc857717947: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-99c4416401f2427a9f7e68b64ec6915e received from {username='slave'} at 127.0.0.1:50568
I20260709 13:04:11.192619 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:04:11.205336  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 45877.1us
W20260709 13:04:11.232079 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 120509us
I20260709 13:04:11.222965  9387 tablet_copy_service.cc:434] P 925acbe78db14db3b9e4cfc857717947: ending tablet copy session b0812463215649c3b011d36e2f0400c9-99c4416401f2427a9f7e68b64ec6915e on tablet 99c4416401f2427a9f7e68b64ec6915e with peer b0812463215649c3b011d36e2f0400c9
W20260709 13:04:11.234869 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 43497.3us
I20260709 13:04:11.231863 14035 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.247028  9341 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:04:11.249434  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:11.258602  9418 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.161s	user 0.056s	sys 0.092s
W20260709 13:04:11.262708  9418 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.166s	user 0.057s	sys 0.092s
W20260709 13:04:11.263191  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 1.18119e+06us
I20260709 13:04:11.263587  9520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 2051) took 1949 ms. Trace:
I20260709 13:04:11.264008  9520 rpcz_store.cc:276] 0709 13:04:09.313887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.339302 (+ 25415us) service_pool.cc:224] Handling call
0709 13:04:09.339669 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:09.693433 (+353764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:11.263334 (+1569901us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b5400155ed4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:04:11.263527 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":793515776}
I20260709 13:04:11.264407  9418 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:11.268354 14091 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:11.273078  9418 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:11.254151 14022 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:11.275700  9418 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:11.282604 13968 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:11.277974 14022 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.283898 14022 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:11.286821  9370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52548 (request call id 2043) took 1181 ms. Trace:
I20260709 13:04:11.287264  9370 rpcz_store.cc:276] 0709 13:04:10.104972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:10.241338 (+136366us) service_pool.cc:224] Handling call
0709 13:04:10.241641 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:10.243491 (+  1850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:10.243523 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:10.243980 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:04:11.039760 (+795780us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b1800432b20. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58345fe07 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b 00007fb586109d23 00007fb58610a0d1 00007fb586525a0f
0709 13:04:11.196564 (+156804us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:11.196611 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:11.196709 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:11.286478 (+ 89769us) raft_consensus.cc:1685] finished
0709 13:04:11.286503 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:11.286753 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3152,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":7293,"spinlock_wait_cycles":8615808,"thread_start_us":156579,"threads_started":1,"wal-append.queue_time_us":1003445}
I20260709 13:04:11.253513 14035 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:11.299243 14035 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:11.276160 14091 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:11.314319 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:11.281653 14092 raft_consensus.cc:2749] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:04:11.326787 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 89933.9us
I20260709 13:04:11.328480  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:11.329418  9446 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:04:11.326423 14183 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.278649 14066 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:11.335557 14183 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:11.338773 14183 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:11.340240 14048 raft_consensus.cc:493] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:11.340903 14048 raft_consensus.cc:515] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:11.341320 14066 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:11.342895 13919 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:11.343678 13688 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:11.347848 13906 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:11.356086  9517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 2067) took 1277 ms. Trace:
I20260709 13:04:11.356544  9517 rpcz_store.cc:276] 0709 13:04:10.078400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:10.366155 (+287755us) service_pool.cc:224] Handling call
0709 13:04:10.366476 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:10.961741 (+595265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:11.355871 (+394130us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b54000b9d54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:04:11.356028 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1366957952}
I20260709 13:04:11.359694 14002 consensus_queue.cc:1048] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:11.360102 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:11.359637 14048 leader_election.cc:290] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:11.365216 13906 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:11.333801 10025 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:11.370286  9341 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:11.397058  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:11.398056  9451 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:04:11.401044  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:11.401997  9451 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:11.379472 13919 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:11.404675 14144 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:11.405220 14144 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.408504 14144 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:11.417829 14144 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:11.420336 14144 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:11.421224 10026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.425755 13884 raft_consensus.cc:3055] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:11.426245 13884 raft_consensus.cc:740] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:11.427125 13884 consensus_queue.cc:260] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:11.428390 13884 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:11.430413  9490 leader_election.cc:336] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.506s (SENT)
I20260709 13:04:11.431066 14087 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:11.432593  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:11.435209 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:11.436858  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:11.437510  9443 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:11.438663 13688 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:11.446389 14111 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:04:11.450765 14144 raft_consensus.cc:1064] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:04:11.453933 14022 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:11.454921  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.454896 14087 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:11.455595 14153 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:11.456525 14022 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:11.464433 14070 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:11.465137 14070 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:11.466328 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:11.467206 14070 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:11.469529  9343 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:11.473416  9341 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:11.476830  9443 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
I20260709 13:04:11.480197  9343 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:11.453912 14144 consensus_queue.cc:237] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:11.486032  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:11.486475  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:11.486748  9447 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:11.489816  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:11.490422  9449 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:11.491470  9443 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:04:11.493594  9446 raft_consensus.cc:1275] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:04:11.494282  9343 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:11.501715  9490 leader_election.cc:336] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.566s (SENT)
I20260709 13:04:11.493474  9341 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:04:11.503567 10024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.489260 13923 raft_consensus.cc:2804] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:11.513443 13923 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.513955 13923 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:11.515033 13864 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:11.515666 13864 raft_consensus.cc:697] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:11.516615 13864 consensus_queue.cc:237] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:11.521914 13919 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:11.522504 13919 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:11.524632 13919 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:11.527057 13907 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:11.520881 14002 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:04:11.504125  9343 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:11.529582 14002 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:11.531169  9343 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:11.533042 13919 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:11.507385 14143 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:11.534674 14153 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.534797 13919 raft_consensus.cc:697] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:11.535185 14096 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:11.535455 14153 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:11.536082 13919 consensus_queue.cc:237] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:11.539047 14153 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:11.539884  9490 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:11.545488  9449 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
I20260709 13:04:11.547458  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:04:11.550714  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.553757  9451 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:04:11.550647  9447 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 17.
I20260709 13:04:11.503655 14064 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:11.504084 13986 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:11.559562  9341 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:04:11.568645  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 293034us
I20260709 13:04:11.569952  9418 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:11.572288  9418 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:11.559397 14153 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:11.572593 14100 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.577765 14100 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:11.557902 14143 consensus_queue.cc:1048] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:04:11.582815  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:11.584300  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:11.583421  9521 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 9.
I20260709 13:04:11.579604  9341 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:11.589792 10027 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:11.595710  9341 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:11.595432  9371 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 8.
I20260709 13:04:11.565182 13986 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:11.580906 14186 log.cc:927] Time spent T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.172s	user 0.003s	sys 0.002s
I20260709 13:04:11.561407 13983 consensus_queue.cc:1048] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:04:11.570596 13948 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:11.609990  9447 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:04:11.562968 14035 consensus_queue.cc:1059] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:04:11.580020 14091 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:11.580358 14111 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:11.579933 14100 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:11.598392 14096 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:11.601903 13968 consensus_queue.cc:1048] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:04:11.599795 14011 raft_consensus.cc:2804] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:11.605218 13986 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:11.641206  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.597522 14148 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:11.610594 14070 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:11.666838  9521 raft_consensus.cc:1240] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 6. Current term is 7. Ops: []
W20260709 13:04:11.681821  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 69153.9us
I20260709 13:04:11.659153 14011 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.695055 14175 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:11.664732 14148 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:11.699401 13985 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:11.700042 13985 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:11.700495 14148 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:11.679709 14096 raft_consensus.cc:697] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:11.702656 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:11.702526 14096 consensus_queue.cc:237] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:11.743062  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:11.662456 13923 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:11.693606 14011 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:11.679498 14100 consensus_queue.cc:1059] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:04:11.624361  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:04:11.761736  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 158817us
I20260709 13:04:11.702566 13985 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:11.763746  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:11.796663  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:11.797607  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 220171us
I20260709 13:04:11.827978  9343 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:11.852087  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:11.853617  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:11.855429  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:11.855705  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:11.856370  9370 raft_consensus.cc:2393] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 11: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:11.856441  9373 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:11.858522  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:11.859922  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:11.860200  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:11.860628  9372 raft_consensus.cc:2393] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 17: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
W20260709 13:04:11.861833  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 96103.4us
I20260709 13:04:11.862249  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:11.862910  9369 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:11.862869  9418 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:11.853965  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:11.868218  9370 raft_consensus.cc:1240] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:11.869678  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:11.874984  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:11.854501  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:11.878950  9368 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:11.882727  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:11.886271  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:11.887277  9372 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:11.891487 10067 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:04:11.851455 14000 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:04:11.897367  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:11.861649 13947 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:11.861485 13919 consensus_queue.cc:1048] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:04:11.901083 13986 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:11.903249 13986 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:11.906222  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:11.888375  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:11.909243  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:11.909886  9377 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:11.910001  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:11.910737  9374 raft_consensus.cc:2393] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 8: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:11.911490  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:11.912469  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:11.913268  9371 raft_consensus.cc:2393] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 13: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:11.913460  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:04:11.921820 14195 log.cc:927] Time spent T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:04:11.947865  9370 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:04:11.921912 13995 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.948802 13995 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:11.920953  9377 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:04:11.939486 13688 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.950430 13688 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:11.940017 13884 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:11.952034 13884 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:11.954576 13884 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:11.944491 14022 raft_consensus.cc:3055] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:11.955638 14022 raft_consensus.cc:740] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:04:11.949851 14193 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:04:11.956765 14022 consensus_queue.cc:260] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:11.960825 14022 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:11.959762 13688 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:11.967119  9369 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:04:11.975384  9373 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 20.
W20260709 13:04:11.975804  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 113081us
I20260709 13:04:11.978623  9418 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:11.979367  9368 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
I20260709 13:04:11.980069  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:11.984393  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:11.985070  9443 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:11.985123  9449 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:11.980911  9376 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:11.988137  9492 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:12.004132  9372 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:04:12.004587  9443 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:04:12.011371 14087 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:11.974304 14200 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.997363 14111 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:12.007827  9418 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:11.997115 14148 consensus_queue.cc:1059] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:04:12.067836  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:12.068125  9492 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:12.068751  9373 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:04:12.069780  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:12.070484  9369 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:04:12.072755  9368 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:04:12.036289 14091 raft_consensus.cc:2764] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:04:12.073083 14000 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:12.057260 14070 raft_consensus.cc:697] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:12.016362 14201 consensus_queue.cc:1048] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:04:12.068830 14200 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:12.099267 14200 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:12.034061 14144 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:04:12.085472 14148 consensus_queue.cc:1243] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:04:12.081957 14111 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:12.083994 13948 raft_consensus.cc:697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:12.087605 14183 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:12.089895 14175 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:04:12.119397  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 51332.4us
I20260709 13:04:12.124714 14183 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:12.125591 14080 raft_consensus.cc:3055] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:12.125368 14070 consensus_queue.cc:237] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:12.128311  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.130930  9492 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:12.090684 14000 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:12.113183 14111 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.115031 13688 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:12.157097  9491 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947
W20260709 13:04:12.133473 14196 log.cc:927] Time spent T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:04:12.115845 14148 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:12.161163 13884 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:12.133757 14080 raft_consensus.cc:740] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:04:12.173174 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:12.173801 10067 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 10 LEARNER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:12.140564 13923 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:12.142558  9492 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:04:12.144804  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 414143us
I20260709 13:04:12.165817 14111 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:12.193892  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 186190us
I20260709 13:04:12.169169 14153 raft_consensus.cc:2804] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:12.169962 14124 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:12.134094 14175 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:12.197177  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:12.198143  9517 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:12.198071  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:12.201907  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:12.202509  9519 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:12.198354  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:12.203984  9522 raft_consensus.cc:2393] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 17: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:12.199954  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:12.170506 13884 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:12.206264  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:12.202433  9418 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:12.208071  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:12.206944  9521 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
I20260709 13:04:12.168524 13948 consensus_queue.cc:237] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:12.208914  9525 raft_consensus.cc:2393] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 14: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:12.210093  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:12.212234  9522 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:12.215404  9523 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:04:12.217648  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 187730us
I20260709 13:04:12.218537 14175 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:12.219528  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:12.219911  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:12.221438  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:12.222337  9524 raft_consensus.cc:2393] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 13: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:12.225555  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:12.226423  9521 raft_consensus.cc:2393] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 12: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:12.196928 14153 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:12.195209 10068 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:04:12.238389  9418 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:12.209072 13884 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:12.238886  9450 raft_consensus.cc:1275] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:12.240689  9447 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:04:12.243162  9519 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 17.
I20260709 13:04:12.177505 14148 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:04:12.216936 14208 log.cc:927] Time spent T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:04:12.227862 14092 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:12.262035  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:12.262285  9519 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:04:12.243310  9341 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:12.267403  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:12.268981  9372 raft_consensus.cc:1240] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:12.271986  9343 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:12.261158  9522 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
W20260709 13:04:12.269966  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 127457us
I20260709 13:04:12.272573  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
W20260709 13:04:12.245841 14198 log.cc:927] Time spent T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 13:04:12.278266  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:12.294827  9447 raft_consensus.cc:2368] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 13. Current term is 14.
I20260709 13:04:12.295871  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:12.246116 13688 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:12.277851  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:12.279237  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:12.281668  9519 pending_rounds.cc:85] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 7
I20260709 13:04:12.306829  9519 pending_rounds.cc:107] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:04:12.307231  9519 raft_consensus.cc:2889] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:12.307304  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:12.282083  9524 raft_consensus.cc:2393] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 13: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:12.282027  9492 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:12.311210  9375 raft_consensus.cc:1240] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:12.311654  9492 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:12.313959  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:12.295279 13948 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:04:12.299049 14064 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:04:12.313107  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:12.274144 14201 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:12.297856 13923 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:12.317905  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:12.334237  9524 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:12.317319  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:12.282404  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:12.291971  9523 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:12.277228  9526 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:12.298271  9447 raft_consensus.cc:2368] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 13. Current term is 14.
I20260709 13:04:12.327337  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:12.280153  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:12.257546 14153 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:12.319861  9452 raft_consensus.cc:1240] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:12.342327  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:12.339151  9522 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:04:12.339870  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:12.340251  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:12.344784  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:12.338927  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:12.354053  9524 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:04:12.362136  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:12.363873  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:12.368860  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:12.292373 14191 consensus_queue.cc:1059] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
W20260709 13:04:12.374279  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.372917  9526 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
W20260709 13:04:12.380316  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 68752.7us
I20260709 13:04:12.381656  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:12.331115 14220 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:12.382431  9524 raft_consensus.cc:2393] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 14: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:12.381486  9492 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:12.327477 14064 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:12.324173 13688 raft_consensus.cc:697] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:12.401144  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:12.375303 13923 raft_consensus.cc:697] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:12.376376 14201 raft_consensus.cc:697] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:12.323979 14216 consensus_queue.cc:1059] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:04:12.400722 14064 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:12.423004 14191 raft_consensus.cc:3055] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:12.423583 14191 raft_consensus.cc:740] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:12.424687 14191 consensus_queue.cc:260] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:12.410033 14227 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:12.394269 14225 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:12.421590 13688 consensus_queue.cc:237] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:12.424911 14064 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:12.441869 14011 consensus_meta.cc:287] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9: Time spent flushing consensus metadata: real 0.659s	user 0.012s	sys 0.001s
I20260709 13:04:12.441675 14201 consensus_queue.cc:237] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:12.442662 14011 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:12.443516 14080 consensus_queue.cc:260] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:12.445050 14080 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:12.445609 13923 consensus_queue.cc:237] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:12.407400 14183 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:12.426414 14191 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:12.427680 13995 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:12.608953  9342 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
W20260709 13:04:12.703675  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 95127.2us
I20260709 13:04:12.292852  9343 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:12.614728  9368 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 19. Current term is 20. Ops: []
I20260709 13:04:12.707329  9368 raft_consensus.cc:1240] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 14. Current term is 15. Ops: []
W20260709 13:04:12.707408  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 414457us
I20260709 13:04:12.614390  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:12.318636  9371 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:12.616375  9370 raft_consensus.cc:1240] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:04:12.712276 14066 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:12.622732  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:12.714497  9375 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 8.
I20260709 13:04:12.624723  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:12.715792 14096 raft_consensus.cc:2804] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:12.716353 14096 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.626121  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:12.716749 14096 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:12.717975 14183 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:12.718781 14183 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:12.719197 14183 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:12.633929  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:12.721390 14092 raft_consensus.cc:697] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:12.373786  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:12.723420 14092 consensus_queue.cc:237] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:12.650432  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.658898  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:12.521430 14153 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:04:12.726100  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 344566us
I20260709 13:04:12.726891 14222 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:12.727524  9492 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:12.431563 14225 raft_consensus.cc:697] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:12.504349 14111 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:12.431205 14227 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:12.727638 14222 raft_consensus.cc:697] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:12.686806 13984 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.733623 13984 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:12.735653  9517 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:04:12.688622 13919 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.688759 13986 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:04:12.693418 13985 consensus_queue.cc:1048] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:12.696482  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:12.741832  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:12.702404  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:12.723865  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:12.648057  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:12.765475  9418 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:12.767071  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:04:12.780452  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 71656.6us
W20260709 13:04:12.786149  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.732801 14000 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:12.798342  9452 raft_consensus.cc:2368] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12.
I20260709 13:04:12.794306 14238 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:04:12.803359  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 76101.5us
I20260709 13:04:12.760298 13919 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:12.813777 14245 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:12.816504  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:12.807859  9524 raft_consensus.cc:2376] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15. Re-sending same reply.
I20260709 13:04:12.815075 14245 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:12.825420  9492 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:12.827068  9492 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:12.831327 14153 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:12.832140  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:12.832543 14153 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:12.833096 14153 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:12.833606 14153 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:12.834319 13985 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:12.834969  9343 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:12.838624 10025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.841048  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:12.841742 14011 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:12.842672  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:12.844115  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:12.820732  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:12.860801  9343 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:12.862257 14221 log.cc:927] Time spent T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.376s	user 0.009s	sys 0.029s
I20260709 13:04:12.863570 13919 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:12.865092 14227 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:12.865272  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:12.866421  9448 raft_consensus.cc:2393] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 15: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:12.866828 14111 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:12.867589  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:12.869359  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:12.870082  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:12.871119  9448 raft_consensus.cc:2393] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 13: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:12.866276 14227 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:12.875809 14227 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.876498 14227 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:12.877628  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 112599us
I20260709 13:04:12.870996  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:12.881527  9524 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:12.882838  9444 raft_consensus.cc:1240] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260709 13:04:12.882985 14229 log.cc:927] Time spent T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.497s	user 0.000s	sys 0.021s
I20260709 13:04:12.884902  9444 raft_consensus.cc:1240] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:04:12.873481  9520 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:12.880270  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:12.819319 14220 raft_consensus.cc:697] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:12.733273 14222 consensus_queue.cc:237] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:12.730767 14225 consensus_queue.cc:237] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:12.861249 13985 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:12.907814 13688 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:12.912526 14220 consensus_queue.cc:237] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:12.914983 13984 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:12.912708 10027 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
W20260709 13:04:12.906656  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 79877.3us
I20260709 13:04:12.926705  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:12.930012  9369 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:04:12.930162 14245 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:12.930698 14180 raft_consensus.cc:2804] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:12.931254 14180 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.931443 14243 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.931697 14180 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:12.932277 14243 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:12.934374  9448 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:04:12.935222 14243 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:12.935995  9521 raft_consensus.cc:1240] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:12.908797 13688 raft_consensus.cc:697] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:12.938328 13688 consensus_queue.cc:237] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:12.939939  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:12.941855  9520 raft_consensus.cc:1240] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:04:12.942742 14187 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:12.943092  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:12.943535  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:12.943940  9520 raft_consensus.cc:3060] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:12.943472 14187 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:12.946398 14187 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:12.946650  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:12.960518  9370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 1915) took 1053 ms. Trace:
I20260709 13:04:12.946475  9444 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:04:12.962019 14111 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:13.010317  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:12.965335  9370 rpcz_store.cc:276] 0709 13:04:11.906691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.948751 (+ 42060us) service_pool.cc:224] Handling call
0709 13:04:11.949720 (+   969us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:12.713362 (+763642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:12.960090 (+246728us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b54000613d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:04:12.960402 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1530980608}
I20260709 13:04:13.029448  9343 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:13.036183  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:13.041566  9448 raft_consensus.cc:1240] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 13. Current term is 14. Ops: []
W20260709 13:04:13.043002  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 162985us
I20260709 13:04:13.044831 13923 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:04:13.045727 14243 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:13.046388  9526 raft_consensus.cc:1240] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:13.048651 14230 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:13.049187 14233 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:13.049652  9371 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:04:13.050037  9368 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 9.
I20260709 13:04:13.054076 14148 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:04:13.057277  9376 consensus_meta.cc:287] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 1.041s	user 0.014s	sys 0.012s
I20260709 13:04:13.057942  9376 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
W20260709 13:04:13.058156 13884 consensus_meta.cc:287] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.767s	user 0.014s	sys 0.005s
I20260709 13:04:13.041203 14175 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:13.067656 14175 raft_consensus.cc:697] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:13.069124 14175 consensus_queue.cc:237] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:13.069885 14180 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:13.080304  9376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52562 (request call id 1913) took 1160 ms. Trace:
I20260709 13:04:13.080873  9376 rpcz_store.cc:276] 0709 13:04:11.906116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.979746 (+ 73630us) service_pool.cc:224] Handling call
0709 13:04:13.058602 (+1078856us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:13.049662 14230 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:13.079538 13919 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:13.064987 13884 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:13.096550  9518 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 19. Current term is 20. Ops: []
I20260709 13:04:13.079317 14180 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:13.113930 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 73110us
I20260709 13:04:13.114465 13983 raft_consensus.cc:2955] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:13.050005 14233 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:13.121336  9521 raft_consensus.cc:2393] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 in current term 9: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:13.121158 14251 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.122169 14251 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:13.124007 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:13.124933 10067 raft_consensus.cc:2368] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 8. Current term is 9.
I20260709 13:04:13.125643 14251 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:13.126859  9519 raft_consensus.cc:1240] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 14. Current term is 15. Ops: []
W20260709 13:04:13.098111  9490 leader_election.cc:336] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 2.027s (SENT)
I20260709 13:04:13.098873 13906 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.091212  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:13.109596 13884 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:13.138032  9520 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 10.
I20260709 13:04:13.135843  9448 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
I20260709 13:04:13.141920  9490 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:13.078613 14096 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:13.137362  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:13.156908  9491 leader_election.cc:400] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Vote denied by peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623) with higher term. Message: Invalid argument: T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 8. Current term is 9.
I20260709 13:04:13.158044  9491 leader_election.cc:403] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:04:13.159906  9524 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:13.153941 10067 raft_consensus.cc:2955] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:13.136785 14233 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:13.176154 14225 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:13.178066 14183 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:13.184248  9369 raft_consensus.cc:2468] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 10.
W20260709 13:04:13.187605  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 45217.7us
I20260709 13:04:13.186278 10027 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:13.143401 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:13.192524 14087 raft_consensus.cc:3055] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:13.106021 14092 consensus_queue.cc:1048] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:04:13.136277 13906 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:13.213932 14191 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:13.202375 14087 raft_consensus.cc:740] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:13.210319 14183 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:13.226871  9524 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 9.
W20260709 13:04:13.229200  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 188019us
I20260709 13:04:13.240119  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:13.242213  9369 raft_consensus.cc:2393] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 in current term 9: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
W20260709 13:04:13.244748  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 146832us
I20260709 13:04:13.215021 14191 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:13.219817 14227 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:13.230540 14251 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623) with higher term. Message: Invalid argument: T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 8. Current term is 9.
I20260709 13:04:13.250358 14080 raft_consensus.cc:2804] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:13.233989 10027 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:04:13.294204 14087 consensus_queue.cc:260] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:13.295135 14230 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:04:13.295961  9490 leader_election.cc:336] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 2.178s (SENT)
I20260709 13:04:13.296695  9490 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:13.298980 14087 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:13.303305 14191 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:13.315951 14225 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:13.316246 14096 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:13.316861 13884 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:13.319659 14227 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:13.321449 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:13.317150 14153 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:13.316929 14047 raft_consensus.cc:2804] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:13.325275 14080 raft_consensus.cc:697] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 10 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
W20260709 13:04:13.292150 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 58238.2us
I20260709 13:04:13.336194 13923 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:04:13.338495 10068 raft_consensus.cc:2393] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 9: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:04:13.340770  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:13.337409 13884 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:13.336516 14047 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:13.344163 14047 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:13.344986 14153 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:13.346288 13884 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:13.345954 14080 consensus_queue.cc:237] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:13.357937 10027 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:13.361819  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:13.362643  9447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51016 (request call id 1844) took 1078 ms. Trace:
I20260709 13:04:13.363011  9447 rpcz_store.cc:276] 0709 13:04:12.284114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.361234 (+1077120us) service_pool.cc:224] Handling call
0709 13:04:13.362585 (+  1351us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:13.364635  9372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 1920) took 1298 ms. Trace:
I20260709 13:04:13.365403  9372 rpcz_store.cc:276] 0709 13:04:12.065908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.066079 (+   171us) service_pool.cc:224] Handling call
0709 13:04:12.066499 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:12.277114 (+210615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:13.364161 (+1087047us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b540021e154. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:04:13.364441 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465197440}
I20260709 13:04:13.368000  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 2070) took 1055 ms. Trace:
I20260709 13:04:13.368772  9519 rpcz_store.cc:276] 0709 13:04:12.312714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.315769 (+  3055us) service_pool.cc:224] Handling call
0709 13:04:12.316145 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:13.127389 (+811244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:13.367560 (+240171us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b54001a04d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:04:13.367873 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1817166080}
W20260709 13:04:13.378511 14261 log.cc:927] Time spent T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:04:13.379611 14180 raft_consensus.cc:2804] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:13.389994  9275 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 82) took 7115 ms. Trace:
I20260709 13:04:13.396950  9343 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:13.398424 13919 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:13.399010 13919 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:13.399410 13919 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:13.430310 14228 raft_consensus.cc:3055] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:13.430966 14228 raft_consensus.cc:740] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:13.390710  9275 rpcz_store.cc:276] 0709 13:04:06.274515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.274692 (+   177us) service_pool.cc:224] Handling call
0709 13:04:13.389580 (+7114888us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:10.713268 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:10.714250 (+   982us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:10.714309 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:04:10.714339 (+    30us) tablet.cc:662] Decoding operations
0709 13:04:10.714910 (+   571us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:10.714997 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:10.715059 (+    62us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:10.715338 (+   279us) tablet.cc:701] Row locks acquired
0709 13:04:10.715387 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:04:10.715621 (+   234us) write_op.cc:270] Start()
0709 13:04:10.715795 (+   174us) write_op.cc:276] Timestamp: P: 1783602250715546 usec, L: 0
0709 13:04:10.715828 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:04:10.716968 (+  1140us) log.cc:844] Serialized 527 byte log entry
0709 13:04:11.256973 (+540005us) op_driver.cc:464] REPLICATION: finished
0709 13:04:11.703240 (+446267us) write_op.cc:301] APPLY: starting
0709 13:04:11.712994 (+  9754us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:11.967559 (+254565us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:11.972326 (+  4767us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:12.062168 (+ 89842us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:12.088554 (+ 26386us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:04:12.095034 (+  6480us) write_op.cc:312] APPLY: finished
0709 13:04:12.112685 (+ 17651us) log.cc:844] Serialized 25 byte log entry
0709 13:04:12.131700 (+ 19015us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:12.133714 (+  2014us) write_op.cc:454] Released schema lock
0709 13:04:12.136825 (+  3111us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:12.179103 (+ 42278us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:12.181276 (+  2173us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2718023,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":419410,"apply.run_cpu_time_us":7833,"apply.run_wall_time_us":481560,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8297,"cfile_init":1,"lbm_read_time_us":610,"lbm_reads_lt_1ms":4,"num_ops":1,"prepare.queue_time_us":174845,"prepare.run_cpu_time_us":28041,"prepare.run_wall_time_us":186857,"raft.queue_time_us":268208,"raft.run_cpu_time_us":45917,"raft.run_wall_time_us":325238,"replication_time_us":521142,"thread_start_us":601919,"threads_started":4,"wal-append.queue_time_us":195347,"wal-append.run_cpu_time_us":90263,"wal-append.run_wall_time_us":2254155}]]}
I20260709 13:04:13.434955  9518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 2083) took 1106 ms. Trace:
I20260709 13:04:13.435515  9518 rpcz_store.cc:276] 0709 13:04:12.328256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.905221 (+576965us) service_pool.cc:224] Handling call
0709 13:04:12.913659 (+  8438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:13.126032 (+212373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:13.433947 (+307915us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b5400240754. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:04:13.434860 (+   913us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":379997056}
I20260709 13:04:13.432130 14228 consensus_queue.cc:260] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:13.457345  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 224641us
I20260709 13:04:13.482141 14180 raft_consensus.cc:697] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 9 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
W20260709 13:04:13.493323  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 118652us
W20260709 13:04:13.497706  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 171004us
W20260709 13:04:13.502985 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 95162.3us
I20260709 13:04:13.518215  9343 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:13.522993 13986 raft_consensus.cc:2804] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:13.523612 13986 raft_consensus.cc:697] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:13.525409 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:13.526130  9452 raft_consensus.cc:1275] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:13.515290 14228 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:13.533316  9523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46902 (request call id 2077) took 1208 ms. Trace:
I20260709 13:04:13.511970  9341 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:04:13.542454  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 134103us
I20260709 13:04:13.533759  9523 rpcz_store.cc:276] 0709 13:04:12.324904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.888635 (+563731us) service_pool.cc:224] Handling call
0709 13:04:12.913659 (+ 25024us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:13.007793 (+ 94134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:13.007868 (+    75us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:13.035385 (+ 27517us) log.cc:844] Serialized 26 byte log entry
0709 13:04:13.330929 (+295544us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:13.330963 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:13.331037 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:13.533077 (+202040us) raft_consensus.cc:1685] finished
0709 13:04:13.533096 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:13.533255 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16865,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":101,"spinlock_wait_cycles":53504,"thread_start_us":334278,"threads_started":2,"wal-append.queue_time_us":431235}
I20260709 13:04:13.544842 14175 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:13.546923 14175 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.547299 14175 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:13.548629 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:04:13.549907  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:13.552235  9490 leader_election.cc:336] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.715s (SENT)
I20260709 13:04:13.534025 14047 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:13.559782 14047 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:13.566408  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 51044.2us
I20260709 13:04:13.583515 14267 consensus_queue.cc:1059] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:13.584954 14267 raft_consensus.cc:3055] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:04:13.585713 14267 raft_consensus.cc:740] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:04:13.597942  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:13.584929 14214 log.cc:927] Time spent T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 1.187s	user 0.002s	sys 0.011s
I20260709 13:04:13.524791 13986 consensus_queue.cc:237] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:13.610545  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 58374.9us
I20260709 13:04:13.615769 14035 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.616600  9447 raft_consensus.cc:2955] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:13.633955 14035 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:13.640959  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:13.643281  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:04:13.651851  9450 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51016 (request call id 1868) took 1353 ms (client timeout 1705 ms). Trace:
W20260709 13:04:13.652315  9450 rpcz_store.cc:269] 0709 13:04:12.309120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.340036 (+ 30916us) service_pool.cc:224] Handling call
0709 13:04:13.651504 (+1311468us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b5400019fd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:04:13.651664 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1281717504}
I20260709 13:04:13.657205  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:13.657968  9449 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:04:13.663829 14227 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.640344 14064 consensus_queue.cc:1048] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:04:13.666028 13884 consensus_queue.cc:1059] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:13.625623 14191 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.670873 13906 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:13.616989 13948 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.683513  9341 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:13.641611 14230 consensus_queue.cc:1059] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:04:13.700508 13948 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:13.709614 13948 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:13.698503 13906 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:13.712754 13688 consensus_queue.cc:1059] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:13.702788 13884 consensus_queue.cc:1243] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 13.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:04:13.713735 13688 consensus_queue.cc:1243] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:04:13.716439 14223 log.cc:927] Time spent T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 1.310s	user 0.003s	sys 0.012s
I20260709 13:04:13.718940 14035 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:13.718765 13919 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:13.696031 14227 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:13.722890 14227 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:13.725044  9418 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:13.639418 14267 consensus_queue.cc:260] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:13.701679 14047 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.622625 14180 consensus_queue.cc:237] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:13.712917 13906 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:13.768318  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 67065.4us
I20260709 13:04:13.769742  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:13.770334  9418 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:13.771732  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:13.772147 14267 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:13.772490  9368 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 9.
I20260709 13:04:13.773491 14064 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:13.774540 14064 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:13.781062 14064 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:13.782400  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:13.700624 14191 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:13.787827  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:13.790388  9523 raft_consensus.cc:2393] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 in current term 9: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:13.747272 13919 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:13.799175  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:13.787381 13906 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:13.802420  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:13.804715 10027 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:13.811715 14268 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:13.811863 13995 raft_consensus.cc:2804] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:13.795384 14092 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:13.812609 13995 raft_consensus.cc:697] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 9 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:04:13.814517 14175 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:13.817589 14175 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:13.818627 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:13.827991  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:13.828016 14111 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:13.828972 14268 raft_consensus.cc:697] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 12 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:13.829129 14227 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:13.788978 14047 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:13.840328  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:13.855343  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:13.856036  9444 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:13.857161  9443 raft_consensus.cc:3055] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:13.857586  9443 raft_consensus.cc:740] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:13.859468 14047 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:13.847553 14111 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:13.866130 14111 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:13.869328 13995 consensus_queue.cc:237] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:13.873453 14268 consensus_queue.cc:237] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:13.883486  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:13.886919  9445 raft_consensus.cc:1275] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:04:13.891274 14144 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:04:13.891592 14276 log.cc:927] Time spent T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:04:13.892016 14144 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:13.893573  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:13.847802 14227 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:13.894366  9525 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 7.
I20260709 13:04:13.896157 14191 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:13.897346  9523 raft_consensus.cc:3055] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:13.897927  9523 raft_consensus.cc:740] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:13.898394  9368 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 6.
I20260709 13:04:13.898814  9523 consensus_queue.cc:260] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:13.900038  9523 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:13.893632  9369 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:13.897449 14087 raft_consensus.cc:3055] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:13.902077 10027 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:13.903157 14011 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:13.903616 14011 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:13.903858 14279 log.cc:927] Time spent T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:04:13.903977 14011 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:13.906847  9520 raft_consensus.cc:1240] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:13.901631 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:13.902201 14087 raft_consensus.cc:740] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:13.911451 14087 consensus_queue.cc:260] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:13.912395  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 60361.1us
I20260709 13:04:13.896253 14227 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:13.851416 14175 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:13.922101  9370 raft_consensus.cc:1240] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:04:13.923586  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:13.921423  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:13.925343  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:13.920727  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:13.932273  9368 raft_consensus.cc:2368] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 8. Current term is 9.
I20260709 13:04:13.926873  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:13.922573  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:13.925990  9374 raft_consensus.cc:1217] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Deduplicated request from leader. Original: 12.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 13:04:13.934502  9374 raft_consensus.cc:1240] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:04:13.928578  9525 raft_consensus.cc:1275] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:13.912829 14087 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:13.917917 13948 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:04:13.917773 14272 log.cc:927] Time spent T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.334s	user 0.000s	sys 0.008s
I20260709 13:04:13.921099  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:13.944619  9368 raft_consensus.cc:1275] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:13.938182 14047 consensus_queue.cc:1048] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:04:13.941956  9444 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 16.
I20260709 13:04:13.944909  9445 raft_consensus.cc:1275] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:13.943289  9372 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 5.
I20260709 13:04:13.945791  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:13.948693  9376 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 18.
I20260709 13:04:13.918081 13984 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:13.946029 13948 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:13.916942 14070 consensus_queue.cc:1048] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:04:13.952845 13948 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:13.924130 14144 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:13.953701 13984 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:13.955953 13984 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:13.922564 13906 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:13.950174  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:13.961584  9520 raft_consensus.cc:1240] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:13.969504  9521 raft_consensus.cc:1240] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:13.969404  9522 raft_consensus.cc:1240] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:13.971597  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:13.959800 13906 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:13.972829  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:13.919348 14175 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:13.970496 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:13.980585  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:13.982138  9373 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:13.984411  9368 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:13.986055  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:13.992116  9443 consensus_queue.cc:260] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:13.982064 14125 consensus_queue.cc:1048] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:04:13.993902  9443 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:13.997468  9369 raft_consensus.cc:2393] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 15: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:14.010269  9517 raft_consensus.cc:1275] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:14.011404  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:14.016213 14269 raft_consensus.cc:3055] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:14.016776 14269 raft_consensus.cc:740] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:14.007954  9373 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:04:14.027033  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:14.027824  9524 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
I20260709 13:04:14.029874  9368 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
I20260709 13:04:14.039822  9341 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:14.045826 14218 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:04:14.046667  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.046308 14144 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:14.046446 14218 raft_consensus.cc:697] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:14.054193 14218 consensus_queue.cc:237] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:14.055508  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:14.056505  9447 raft_consensus.cc:2393] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 10: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:14.057637  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:14.062546 14269 consensus_queue.cc:260] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:14.064294 14269 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:14.070924  9373 raft_consensus.cc:1275] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:14.071441  9523 raft_consensus.cc:1275] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:04:14.071867  9523 pending_rounds.cc:85] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 5
I20260709 13:04:14.074476  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:14.072336  9523 pending_rounds.cc:107] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:04:14.080183  9523 raft_consensus.cc:2889] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:14.081614  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:14.082653  9521 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 17.
W20260709 13:04:14.084372 14287 log.cc:927] Time spent T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:04:14.090396  9368 raft_consensus.cc:1240] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:04:14.091475  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:14.092098  9377 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:14.094805  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:04:14.128026 14280 log.cc:927] Time spent T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:04:14.129052  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:14.131489  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:04:14.133965  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.139679  9371 raft_consensus.cc:1240] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:14.141937  9370 raft_consensus.cc:1240] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:14.149475  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:14.152295  9517 raft_consensus.cc:1275] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:14.154315  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:14.155061  9523 raft_consensus.cc:2393] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 15: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:14.157871  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:14.159152  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:14.160472  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:14.161103  9374 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:04:14.161356  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:14.161680  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:14.162572  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:14.162909  9371 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:04:14.162824  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:14.163923  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:14.164724  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:14.166373  9444 raft_consensus.cc:2368] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 15. Current term is 16.
I20260709 13:04:14.167814  9444 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:04:14.169391  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:04:14.176302  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.177239  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:14.178488  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:14.179034  9371 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:04:14.182367 14011 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:14.183840 10064 raft_consensus.cc:2368] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8.
I20260709 13:04:14.185393 14087 consensus_queue.cc:1059] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:14.186152  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:14.186380 14087 raft_consensus.cc:3055] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:14.186786 14087 raft_consensus.cc:740] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:14.187990 14087 consensus_queue.cc:260] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:14.189515 14087 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:14.199710  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:14.203245  9492 leader_election.cc:400] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 8. Current term is 9.
I20260709 13:04:14.203912  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:14.209252  9517 raft_consensus.cc:2393] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 9: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
W20260709 13:04:14.153963 14251 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:04:14.212761  9443 raft_consensus.cc:1275] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:04:14.213217  9443 pending_rounds.cc:85] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 5
I20260709 13:04:14.213442  9443 pending_rounds.cc:107] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:04:14.213716  9443 raft_consensus.cc:2889] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:14.215559  9526 raft_consensus.cc:1275] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:04:14.216540  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:14.192358 14011 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:14.217201  9492 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:14.232659  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:14.247241  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:14.248100  9373 raft_consensus.cc:2376] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12. Re-sending same reply.
I20260709 13:04:14.251442  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:14.251371  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:14.250727  9518 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:04:14.258061  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:14.269858  9342 leader_election.cc:400] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Vote denied by peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623) with higher term. Message: Invalid argument: T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8.
I20260709 13:04:14.270341  9342 leader_election.cc:403] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:04:14.271520  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.272063 14251 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:14.272428 13986 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:04:14.273893  9272 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43240 (request call id 182) took 15453 ms (client timeout 15000 ms). Trace:
I20260709 13:04:14.276081 14175 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:14.279202 14284 log.cc:927] Time spent T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.227s	user 0.002s	sys 0.000s
I20260709 13:04:14.259959  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:14.291723  9520 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:14.263659  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:14.299335  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:14.310771  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:14.312170  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:14.301548 13906 consensus_queue.cc:1048] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:04:14.315531  9518 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:04:14.312840  9418 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:04:14.326375  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.329591  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:04:14.274312  9272 rpcz_store.cc:269] 0709 13:03:58.820779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.820992 (+   213us) service_pool.cc:224] Handling call
0709 13:04:14.273673 (+15452681us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:06.624362 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:06.788615 (+164253us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:06.790573 (+  1958us) write_op.cc:435] Acquired schema lock
0709 13:04:06.796231 (+  5658us) tablet.cc:662] Decoding operations
0709 13:04:06.865055 (+ 68824us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:06.865150 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:06.865181 (+    31us) tablet.cc:685] Acquiring locks for 26 operations
0709 13:04:06.870693 (+  5512us) tablet.cc:701] Row locks acquired
0709 13:04:06.870714 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:04:06.870864 (+   150us) write_op.cc:270] Start()
0709 13:04:06.870983 (+   119us) write_op.cc:276] Timestamp: P: 1783602246870816 usec, L: 0
0709 13:04:06.871010 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:04:06.963541 (+ 92531us) log.cc:844] Serialized 10004 byte log entry
0709 13:04:07.565251 (+601710us) op_driver.cc:464] REPLICATION: finished
0709 13:04:07.973645 (+408394us) write_op.cc:301] APPLY: starting
0709 13:04:07.973749 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:07.975606 (+  1857us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:07.975732 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:08.174612 (+198880us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:08.175030 (+   418us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=17,mrs_lookups=52
0709 13:04:08.175087 (+    57us) write_op.cc:312] APPLY: finished
0709 13:04:08.175765 (+   678us) log.cc:844] Serialized 332 byte log entry
0709 13:04:08.175960 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:08.183229 (+  7269us) write_op.cc:454] Released schema lock
0709 13:04:08.183299 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:08.183800 (+   501us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:08.183829 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":550124,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":405295,"apply.run_cpu_time_us":32872,"apply.run_wall_time_us":210139,"cfile_cache_hit":50,"cfile_cache_hit_bytes":52125,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6212,"cfile_init":1,"lbm_read_time_us":1098,"lbm_reads_lt_1ms":8,"num_ops":26,"prepare.queue_time_us":252046,"prepare.run_cpu_time_us":27843,"prepare.run_wall_time_us":490494,"raft.queue_time_us":196057,"raft.run_cpu_time_us":22989,"raft.run_wall_time_us":243609,"replication_time_us":691392,"thread_start_us":558033,"threads_started":4,"wal-append.queue_time_us":166089,"wal-append.run_cpu_time_us":36978,"wal-append.run_wall_time_us":2431862}]]}
I20260709 13:04:14.369199  9522 raft_consensus.cc:1275] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:04:14.373435  9273 catalog_manager.cc:5697] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 6 to 8, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 8 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.387279  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:14.377662  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:14.378904  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81c17774a484973a3b82a63d2a33ff0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:14.329253 13948 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.334664 14111 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:14.396870  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:14.398036  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:14.395696  9520 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 8.
I20260709 13:04:14.404790  9418 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:14.410943  9452 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:04:14.412209  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:14.400343  9524 raft_consensus.cc:2955] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:14.407512 14267 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:14.438408  9418 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:14.438931  9520 raft_consensus.cc:1275] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:04:14.439404  9520 pending_rounds.cc:85] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 7
I20260709 13:04:14.461790  9520 pending_rounds.cc:107] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 13.8
W20260709 13:04:14.463397  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 246258us
I20260709 13:04:14.464310  9492 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:14.483062  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:14.484249  9520 raft_consensus.cc:2889] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:14.429868 14268 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:14.484705  9492 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:14.496078  9444 raft_consensus.cc:1275] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:14.459167 14070 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.417829 13948 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:14.506577  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:14.507495  9520 raft_consensus.cc:2368] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8.
W20260709 13:04:14.509354  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 71047.4us
I20260709 13:04:14.510085  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:14.493925 14111 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:14.512115  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:14.494908 14251 raft_consensus.cc:2804] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:14.493191 14227 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:14.500465  9492 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:14.523909  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:14.519119 13986 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623) with higher term. Message: Invalid argument: T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8.
I20260709 13:04:14.532424  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:14.534518 13948 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:14.513926 14070 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:14.558867  9519 raft_consensus.cc:2393] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 15: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:14.542276  9418 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:14.532555  9520 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:14.549991  9526 raft_consensus.cc:1275] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:04:14.550726  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:14.497728 14268 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:14.556327  9343 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:14.517088 14227 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:14.567619 14227 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:14.517174 14251 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:14.570362 14251 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:14.571282 14070 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:14.545768  9523 raft_consensus.cc:2410] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:04:14.583328 14299 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:14.584036 14299 raft_consensus.cc:697] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:04:14.584662 14292 log.cc:927] Time spent T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.213s	user 0.002s	sys 0.000s
I20260709 13:04:14.585209 14299 consensus_queue.cc:237] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:14.588595 13948 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:14.562170 14087 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:14.615103 14087 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:14.617175  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 75014.2us
I20260709 13:04:14.623958 14268 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:14.625072 14267 consensus_queue.cc:1059] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:14.626255 14269 raft_consensus.cc:3055] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:14.626663 14269 raft_consensus.cc:740] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:14.627722 14269 consensus_queue.cc:260] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:14.630666  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 74437.6us
I20260709 13:04:14.631261  9370 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 8.
I20260709 13:04:14.566432  9449 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 20.
I20260709 13:04:14.587414  9517 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:04:14.566325 14111 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:14.588642  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.640089 14111 consensus_queue.cc:1059] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:14.645866  9343 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:14.648152  9520 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:04:14.649523  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:14.650519  9447 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 20.
I20260709 13:04:14.654861  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:14.659508 14267 raft_consensus.cc:3055] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:14.660077 14267 raft_consensus.cc:740] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:14.641888 14268 consensus_queue.cc:1059] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:04:14.662047 14268 raft_consensus.cc:3055] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:14.662426 14268 raft_consensus.cc:740] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:14.663460 14268 consensus_queue.cc:260] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:14.645844  9490 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.569s (SENT) [suppressed 33 similar messages]
I20260709 13:04:14.666301 14227 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:14.668481 14035 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:14.664780 14268 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:14.677654  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.671036  9343 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:14.695614 10027 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
W20260709 13:04:14.704864  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 204478us
W20260709 13:04:14.705813  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 59993.3us
W20260709 13:04:14.707341  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.668960 14227 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:14.713954 14187 consensus_queue.cc:1048] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:04:14.717343 14047 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:14.672770  9371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:14.719710  9371 raft_consensus.cc:606] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:14.720168  9371 raft_consensus.cc:614] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:14.671450 14087 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:14.721359 14035 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:14.709662 14251 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:14.724529 14269 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:14.725157  9377 raft_consensus.cc:1275] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:04:14.727135  9341 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:14.728963 13984 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:14.732563 13984 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:14.732942 13984 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:04:14.732964  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 62008.8us
W20260709 13:04:14.742518  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 112650us
I20260709 13:04:14.763577  9343 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:14.772195  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 63050.2us
I20260709 13:04:14.768882  9492 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:14.778720  9343 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:14.789285  9343 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
W20260709 13:04:14.793457  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:14.793951  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 82079.4us
I20260709 13:04:14.762472 14047 raft_consensus.cc:697] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 8 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:04:14.771358 13986 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:14.800446  9524 raft_consensus.cc:1275] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:14.801530 14218 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:14.673243 14267 consensus_queue.cc:260] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:14.813750  9490 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:14.787631 14222 raft_consensus.cc:2804] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:14.771153 13919 consensus_queue.cc:1048] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:04:14.797371 14070 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:14.819272  9370 raft_consensus.cc:1275] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:14.800736 14251 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:14.824411 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 48444.3us
I20260709 13:04:14.802991 13986 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:14.774142 14313 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:14.792045 14175 consensus_queue.cc:1048] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:04:14.792915 14144 consensus_queue.cc:1048] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:04:14.833557  9492 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:04:14.832435 13986 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:14.835268  9343 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:14.835650 14312 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:04:14.832643 14299 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:14.874706 13983 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:14.874886 14227 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:14.837978 14047 consensus_queue.cc:237] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:14.839190 14267 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:14.836860 14011 consensus_queue.cc:1048] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:04:14.861984 14313 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:14.885840 14313 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:14.826045 14302 consensus_queue.cc:1048] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:04:14.864507 14087 raft_consensus.cc:2804] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:14.886714 14087 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:14.887145 14087 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:14.865204  9376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:14.887977  9376 raft_consensus.cc:606] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
W20260709 13:04:14.889422 14314 log.cc:927] Time spent T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.071s	user 0.000s	sys 0.002s
I20260709 13:04:14.865342  9492 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:14.869804  9343 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:14.891923  9343 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:14.900568  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:14.902480  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.853969 14222 raft_consensus.cc:697] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:04:14.908420  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.825604 13906 consensus_queue.cc:1048] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
W20260709 13:04:14.912541  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 126974us
I20260709 13:04:14.912853  9343 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:14.897202 14035 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:04:14.909286 14320 log.cc:927] Time spent T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.073s	user 0.000s	sys 0.003s
I20260709 13:04:14.870307 14275 consensus_queue.cc:1048] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:04:14.944087 14222 consensus_queue.cc:237] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:14.946214 14175 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:14.913405 14302 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:14.948104 14302 raft_consensus.cc:697] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:14.929919 14312 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.907205 14218 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:04:14.949534 13919 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:14.950647 14184 consensus_queue.cc:1048] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
W20260709 13:04:14.997457  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 184662us
I20260709 13:04:15.002022  9490 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:15.004302  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 91551.8us
I20260709 13:04:15.010444  9376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:14.994526 14302 consensus_queue.cc:237] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:15.011430  9376 raft_consensus.cc:606] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:14.960860 14312 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:15.041574  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 71048.3us
I20260709 13:04:15.037910 14227 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.040500 14087 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:15.006336 14251 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:15.056996 14227 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:15.070923 14311 log.cc:927] Time spent T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.233s	user 0.000s	sys 0.002s
I20260709 13:04:15.072046 14227 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:15.077066  9452 raft_consensus.cc:1275] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:04:15.077591  9452 pending_rounds.cc:85] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 4
I20260709 13:04:15.077841  9452 pending_rounds.cc:107] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:04:15.078097  9452 raft_consensus.cc:2889] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:15.083563  9451 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 17.
I20260709 13:04:15.086246 14315 consensus_queue.cc:1059] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:15.089372 14327 raft_consensus.cc:3055] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:15.089819 14327 raft_consensus.cc:740] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:04:15.090293 14317 log.cc:927] Time spent T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.299s	user 0.004s	sys 0.000s
I20260709 13:04:15.090747 14327 consensus_queue.cc:260] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:15.091781 14315 consensus_queue.cc:1059] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:15.092278 14327 raft_consensus.cc:3060] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:15.092556 14315 consensus_queue.cc:1243] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 6d50f1c263264b21919230bee398022b log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:04:15.094389  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:04:15.095371  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 62599.8us
I20260709 13:04:15.118099 14330 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.097582 14111 raft_consensus.cc:3055] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:15.102140 14312 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:15.118919 14111 raft_consensus.cc:740] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:15.119385  9490 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:15.120260  9343 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:15.122630 14227 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:15.123406 14227 consensus_queue.cc:1059] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:15.123611 14329 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:15.124769 14331 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:15.125538 14111 consensus_queue.cc:260] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:15.127664 14251 raft_consensus.cc:3055] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:15.128146 14251 raft_consensus.cc:740] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:15.127878 14111 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:15.103446 14269 consensus_queue.cc:1059] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:15.129241 14251 consensus_queue.cc:260] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:15.130309 14251 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:15.105597 14087 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:15.096778 14313 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:15.133792 14313 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:15.133944 13986 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:15.134639 14330 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:15.136260 14313 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:15.129626 14269 raft_consensus.cc:3055] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:15.106992 13864 consensus_queue.cc:1048] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:15.141683  9343 leader_election.cc:400] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 7. Current term is 8.
I20260709 13:04:15.142788  9343 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:15.143582  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 49299.3us
I20260709 13:04:15.144397  9418 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:15.147265  9371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
W20260709 13:04:15.148860 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 150596us
I20260709 13:04:15.151473  9520 raft_consensus.cc:1240] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:04:15.163630 14267 raft_consensus.cc:2749] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:15.172302  9341 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:15.139016 14269 raft_consensus.cc:740] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:15.149096 14315 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:15.137034 13984 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:15.191051 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:15.196310  9371 raft_consensus.cc:606] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:15.196964  9371 raft_consensus.cc:614] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:15.186425 13983 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:15.188084 13919 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:15.182538 14315 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:15.202064  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:15.215492  9518 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:04:15.215935  9518 pending_rounds.cc:85] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 11
I20260709 13:04:15.216434  9518 pending_rounds.cc:107] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:04:15.216784  9518 raft_consensus.cc:2889] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:15.197749 14218 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.224351  9517 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 17.
I20260709 13:04:15.228722 13986 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:15.231707 14267 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.193029 13995 consensus_queue.cc:1059] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:04:15.209990 13919 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.216550 14315 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:04:15.242785  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 98471.9us
I20260709 13:04:15.242807 13919 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:15.268821  9376 raft_consensus.cc:1240] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:15.215791 14269 consensus_queue.cc:260] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:15.296417 14269 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:15.280431 14125 raft_consensus.cc:3055] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:15.297221 14125 raft_consensus.cc:740] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:04:15.298485 14125 consensus_queue.cc:260] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:15.294968 13984 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 21 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:15.301069  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:15.301501  9371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
W20260709 13:04:15.305189  9490 leader_election.cc:336] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.532s (SENT)
I20260709 13:04:15.305899  9490 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:15.238375 14218 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:15.304679  9371 raft_consensus.cc:606] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 18 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:15.240355 14267 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:15.316205  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:15.325408  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:15.322746  9370 raft_consensus.cc:1240] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:15.324257  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:15.328246  9519 raft_consensus.cc:1240] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:15.339211  9371 raft_consensus.cc:1240] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:15.343798  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:04:15.374290  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 69134.1us
W20260709 13:04:15.326831 14268 consensus_meta.cc:287] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.631s	user 0.008s	sys 0.005s
W20260709 13:04:15.381645  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:15.388609  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:15.390232  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:15.397392  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:15.413138  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:15.413407  9371 raft_consensus.cc:1240] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:15.425674  9369 raft_consensus.cc:1240] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:15.432868  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:15.434652  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:15.435735  9449 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
I20260709 13:04:15.437955  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:15.439944  9445 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:04:15.443832  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 224436us
W20260709 13:04:15.447460  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:15.451346  9452 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:04:15.452737  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:15.453326  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:15.458047  9343 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:15.464848  9374 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:04:15.464920  9370 raft_consensus.cc:1275] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:04:15.465284  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:15.466010  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:15.470283  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:15.470393  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:15.479599  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:15.484946  9369 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:04:15.480692  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:15.490720 14070 consensus_queue.cc:1048] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:15.464519 14035 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.492363 14035 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:15.494710 14035 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:15.490762 13947 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:15.536844  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:15.543388 14267 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:15.543943 14332 log.cc:927] Time spent T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
W20260709 13:04:15.555066  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 73715.6us
I20260709 13:04:15.556211  9341 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:15.560058  9343 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:15.574026  9445 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 21.
W20260709 13:04:15.593681 10026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:15.562058 14353 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:15.596663 13906 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:04:15.613955  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 238116us
W20260709 13:04:15.621538  9490 leader_election.cc:336] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.610s (SENT)
I20260709 13:04:15.608330 14218 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:15.561583 14345 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:04:15.619516 13986 raft_consensus.cc:993] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:15.639601  9490 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:15.615409 14353 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:15.640622 14340 log.cc:927] Time spent T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.244s	user 0.002s	sys 0.000s
W20260709 13:04:15.684062  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 86604.2us
W20260709 13:04:15.685107  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 127724us
I20260709 13:04:15.686658  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:15.679836 14353 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:15.685479 14096 raft_consensus.cc:1081] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:15.685547 13906 raft_consensus.cc:697] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:15.703210  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:04:15.704639 14348 log.cc:927] Time spent T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
W20260709 13:04:15.811743  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 105780us
W20260709 13:04:15.816393 14357 log.cc:927] Time spent T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:04:15.816592 14349 log.cc:927] Time spent T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:04:15.818177 14125 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:15.819121 14356 log.cc:927] Time spent T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:04:15.825803 13906 consensus_queue.cc:237] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
W20260709 13:04:15.830222  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:15.832820  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 211329us
W20260709 13:04:15.833585  9490 leader_election.cc:336] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.637s (SENT)
I20260709 13:04:15.833976  9490 leader_election.cc:304] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:15.835095  9490 leader_election.cc:336] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.640s (SENT)
I20260709 13:04:15.835475  9490 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:15.837579 14302 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:15.838714 14355 raft_consensus.cc:993] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:15.839205 14355 raft_consensus.cc:1081] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:15.841382 14222 consensus_queue.cc:1059] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:15.837766 14087 raft_consensus.cc:2749] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:04:15.849728  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:15.873823  9490 leader_election.cc:336] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Timed out: RequestConsensusVote RPC to 127.8.4.66:45279 timed out after 1.659s (SENT)
I20260709 13:04:15.874444  9490 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:15.876096  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 62750.8us
I20260709 13:04:15.877358  9341 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:04:15.820851 13919 consensus_meta.cc:287] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.514s	user 0.005s	sys 0.004s
I20260709 13:04:15.894761 14111 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.899493 14111 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:15.900712 13983 consensus_meta.cc:287] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.668s	user 0.018s	sys 0.005s
W20260709 13:04:15.899969  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:15.902916 14111 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:15.910183  9374 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:04:15.914498 13983 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:15.919412 14364 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.105s
I20260709 13:04:15.920656 13947 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:04:15.923643 14358 log.cc:927] Time spent T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:04:15.925088  9375 raft_consensus.cc:1240] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:15.926519 14360 log.cc:927] Time spent T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:04:15.934577 13986 raft_consensus.cc:993] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:15.935182 13986 raft_consensus.cc:1081] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 18 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:15.880213 14312 raft_consensus.cc:3055] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:04:15.838724 14302 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:04:15.939103  9418 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.003s	sys 0.006s
W20260709 13:04:15.951572  9418 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.003s	sys 0.006s
W20260709 13:04:15.956084  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 78856.6us
W20260709 13:04:15.949319 14269 consensus_meta.cc:287] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.648s	user 0.012s	sys 0.000s
I20260709 13:04:15.972791  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:15.973721  9445 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:04:15.944916 14312 raft_consensus.cc:740] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:15.889065 13919 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.002666 13919 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:15.981154 14251 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:16.009428 14353 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:15.984701 14330 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:15.987747 14302 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.011304 14302 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.013703 14302 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:15.988602  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:16.014497  9450 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
W20260709 13:04:16.015327  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:16.016163  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:15.990793 14341 log.cc:927] Time spent T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.554s	user 0.003s	sys 0.000s
I20260709 13:04:16.018379  9377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50568 (request call id 778) took 1112 ms. Trace:
I20260709 13:04:16.018769  9377 rpcz_store.cc:276] 0709 13:04:14.906378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.906569 (+   191us) service_pool.cc:224] Handling call
0709 13:04:14.906968 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:15.050562 (+143594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:15.050617 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:15.059266 (+  8649us) log.cc:844] Serialized 26 byte log entry
0709 13:04:15.238329 (+179063us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:15.238376 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.238528 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:15.989921 (+751393us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb58610586e 00007fb586104bb6 00007fb5861047d8 00007fb58610e221 00007fb58610e1d9 00007fb58610e169
0709 13:04:16.018061 (+ 28140us) raft_consensus.cc:1685] finished
0709 13:04:16.018088 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:16.018316 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":436,"raft.queue_time_us":4510,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":20843,"spinlock_wait_cycles":6926208,"thread_start_us":202032,"threads_started":2,"wal-append.queue_time_us":166358}
I20260709 13:04:15.990545 14333 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 13:04:16.026827 14327 consensus_meta.cc:287] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.934s	user 0.016s	sys 0.001s
W20260709 13:04:15.998881 14315 consensus_meta.cc:287] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.745s	user 0.010s	sys 0.003s
I20260709 13:04:15.999899 14312 consensus_queue.cc:260] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:15.978953 14368 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:04:16.038838  9418 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:04:16.032756  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 325986us
I20260709 13:04:16.042783  9368 raft_consensus.cc:1275] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:04:16.047458  9368 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:16.049916  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:16.051774  9492 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
W20260709 13:04:16.054631  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 180852us
I20260709 13:04:16.055838  9490 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:16.057977 14111 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.078405  9418 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:16.040042 14315 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.052865 14302 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:16.060797 14368 raft_consensus.cc:697] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 21 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:16.061321 14087 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:16.066533 14312 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:16.084194  9490 leader_election.cc:400] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 15. Current term is 16.
I20260709 13:04:16.070183 14227 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:16.073411 14313 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:16.094424 14368 consensus_queue.cc:237] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.057222 14251 consensus_queue.cc:1048] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:04:16.099340  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:16.104486  9449 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:16.083350 14269 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:16.113090  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:16.113423  9447 raft_consensus.cc:1240] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 17. Current term is 18. Ops: []
I20260709 13:04:16.083127 14369 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:16.121660  9341 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:16.127846  9341 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:16.132382  9526 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:04:16.088783 14302 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:16.139042  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 55056.1us
I20260709 13:04:16.087294 14111 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.141077  9490 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:16.149121  9446 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:16.127849 14070 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:16.151906  9490 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:16.162030  9449 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 18.
I20260709 13:04:16.162289  9490 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:16.137948 14329 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:04:16.168972  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 52717.2us
I20260709 13:04:16.157310 14333 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:04:16.174522 14373 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:04:16.123335 14087 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:04:16.121685 14370 consensus_queue.cc:1048] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:04:16.186448 14111 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:16.153965 14070 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:16.187770 14070 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:16.187892 14315 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 18 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:16.149537 14353 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:16.188944  9375 raft_consensus.cc:1240] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:04:16.155361 14227 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:16.195261  9446 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 16.
I20260709 13:04:16.201516  9418 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:16.207255 14327 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:16.168679 14329 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:16.204005 14251 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:16.196755 14269 consensus_queue.cc:1059] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:04:16.223142 14327 consensus_queue.cc:1059] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:04:16.226125 14269 raft_consensus.cc:3055] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:16.226694 14269 raft_consensus.cc:740] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:16.227594 14269 consensus_queue.cc:260] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.229282 14227 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:16.229939 14371 consensus_queue.cc:1059] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:16.195034 14369 consensus_queue.cc:1059] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:04:16.231352 14369 raft_consensus.cc:3055] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:16.226202 14327 raft_consensus.cc:3055] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:16.219657 14329 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:16.232091 14327 raft_consensus.cc:740] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:16.231722 14369 raft_consensus.cc:740] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:16.233990 14369 consensus_queue.cc:260] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.235258 14369 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:16.240681  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:16.241725  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:16.250738  9341 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:16.257273 14331 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:16.257911 14331 raft_consensus.cc:697] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 18 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:16.258882 14331 consensus_queue.cc:237] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.231910 14269 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:16.266072  9449 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
W20260709 13:04:16.266350 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 101226us
I20260709 13:04:16.267364  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:16.268957  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:16.274282  9452 raft_consensus.cc:2368] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 17. Current term is 18.
I20260709 13:04:16.274627 14312 raft_consensus.cc:3055] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:16.275154 14312 raft_consensus.cc:740] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:16.272622 14302 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:16.298216 14070 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.240538 14327 consensus_queue.cc:260] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.300778 14327 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:16.327795  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:16.328806  9446 raft_consensus.cc:2368] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 15. Current term is 16.
W20260709 13:04:16.326887  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 58843.9us
I20260709 13:04:16.254048 14329 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.351228  9341 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:16.362178  9447 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:04:16.363024  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:16.360688  9444 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:04:16.329645 14035 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:16.371415  9452 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:04:16.365592 13919 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:16.378999  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:16.370630 13864 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:16.410161  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:16.393955 14070 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:16.396914  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 234745us
I20260709 13:04:16.276749 14312 consensus_queue.cc:260] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.412091  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:16.417761  9452 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:16.415797  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:16.454694  9371 raft_consensus.cc:1240] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:16.455601  9375 raft_consensus.cc:1240] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:04:16.345567 14328 consensus_queue.cc:1059] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:04:16.374461 14373 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.462914  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:04:16.465144  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 47399.4us
I20260709 13:04:16.478374  9490 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:16.478049  9446 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:04:16.420715 13864 raft_consensus.cc:697] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:16.386379 14035 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.481166  9448 raft_consensus.cc:1240] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:16.492370  9490 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:16.488407 14087 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:04:16.497754  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 76436.7us
I20260709 13:04:16.419926 13919 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.478760 14312 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:16.504043  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:16.490871  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:16.546612 13919 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:16.548036  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:16.575613  9521 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:16.549000 14329 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:16.549883  9522 raft_consensus.cc:1240] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:16.551111  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:16.551556  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:16.497256 14387 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:16.552138  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:16.553584  9518 raft_consensus.cc:1240] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:16.553719  9443 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:04:16.592272  9443 pending_rounds.cc:85] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 7
I20260709 13:04:16.592665  9443 pending_rounds.cc:107] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:04:16.592978  9443 raft_consensus.cc:2889] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:16.555198  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:16.479712 14386 consensus_queue.cc:1059] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
W20260709 13:04:16.561888 14356 log.cc:927] Time spent T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.064s	user 0.005s	sys 0.000s
W20260709 13:04:16.565310  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 80034.4us
I20260709 13:04:16.566037 14035 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:16.566573 14389 log.cc:927] Time spent T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:04:16.601157  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:16.566973  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:04:16.567435 14388 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:04:16.540693 13864 consensus_queue.cc:237] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.579706 14269 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.581441  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:16.611444  9523 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
I20260709 13:04:16.578452  9418 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:16.590235  9524 raft_consensus.cc:1240] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 5. Current term is 6. Ops: []
W20260709 13:04:16.554188  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 55472.9us
I20260709 13:04:16.597967  9490 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:16.602020  9371 raft_consensus.cc:2393] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 13: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:16.479122 14373 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.604156  9452 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:04:16.580245  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:16.615203  9517 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:16.618194  9418 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:16.616984  9341 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:16.609658 14313 raft_consensus.cc:3055] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:16.629123  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:16.630156  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:16.630942  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:16.639258  9449 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:16.631111  9490 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:16.631559 13919 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:16.622565 14339 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:16.646253 13906 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:16.646862 13906 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.622314 14381 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:16.652843 13919 raft_consensus.cc:697] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:16.654364 13919 consensus_queue.cc:237] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.629238 14087 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:16.613160 14269 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.657652 14087 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:16.659094 14269 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:16.660401 14387 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:16.637881 14313 raft_consensus.cc:740] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:16.662410 14313 consensus_queue.cc:260] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.663515 14313 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:16.663412  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:16.665869 14373 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:16.624158 14315 consensus_queue.cc:1059] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:04:16.667114 14315 raft_consensus.cc:3055] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:16.667500 14315 raft_consensus.cc:740] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:16.658882  9490 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:16.678786 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 174721us
I20260709 13:04:16.648878 13906 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:16.683441  9449 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
I20260709 13:04:16.686478  9418 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:04:16.690878  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 179183us
I20260709 13:04:16.700610  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:16.702062  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:16.705686  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:16.706566  9524 raft_consensus.cc:2410] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:16.709631  9377 raft_consensus.cc:1240] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 12. Current term is 13. Ops: []
W20260709 13:04:16.710266  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 51484.4us
I20260709 13:04:16.699260 14381 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:16.721186  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:16.722470  9369 raft_consensus.cc:2410] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:16.697428 14087 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:16.713631 14392 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:16.709507 14373 consensus_queue.cc:1059] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:04:16.758100  9418 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:16.781222  9418 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:16.782209  9517 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 18.
I20260709 13:04:16.727494 14387 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:16.739445 14354 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.722878 14251 consensus_queue.cc:1048] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 13:04:16.794900  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 56026.4us
I20260709 13:04:16.804888  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:16.805634  9372 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
W20260709 13:04:16.808634  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 63132.2us
I20260709 13:04:16.809494  9490 leader_election.cc:400] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 17. Current term is 18.
I20260709 13:04:16.809772  9490 leader_election.cc:403] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:04:16.809949  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:16.811684  9369 raft_consensus.cc:1240] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:04:16.745163 14269 consensus_queue.cc:1059] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:04:16.791716 14144 raft_consensus.cc:3055] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:04:16.848397  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 46045.3us
I20260709 13:04:16.784175 14087 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:16.795501 14268 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:16.815191 14111 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:16.821563 14312 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:16.806581 14354 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.784596 14392 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.866480 14392 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:16.835318  9490 leader_election.cc:400] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 15. Current term is 16.
I20260709 13:04:16.837249 14302 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:16.800158 14387 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:16.854393  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 44511.2us
I20260709 13:04:16.855443  9341 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:16.814702 13864 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:16.814050 14369 consensus_queue.cc:1059] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:04:16.857081 14269 consensus_queue.cc:1243] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 925acbe78db14db3b9e4cfc857717947 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:04:16.848165 14144 raft_consensus.cc:740] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:16.859629 14111 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:16.898147 14111 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:16.882928 13864 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:16.903765 13864 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:16.905262 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:16.905668 14144 consensus_queue.cc:260] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.906193 10067 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:04:16.906736 14144 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:16.907814  9342 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:16.908840 13864 raft_consensus.cc:2804] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:16.911448 14269 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.911986 14269 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.846215 14381 consensus_queue.cc:1059] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
W20260709 13:04:16.887264  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 52212.3us
I20260709 13:04:16.859493 14087 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.862476 14397 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:16.866506 14354 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:16.884498  9418 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:16.882388 13984 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:16.918710 13984 raft_consensus.cc:697] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:16.882175 14302 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.909369 13864 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:16.930116 13864 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:16.892745 14387 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:16.916639 14397 raft_consensus.cc:697] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 18 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:16.936061 14397 consensus_queue.cc:237] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.947875 14370 raft_consensus.cc:3055] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:16.948500 14370 raft_consensus.cc:740] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:16.948688 14339 raft_consensus.cc:3055] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:16.949784 14370 consensus_queue.cc:260] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:16.951241 14370 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:16.911811 14315 consensus_queue.cc:260] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:16.920471 13984 consensus_queue.cc:237] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:16.959029  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.959940 14339 raft_consensus.cc:740] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:16.966230 14269 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:16.969724 14087 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:16.968515  9275 catalog_manager.cc:5697] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 6 to 9, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 9 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:16.963603  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:17.041630  9443 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 21 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:04:16.973788 14328 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.049502  9275 catalog_manager.cc:5697] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index -1 to 10, VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 10 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:04:16.977324  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 62733.4us
I20260709 13:04:16.979058 14302 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:16.979800 14111 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:16.980538  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 96152.9us
I20260709 13:04:17.012205  9492 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:04:17.059238  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 47170.2us
I20260709 13:04:17.012852  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:17.013602  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:17.014032  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:17.016743 13864 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:17.027354  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:04:17.039809 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 293117us
I20260709 13:04:17.051790  9275 catalog_manager.cc:5697] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 4 to 6, leader changed from b0812463215649c3b011d36e2f0400c9 (127.8.4.68) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 6 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:17.055842 14369 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:17.066150  9490 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:17.068953  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:17.072150  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:17.075793  9490 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:17.077486  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.079483  9490 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:17.068166 14302 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:17.093694  9490 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:17.133960 14302 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.134407 14302 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:17.135083  9490 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:17.136323  9490 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:17.137758 14087 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:17.057720 14328 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:17.138772 14313 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:17.140084  9490 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:17.141376  9490 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:17.142277 14403 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:17.142930 14403 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:17.144364 14403 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:17.146080  9275 catalog_manager.cc:5697] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:17.113139 14339 consensus_queue.cc:260] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:17.114579 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:17.149894 14339 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:17.115975 14404 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.153460  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:17.153316 14404 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:17.111014 14111 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:17.077847 14392 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:17.156302 14404 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:17.149894  9444 raft_consensus.cc:1240] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:17.086767 14251 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:17.158560 10067 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:04:17.118559 14387 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:17.084839 14386 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:04:17.117883 14312 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 17. Current term is 18.
I20260709 13:04:17.140213 14328 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:17.108263 14315 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:17.138384 14087 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:17.161432  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:17.159870  9342 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:17.162065  9447 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
I20260709 13:04:17.162539 14328 raft_consensus.cc:2804] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:17.163014 14328 raft_consensus.cc:697] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:17.164050 14328 consensus_queue.cc:237] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:17.113277 13864 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:04:17.166319  9273 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43244 (request call id 187) took 24436 ms (client timeout 15000 ms). Trace:
I20260709 13:04:17.170477  9452 raft_consensus.cc:1275] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:04:17.171234  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:17.171984  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:17.173547  9452 raft_consensus.cc:1240] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:04:17.148270  9275 catalog_manager.cc:5697] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:17.174974 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 87781.7us
I20260709 13:04:17.175228  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:17.171569  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:17.174571  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:17.182765  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:17.184927  9452 raft_consensus.cc:1240] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:17.187716  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:17.188654  9449 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:04:17.192312  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:17.195636  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:17.213135  9446 raft_consensus.cc:1240] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 18 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 17. Current term is 18. Ops: []
W20260709 13:04:17.218034  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.218820  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:17.217904  9449 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:04:17.221150  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.220379  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:17.181914 14087 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.227494  9525 raft_consensus.cc:1240] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:17.228173  9418 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:17.234476  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:17.237627  9523 raft_consensus.cc:1240] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:04:17.241569  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:17.232514  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:17.243800  9518 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:17.167034  9273 rpcz_store.cc:269] 0709 13:03:52.729817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.747792 (+ 17975us) service_pool.cc:224] Handling call
0709 13:03:52.987000 (+239208us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b540016e4d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d4090 00007fb586572f3a 00007fb58c3291cc 00007fb58c42737e 00007fb58a8e82a4 00007fb58a8e8232 00007fb58a8e8161 00007fb58a8e80dc 00007fb58a8e7392 00007fb5848a548c 00007fb5848a48c6
0709 13:04:17.166100 (+24179100us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:14.706195 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:14.707324 (+  1129us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:14.707392 (+    68us) write_op.cc:435] Acquired schema lock
0709 13:04:14.707423 (+    31us) tablet.cc:662] Decoding operations
0709 13:04:14.707986 (+   563us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:14.708143 (+   157us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:14.708188 (+    45us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:14.708600 (+   412us) tablet.cc:701] Row locks acquired
0709 13:04:14.708667 (+    67us) write_op.cc:260] PREPARE: finished
0709 13:04:14.708929 (+   262us) write_op.cc:270] Start()
0709 13:04:14.777075 (+ 68146us) write_op.cc:276] Timestamp: P: 1783602254708830 usec, L: 0
0709 13:04:14.794771 (+ 17696us) op_driver.cc:348] REPLICATION: starting
0709 13:04:14.938108 (+143337us) log.cc:844] Serialized 532 byte log entry
0709 13:04:16.007051 (+1068943us) op_driver.cc:464] REPLICATION: finished
0709 13:04:16.155662 (+148611us) write_op.cc:301] APPLY: starting
0709 13:04:16.167697 (+ 12035us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:16.182731 (+ 15034us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:16.182886 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:16.183867 (+   981us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:16.184174 (+   307us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:04:16.184247 (+    73us) write_op.cc:312] APPLY: finished
0709 13:04:16.184526 (+   279us) log.cc:844] Serialized 25 byte log entry
0709 13:04:16.189715 (+  5189us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:16.189810 (+    95us) write_op.cc:454] Released schema lock
0709 13:04:16.189877 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:16.211146 (+ 21269us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:16.211200 (+    54us) write_op.cc:454] Released schema lock
0709 13:04:16.272020 (+ 60820us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b540016e4d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656732a 00007fb5864ecf14 00007fb5864ecec3 00007fb5864ece38 00007fb5864ecdf3 00007fb5864ec0dc 00007fb586515e16 00007fb5864fdcbb 00007fb5864e839d 00007fb5864ebd75
Metrics: {"reported_tablets":53,"spinlock_wait_cycles":416562048,"child_traces":[["op",{"apply.queue_time_us":114595,"apply.run_cpu_time_us":4829,"apply.run_wall_time_us":65554,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8297,"num_ops":1,"prepare.queue_time_us":42880,"prepare.run_cpu_time_us":29331,"prepare.run_wall_time_us":501082,"raft.queue_time_us":363855,"raft.run_cpu_time_us":15655,"raft.run_wall_time_us":268386,"replication_time_us":1212050,"spinlock_wait_cycles":6763904,"thread_start_us":624079,"threads_started":4,"wal-append.queue_time_us":284641,"wal-append.run_cpu_time_us":226100,"wal-append.run_wall_time_us":1959166}]]}
I20260709 13:04:17.246918  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:17.247803  9519 raft_consensus.cc:2410] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:04:17.248288  9447 raft_consensus.cc:2468] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:04:17.260887  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:17.261940  9521 raft_consensus.cc:2410] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:04:17.262725  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:17.263697  9517 raft_consensus.cc:2410] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:04:17.202944 14312 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:17.270533  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:17.282207  9517 raft_consensus.cc:1240] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 17. Current term is 18. Ops: []
I20260709 13:04:17.282588  9418 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:17.232394 14386 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.286785  9448 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
I20260709 13:04:17.287597  9374 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:04:17.243187 14251 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:17.288393 14397 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:17.306368 14374 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:04:17.308310  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:17.309090  9448 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:04:17.310478  9444 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:04:17.280395 14406 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:17.316459  9446 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:17.317535  9447 raft_consensus.cc:1275] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:04:17.246296 14087 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:17.304905  9523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46894
I20260709 13:04:17.364534  9523 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:17.365842  9523 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:17.317046  9526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46894
I20260709 13:04:17.366632  9526 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:17.366988  9526 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:17.381125  9517 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46894
I20260709 13:04:17.382015  9517 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:17.382462  9517 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:17.303601 14312 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:17.389477 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 85414.5us
I20260709 13:04:17.397491  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:17.400883  9520 raft_consensus.cc:2410] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 16 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:04:17.301797 14386 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:17.311691 14251 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:17.410055  9517 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:17.429322  9522 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:17.374475 14144 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:04:17.436884  9517 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:17.436731  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:17.437621  9374 raft_consensus.cc:3055] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:17.437915  9374 raft_consensus.cc:740] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:17.447136  9523 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:17.442616  9374 consensus_queue.cc:260] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:17.449780  9374 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:17.456408  9523 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:17.459347  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:17.460022  9370 raft_consensus.cc:3055] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:17.460346  9370 raft_consensus.cc:740] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:04:17.463099 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 92220.3us
I20260709 13:04:17.473646  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:17.474509  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:17.478282  9520 raft_consensus.cc:2410] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 16 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:04:17.468604  9370 consensus_queue.cc:260] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:17.455008 14327 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.495005  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:17.496459  9370 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:17.447721 14268 consensus_queue.cc:1059] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:04:17.499764  9445 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:04:17.500166  9445 pending_rounds.cc:85] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 8
I20260709 13:04:17.500381  9445 pending_rounds.cc:107] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:04:17.500597  9445 raft_consensus.cc:2889] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:17.500535  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:17.502295  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:17.497269  9520 raft_consensus.cc:2410] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:04:17.498749  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.507468  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:17.510538  9371 raft_consensus.cc:1275] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:04:17.514299  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:17.518829  9520 raft_consensus.cc:2393] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 19: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:17.528353  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:17.529098  9520 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
I20260709 13:04:17.559350  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:17.575875  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:17.563095  9517 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
I20260709 13:04:17.501246 14327 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:17.585175  9370 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:04:17.586133  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:17.593354  9372 raft_consensus.cc:2393] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 16: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:17.594316  9492 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:17.595984  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:17.527100 14315 consensus_queue.cc:1048] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
W20260709 13:04:17.575019 14409 log.cc:927] Time spent T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:04:17.586899  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:17.596799  9523 raft_consensus.cc:2393] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 10: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:17.597785  9518 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 17.
I20260709 13:04:17.577447 14087 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:17.605343 14414 log.cc:927] Time spent T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 13:04:17.606207 14416 log.cc:927] Time spent T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:04:17.602267 14381 raft_consensus.cc:3055] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:17.618031 14386 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:17.619165 14251 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:17.599331 14408 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:04:17.623418 14374 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.629436  9524 raft_consensus.cc:1240] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:04:17.635043  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:17.650794  9447 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:17.598207 14370 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:17.635774  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:17.653764  9446 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:17.639979  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:17.640628  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:17.641489  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:17.644691  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:17.603578 14312 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:17.661617  9450 raft_consensus.cc:2410] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
W20260709 13:04:17.596699  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 120903us
I20260709 13:04:17.647940  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:17.648234  9525 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 18.
I20260709 13:04:17.665812  9518 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:17.669397  9418 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:17.647601  9517 raft_consensus.cc:2393] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 10: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:17.642113 14381 raft_consensus.cc:740] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:17.675179  9490 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:17.676489  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.677934  9525 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:04:17.682458  9490 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:17.693337  9518 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:17.681038  9341 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:17.694999  9447 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 19.
I20260709 13:04:17.699410  9490 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:17.700763  9490 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:17.674685 14269 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:17.671638 14370 raft_consensus.cc:697] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:17.754765  9524 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:04:17.757575  9524 pending_rounds.cc:85] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 7
I20260709 13:04:17.757897  9524 pending_rounds.cc:107] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:04:17.758144  9524 raft_consensus.cc:2889] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:17.759840  9446 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:04:17.656741 14374 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:17.766230  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 65545.2us
I20260709 13:04:17.767225  9517 raft_consensus.cc:1275] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 7. (term mismatch)
I20260709 13:04:17.778410  9490 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:17.769373 14087 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:17.697276 14369 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.778640  9517 pending_rounds.cc:85] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 6
I20260709 13:04:17.702086 14312 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:17.757723  9526 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:17.697091 14392 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:17.789608  9490 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:17.793710  9517 pending_rounds.cc:107] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 15.7
I20260709 13:04:17.781144  9522 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 16.
I20260709 13:04:17.797406  9517 raft_consensus.cc:2889] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:17.704917 14386 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:17.802037  9520 raft_consensus.cc:1240] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:17.802304  9490 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:17.692602 14251 consensus_queue.cc:1048] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:04:17.791814 14381 consensus_queue.cc:260] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:17.808893 14403 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:17.815348 14381 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:04:17.815779  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.787177 14269 raft_consensus.cc:697] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:17.821228 14392 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:17.822206 14269 consensus_queue.cc:237] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:17.794931 14387 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:04:17.815397 14419 log.cc:927] Time spent T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:04:17.825639 14374 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:17.825909  9526 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:04:17.796700 14416 log.cc:927] Time spent T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.098s	user 0.006s	sys 0.006s
W20260709 13:04:17.824542 14302 consensus_meta.cc:287] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.690s	user 0.004s	sys 0.007s
I20260709 13:04:17.774209 14328 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:17.827333 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:17.832466 10067 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:17.830468  9525 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260709 13:04:17.834774  9525 pending_rounds.cc:85] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 10
I20260709 13:04:17.835135  9525 pending_rounds.cc:107] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 13:04:17.835464  9525 raft_consensus.cc:2889] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:17.837777  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 143185us
I20260709 13:04:17.851012 10067 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:04:17.834093 14328 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.840368 14312 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.810225 14369 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:17.828714 13906 consensus_queue.cc:1059] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.030s
W20260709 13:04:17.872485 14420 log.cc:927] Time spent T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.282s	user 0.003s	sys 0.000s
I20260709 13:04:17.839316 14302 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:17.881758 14327 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:17.889958 14302 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:17.891250 14369 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:17.883955  9374 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 19.
I20260709 13:04:17.833102 13984 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 13:04:17.894842  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 56425.1us
W20260709 13:04:17.895869  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 93767.3us
I20260709 13:04:17.898396  9490 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:17.863014 14328 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:17.903999  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 73771.1us
I20260709 13:04:17.914621  9490 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:17.893126 14312 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:17.917557 14251 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:17.927069  9341 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:17.942442 14251 raft_consensus.cc:697] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:17.942912 13984 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:17.943377 13984 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.943780 13984 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:17.943565 14354 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:17.944041 14428 consensus_queue.cc:1048] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:17.885546 14370 consensus_queue.cc:237] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:17.945137 14354 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:04:17.948210  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.953608  9446 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:17.947194  9343 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:17.955147  9343 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:17.956241 14354 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:17.957159 14354 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:17.959249 14312 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:04:17.959656  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 45131.9us
I20260709 13:04:17.959865 14312 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:17.960701  9490 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:17.961871  9490 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:17.962349 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:17.962664 10064 raft_consensus.cc:1240] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:17.962888 14302 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:17.963188 10067 raft_consensus.cc:2410] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:04:17.963404  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.963693 14302 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:17.965130  9343 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:17.965991 14433 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:17.966837  9445 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:17.968025  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:17.976531 10067 raft_consensus.cc:1275] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:17.963238  9490 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:17.993376  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:17.995167  9525 raft_consensus.cc:1275] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:04:17.994087  9521 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
I20260709 13:04:18.005439  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:18.009596  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:18.004452  9418 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:18.010329  9520 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 21.
I20260709 13:04:18.011780  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:18.012135  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:18.012687  9445 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:18.013504  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:18.014178  9444 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:18.004977 13984 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:18.015709  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:18.017295  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:18.020092  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:18.028882  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:18.029743  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:18.029388  9374 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:18.030443  9369 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
I20260709 13:04:18.033600  9521 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:18.036257  9520 raft_consensus.cc:1275] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:18.037254  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:18.039845  9492 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:18.047269  9374 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:04:18.049160  9523 raft_consensus.cc:1240] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:18.053468  9445 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:04:18.055038  9490 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:04:18.056529  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.017197 14268 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:18.039049 14430 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:18.039758 14381 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:17.943472 14251 consensus_queue.cc:237] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:18.011075 14327 consensus_queue.cc:1048] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:04:18.032996 13919 consensus_queue.cc:1048] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:04:18.058089 14386 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:18.087060  9444 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:04:18.060052 14268 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.016983 14431 consensus_queue.cc:1059] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:04:18.068949 14381 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:18.102334  9490 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:18.090811 14268 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:18.094512 14392 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:18.105247 14381 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:04:18.161926  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 99864.2us
I20260709 13:04:18.136799 13984 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:18.193529 14437 log.cc:927] Time spent T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:04:18.184504 14430 raft_consensus.cc:697] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 19 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:04:18.221854 14438 log.cc:927] Time spent T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:04:18.201804 14432 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:04:18.231695 14087 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:04:18.257251 14435 log.cc:927] Time spent T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:04:18.257107 14328 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:18.259423 14328 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:18.263368 14354 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:18.269964  9375 raft_consensus.cc:1240] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:18.247663 14315 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:04:18.281495  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 82986.9us
I20260709 13:04:18.294301 14444 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.269034 14087 raft_consensus.cc:697] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:18.408012 14381 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:18.412415 14087 consensus_queue.cc:237] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:18.282577 14315 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:18.361567 14392 raft_consensus.cc:697] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:18.422565 14392 consensus_queue.cc:237] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:18.428859  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:18.429697  9522 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:18.401739 14448 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.402807 14421 raft_consensus.cc:3055] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:18.305653 14430 consensus_queue.cc:237] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:18.362330  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 310053us
I20260709 13:04:18.438067  9492 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:18.439189  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 235907us
W20260709 13:04:18.441919  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.403000 14444 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:18.443482  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:18.462963 10064 raft_consensus.cc:1240] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:18.466747  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.471410  9522 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 22.
I20260709 13:04:18.473476  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:18.411088 14381 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 22 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:18.483969  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 43857.7us
I20260709 13:04:18.436596 14421 raft_consensus.cc:740] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:18.441126 14397 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.464901 14354 consensus_queue.cc:1059] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:04:18.449191 14448 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:18.523270  9377 raft_consensus.cc:3055] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:18.523705  9377 raft_consensus.cc:740] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:18.525274 14448 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:18.525962 14447 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:18.527936 14447 consensus_queue.cc:1048] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:18.493997 14440 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:18.492722 14442 consensus_queue.cc:1059] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:04:18.479494 14328 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:04:18.559201 14268 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:18.560395 14456 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.560928 14456 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:18.547937 14458 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:04:18.556479 14452 log.cc:927] Time spent T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:04:18.481245 14450 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.059s
W20260709 13:04:18.589569  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 101859us
W20260709 13:04:18.599568  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 111058us
I20260709 13:04:18.540041 14269 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:18.540475 14444 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:18.506574 14397 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:18.587271 14440 raft_consensus.cc:697] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 22 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:04:18.616389  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 126028us
I20260709 13:04:18.615160 14328 consensus_queue.cc:1059] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:04:18.638433 14268 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:18.639403  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:18.656944  9446 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:18.657136  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:18.641767 14397 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:18.634320 14453 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:18.616878  9343 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:18.663563 14460 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:18.650621  9443 raft_consensus.cc:1240] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:18.609618 14269 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:18.652959  9445 raft_consensus.cc:1240] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:18.658072  9372 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:18.659955  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:18.660712  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:18.661573  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:18.647841  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:18.671157  9522 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:18.665660  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:18.674294  9448 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:18.676796  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:18.638166 14440 consensus_queue.cc:237] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:18.677856  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 61042.1us
I20260709 13:04:18.677856  9521 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:04:18.663322 14453 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:18.680255 14269 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:18.680727  9443 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:04:18.658347 13984 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:18.696238  9448 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 16.
I20260709 13:04:18.646795 14353 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:04:18.719344  9446 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:04:18.726151  9372 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 17.
I20260709 13:04:18.733793  9492 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:18.735562 14448 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:18.722409 14460 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:18.737551 14443 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:04:18.736784  9522 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 17.
I20260709 13:04:18.738850 14460 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:18.725482 14328 consensus_queue.cc:1048] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:04:18.720779 13984 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:18.739719  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:18.740335  9520 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:04:18.741559 13984 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:18.745205  9370 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 5.
I20260709 13:04:18.748826  9520 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:04:18.729588 14392 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.729581 14470 raft_consensus.cc:2764] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:04:18.755983  9418 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:18.757200  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:18.763513  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:18.763896  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:18.765293  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:18.768121  9369 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:04:18.772291  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:18.773420  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:18.775393  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:18.775485  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:18.778105  9519 raft_consensus.cc:2393] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 6: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:18.783792  9343 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:18.767611 14302 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:18.769596 14386 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:18.774616 14451 raft_consensus.cc:2804] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:18.749867 14392 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:18.794981  9418 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:18.795244 13919 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:18.795704 14469 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:18.792631 14453 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:18.801996  9490 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:18.806658  9519 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:04:18.812456  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:18.818921  9418 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:18.823624  9490 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:18.843385  9418 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:18.813344 14451 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.805943 14268 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:18.829670 14269 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:18.830740 13919 raft_consensus.cc:697] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:18.809988 14302 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:18.843204 14406 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:18.868410 14476 log.cc:927] Time spent T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:04:18.844233 14397 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:04:18.851713 14451 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:18.863483 14268 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:18.935623 14268 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:18.936481 14268 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.871445 14269 raft_consensus.cc:697] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:18.938102 14269 consensus_queue.cc:237] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:18.849231 14087 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:18.941382 13919 consensus_queue.cc:237] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:18.863673 14339 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:18.870903 14381 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:18.945621 14381 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:18.946875 14302 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:18.948372 14381 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:18.949865 14477 log.cc:927] Time spent T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:04:18.827675 14386 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:18.954527 14386 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:18.850236 14430 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 13:04:18.834057 14469 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:18.966028 14453 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:04:19.001214  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 187529us
I20260709 13:04:18.983162 14458 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:18.959101 14268 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:19.126264  9519 raft_consensus.cc:1240] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:19.118317 14464 log.cc:927] Time spent T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 13:04:19.205039  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.205365  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:19.206389  9450 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:04:19.200078  9444 raft_consensus.cc:1240] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:19.201130  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:19.208465  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:19.210384  9447 raft_consensus.cc:2368] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12.
I20260709 13:04:19.212425  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:19.218036 14488 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:19.242827  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:04:19.254609  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 136476us
I20260709 13:04:19.242303 14392 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:19.134125 14458 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:19.295056 14440 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:19.295976 14440 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:19.299257 14440 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:19.314568  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:19.333360  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:19.336088  9368 raft_consensus.cc:1240] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:19.341071  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:19.344115  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:19.352152  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:19.354540  9368 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 19.
I20260709 13:04:19.370018 14498 consensus_queue.cc:1059] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:19.372434 14501 raft_consensus.cc:3055] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:19.372895 14501 raft_consensus.cc:740] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:19.378424 14441 consensus_queue.cc:1059] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:19.379500 14450 consensus_queue.cc:1059] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:19.380579 14450 consensus_queue.cc:1243] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer d62c9d5a052b42ce8675f8438f846526 log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:04:19.382993  9492 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:19.338567 14070 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:19.384747 14070 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:19.402339 14487 log.cc:927] Time spent T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:04:19.402508 14070 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:19.405253 14495 log.cc:927] Time spent T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:04:19.408476 14486 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:19.409243 14486 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:19.411512 14486 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:19.395048 14498 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:19.379616  9341 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:04:19.393164 14269 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:19.421209 14269 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:19.400396 14268 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:19.431473 14451 consensus_meta.cc:287] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.002s
I20260709 13:04:19.424497 14269 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:19.403901 14469 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:19.425598 14458 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:19.425982 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:19.415031 14501 consensus_queue.cc:260] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:19.414580 14498 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.437579 14501 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:19.440088 14485 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:19.440822 14485 raft_consensus.cc:697] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:19.441869 14485 consensus_queue.cc:237] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:19.444942 14421 consensus_queue.cc:260] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:19.447042 14421 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:19.449143 14498 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:04:19.450747  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 71185.4us
I20260709 13:04:19.431941 14451 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:19.474820  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:19.454497 14469 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:19.477454  9444 raft_consensus.cc:2368] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7.
I20260709 13:04:19.471593  9377 consensus_queue.cc:260] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:19.478425  9377 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:19.473925 14444 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:19.476027 14460 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:19.479668 14444 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:19.479759 14460 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:19.482632 14460 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:19.487385  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:19.490989  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:19.490631 14469 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:19.508615 14469 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:19.515199  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:19.518669  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:19.519650  9448 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 16.
I20260709 13:04:19.522001  9446 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 22 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 21. Current term is 22. Ops: []
I20260709 13:04:19.525774  9341 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:19.529251  9522 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:04:19.492106 14481 log.cc:927] Time spent T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.631s	user 0.000s	sys 0.009s
I20260709 13:04:19.535930  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:19.539314  9447 raft_consensus.cc:1240] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:19.540977  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:19.544364  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:19.548599  9418 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:19.532815 14501 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:19.554824  9418 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:19.560405  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:19.566802  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:19.567883  9522 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:19.545742 14251 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:19.549468 14269 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:19.578976 14489 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.575698 14381 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:19.582293 14500 consensus_queue.cc:1059] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:04:19.604286  9341 leader_election.cc:400] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7.
I20260709 13:04:19.614938  9341 leader_election.cc:403] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:19.611119 14498 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:19.554740 14268 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:19.616829  9377 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:04:19.574792 14501 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:19.636845  9377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52562 (request call id 1987) took 1662 ms. Trace:
I20260709 13:04:19.637754  9377 rpcz_store.cc:276] 0709 13:04:17.974220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:17.974331 (+   111us) service_pool.cc:224] Handling call
0709 13:04:18.523130 (+548799us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b540026f820. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5864e1dc0 00007fb58656de18 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6
0709 13:04:19.466574 (+943444us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b540026f820. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5864e806f 00007fb586560f60 00007fb5865627de 00007fb58656e27c 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2
0709 13:04:19.636719 (+170145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308367616}
I20260709 13:04:19.554988 14510 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:19.574224 14451 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:19.640825  9522 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:04:19.645248 13984 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:04:19.654855  9521 raft_consensus.cc:2393] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 20: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:19.591936 14251 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:19.582418 14475 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:04:19.658624 14445 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:04:19.664081 14312 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:19.643375 14370 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:19.680008 14312 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:19.680496 14370 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:19.682380 14312 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:19.582662 14505 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:04:19.683815 14370 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:19.649046 14500 consensus_queue.cc:1243] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer d62c9d5a052b42ce8675f8438f846526 log is divergent from this leader: its last log entry 22.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:04:19.691635 14251 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:19.693591 14501 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:19.676498 14456 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:19.617610 14489 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:19.696194 14489 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:19.658875 14400 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.697259 14400 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:19.644611 14510 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:19.701278 14510 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:19.702270 14444 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:04:19.716831  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.617882 14269 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:19.668630 13984 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7.
I20260709 13:04:19.724370  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:19.725255  9447 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 11.
I20260709 13:04:19.726580 13906 raft_consensus.cc:493] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:19.727916 13906 raft_consensus.cc:515] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:19.461964  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:19.721798 14421 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:19.734987 14421 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:19.737342  9275 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 83) took 5465 ms. Trace:
I20260709 13:04:19.737776  9275 rpcz_store.cc:276] 0709 13:04:14.271918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.272090 (+   172us) service_pool.cc:224] Handling call
0709 13:04:19.737272 (+5465182us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:17.478644 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:17.619663 (+141019us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:17.619706 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:04:17.619728 (+    22us) tablet.cc:662] Decoding operations
0709 13:04:17.620508 (+   780us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:17.620617 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:17.620649 (+    32us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:04:17.621227 (+   578us) tablet.cc:701] Row locks acquired
0709 13:04:17.621257 (+    30us) write_op.cc:260] PREPARE: finished
0709 13:04:17.621418 (+   161us) write_op.cc:270] Start()
0709 13:04:17.621549 (+   131us) write_op.cc:276] Timestamp: P: 1783602257621360 usec, L: 0
0709 13:04:17.621574 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:04:17.622278 (+   704us) log.cc:844] Serialized 2084 byte log entry
0709 13:04:17.973257 (+350979us) op_driver.cc:464] REPLICATION: finished
0709 13:04:18.102454 (+129197us) write_op.cc:301] APPLY: starting
0709 13:04:18.108730 (+  6276us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:18.262454 (+153724us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:18.262570 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:18.325270 (+ 62700us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:18.470943 (+145673us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:04:18.483417 (+ 12474us) write_op.cc:312] APPLY: finished
0709 13:04:18.521968 (+ 38551us) log.cc:844] Serialized 57 byte log entry
0709 13:04:18.522170 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:18.522301 (+   131us) write_op.cc:454] Released schema lock
0709 13:04:18.522356 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:18.522810 (+   454us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:18.522843 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":135443,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":110855,"apply.run_cpu_time_us":16007,"apply.run_wall_time_us":435474,"cfile_cache_hit":22,"cfile_cache_hit_bytes":24977,"num_ops":5,"prepare.queue_time_us":222851,"prepare.run_cpu_time_us":89336,"prepare.run_wall_time_us":404827,"raft.queue_time_us":84550,"raft.run_cpu_time_us":11428,"raft.run_wall_time_us":73126,"replication_time_us":351505,"thread_start_us":466912,"threads_started":4,"wal-append.queue_time_us":237948,"wal-append.run_cpu_time_us":17526,"wal-append.run_wall_time_us":1664433}]]}
I20260709 13:04:19.743727  9418 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:04:19.743862  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.722278 14400 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:19.755389 14514 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:19.757412 14269 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:19.757917 13906 leader_election.cc:290] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:19.763278  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:19.763996  9443 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 19.
I20260709 13:04:19.765422  9444 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:04:19.765625  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.767457  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:19.768477  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:19.767447  9370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52548 (request call id 2110) took 1107 ms. Trace:
I20260709 13:04:19.770319  9370 rpcz_store.cc:276] 0709 13:04:18.659584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:18.659700 (+   116us) service_pool.cc:224] Handling call
0709 13:04:19.767277 (+1107577us) spinlock_profiling.cc:243] Waited 75.5 ms on lock 0x7b5400385c54. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656e2fa 00007fb58b52fb17 00007fb584aaa6d4 00007fb584aaa662 00007fb584aaa591 00007fb584aaa50c 00007fb584aa97c2 00007fb5848a548c 00007fb5848a48c6 00007fb5848a426f
0709 13:04:19.767388 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173706496}
I20260709 13:04:19.771404  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:19.773984  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:19.774274  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:19.774606  9377 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 19.
I20260709 13:04:19.773984  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:19.776844  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:19.777660  9443 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:04:19.779270  9444 raft_consensus.cc:1275] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:19.784443  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:19.786592 14315 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:19.786803 14444 raft_consensus.cc:493] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:19.787420 14444 raft_consensus.cc:515] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:19.788599 14386 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:19.789168 14386 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:19.791040  9519 raft_consensus.cc:1217] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Deduplicated request from leader. Original: 14.11->[16.12-16.12]   Dedup: 16.12->[]
I20260709 13:04:19.791594  9519 raft_consensus.cc:1240] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:04:19.791968  9490 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:19.794247  9490 leader_election.cc:400] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12.
I20260709 13:04:19.794649  9490 leader_election.cc:403] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:19.797039  9490 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:19.800379  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:19.800721 14444 leader_election.cc:290] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:19.801045 14386 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:19.799659 14448 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:19.801935 14448 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:19.802412 14448 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:19.799595 14501 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:19.798980 14456 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12.
I20260709 13:04:19.814361  9418 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:19.815127 14498 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 20 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:19.791481 14431 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.817803  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:19.818001  9519 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 22 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:04:19.818778  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:19.819372  9372 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 19.
I20260709 13:04:19.821038  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:19.823264  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:19.823547  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:19.824594  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:19.825151 14469 raft_consensus.cc:2804] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:19.827687 14469 raft_consensus.cc:697] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:19.829708  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:19.833950  9375 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 7.
I20260709 13:04:19.835168  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:19.828562 14469 consensus_queue.cc:237] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:19.843834  9371 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:04:19.816566 14431 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:19.848958  9490 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:19.864715 14510 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:19.852114 14440 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:04:19.870388 14144 raft_consensus.cc:3055] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:04:19.870890 14144 raft_consensus.cc:740] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:19.871845 14144 consensus_queue.cc:260] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:19.852563 14498 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:04:19.872943 14144 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:19.878682  9370 raft_consensus.cc:2393] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 17: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:19.854948  9418 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:19.891418  9418 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:19.897702  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:19.898437  9371 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 11.
I20260709 13:04:19.895229  9418 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:19.901844  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:04:19.891690  9490 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:19.912032  9418 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:19.721246 14475 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:19.891227 14510 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:19.905625 14440 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:19.899271 14315 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:19.894131 14431 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:19.927857  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.909301 14381 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:19.920517  9418 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:19.911902 14498 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:19.938220  9418 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:19.939286 14460 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:19.939998 14460 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:19.941553  9371 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:04:19.941831 14460 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:19.920267 14327 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:19.952123  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:19.953935  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:19.954267  9368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36e88678fcd042e78609b17fe3521242"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:19.955157  9368 raft_consensus.cc:606] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:19.955574  9368 raft_consensus.cc:614] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:19.956705  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:19.927870 14397 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:19.925158 14180 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:19.928542 14440 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.964289  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:19.937259 14421 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:19.913908 14457 consensus_queue.cc:1048] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:04:19.934513 14498 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:19.949870 14327 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.978744 14440 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:19.975059 14447 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:19.984688 14406 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:19.997507 14498 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:19.999441 14327 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:20.009467 14515 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:19.976794 14180 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:20.038618 14180 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:20.041611  9368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:20.041939 14448 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.042362  9368 raft_consensus.cc:606] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:20.047458  9368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:20.048139  9368 raft_consensus.cc:606] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:20.048573  9368 raft_consensus.cc:614] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:20.055565  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:20.057952 14475 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:20.044747 14448 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:20.061563  9368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:20.062312  9368 raft_consensus.cc:606] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:20.020287 14369 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:04:20.068015 14429 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.020431 14447 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:20.077513  9377 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 22 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:04:20.068806 14429 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.025745 14406 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:20.080457 14429 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:20.024379 14460 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:20.081607 14460 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:20.082279  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:20.083914 14460 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:20.093492 14515 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:20.080758 14406 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:20.102749 14447 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:20.065249  9368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:20.132834 14429 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:20.167352  9368 raft_consensus.cc:606] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:20.167791  9368 raft_consensus.cc:614] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:20.168538  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:20.169296  9450 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:04:20.170238  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:20.133083 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:20.135293  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:20.178467  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:20.179016  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:20.135942 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:04:20.136482  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 67463.8us
I20260709 13:04:20.140884 10025 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:04:20.145268  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.072767 13984 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:20.162859  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:20.181473  9370 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 10.
I20260709 13:04:20.176126  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:20.183753  9418 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:04:20.192358 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 228851us
I20260709 13:04:20.194984  9444 raft_consensus.cc:1217] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 22 LEADER]: Deduplicated request from leader. Original: 19.10->[21.11-21.11]   Dedup: 21.11->[]
I20260709 13:04:20.195554  9444 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 22 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:04:20.162493 14369 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:20.208125  9522 raft_consensus.cc:1275] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:20.210126  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:20.210813  9518 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:04:20.216265  9341 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:20.186643 14312 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:20.197340 14417 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:20.197983 14315 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:20.201853 14499 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:20.204128 14489 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:20.201764 14460 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:20.215351 14406 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:20.213073 14405 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:20.191639 13984 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:20.184223 14429 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:20.215713 14369 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.241792 14312 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:20.220053 14440 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.215926 14498 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.243026 14417 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.273316  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:20.256592  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:20.257108  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:20.258899  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:20.240630 14461 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:20.269840  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:20.266794  9371 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:04:20.252564 14327 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.256031 14501 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:20.277693  9522 raft_consensus.cc:2468] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 4.
I20260709 13:04:20.258565 14374 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:20.298944 14501 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.299607 14374 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.301855 14374 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:20.261209 14405 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.249389 14315 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.281093 14515 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:20.281502 14312 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:20.256814 14489 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.283493 14475 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:20.288652 14485 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:20.289183 13984 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:20.291769 14429 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:20.260506 14460 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.293493 14369 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:20.294260  9447 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 19. Current term is 20. Ops: []
I20260709 13:04:20.295245 14327 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 20 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:20.296283 14406 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:20.296861 14440 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 20 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:20.297587 14533 log.cc:927] Time spent T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:04:20.298429 14498 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:20.276057 14417 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:20.277405 14461 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:20.303040  9520 raft_consensus.cc:1217] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 22 FOLLOWER]: Deduplicated request from leader. Original: 19.10->[21.11-21.11]   Dedup: 21.11->[]
I20260709 13:04:20.353279 14461 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:20.353431  9520 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 22 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:04:20.297565  9446 raft_consensus.cc:2393] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 20: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:20.308758  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:20.313041 14405 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:20.315328 14315 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:20.322105  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:20.355916 13864 raft_consensus.cc:993] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:20.356451 13864 raft_consensus.cc:1081] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:20.329926 14432 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:20.362259 14432 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.362875 14510 raft_consensus.cc:993] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:20.363674 14510 raft_consensus.cc:1081] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:20.355952  9526 raft_consensus.cc:2393] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 20: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
W20260709 13:04:20.329982  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.374713 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:20.375155  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:20.375361 14460 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:20.378572  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:20.325084 14469 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:20.382061  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:20.326264 14501 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:20.323568 14339 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:20.329562  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:20.333266  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:20.386448  9418 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:04:20.401885  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:04:20.417411  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 75323.3us
I20260709 13:04:20.418810 14315 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:20.419307 14315 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:20.419730 14315 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:20.402837  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:20.423674  9446 raft_consensus.cc:1275] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:04:20.364873 14432 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:20.425489  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:20.426225  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:20.425335  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:20.331400 14475 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:20.331307 14485 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.433729 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:20.400029 14469 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.457137  9526 raft_consensus.cc:1275] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:20.437094 14374 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:20.465474 14374 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.466923 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:20.427392 14339 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:20.469830 14339 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:20.416587 14011 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:20.470578 14011 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:20.471073 14485 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:20.427644 14460 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:04:20.441524  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:20.442199  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:20.442443  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:20.443023  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:20.444042  9418 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:20.464502 14489 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:20.467813 14374 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:20.454790  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:20.483026  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:20.484467  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:20.484787  9446 raft_consensus.cc:1240] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:20.489490 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:20.490164 10067 raft_consensus.cc:2468] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 6.
I20260709 13:04:20.479987 14327 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:20.492156  9451 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:04:20.494566 14315 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:20.496968 14315 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:20.499781 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:20.498031  9274 catalog_manager.cc:5697] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:20.502624  9274 catalog_manager.cc:5697] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 11 to 14, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 14 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:20.504467  9274 catalog_manager.cc:5697] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 15 to 16, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 16 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:20.506395  9274 catalog_manager.cc:5697] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:20.507527 14475 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:20.508111  9274 catalog_manager.cc:5697] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 8 to 18. New cstate: current_term: 18 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:20.482870 14417 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:20.494692 14374 consensus_queue.cc:1059] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:04:20.511729  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:20.532269  9520 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:04:20.533586  9418 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:20.534629  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:04:20.509126 14537 log.cc:927] Time spent T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:04:20.525684  9417 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:20.480034 14499 consensus_queue.cc:1059] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:04:20.529579  9368 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:04:20.529906  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:20.545142  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:20.529579  9370 raft_consensus.cc:1275] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:20.530553  9374 raft_consensus.cc:1240] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:20.532356  9375 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:04:20.510641 14469 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:20.536574  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:20.546872  9373 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:04:20.546698  9274 catalog_manager.cc:5697] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 11 to 13, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 13 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:20.541880 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:20.548702  9274 catalog_manager.cc:5697] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 8 to 9, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 9 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:20.536325 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31a8af9a9a6948d584c9c4c96ee8c808" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:20.560031  9274 catalog_manager.cc:5697] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:20.493103 14489 consensus_queue.cc:1048] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:04:20.566876  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:20.566475  9274 catalog_manager.cc:5697] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 13 to 14, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 14 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:20.532928 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:20.571170  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:20.571509  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:20.542717 14315 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:20.553709 14369 raft_consensus.cc:2804] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:20.576046  9490 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:20.580798  9274 catalog_manager.cc:5697] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:20.582625 14403 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:20.585675  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:20.586380  9373 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:20.588649  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:20.589301  9375 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:20.576710 14315 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:20.591411  9274 catalog_manager.cc:5697] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 13 to 15, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 15 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:20.592289 14315 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:20.577329 10064 raft_consensus.cc:1240] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:20.576902 14498 raft_consensus.cc:3055] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:04:20.597563 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:20.598811 10069 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:04:20.580889 14011 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:20.577800 14369 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:20.602895  9274 catalog_manager.cc:5697] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 12 to 13, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 13 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:20.604550  9274 catalog_manager.cc:5697] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 13 to 14, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 14 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:20.587570 14403 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:20.608592  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:20.616824  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:20.620882  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:20.598242 14498 raft_consensus.cc:740] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:20.625447  9274 catalog_manager.cc:5697] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 12 to 13, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 13 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:20.631331  9375 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 20.
I20260709 13:04:20.605764 14369 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:20.635502  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:20.637660  9373 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 20.
I20260709 13:04:20.616909 14403 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:20.623383 14450 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:04:20.656083  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:20.659379  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:20.660954 14312 raft_consensus.cc:3055] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:20.661489 14312 raft_consensus.cc:740] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:20.662397 14312 consensus_queue.cc:260] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.663657 14312 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:20.672119  9452 raft_consensus.cc:1275] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:20.625337 14461 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:20.682209 10069 raft_consensus.cc:1240] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 12. Ops: []
I20260709 13:04:20.687079  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:20.698107 14417 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:20.698529  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:20.699612  9343 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:20.700798  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:20.711134  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:20.711145  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:20.712903  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:20.716320  9377 raft_consensus.cc:1240] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:20.715726  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:20.721536  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:20.723392  9274 catalog_manager.cc:5697] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 13 to 14, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 14 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:20.681571 14489 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.705693 14460 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.735121 14460 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.729336  9343 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:20.736881 10025 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:20.715456 14500 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:20.738170  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:20.740729  9343 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:20.734057 14369 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:20.766656  9450 raft_consensus.cc:1240] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:20.767638 14369 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:20.768285 14403 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:20.746779 14536 log.cc:927] Time spent T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.400s	user 0.004s	sys 0.004s
I20260709 13:04:20.747596 14461 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:20.785401  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:20.785878  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:20.787017 14432 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:04:20.787137  9418 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
W20260709 13:04:20.787726  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.789749 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:20.751559 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:20.790515 10027 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:20.757808 14499 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:20.757688 14475 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.713495 14442 consensus_queue.cc:1048] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:04:20.760291 14460 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:20.761183 14500 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:20.761413 14386 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:20.814857 14386 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.762435 14428 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:20.740015 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7260766fbe5c43b1aab09346a89d9ac6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:20.683660 14498 consensus_queue.cc:260] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.818848 14498 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:20.770128 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
W20260709 13:04:20.770939 14540 log.cc:927] Time spent T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:04:20.772150 14180 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:20.772969  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:20.773748  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:20.824368  9371 raft_consensus.cc:2393] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 11: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:20.777374  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:20.826705 14445 consensus_queue.cc:1059] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:20.827913 13984 raft_consensus.cc:3055] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:20.828298 13984 raft_consensus.cc:740] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:20.829174 13984 consensus_queue.cc:260] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:20.830240 13984 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:20.830736 14500 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:20.833106 14374 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:20.833659 14374 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.835270 14315 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.740890  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:20.783273  9274 catalog_manager.cc:5697] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:20.792479  9375 raft_consensus.cc:1275] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:20.837258  9447 raft_consensus.cc:1240] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:20.837453  9274 catalog_manager.cc:5697] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 4 to 5, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 5 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:20.839627  9274 catalog_manager.cc:5697] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 10 to 11, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 11 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:20.795441  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.804358 14400 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:20.809057 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:04:20.809588  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 68935.9us
I20260709 13:04:20.854367  9343 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:20.843269  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:20.809672 13906 consensus_queue.cc:1048] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:20.841621  9342 leader_election.cc:304] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:20.835819 14374 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:20.842125  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:20.844511  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:20.777652  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:20.845289  9491 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:20.864979  9368 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:20.865495  9523 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:04:20.858839  9274 catalog_manager.cc:5697] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 16 to 18, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 18 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:20.850504  9418 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:20.728695 14489 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.800272 14432 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.799857 14501 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:20.808367 14405 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:20.874646 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:20.878938  9418 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:20.883908  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:04:20.884960 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:20.880740 14432 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.880854 14501 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.879209 14405 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:20.861903 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:20.880723 13864 raft_consensus.cc:2804] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:20.808983 14475 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.808604 14499 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:20.880856 14460 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:20.880923 14528 consensus_queue.cc:1059] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:04:20.880687 14429 raft_consensus.cc:2749] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:20.889994 10027 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:20.892266 14405 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:20.896438 14475 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:20.879954 14374 raft_consensus.cc:2749] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:20.912055  9418 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:20.933419  9368 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 12.
I20260709 13:04:20.939976  9343 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:20.949939  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:20.952324  9418 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:20.965446 14440 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:20.968744  9418 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:20.896564 14489 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:20.887410 14469 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:04:20.913240 14369 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:20.893466 13864 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:20.898391 14499 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:20.876705 14474 consensus_queue.cc:1059] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:04:20.903661 14432 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:20.990263  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 145059us
W20260709 13:04:20.979503 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 64830.3us
I20260709 13:04:20.984488  9526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46894
I20260709 13:04:20.993791  9526 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:20.994180  9526 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:20.994482  9491 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:20.987718  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:20.988344  9521 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46894
I20260709 13:04:20.992165  9492 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:20.996112  9521 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:20.996527  9521 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:20.974419  9342 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:20.989363  9519 raft_consensus.cc:1275] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:04:20.997651  9519 pending_rounds.cc:85] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 9
I20260709 13:04:20.971459 14339 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:20.997983  9519 pending_rounds.cc:107] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:04:21.001823  9519 raft_consensus.cc:2889] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:20.999454  9342 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:21.000514  9418 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:20.984498 13864 raft_consensus.cc:3060] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:20.980007 14461 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:21.000926  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:21.015662  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:21.005321  9418 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:21.017364 14339 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:21.018400  9418 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:21.019510 14489 consensus_queue.cc:1048] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:21.008750  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:21.014185  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:21.021763 14489 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:21.005808 14469 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:21.028592  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:21.029652 14429 raft_consensus.cc:3055] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:21.030114 14429 raft_consensus.cc:740] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:21.030977 14429 consensus_queue.cc:260] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:21.031450  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:21.032172 14429 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:21.035851  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:21.037895  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:21.039588  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:21.043952  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:20.992667 14369 raft_consensus.cc:697] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 20 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:21.057468  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:04:21.061499  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.003908 14386 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:21.009891 14460 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:21.013835 14445 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:21.084075 13864 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:04:21.086596  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 92173.9us
I20260709 13:04:21.074859 14502 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:21.077826 14424 raft_consensus.cc:3055] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:21.102330 14405 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:21.090415 14448 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:21.087623  9491 leader_election.cc:304] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:21.090595 14374 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:04:21.174147  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 86645.6us
I20260709 13:04:21.176110  9491 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:21.176211  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:21.176483  9523 raft_consensus.cc:1240] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:21.089258 14315 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:21.125379  9526 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:21.178951  9522 raft_consensus.cc:1240] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:21.172405  9521 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:21.182646  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 190555us
I20260709 13:04:21.218561  9492 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:21.221560  9526 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:21.103772 14424 raft_consensus.cc:740] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:04:21.236661  9521 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:21.243431  9521 raft_consensus.cc:1240] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 14. Current term is 16. Ops: []
I20260709 13:04:21.233680  9525 raft_consensus.cc:1240] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:21.258800  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 73425.9us
I20260709 13:04:21.259063  9492 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:04:21.216753 14501 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:21.215879 14499 raft_consensus.cc:2804] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:21.184813 14457 raft_consensus.cc:2749] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:21.265353 14386 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:21.220887 14369 consensus_queue.cc:237] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:21.274297  9492 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:21.294028 14551 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:21.267592 14499 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:21.298314  9492 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:21.301992  9492 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:21.303314  9492 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:21.305366  9492 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:21.258251 14547 consensus_queue.cc:1059] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:04:21.287001 14448 raft_consensus.cc:2804] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:21.345767  9492 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:21.305155 14386 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:21.355332  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:21.302515 14499 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:21.325945 14312 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:21.322356 14498 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:21.328536 14551 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:21.291039 14555 consensus_queue.cc:1048] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
W20260709 13:04:21.368366  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:21.371449 14554 log.cc:927] Time spent T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:04:21.373739 14405 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:21.343063 14448 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:21.416280  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:21.417400  9452 raft_consensus.cc:1240] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:21.368135 14460 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:21.397979 14386 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:21.301949 14424 consensus_queue.cc:260] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:04:21.415834 14549 log.cc:927] Time spent T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.316s	user 0.000s	sys 0.001s
I20260709 13:04:21.406347 14551 raft_consensus.cc:697] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:21.433990  9375 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
I20260709 13:04:21.418821 14448 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:21.422386 14460 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:04:21.435472 14548 log.cc:927] Time spent T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.330s	user 0.001s	sys 0.000s
I20260709 13:04:21.453784  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:21.441273 14417 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:21.454695  9521 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
I20260709 13:04:21.445669 14460 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:21.449702 13984 consensus_meta.cc:287] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.619s	user 0.011s	sys 0.002s
I20260709 13:04:21.438309 14415 consensus_queue.cc:1059] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:04:21.450335 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
W20260709 13:04:21.473521  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 127850us
I20260709 13:04:21.475710  9492 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:21.485541  9492 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:21.489688  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:21.490549  9521 raft_consensus.cc:2393] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 15: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:21.491230 14475 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:21.479297 14369 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:21.497605 14369 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:21.488389 14567 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:21.507442 14563 raft_consensus.cc:3055] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:21.525628 14563 raft_consensus.cc:740] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:04:21.526614 14563 consensus_queue.cc:260] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:21.528064 14563 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:21.507586 14551 consensus_queue.cc:237] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:21.511175 13864 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:04:21.539726 14545 log.cc:927] Time spent T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.468s	user 0.009s	sys 0.006s
I20260709 13:04:21.501209 14369 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:21.556324  9371 raft_consensus.cc:1240] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:21.557569  9490 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:21.516382 14500 consensus_meta.cc:287] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.685s	user 0.001s	sys 0.011s
I20260709 13:04:21.571590  9490 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:21.517272 14403 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:21.582276  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:21.582890  9490 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:21.587481  9377 raft_consensus.cc:2393] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 12: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:04:21.590616  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:21.575726 14567 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:21.582926 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:21.585741 14475 raft_consensus.cc:2749] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:21.604949  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:21.589488  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:21.588748 14369 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:21.594199 14403 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:21.608469  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:21.610729  9452 raft_consensus.cc:2393] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 15: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:21.578205 14500 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:21.612835  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:21.613677  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:21.614280  9443 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:21.617762  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:21.618109  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:21.618678  9452 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:04:21.623955  9418 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:21.609774 14556 consensus_queue.cc:1059] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:04:21.610989 14369 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:21.635573 14405 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:21.661336 14405 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:21.661823 14405 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:21.666630 14500 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:21.671645  9452 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
I20260709 13:04:21.675912  9447 raft_consensus.cc:1240] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 14. Current term is 16. Ops: []
I20260709 13:04:21.676075 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:21.676630 14011 raft_consensus.cc:3055] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:21.631386 14374 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:04:21.626629 14448 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:21.680735  9343 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:21.702081  9517 raft_consensus.cc:1240] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:21.702600  9443 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:04:21.676994 14011 raft_consensus.cc:740] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:04:21.713887 14011 consensus_queue.cc:260] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:21.715509 14011 raft_consensus.cc:3060] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:21.705770 13864 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:21.711614 14448 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:04:21.712443 14574 log.cc:927] Time spent T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:04:21.719406 14457 raft_consensus.cc:3055] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:21.720110 14457 raft_consensus.cc:740] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:21.723670 14460 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:21.700897 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:21.740657 14457 consensus_queue.cc:260] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:21.742699 10061 raft_consensus.cc:2393] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 12: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:04:21.742842  9375 raft_consensus.cc:1240] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:21.743057 14457 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:21.765868 14399 consensus_queue.cc:1059] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:21.767252 14399 raft_consensus.cc:3055] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:21.767668 14399 raft_consensus.cc:740] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:04:21.746423 14369 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:21.768950 14399 consensus_queue.cc:260] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:04:21.753611  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 63225.4us
I20260709 13:04:21.770787 14399 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:21.769460 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:21.747191 14442 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:04:21.749522 14550 consensus_queue.cc:1059] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:04:21.774966 14556 raft_consensus.cc:3055] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:21.750324 14448 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:21.775437 14556 raft_consensus.cc:740] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:04:21.775673 14405 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:21.756662 14424 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:21.776690 14556 consensus_queue.cc:260] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:21.779315 14556 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:21.777226 14448 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:21.747705  9343 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:21.784655 14448 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:21.729067 14460 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:21.688412 14499 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:21.787739  9520 raft_consensus.cc:1240] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:21.743348 10025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.789819 14499 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:21.790880 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
W20260709 13:04:21.805572  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 57948.4us
I20260709 13:04:21.807337 14485 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:21.815143  9343 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:21.815343 14573 consensus_queue.cc:1059] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:21.817341 14429 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:21.817770 13984 raft_consensus.cc:3055] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:21.818171  9444 raft_consensus.cc:1240] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:21.818220 13984 raft_consensus.cc:740] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:21.818559 14429 consensus_queue.cc:1059] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:21.819633 14429 raft_consensus.cc:3055] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:21.819387 13984 consensus_queue.cc:260] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:21.820061 14429 raft_consensus.cc:740] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:21.822474 13984 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:04:21.825608  9343 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:21.828913 14570 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:21.829849 14447 consensus_queue.cc:1059] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:21.831085 14447 raft_consensus.cc:3055] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:21.831574 14447 raft_consensus.cc:740] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:21.820889 14429 consensus_queue.cc:260] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:21.832998 14429 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:21.832653 14447 consensus_queue.cc:260] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:21.837661 14447 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:21.838256 14405 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:21.842370  9343 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:21.843221 14485 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:21.845920 14457 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.846561 14457 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:21.853062 14457 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:21.854821 14485 consensus_queue.cc:1059] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:21.855674  9443 raft_consensus.cc:1240] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:21.856088 14570 raft_consensus.cc:3055] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:21.856496 14570 raft_consensus.cc:740] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:21.857326 14570 consensus_queue.cc:260] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:21.859295 14570 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:21.859757  9443 raft_consensus.cc:1240] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:21.862658  9444 raft_consensus.cc:1240] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:21.862871  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:21.863727  9375 raft_consensus.cc:2393] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 15: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:21.865621  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:04:21.866348  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 188828us
I20260709 13:04:21.867331  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:21.867492  9418 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:21.868937  9490 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:21.868327 14577 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:21.870918  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:21.880334 14457 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:21.890192  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:21.901453  9371 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:04:21.904773  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:21.907426  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:21.909122  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:21.911425  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:21.909860  9374 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 17.
I20260709 13:04:21.919700  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:21.919691  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:21.920447  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:21.919121  9490 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:21.923074  9492 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:21.923979  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:21.924454  9492 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:21.928000  9343 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:21.928860 14374 raft_consensus.cc:2749] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:21.929143 14499 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:21.929711 14499 raft_consensus.cc:697] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:21.930698 14499 consensus_queue.cc:237] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:21.931638  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:21.933558  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:21.934139  9517 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:21.935925  9492 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:21.936836 14501 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:21.929723 14374 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:21.922706  9490 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:21.947479  9517 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 17.
I20260709 13:04:21.951442  9518 raft_consensus.cc:1240] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:04:21.954813 14442 consensus_queue.cc:1059] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:21.959240  9418 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:21.952888 14457 raft_consensus.cc:2804] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:21.964068 14450 raft_consensus.cc:3055] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:21.967723 14450 raft_consensus.cc:740] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:21.969432 14315 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:21.969745 14450 consensus_queue.cc:260] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:21.971002 14450 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:21.971904  9492 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:21.973150 14374 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:21.973520 14374 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:21.973850 14374 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:21.966167 14175 consensus_queue.cc:1059] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.011s
W20260709 13:04:21.977205  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 49272.2us
I20260709 13:04:21.982290  9418 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:04:21.989580  9371 raft_consensus.cc:2468] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:04:21.979120 14457 raft_consensus.cc:697] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:21.988086 14175 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:21.998957  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:22.000550  9377 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:04:22.005365  9375 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
I20260709 13:04:21.999055  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:22.010376  9443 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 17.
I20260709 13:04:21.992599 14315 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:22.012271  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:22.013430 14577 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:22.010179 14328 raft_consensus.cc:3055] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:22.025545  9418 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:04:22.028064 14583 log.cc:927] Time spent T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:04:22.024513 14315 raft_consensus.cc:697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:22.030321 14315 consensus_queue.cc:237] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:22.031337 14515 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:22.044402  9492 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:04:22.042883 14432 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.051553 14432 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:22.024680 14328 raft_consensus.cc:740] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:22.050544 14448 raft_consensus.cc:2804] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:22.059252 14448 raft_consensus.cc:697] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:22.059152 14328 consensus_queue.cc:260] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:22.060289 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:22.060667 14328 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:22.064220  9418 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:22.056715 14432 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:04:22.070709 14582 log.cc:927] Time spent T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:04:22.071602  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:22.072284  9444 raft_consensus.cc:2468] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 7.
I20260709 13:04:22.063591 14577 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:22.074975 14440 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:22.075644 14440 raft_consensus.cc:697] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:22.076588 14440 consensus_queue.cc:237] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:22.083559  9490 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:22.067762 14457 consensus_queue.cc:237] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:22.085038 14501 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:22.089775  9518 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:04:22.090293  9518 pending_rounds.cc:85] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b: Aborting all ops after (but not including) 11
I20260709 13:04:22.090581  9518 pending_rounds.cc:107] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:04:22.090878  9518 raft_consensus.cc:2889] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:22.060283 14448 consensus_queue.cc:237] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:22.083060  9341 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: b0812463215649c3b011d36e2f0400c9
W20260709 13:04:22.094641 14584 log.cc:927] Time spent T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.057s	user 0.002s	sys 0.000s
I20260709 13:04:22.094951 14428 raft_consensus.cc:2804] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:22.095490 14428 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:22.095856 14428 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:22.119501  9451 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:04:22.121558  9368 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:04:22.123989 14571 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:22.150520 14374 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:22.162061 14374 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:22.153232 14405 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:22.165211  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:22.165863  9375 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:22.166899 14577 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:22.208964  9375 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 18.
W20260709 13:04:22.245617  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 92934us
I20260709 13:04:22.262920  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:22.263350  9492 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:22.263665  9444 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:22.275790  9444 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 18.
I20260709 13:04:22.266157 14457 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:22.256278 14428 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:22.296509 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:22.297286 10061 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:04:22.310292 14428 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:22.319357  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:22.325807  9452 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:22.281495 14450 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:22.327611 14457 raft_consensus.cc:697] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 18 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:22.317579 14501 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:04:22.350244 14556 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.353138 14556 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:22.358369  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:22.359048  9368 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 12.
I20260709 13:04:22.336514 14450 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:22.375406  9452 raft_consensus.cc:2468] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:04:22.376936  9341 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:22.385253  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:22.389719 14457 consensus_queue.cc:237] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:22.391688 14596 log.cc:927] Time spent T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:04:22.405933 14428 raft_consensus.cc:2804] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:22.420974 14428 raft_consensus.cc:697] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:22.426851 14428 consensus_queue.cc:237] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:22.429999  9452 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:04:22.424340 10061 raft_consensus.cc:2468] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 8.
I20260709 13:04:22.435343 14556 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:22.437163  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:22.438192  9522 raft_consensus.cc:2410] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:04:22.439622 10027 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:22.441043 14556 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:22.441107 14593 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:22.458534  9377 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:04:22.489966 14571 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:22.570029  9275 catalog_manager.cc:5697] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 9 to 10, leader changed from b0812463215649c3b011d36e2f0400c9 (127.8.4.68) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 10 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:22.571604  9275 catalog_manager.cc:5697] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:22.586165 14450 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:22.590103  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:04:22.590692 14597 log.cc:927] Time spent T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:04:22.621583  9377 raft_consensus.cc:1275] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:04:22.631227  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:22.644420  9341 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:22.646883  9375 raft_consensus.cc:1275] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:04:22.651587 14599 log.cc:927] Time spent T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.084s	user 0.003s	sys 0.001s
I20260709 13:04:22.655961 14445 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:22.657440 14460 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:22.657505  9450 raft_consensus.cc:1275] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:22.656155  9520 raft_consensus.cc:1275] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:04:22.662344 14604 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:22.662433 14515 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:22.683732  9375 raft_consensus.cc:1275] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:22.685451 14501 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:22.697093 10061 raft_consensus.cc:3060] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:22.700310  9375 raft_consensus.cc:1275] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:04:22.713524 14571 consensus_queue.cc:1048] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:04:22.767076 14606 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:04:22.797277  9451 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:04:22.801939 14606 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:04:22.827950 10061 raft_consensus.cc:1275] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:04:22.830133 14571 consensus_queue.cc:1048] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:22.864681  9520 raft_consensus.cc:1275] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:22.870476 14011 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.871162 14011 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:22.874976 14460 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:04:22.885474 14011 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:22.892321 14556 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.893599 14556 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:22.896986 14556 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:22.947142  9275 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 84) took 2975 ms. Trace:
I20260709 13:04:22.953980  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:22.957432  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:22.995476  9368 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 11.
I20260709 13:04:22.972221  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:22.974619  9450 raft_consensus.cc:1275] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:22.986527  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:22.998622  9447 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 11.
I20260709 13:04:22.991118  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:23.000398  9377 raft_consensus.cc:2468] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 5.
I20260709 13:04:23.019572 10025 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:23.028398 14424 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:23.030079 14424 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.030673 14424 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:23.067044 10027 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b
W20260709 13:04:23.044596  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 53562us
I20260709 13:04:22.994201  9275 rpcz_store.cc:276] 0709 13:04:19.972007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:19.977275 (+  5268us) service_pool.cc:224] Handling call
0709 13:04:22.946736 (+2969461us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:22.674344 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:22.675100 (+   756us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:22.675145 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:04:22.675170 (+    25us) tablet.cc:662] Decoding operations
0709 13:04:22.675709 (+   539us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:22.675803 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:22.675844 (+    41us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:04:22.676408 (+   564us) tablet.cc:701] Row locks acquired
0709 13:04:22.676434 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:04:22.676619 (+   185us) write_op.cc:270] Start()
0709 13:04:22.676826 (+   207us) write_op.cc:276] Timestamp: P: 1783602262676566 usec, L: 0
0709 13:04:22.676856 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:04:22.687160 (+ 10304us) log.cc:844] Serialized 901 byte log entry
0709 13:04:22.753713 (+ 66553us) op_driver.cc:464] REPLICATION: finished
0709 13:04:22.754172 (+   459us) write_op.cc:301] APPLY: starting
0709 13:04:22.754269 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:22.782107 (+ 27838us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:22.782245 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:22.783991 (+  1746us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:22.784229 (+   238us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:04:22.784299 (+    70us) write_op.cc:312] APPLY: finished
0709 13:04:22.784552 (+   253us) log.cc:844] Serialized 33 byte log entry
0709 13:04:22.784759 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:22.784847 (+    88us) write_op.cc:454] Released schema lock
0709 13:04:22.784891 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:22.813288 (+ 28397us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:22.814258 (+   970us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":156677,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":118,"apply.run_cpu_time_us":5675,"apply.run_wall_time_us":45565,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8340,"num_ops":2,"prepare.queue_time_us":86547,"prepare.run_cpu_time_us":3968,"prepare.run_wall_time_us":13191,"replication_time_us":76688,"thread_start_us":58570,"threads_started":1}]]}
I20260709 13:04:23.085978  9375 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:04:23.056020 13864 consensus_queue.cc:1048] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:04:23.093362 14571 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:23.094442 14571 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:23.112739 14556 raft_consensus.cc:2804] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:23.113479 14556 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.113998 14556 raft_consensus.cc:3060] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:23.135560 10064 raft_consensus.cc:1275] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:23.142890 14485 consensus_queue.cc:1048] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:23.183820 14550 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.184631 14550 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:23.185279 14424 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:23.189240 14424 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:23.189831 14550 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:23.206930  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:23.212531  9518 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 8.
I20260709 13:04:23.214515 10027 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:23.214524  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:23.215822  9369 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 9.
W20260709 13:04:23.218119  9274 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43244 (request call id 188) took 11328 ms (client timeout 15000 ms). Trace:
I20260709 13:04:23.227596 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:23.229041 14424 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:23.230069 14424 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.229230 14328 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:23.230727 14424 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:23.233656 14328 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:23.230486 14571 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:04:23.230012 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 210841us
I20260709 13:04:23.246030  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:23.251565  9377 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:23.208832 14550 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.272951 14457 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:23.282657  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:23.284684  9444 raft_consensus.cc:3060] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:23.218703  9274 rpcz_store.cc:269] 0709 13:04:11.889728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.889936 (+   208us) service_pool.cc:224] Handling call
0709 13:04:23.217874 (+11327938us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:21.448379 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:21.468048 (+ 19669us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:21.468094 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:04:21.468116 (+    22us) tablet.cc:662] Decoding operations
0709 13:04:21.535713 (+ 67597us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:21.535769 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:21.535796 (+    27us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:04:21.537162 (+  1366us) tablet.cc:701] Row locks acquired
0709 13:04:21.537184 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:04:21.537384 (+   200us) write_op.cc:270] Start()
0709 13:04:21.537562 (+   178us) write_op.cc:276] Timestamp: P: 1783602261537327 usec, L: 0
0709 13:04:21.537583 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:04:21.538933 (+  1350us) log.cc:844] Serialized 7355 byte log entry
0709 13:04:21.954184 (+415251us) op_driver.cc:464] REPLICATION: finished
0709 13:04:22.034811 (+ 80627us) spinlock_profiling.cc:243] Waited 6.21 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb5834600ac 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb589fa0ef0
0709 13:04:22.113976 (+ 79165us) write_op.cc:301] APPLY: starting
0709 13:04:22.117044 (+  3068us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:22.163595 (+ 46551us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:22.163630 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:22.408243 (+244613us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:22.408541 (+   298us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:04:22.408588 (+    47us) write_op.cc:312] APPLY: finished
0709 13:04:22.408975 (+   387us) log.cc:844] Serialized 172 byte log entry
0709 13:04:22.409175 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:22.409357 (+   182us) write_op.cc:454] Released schema lock
0709 13:04:22.409413 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:22.413364 (+  3951us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:22.413395 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":142636,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":156790,"apply.run_cpu_time_us":29629,"apply.run_wall_time_us":299393,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83357,"num_ops":19,"prepare.queue_time_us":416260,"prepare.run_cpu_time_us":12596,"prepare.run_wall_time_us":189880,"raft.queue_time_us":299138,"raft.run_cpu_time_us":34953,"raft.run_wall_time_us":129251,"replication_time_us":416454,"spinlock_wait_cycles":14283136,"thread_start_us":739370,"threads_started":5,"wal-append.queue_time_us":92274}]]}
I20260709 13:04:23.302981 14606 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.306984 14328 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:23.307156 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:23.307678 14405 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:23.313257  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:23.313112 14550 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:23.331110 14011 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.336383 14457 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.336099 14424 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:23.346243  9371 raft_consensus.cc:2393] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 5: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:23.349483 14457 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:23.358693 14405 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:23.361306 14606 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:23.362393  9273 catalog_manager.cc:5697] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:23.365927 14011 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:23.366554 14550 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:23.367255 10063 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
I20260709 13:04:23.372223  9342 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:23.365375 14424 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:23.383244 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 56711.6us
I20260709 13:04:23.391074  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:23.391865  9369 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:23.392485  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:23.396219 14429 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:23.396801 14429 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:23.396975  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:23.397400 14429 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:23.397982  9517 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 10.
I20260709 13:04:23.399353  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:23.400071  9523 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:04:23.402711  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:23.403502  9368 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 9.
I20260709 13:04:23.406071  9444 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 12.
I20260709 13:04:23.411532  9369 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 10.
I20260709 13:04:23.415781 10027 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:23.418159 14550 raft_consensus.cc:2804] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:23.418660 14550 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.419097 14550 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:23.420804 14405 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:23.425529 14606 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:23.427053 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:23.428071 10063 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:04:23.432880 14457 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:23.448364  9273 catalog_manager.cc:5697] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 13 to 14, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 14 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:23.451579  9273 catalog_manager.cc:5697] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 19 to 21, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 21 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:23.457350 14011 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:23.494115  9273 catalog_manager.cc:5697] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 13 to 15, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 15 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:23.474774 14328 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.478413 14556 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:04:23.487835  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 48727.6us
I20260709 13:04:23.490911 14448 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:04:23.463974 14621 log.cc:927] Time spent T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:04:23.502187  9377 raft_consensus.cc:2468] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 12.
W20260709 13:04:23.490424 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 73453.1us
I20260709 13:04:23.504446 14448 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:23.505266 10027 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:23.507234 14448 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:23.514257 14011 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:23.516373 14328 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:23.517174 14011 raft_consensus.cc:697] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 10 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:04:23.518433 14011 consensus_queue.cc:237] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:23.519433 14328 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:23.521469  9523 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 10.
I20260709 13:04:23.527318 10067 raft_consensus.cc:2368] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6.
I20260709 13:04:23.507992 14429 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:23.499297 14405 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.540503 10027 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:23.551733  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:23.552490  9368 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:04:23.553437  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:23.554293  9447 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:04:23.555205  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:23.555845  9368 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:04:23.556154  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:23.556813  9447 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:04:23.557998 14550 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:23.559049  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:23.560009  9368 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:04:23.563056  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:23.563939  9444 raft_consensus.cc:2393] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 13: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:23.566579 14405 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:23.569559  9492 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:23.570621 14448 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:23.571211 14448 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.571681 14448 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:23.571861  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:23.572682  9518 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
I20260709 13:04:23.577795  9492 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:23.578835 14386 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:23.579268 14386 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.579669 14386 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:23.582434 14405 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:23.584643 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:04:23.586076 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 45636.7us
I20260709 13:04:23.576948  9273 catalog_manager.cc:5697] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 16 to 18, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 18 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:23.585610 10064 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:04:23.589484  9374 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 14.
I20260709 13:04:23.595821  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:23.596011 14624 raft_consensus.cc:2804] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:23.596541  9370 raft_consensus.cc:3060] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:23.596650 14624 raft_consensus.cc:697] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 12 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:04:23.598380 14624 consensus_queue.cc:237] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:23.598948 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:23.600912  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:23.601887  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:23.602487  9377 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:04:23.605126 14429 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:23.609906  9417 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:23.593288  9492 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:23.617472  9377 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 11.
I20260709 13:04:23.617056  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:23.619686  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:23.622136 14457 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:23.622699 14457 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:23.622886  9343 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:23.623124 14457 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:23.629784  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:23.624961 14175 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:23.619295 10027 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:23.635999  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:23.637180 10027 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:23.634928 14175 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.640375 14175 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:23.645732  9491 leader_election.cc:400] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Vote denied by peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623) with higher term. Message: Invalid argument: T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6.
I20260709 13:04:23.646131  9491 leader_election.cc:403] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:23.646828 14626 raft_consensus.cc:2804] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:23.647507  9370 raft_consensus.cc:2468] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 6.
I20260709 13:04:23.647855 14626 raft_consensus.cc:697] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 11 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:04:23.650467 14457 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:23.652227 14556 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:23.656355 14175 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:23.639281  9273 catalog_manager.cc:5697] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 13 to 16, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 16 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:23.662226 14374 raft_consensus.cc:3060] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:04:23.663086 10063 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
I20260709 13:04:23.669919 14550 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:23.674711  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:23.689384  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:23.689807 14424 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:23.692039 14424 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.692468 14424 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:23.698685 14386 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:23.699962  9519 raft_consensus.cc:2368] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 14. Current term is 15.
I20260709 13:04:23.616804 14405 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:23.678850  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:23.680999 14457 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:23.682176  9368 raft_consensus.cc:2368] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 14. Current term is 15.
I20260709 13:04:23.681643 14175 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:23.704286 14448 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:23.708585  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:23.709756  9517 raft_consensus.cc:3060] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:23.719429  9342 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:23.720328 14175 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:23.709662 10027 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:23.710413  9447 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 14.
I20260709 13:04:23.712689  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:23.713958 14626 consensus_queue.cc:237] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:23.682706  9273 catalog_manager.cc:5697] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 11 to 15, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 15 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:23.716521  9374 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:04:23.721325  9418 leader_election.cc:400] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 14. Current term is 15.
I20260709 13:04:23.727470  9418 leader_election.cc:403] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:23.722252  9370 raft_consensus.cc:2393] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 15: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:23.723213  9520 raft_consensus.cc:2393] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 15: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:23.724377 14175 raft_consensus.cc:697] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:23.724977 14556 raft_consensus.cc:2804] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:23.729367  9517 raft_consensus.cc:2468] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 11.
I20260709 13:04:23.733888 14175 consensus_queue.cc:237] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:23.734953  9492 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:23.737963 14457 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:23.735800 14556 raft_consensus.cc:697] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 6 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:04:23.736207  9273 catalog_manager.cc:5697] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:23.739831 14556 consensus_queue.cc:237] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:23.740684  9273 catalog_manager.cc:5697] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 12 to 14, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 14 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:23.726861 14405 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.738538 14457 raft_consensus.cc:697] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:23.745360 14405 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:23.746013 14457 consensus_queue.cc:237] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:23.749622 14374 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623) with higher term. Message: Invalid argument: T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 5. Current term is 6.
I20260709 13:04:23.750243  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:23.751030  9447 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:04:23.744441  9273 catalog_manager.cc:5697] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 9 to 10, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 10 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:23.756597  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:23.725859 14424 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:23.764905  9523 raft_consensus.cc:2468] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 6.
I20260709 13:04:23.719489 14386 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:23.776252 14369 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:04:23.782209  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:23.773383  9273 catalog_manager.cc:5697] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 15 to 16, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 16 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:23.789826  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:23.790545  9374 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:23.790289  9273 catalog_manager.cc:5697] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 14 to 15, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 15 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:23.826287  9374 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
W20260709 13:04:23.841688  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 69646.4us
I20260709 13:04:23.846740  9418 leader_election.cc:400] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 14. Current term is 15.
I20260709 13:04:23.853866  9273 catalog_manager.cc:5697] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 14 to 15, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 15 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:23.866405  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:23.872053 14440 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.872747 14440 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:23.875325 14440 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:23.879364 14405 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:23.880623  9444 raft_consensus.cc:2368] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 14. Current term is 15.
I20260709 13:04:23.881964 14424 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:23.881289  9273 catalog_manager.cc:5697] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 14 to 16, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 16 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:23.883162  9273 catalog_manager.cc:5697] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 15 to 17, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 17 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:23.883905  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:23.859458 14448 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:23.885759 10025 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:23.876731 14369 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 14. Current term is 15.
I20260709 13:04:23.902906  9273 catalog_manager.cc:5697] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:23.907917 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:23.908671 10063 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:23.893887 14424 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:23.941999 14405 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:23.944068 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:23.946588  9341 leader_election.cc:400] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 14. Current term is 15.
I20260709 13:04:23.968880 10063 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:04:23.970389  9491 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:23.975986 14448 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:23.976631 14448 raft_consensus.cc:697] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:23.977087 10067 raft_consensus.cc:2393] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 15: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:04:23.979651 14448 consensus_queue.cc:237] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:24.003584  9519 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:04:24.005259 14424 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:24.012171  9450 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
I20260709 13:04:24.026767  9273 catalog_manager.cc:5697] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 10 to 13, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 13 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:24.038192  9273 catalog_manager.cc:5697] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:24.040042  9273 catalog_manager.cc:5697] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:24.043620  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:24.044958  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:24.045936  9444 raft_consensus.cc:2393] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 15: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:24.044978  9450 raft_consensus.cc:2393] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 13: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:24.055375  9273 catalog_manager.cc:5697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 11 to 14, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 14 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:24.050150  9341 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:04:24.061076  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:24.061794  9451 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:24.077073  9368 raft_consensus.cc:1275] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:24.057327  9273 catalog_manager.cc:5697] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:24.092309  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:24.093348  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:24.092892  9375 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:04:24.096751 14550 consensus_queue.cc:1048] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:24.107184  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:24.107544  9452 raft_consensus.cc:1275] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:24.109747 14442 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:24.109912 14626 consensus_queue.cc:1048] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:24.110394 14442 raft_consensus.cc:697] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:24.115214  9451 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:04:24.115234 14442 consensus_queue.cc:237] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:24.132586  9375 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:04:24.134022 14424 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:24.152493  9490 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:24.153491 14448 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:24.201484  9520 raft_consensus.cc:1275] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:24.203153 14556 consensus_queue.cc:1048] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:24.205940 10067 raft_consensus.cc:1240] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:24.208223 14328 consensus_queue.cc:1059] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:24.209236 14328 raft_consensus.cc:3055] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:24.209610 14328 raft_consensus.cc:740] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:24.210556 14328 consensus_queue.cc:260] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:24.211894 14328 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:24.280329  9377 raft_consensus.cc:1275] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:24.291239 14556 consensus_queue.cc:1048] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 13:04:24.318979  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 51866.8us
I20260709 13:04:24.352458  9520 raft_consensus.cc:1275] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:04:24.365556 14550 consensus_queue.cc:1048] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:24.369918  9368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e30c155cba64357ae275b3366772777"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:24.370873  9368 raft_consensus.cc:606] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:24.391562  9369 raft_consensus.cc:1275] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:04:24.421634  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 155035us
I20260709 13:04:24.424701  9371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36e88678fcd042e78609b17fe3521242"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:24.424887  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:04:24.425434  9371 raft_consensus.cc:606] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:24.425873  9371 raft_consensus.cc:614] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:24.426065 14650 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:24.427242 14650 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:24.428823  9418 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:24.427682 14650 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:24.432555  9369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:24.433329  9369 raft_consensus.cc:606] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:24.441463  9371 raft_consensus.cc:1275] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:24.437325 14632 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:24.418388 14550 consensus_queue.cc:1048] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:04:24.460397  9444 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:04:24.461277  9444 raft_consensus.cc:606] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:24.462093 14646 consensus_queue.cc:1048] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:24.536428  9369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:24.537163  9369 raft_consensus.cc:606] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:24.542881 14650 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:24.545885 14650 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:24.543185 10067 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:04:24.549805  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:24.552465  9374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:24.553180  9374 raft_consensus.cc:606] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:24.553617  9374 raft_consensus.cc:614] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:24.556432  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:04:24.558297  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:24.562878 14648 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:24.569777  9374 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:04:24.570706  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:24.585978  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:24.586452 14374 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:24.587059 14405 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:24.601858  9444 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:24.605149 14442 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:24.622251  9522 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:24.644111 14633 raft_consensus.cc:993] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:24.644670 14633 raft_consensus.cc:1081] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:24.647823  9522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46902
I20260709 13:04:24.648841  9522 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.649428  9522 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:24.654939  9444 raft_consensus.cc:1240] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:24.657778  9444 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:04:24.666638 14428 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:24.669193 14328 raft_consensus.cc:993] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:24.669785 14328 raft_consensus.cc:993] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:24.670300 14328 raft_consensus.cc:1081] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:24.671231 14328 raft_consensus.cc:1081] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:24.684688 14445 raft_consensus.cc:993] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:24.685738 14442 raft_consensus.cc:1081] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
W20260709 13:04:24.709159  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 49938.6us
I20260709 13:04:24.715094 14648 consensus_queue.cc:1059] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:24.715958 14374 raft_consensus.cc:3055] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:24.716437 14374 raft_consensus.cc:740] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:24.717587 14648 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:24.717442 14374 consensus_queue.cc:260] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:24.723151  9524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e30c155cba64357ae275b3366772777"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46894
I20260709 13:04:24.723801  9524 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.724180  9524 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:24.728240  9518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46894
I20260709 13:04:24.733755  9518 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.734246  9518 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:24.736510 14374 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:24.741544  9520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46894
I20260709 13:04:24.742189  9520 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.742551  9520 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:24.755674  9524 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:24.755842  9520 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:24.741500  9522 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:24.766736  9524 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:24.767903  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:24.775041  9373 raft_consensus.cc:3055] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:24.775434  9373 raft_consensus.cc:740] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:24.776216  9373 consensus_queue.cc:260] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:24.777420  9373 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:24.760286  9518 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:24.779321  9518 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:24.771377  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:24.769863  9522 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:24.780879  9374 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:24.768114  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:24.780046  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:24.766776  9520 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:24.784425  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:24.785131  9444 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:24.787254  9371 raft_consensus.cc:3055] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:24.787635  9371 raft_consensus.cc:740] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:24.788399  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:24.788565  9371 consensus_queue.cc:260] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:24.789306  9446 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:24.789979  9371 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:24.792948  9370 raft_consensus.cc:3055] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:24.793375  9370 raft_consensus.cc:740] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:24.794173  9370 consensus_queue.cc:260] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:24.795423  9370 raft_consensus.cc:3060] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:24.798527  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:24.799173  9447 raft_consensus.cc:3055] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:24.799458  9447 raft_consensus.cc:740] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:24.800377  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:24.800233  9447 consensus_queue.cc:260] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:24.801064  9450 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:24.801602  9447 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:24.810917  9447 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:04:24.799186  9446 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:04:24.817406  9490 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:24.819088 14374 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:24.819645 14374 raft_consensus.cc:697] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:24.820801 14374 consensus_queue.cc:237] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:24.823076  9274 catalog_manager.cc:5697] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 10 to 11, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 11 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:24.824642  9450 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:04:24.824667  9274 catalog_manager.cc:5697] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:24.830174  9444 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:04:24.830698  9490 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:24.832597 14648 raft_consensus.cc:2804] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:24.832737  9374 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:04:24.833174 14648 raft_consensus.cc:697] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:24.834091 14648 consensus_queue.cc:237] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:24.837913  9370 raft_consensus.cc:2468] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:04:24.828547  9274 catalog_manager.cc:5697] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:24.856197  9371 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:04:24.850087  9373 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:04:24.845961  9490 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:24.870581  9492 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:24.871824 14649 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:24.870592 14374 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:24.872852 14374 raft_consensus.cc:697] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:24.872452 14649 raft_consensus.cc:697] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:24.873838 14374 consensus_queue.cc:237] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:24.875123 14649 consensus_queue.cc:237] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:24.923581  9274 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 85) took 1220 ms. Trace:
I20260709 13:04:24.926136  9274 rpcz_store.cc:276] 0709 13:04:23.703056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.703394 (+   338us) service_pool.cc:224] Handling call
0709 13:04:24.923488 (+1220094us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:24.859454 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:24.860026 (+   572us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:24.860068 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:04:24.860090 (+    22us) tablet.cc:662] Decoding operations
0709 13:04:24.860680 (+   590us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:24.860745 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:24.860779 (+    34us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:04:24.861237 (+   458us) tablet.cc:701] Row locks acquired
0709 13:04:24.861273 (+    36us) write_op.cc:260] PREPARE: finished
0709 13:04:24.861461 (+   188us) write_op.cc:270] Start()
0709 13:04:24.861576 (+   115us) write_op.cc:276] Timestamp: P: 1783602264861408 usec, L: 0
0709 13:04:24.861600 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:04:24.862257 (+   657us) log.cc:844] Serialized 1275 byte log entry
0709 13:04:24.864610 (+  2353us) op_driver.cc:464] REPLICATION: finished
0709 13:04:24.865219 (+   609us) write_op.cc:301] APPLY: starting
0709 13:04:24.865336 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:24.867487 (+  2151us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:24.867587 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:24.874552 (+  6965us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:24.874801 (+   249us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:04:24.874850 (+    49us) write_op.cc:312] APPLY: finished
0709 13:04:24.875110 (+   260us) log.cc:844] Serialized 41 byte log entry
0709 13:04:24.877883 (+  2773us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:24.877989 (+   106us) write_op.cc:454] Released schema lock
0709 13:04:24.878045 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:24.878453 (+   408us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:24.878481 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12320,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":321,"apply.run_cpu_time_us":5939,"apply.run_wall_time_us":13191,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12510,"num_ops":3,"prepare.queue_time_us":130,"prepare.run_cpu_time_us":3168,"prepare.run_wall_time_us":16536,"replication_time_us":2835}]]}
I20260709 13:04:24.966610  9271 catalog_manager.cc:5697] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 8 to 9, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 9 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:24.983726  9262 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 99c4416401f2427a9f7e68b64ec6915e with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 925acbe78db14db3b9e4cfc857717947 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:24.984263  9273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43240 (request call id 183) took 7686 ms. Trace:
I20260709 13:04:24.992975  9273 rpcz_store.cc:276] 0709 13:04:17.298160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:17.305712 (+  7552us) service_pool.cc:224] Handling call
0709 13:04:18.603523 (+1297811us) spinlock_profiling.cc:243] Waited 95.4 ms on lock 0x7b540016e4d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d4090 00007fb586572f3a 00007fb58c3291cc 00007fb58c42737e 00007fb58a8e82a4 00007fb58a8e8232 00007fb58a8e8161 00007fb58a8e80dc 00007fb58a8e7392 00007fb5848a548c 00007fb5848a48c6
0709 13:04:24.984186 (+6380663us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:24.330426 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:24.331096 (+   670us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:24.331213 (+   117us) write_op.cc:435] Acquired schema lock
0709 13:04:24.331232 (+    19us) tablet.cc:662] Decoding operations
0709 13:04:24.358983 (+ 27751us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:24.408545 (+ 49562us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:24.410863 (+  2318us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:04:24.431420 (+ 20557us) tablet.cc:701] Row locks acquired
0709 13:04:24.431486 (+    66us) write_op.cc:260] PREPARE: finished
0709 13:04:24.431896 (+   410us) write_op.cc:270] Start()
0709 13:04:24.432079 (+   183us) write_op.cc:276] Timestamp: P: 1783602264431659 usec, L: 0
0709 13:04:24.432128 (+    49us) op_driver.cc:348] REPLICATION: starting
0709 13:04:24.438119 (+  5991us) log.cc:844] Serialized 8105 byte log entry
0709 13:04:24.633665 (+195546us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b540016ea20. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb5864dfdbe 00007fb5864ea930 00007fb5864ea8d8 00007fb5864ea858 00007fb5864ea813 00007fb5864e9a9c 00007fb58c3d5626 00007fb58c3cfdd8 00007fb5865267cb 00007fb5865292c0
0709 13:04:24.709282 (+ 75617us) op_driver.cc:464] REPLICATION: finished
0709 13:04:24.719667 (+ 10385us) write_op.cc:301] APPLY: starting
0709 13:04:24.719778 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:24.725415 (+  5637us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b540016e4d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656732a 00007fb5864ecf14 00007fb5864ecec3 00007fb5864ece38 00007fb5864ecdf3 00007fb5864ec0dc 00007fb586515e16 00007fb5864fdcbb 00007fb5864e839d 00007fb5864ebd75
0709 13:04:24.751871 (+ 26456us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:24.751915 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:24.786201 (+ 34286us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:24.786713 (+   512us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:04:24.786795 (+    82us) write_op.cc:312] APPLY: finished
0709 13:04:24.787342 (+   547us) log.cc:844] Serialized 188 byte log entry
0709 13:04:24.813280 (+ 25938us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:24.813489 (+   209us) write_op.cc:454] Released schema lock
0709 13:04:24.813584 (+    95us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:24.820842 (+  7258us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:24.820882 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1120140,"reported_tablets":54,"spinlock_wait_cycles":219534720,"child_traces":[["op",{"apply.queue_time_us":10119,"apply.run_cpu_time_us":27516,"apply.run_wall_time_us":101150,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91697,"num_ops":21,"prepare.queue_time_us":70923,"prepare.run_cpu_time_us":17497,"prepare.run_wall_time_us":253178,"raft.queue_time_us":61468,"raft.run_cpu_time_us":5082,"raft.run_wall_time_us":28368,"replication_time_us":276956,"spinlock_wait_cycles":101303552,"thread_start_us":112061,"threads_started":4,"wal-append.queue_time_us":70535}]]}
I20260709 13:04:25.029356  9274 catalog_manager.cc:5697] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 10 to 13, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 13 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:25.031622  9274 catalog_manager.cc:5697] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:25.068358  9274 catalog_manager.cc:5697] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:25.070071  9274 catalog_manager.cc:5697] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:25.087553  9271 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43252 (request call id 171) took 13348 ms (client timeout 15000 ms). Trace:
I20260709 13:04:25.108742  9275 catalog_manager.cc:5697] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 16 to 17, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 17 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:25.112792  9275 catalog_manager.cc:5697] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:25.114702  9275 catalog_manager.cc:5697] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 18 to 20, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 20 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:25.116779  9275 catalog_manager.cc:5697] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:25.119238  9275 catalog_manager.cc:5697] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 21 to 22, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 22 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:25.088119  9271 rpcz_store.cc:269] 0709 13:04:11.739549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.739780 (+   231us) service_pool.cc:224] Handling call
0709 13:04:25.087468 (+13347688us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:24.982775 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:24.983303 (+   528us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:24.983344 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:04:24.983361 (+    17us) tablet.cc:662] Decoding operations
0709 13:04:24.983703 (+   342us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:24.983772 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:24.983813 (+    41us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:24.984052 (+   239us) tablet.cc:701] Row locks acquired
0709 13:04:24.984072 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:04:24.984239 (+   167us) write_op.cc:270] Start()
0709 13:04:24.984361 (+   122us) write_op.cc:276] Timestamp: P: 1783602264984184 usec, L: 0
0709 13:04:24.984383 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:04:24.987294 (+  2911us) log.cc:844] Serialized 532 byte log entry
0709 13:04:24.989114 (+  1820us) op_driver.cc:464] REPLICATION: finished
0709 13:04:24.997250 (+  8136us) write_op.cc:301] APPLY: starting
0709 13:04:24.997334 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:24.998321 (+   987us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:24.998427 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:24.999292 (+   865us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:24.999487 (+   195us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:04:24.999535 (+    48us) write_op.cc:312] APPLY: finished
0709 13:04:24.999741 (+   206us) log.cc:844] Serialized 25 byte log entry
0709 13:04:24.999924 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:25.000012 (+    88us) write_op.cc:454] Released schema lock
0709 13:04:25.000056 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:25.000578 (+   522us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:25.000611 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":280399,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":7838,"apply.run_cpu_time_us":3276,"apply.run_wall_time_us":3275,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4170,"num_ops":1,"prepare.queue_time_us":207,"prepare.run_cpu_time_us":2585,"prepare.run_wall_time_us":4815,"replication_time_us":4559}]]}
I20260709 13:04:25.124503  9275 catalog_manager.cc:5697] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:25.126785  9275 catalog_manager.cc:5697] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:25.129036  9275 catalog_manager.cc:5697] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 14 to 16, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 16 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:25.130374  9275 catalog_manager.cc:5697] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 10 to 11, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 11 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:25.132040  9275 catalog_manager.cc:5697] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 13 to 16, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 16 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:25.136260  9275 catalog_manager.cc:5697] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:25.139446  9275 catalog_manager.cc:5697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 14 to 15, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 15 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:25.147334  9275 catalog_manager.cc:5697] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 13 to 14, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 14 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:25.148959  9275 catalog_manager.cc:5697] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 11 to 13, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 13 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:25.150450  9275 catalog_manager.cc:5697] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 17 to 18, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 18 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:25.153517  9275 catalog_manager.cc:5697] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 18 to 20, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 20 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:25.210774  9517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e"
dest_uuid: "6d50f1c263264b21919230bee398022b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54524
I20260709 13:04:25.211453  9517 raft_consensus.cc:606] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Received request to transfer leadership
W20260709 13:04:25.217383  9262 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leader transfer in progress [suppressed 4 similar messages]
I20260709 13:04:25.246194 14649 raft_consensus.cc:993] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b: : Instructing follower b0812463215649c3b011d36e2f0400c9 to start an election
I20260709 13:04:25.246833 14374 raft_consensus.cc:1081] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Signalling peer b0812463215649c3b011d36e2f0400c9 to start an election
I20260709 13:04:25.265431 10067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e"
dest_uuid: "b0812463215649c3b011d36e2f0400c9"
 from {username='slave'} at 127.0.0.1:45690
I20260709 13:04:25.266124 10067 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:25.266494 10067 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:25.292219  9275 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43244 (request call id 189) took 1420 ms. Trace:
I20260709 13:04:25.292730  9275 rpcz_store.cc:276] 0709 13:04:23.872018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.872243 (+   225us) service_pool.cc:224] Handling call
0709 13:04:25.292124 (+1419881us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:25.160812 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:25.161540 (+   728us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:25.161580 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:04:25.161603 (+    23us) tablet.cc:662] Decoding operations
0709 13:04:25.163067 (+  1464us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:25.163135 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:25.163171 (+    36us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:04:25.164606 (+  1435us) tablet.cc:701] Row locks acquired
0709 13:04:25.164621 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:04:25.164784 (+   163us) write_op.cc:270] Start()
0709 13:04:25.164919 (+   135us) write_op.cc:276] Timestamp: P: 1783602265164735 usec, L: 0
0709 13:04:25.164945 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:04:25.166276 (+  1331us) log.cc:844] Serialized 6214 byte log entry
0709 13:04:25.169474 (+  3198us) op_driver.cc:464] REPLICATION: finished
0709 13:04:25.169952 (+   478us) write_op.cc:301] APPLY: starting
0709 13:04:25.170038 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:25.179966 (+  9928us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:25.180072 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:25.237763 (+ 57691us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:25.238059 (+   296us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:04:25.238112 (+    53us) write_op.cc:312] APPLY: finished
0709 13:04:25.238476 (+   364us) log.cc:844] Serialized 148 byte log entry
0709 13:04:25.247008 (+  8532us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:25.247349 (+   341us) write_op.cc:454] Released schema lock
0709 13:04:25.247408 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:25.247803 (+   395us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:25.247832 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":251,"apply.run_cpu_time_us":21240,"apply.run_wall_time_us":77808,"cfile_cache_hit":64,"cfile_cache_hit_bytes":66720,"num_ops":16,"prepare.queue_time_us":90,"prepare.run_cpu_time_us":5242,"prepare.run_wall_time_us":5739,"replication_time_us":4281}]]}
W20260709 13:04:25.304209  9262 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 86850.5us
I20260709 13:04:25.319955  9520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e"
dest_uuid: "6d50f1c263264b21919230bee398022b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54524
I20260709 13:04:25.320729  9520 raft_consensus.cc:606] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Received request to transfer leadership
I20260709 13:04:25.305186  9370 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:25.325647 14649 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:04:25.326332  9262 catalog_manager.cc:4755] TS 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): ChangeConfig:REMOVE_PEER RPC failed for tablet 99c4416401f2427a9f7e68b64ec6915e: Remote error: Service unavailable: leader transfer in progress
I20260709 13:04:25.331049  9517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e"
dest_uuid: "6d50f1c263264b21919230bee398022b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54524
I20260709 13:04:25.331755  9517 raft_consensus.cc:606] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Received request to transfer leadership
I20260709 13:04:25.331888  9450 raft_consensus.cc:1275] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:04:25.338011  9323 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
I20260709 13:04:25.338145 14448 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:04:25.338752  9323 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 99c4416401f2427a9f7e68b64ec6915e already in progress
W20260709 13:04:25.339237  9323 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 99c4416401f2427a9f7e68b64ec6915e already in progress
I20260709 13:04:25.340139 10067 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:25.355986  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:25.356631  9444 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:25.367636 10067 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:25.374701  9370 raft_consensus.cc:1275] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:25.382222 14649 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:25.386967  9371 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:04:25.390451 14649 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:25.399108  9444 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 14.
I20260709 13:04:25.395661  9271 catalog_manager.cc:5697] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:25.402941 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 210796us
I20260709 13:04:25.412658  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:25.413538  9377 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:25.416577  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:25.417423  9517 raft_consensus.cc:3055] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:25.424886  9517 raft_consensus.cc:740] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:25.427000  9517 consensus_queue.cc:260] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:25.432165  9517 raft_consensus.cc:3060] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:25.446426  9377 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 14.
I20260709 13:04:25.473105  9444 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:25.478902 10027 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:25.486409  9271 catalog_manager.cc:5697] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 10 to 13, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 13 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:25.490046 14669 raft_consensus.cc:2804] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:25.495515  9444 raft_consensus.cc:1275] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:25.499584 14648 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:25.507135  9374 raft_consensus.cc:1275] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:25.519296  9517 raft_consensus.cc:2468] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 14.
I20260709 13:04:25.526960 14669 raft_consensus.cc:697] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 14 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:04:25.529795  9444 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:04:25.527982 14669 consensus_queue.cc:237] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:25.562736 14328 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.564618 14328 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:25.568250  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:25.569983 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:25.570770 10067 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
I20260709 13:04:25.571885 14328 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:25.573436  9342 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:25.574951 14445 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:25.576015 14445 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:25.576614 14445 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:25.582883  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:25.584477  9444 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
I20260709 13:04:25.596985 14445 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:25.599922 14445 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:25.604470 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:25.605623 10067 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:25.553843 14448 consensus_queue.cc:1048] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:04:25.621061  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:25.621825  9444 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:25.621146 14648 consensus_queue.cc:1048] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
W20260709 13:04:25.679733  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 153747us
I20260709 13:04:25.685542 10067 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 16.
W20260709 13:04:25.698655  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 163671us
I20260709 13:04:25.701391  9444 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 16.
I20260709 13:04:25.705893  9342 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:25.709503 14649 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:04:25.757746  9273 catalog_manager.cc:5697] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 13 to 14, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 14 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:25.766299  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 60649.1us
I20260709 13:04:25.764703 14445 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:04:25.798849  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 88517.3us
W20260709 13:04:25.816546  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 54176.5us
I20260709 13:04:25.821667 14445 raft_consensus.cc:697] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:25.822887 14445 consensus_queue.cc:237] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:04:25.838240  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 75531.8us
I20260709 13:04:25.934721 14679 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.958865 14679 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:25.961869  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 96988.5us
W20260709 13:04:25.963465  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 63430.7us
I20260709 13:04:25.973210  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:26.009505 14679 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:26.028203  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:26.029457  9444 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:04:26.060228 14684 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:26.060863 14684 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:26.063074 14684 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:26.064054  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:26.064993  9451 raft_consensus.cc:2393] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 14: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:26.053542  9274 catalog_manager.cc:5697] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 14 to 15, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 15 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:26.072296  9444 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:04:26.074025 14011 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:26.075079  9274 catalog_manager.cc:5697] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 14 to 15, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 15 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:26.043223  9490 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:04:26.087394  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 44361.7us
I20260709 13:04:26.084734  9274 catalog_manager.cc:5697] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 14 to 15, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 15 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:26.101457  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:26.101068  9274 catalog_manager.cc:5697] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 9 to 10, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 10 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:26.108917  9261 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 99c4416401f2427a9f7e68b64ec6915e with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:04:26.101434 14686 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:26.114252  9520 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
W20260709 13:04:26.117695  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 73811.6us
I20260709 13:04:26.115422 14686 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.126276 14686 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:26.145876  9374 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:04:26.147704 14669 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:26.166800  9343 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:26.169078 14428 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:26.169656 14428 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:26.170146 14428 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:26.184374  9271 catalog_manager.cc:5697] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 13 to 16, leader changed from b0812463215649c3b011d36e2f0400c9 (127.8.4.68) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 16 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:26.193647  9524 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:04:26.194480 14686 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:26.197465 14669 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:26.202875 14428 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:26.212109 14428 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:26.223064  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:26.224112  9443 raft_consensus.cc:2393] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 14: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:26.301919 14686 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:26.302733  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:26.303354  9373 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:26.307739  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:26.311815  9373 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:04:26.313249  9492 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:26.318465  9524 raft_consensus.cc:2368] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 14. Current term is 15.
I20260709 13:04:26.319257 14686 raft_consensus.cc:2804] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:26.319754 14686 raft_consensus.cc:697] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:26.320530 14686 consensus_queue.cc:237] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:26.329394  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:26.330045  9451 raft_consensus.cc:3060] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:26.343441  9451 raft_consensus.cc:2468] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:04:26.362471 10067 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:04:26.373440 14428 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:26.374358  9443 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:04:26.376169 14428 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:26.424317  9343 leader_election.cc:400] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 14. Current term is 15.
I20260709 13:04:26.424710  9343 leader_election.cc:403] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:04:26.425709 14688 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 14. Current term is 15.
I20260709 13:04:26.496430  9271 catalog_manager.cc:5697] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:26.654381 10067 consensus_queue.cc:237] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:26.671746  9446 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:04:26.673353 14620 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:26.682138  9373 raft_consensus.cc:1275] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:04:26.683028 14669 raft_consensus.cc:2955] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 14 LEADER]: Committing config change with OpId 14.14: config changed from index 10 to 14, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:26.685797 14424 consensus_queue.cc:1048] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:26.688364  9451 raft_consensus.cc:2955] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Committing config change with OpId 14.14: config changed from index 10 to 14, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:26.696805  9373 raft_consensus.cc:2955] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Committing config change with OpId 14.14: config changed from index 10 to 14, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:26.709825  9271 catalog_manager.cc:5697] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index 10 to 14, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New cstate: current_term: 14 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:26.739229  9261 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 99c4416401f2427a9f7e68b64ec6915e with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 7)
I20260709 13:04:26.751618  9508 tablet_service.cc:1558] Processing DeleteTablet for tablet 99c4416401f2427a9f7e68b64ec6915e with delete_type TABLET_DATA_TOMBSTONED (TS 6d50f1c263264b21919230bee398022b not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:54524
I20260709 13:04:26.809211 14708 tablet_replica.cc:333] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:04:26.813437 14708 raft_consensus.cc:2243] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:26.814136 14708 raft_consensus.cc:2272] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.815382  9524 consensus_queue.cc:237] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:26.838864 14708 ts_tablet_manager.cc:1916] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:26.855746  9451 raft_consensus.cc:1275] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:26.858515 14686 consensus_queue.cc:1048] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:26.875283  9371 raft_consensus.cc:1275] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:26.882087 14679 consensus_queue.cc:1048] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:04:26.887197  9491 consensus_peers.cc:597] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 620e7847d47845ad93329cf9a3a07dba. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:26.888989  9446 raft_consensus.cc:1275] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:04:26.896946 14686 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:26.899704  9373 raft_consensus.cc:1275] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:04:26.905625 14679 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:26.938550 14708 ts_tablet_manager.cc:1929] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.13
I20260709 13:04:26.939159 14708 log.cc:1199] T 99c4416401f2427a9f7e68b64ec6915e P 6d50f1c263264b21919230bee398022b: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-2-root/wals/99c4416401f2427a9f7e68b64ec6915e
I20260709 13:04:26.949687 14648 raft_consensus.cc:2955] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:26.967077  9262 catalog_manager.cc:5028] TS 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): tablet 99c4416401f2427a9f7e68b64ec6915e (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:04:26.979899  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:26.987597  9371 raft_consensus.cc:2955] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
W20260709 13:04:27.006108  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 62765.9us
I20260709 13:04:27.059633  9374 consensus_queue.cc:237] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
W20260709 13:04:27.087649  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 65727.4us
I20260709 13:04:27.089668  9446 raft_consensus.cc:2955] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:27.089664  9271 catalog_manager.cc:5697] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index -1 to 9, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 11 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:27.124244  9524 raft_consensus.cc:1275] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:04:27.125309  9444 raft_consensus.cc:1275] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 13:04:27.126991  9342 consensus_peers.cc:597] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58a6a34a419649a4829c651a0402a5fa. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:27.127585 14688 consensus_queue.cc:1048] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:27.128630 14450 consensus_queue.cc:1048] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:27.162352 14692 raft_consensus.cc:2955] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Committing config change with OpId 16.8: config changed from index -1 to 8, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:27.171267  9520 raft_consensus.cc:2955] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Committing config change with OpId 16.8: config changed from index -1 to 8, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:27.233407  9271 catalog_manager.cc:5697] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b reported cstate change: config changed from index -1 to 8, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 16 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:27.251000  9446 consensus_queue.cc:237] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:27.248296  9451 raft_consensus.cc:2955] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Committing config change with OpId 16.8: config changed from index -1 to 8, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:27.284824  9371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:27.285597  9371 raft_consensus.cc:606] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:27.300084  9371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:27.300779  9371 raft_consensus.cc:606] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:27.305433  9371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:27.306061  9371 raft_consensus.cc:606] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:27.309482  9371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:27.310091  9371 raft_consensus.cc:606] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:27.313808  9417 consensus_peers.cc:597] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5e2df6fa742945289dda523a3fb658b0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:27.328950  9517 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:04:27.331954 14687 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:27.333559  9371 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:04:27.338665 14696 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:27.339890  9374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7a866663507456b9442af6c42748c5f"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:27.340559  9374 raft_consensus.cc:606] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:27.347811  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:27.350555  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:27.389621 14726 ts_tablet_manager.cc:933] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:27.396435 14726 tablet_copy_client.cc:323] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.67:35929
I20260709 13:04:27.401319  9535 tablet_copy_service.cc:140] P 6d50f1c263264b21919230bee398022b: Received BeginTabletCopySession request for tablet 620e7847d47845ad93329cf9a3a07dba from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:52502)
I20260709 13:04:27.401953  9535 tablet_copy_service.cc:161] P 6d50f1c263264b21919230bee398022b: Beginning new tablet copy session on tablet 620e7847d47845ad93329cf9a3a07dba from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:52502: session id = b0812463215649c3b011d36e2f0400c9-620e7847d47845ad93329cf9a3a07dba
I20260709 13:04:27.411974  9535 tablet_copy_source_session.cc:215] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:27.430816 14726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 620e7847d47845ad93329cf9a3a07dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.449134 14428 raft_consensus.cc:993] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:27.449847 14428 raft_consensus.cc:1081] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:27.464707 14726 tablet_copy_client.cc:806] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:27.465520 14726 tablet_copy_client.cc:670] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:27.472666 14726 tablet_copy_client.cc:538] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:27.488631 14696 raft_consensus.cc:2955] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index -1 to 14, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:27.492334 14726 tablet_bootstrap.cc:492] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:04:27.524924  9450 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51012
I20260709 13:04:27.525887  9450 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:27.526400  9450 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:27.531102 14450 raft_consensus.cc:993] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:27.531683 14450 raft_consensus.cc:1081] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:27.576297  9446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7a866663507456b9442af6c42748c5f"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51012
I20260709 13:04:27.576907  9446 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:27.577831  9446 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:27.576889  9450 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:27.616544  9450 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:27.651582  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 65670.9us
I20260709 13:04:27.650720  9446 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:27.668846  9446 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:27.741816  9271 catalog_manager.cc:5697] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index -1 to 14, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 17 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:27.793917  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 160129us
I20260709 13:04:27.797353  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:27.798022  9517 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:27.807029  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:27.807646  9524 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:27.821269 14734 raft_consensus.cc:993] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:27.822108 14734 raft_consensus.cc:1081] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:27.826649  9446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51012
I20260709 13:04:27.827284  9446 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:27.827665  9446 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:27.848138  9446 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:27.864362  9517 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:04:27.865159  9518 raft_consensus.cc:1240] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:27.884106  9524 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:04:27.904197  9371 consensus_queue.cc:237] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:27.911140  9446 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:27.915509  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 57993.4us
W20260709 13:04:27.918219 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 80126.8us
I20260709 13:04:27.929175  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:27.929878  9374 raft_consensus.cc:3055] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:27.930248  9374 raft_consensus.cc:740] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:27.929608  9373 raft_consensus.cc:2955] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index -1 to 14, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:27.935365  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:27.936160  9377 raft_consensus.cc:3055] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:27.936451  9377 raft_consensus.cc:740] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:27.967599  9374 consensus_queue.cc:260] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:27.937361  9377 consensus_queue.cc:260] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:27.981858  9374 raft_consensus.cc:3060] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:27.981555  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 75660.8us
I20260709 13:04:27.986107  9418 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:27.993201  9377 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:27.991686  9418 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:28.010774 14730 raft_consensus.cc:2804] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:28.019062  9377 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
W20260709 13:04:28.035842  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 44271.9us
W20260709 13:04:28.038627  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 104813us
I20260709 13:04:28.039476  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:28.040081  9370 raft_consensus.cc:3055] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:28.040518  9370 raft_consensus.cc:740] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:28.050585  9374 raft_consensus.cc:2468] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:04:28.052933  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:28.053858  9517 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:28.059445  9370 consensus_queue.cc:260] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:28.026638 14730 raft_consensus.cc:697] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:04:28.074954 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 95176.9us
I20260709 13:04:28.089561  9517 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
W20260709 13:04:28.092861 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 75777.3us
I20260709 13:04:28.124540  9370 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:28.140272  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 52691.7us
I20260709 13:04:28.158149  9370 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
I20260709 13:04:28.161947 14754 ts_tablet_manager.cc:933] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
I20260709 13:04:28.174427  9418 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:04:28.180384  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 83311.7us
W20260709 13:04:28.222018  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 287600us
I20260709 13:04:28.214005 14736 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:04:28.228247 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 75373.7us
I20260709 13:04:28.218562 14754 tablet_copy_client.cc:323] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.65:37547
I20260709 13:04:28.145824 14730 consensus_queue.cc:237] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:28.270493 14768 ts_tablet_manager.cc:933] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:28.258896 14729 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:04:28.309046  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 82088.8us
I20260709 13:04:28.306072 14736 raft_consensus.cc:697] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:04:28.329573  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 63902.1us
I20260709 13:04:28.352330  9387 tablet_copy_service.cc:140] P 925acbe78db14db3b9e4cfc857717947: Received BeginTabletCopySession request for tablet 58a6a34a419649a4829c651a0402a5fa from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:50568)
I20260709 13:04:28.353077  9387 tablet_copy_service.cc:161] P 925acbe78db14db3b9e4cfc857717947: Beginning new tablet copy session on tablet 58a6a34a419649a4829c651a0402a5fa from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:50568: session id = b0812463215649c3b011d36e2f0400c9-58a6a34a419649a4829c651a0402a5fa
I20260709 13:04:28.327054 14729 raft_consensus.cc:697] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:28.357190 14729 consensus_queue.cc:237] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:28.361192  9342 consensus_peers.cc:597] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 060ae09cf899421ea6057ee5eca95814. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:28.362210 14734 raft_consensus.cc:993] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:28.362756 14734 raft_consensus.cc:1081] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:28.352460 14768 tablet_copy_client.cc:323] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.66:45279
I20260709 13:04:28.383082  9387 tablet_copy_source_session.cc:215] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:28.391983  9519 raft_consensus.cc:2955] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index -1 to 14, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
W20260709 13:04:28.439157  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 212894us
I20260709 13:04:28.457278 14740 raft_consensus.cc:993] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:28.457875 14740 raft_consensus.cc:1081] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:28.492260 14754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58a6a34a419649a4829c651a0402a5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.457336  9462 tablet_copy_service.cc:140] P d62c9d5a052b42ce8675f8438f846526: Received BeginTabletCopySession request for tablet 5e2df6fa742945289dda523a3fb658b0 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:45366)
I20260709 13:04:28.506003  9462 tablet_copy_service.cc:161] P d62c9d5a052b42ce8675f8438f846526: Beginning new tablet copy session on tablet 5e2df6fa742945289dda523a3fb658b0 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:45366: session id = b0812463215649c3b011d36e2f0400c9-5e2df6fa742945289dda523a3fb658b0
I20260709 13:04:28.508620  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:28.548028  9446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51012
W20260709 13:04:28.548053  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 48320us
I20260709 13:04:28.548748  9446 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:28.549190  9446 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:28.460915 14736 consensus_queue.cc:237] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:28.578676  9462 tablet_copy_source_session.cc:215] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:28.592845  9452 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:04:28.579357  9446 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:28.601388  9446 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:28.609257  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:28.609664  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:28.609968  9370 raft_consensus.cc:3055] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:28.610232  9518 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:28.610361  9370 raft_consensus.cc:740] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:28.611125  9370 consensus_queue.cc:260] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:28.611948  9370 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:28.614921 14768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e2df6fa742945289dda523a3fb658b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.617928  9518 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 17.
I20260709 13:04:28.623912  9524 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:04:28.629976  9452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51012
I20260709 13:04:28.630748  9452 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:28.631250  9452 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:28.639014  9519 raft_consensus.cc:1240] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:28.642135  9418 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:28.644450 14775 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:28.645187 14775 raft_consensus.cc:697] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:28.658686 14753 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:28.660017 14775 consensus_queue.cc:237] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:28.683292 14733 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:04:28.687556 14726 log.cc:927] Time spent T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.087s	user 0.003s	sys 0.000s
I20260709 13:04:28.722226  9370 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 17.
I20260709 13:04:28.725495  9452 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:28.752178  9450 raft_consensus.cc:1240] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:28.753159 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:28.753779 10067 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:28.740542  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:28.759014 14761 consensus_queue.cc:1059] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:28.770744 14768 tablet_copy_client.cc:806] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:28.771445 14768 tablet_copy_client.cc:670] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:28.774816 10067 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 17.
I20260709 13:04:28.779649  9452 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:28.784811  9417 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:28.785779 14782 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:28.786790 14782 raft_consensus.cc:697] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:28.791117 14782 consensus_queue.cc:237] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:28.776068  9370 raft_consensus.cc:3055] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:28.775873 14768 tablet_copy_client.cc:538] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:28.799664  9370 raft_consensus.cc:740] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:28.808240  9523 raft_consensus.cc:1275] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:04:28.807114 14766 raft_consensus.cc:2955] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:28.809849  9443 raft_consensus.cc:2955] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:28.816213  9370 consensus_queue.cc:260] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:28.817608  9370 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:28.829317 14728 consensus_queue.cc:1048] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:28.833077  9444 raft_consensus.cc:1240] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:28.843735  9373 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:04:28.864231  9370 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 17.
W20260709 13:04:28.865316 14761 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:04:28.866246 14754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44540 (request call id 499) took 1006 ms. Trace:
I20260709 13:04:28.866709 14754 rpcz_store.cc:276] 0709 13:04:27.859600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:27.859743 (+   143us) service_pool.cc:224] Handling call
0709 13:04:28.168297 (+308554us) ts_tablet_manager.cc:934] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
0709 13:04:28.458370 (+290073us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:04:28.633544 (+175174us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:28.633662 (+   118us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:04:28.827729 (+194067us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:04:28.857327 (+ 29598us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:28.866106 (+  8779us) ts_tablet_manager.cc:989] Replica registered.
0709 13:04:28.866183 (+    77us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":17403,"tablet-copy.queue_time_us":217132,"thread_start_us":119166,"threads_started":2}
I20260709 13:04:28.868379 14754 tablet_copy_client.cc:806] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:28.868942 14754 tablet_copy_client.cc:670] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:28.870656 14726 tablet_bootstrap.cc:492] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:28.871742 14726 tablet_bootstrap.cc:492] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:04:28.872601 14726 ts_tablet_manager.cc:1403] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 1.381s	user 0.044s	sys 0.030s
I20260709 13:04:28.882249  9519 raft_consensus.cc:2955] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
W20260709 13:04:28.891880 14789 log.cc:927] Time spent T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:04:28.901362  9370 raft_consensus.cc:1275] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:04:28.901448 14736 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:28.922158 14696 consensus_queue.cc:1048] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:04:28.919672 14754 tablet_copy_client.cc:538] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:28.932215  9518 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:04:28.938194 14729 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:28.940749 14766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:60188 (request call id 18) took 1086 ms. Trace:
I20260709 13:04:28.941419 14766 rpcz_store.cc:276] 0709 13:04:27.853919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:27.855956 (+  2037us) service_pool.cc:224] Handling call
0709 13:04:27.920338 (+ 64382us) log.cc:844] Serialized 485 byte log entry
0709 13:04:28.353844 (+433506us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b1800425800. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58347d3f3 00007fb58347f7c1 00007fb58347f779 00007fb58347f709 00007fb58347f6d1 00007fb58347e9cd 000000000038f354 000000000038f199 00007fb58346083a
0709 13:04:28.381566 (+ 27722us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b1800425800. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb58347d3f3 00007fb58347f7c1 00007fb58347f779 00007fb58347f709 00007fb58347f6d1 00007fb58347e9cd 000000000038f354 000000000038f199 00007fb58346083a
0709 13:04:28.940636 (+559070us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1358,"raft.queue_time_us":71513,"raft.run_cpu_time_us":2533,"raft.run_wall_time_us":33745,"spinlock_wait_cycles":100294272,"thread_start_us":237804,"threads_started":1,"wal-append.queue_time_us":382757}
I20260709 13:04:28.946822 14726 raft_consensus.cc:359] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:28.947813 14726 raft_consensus.cc:740] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:04:28.948493 14726 consensus_queue.cc:260] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:28.974980 14726 ts_tablet_manager.cc:1434] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.102s	user 0.011s	sys 0.000s
I20260709 13:04:28.952754 14792 ts_tablet_manager.cc:933] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
I20260709 13:04:28.981654  9535 tablet_copy_service.cc:342] P 6d50f1c263264b21919230bee398022b: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-620e7847d47845ad93329cf9a3a07dba received from {username='slave'} at 127.0.0.1:52502
I20260709 13:04:28.991532  9535 tablet_copy_service.cc:434] P 6d50f1c263264b21919230bee398022b: ending tablet copy session b0812463215649c3b011d36e2f0400c9-620e7847d47845ad93329cf9a3a07dba on tablet 620e7847d47845ad93329cf9a3a07dba with peer b0812463215649c3b011d36e2f0400c9
W20260709 13:04:29.164557  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 66929.6us
W20260709 13:04:29.170085  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 48000.9us
I20260709 13:04:29.182749 14754 tablet_bootstrap.cc:492] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:04:29.179396 14768 tablet_bootstrap.cc:492] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:04:29.212278  9371 raft_consensus.cc:1275] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:04:29.220346  9373 raft_consensus.cc:1275] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:04:29.186616 14792 tablet_copy_client.cc:323] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.65:37547
I20260709 13:04:29.237680  9275 catalog_manager.cc:5697] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 10 to 11, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 11 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:29.242229  9524 raft_consensus.cc:1275] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:04:29.246110  9519 raft_consensus.cc:1275] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
W20260709 13:04:29.271498  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 61143.4us
I20260709 13:04:29.272342 10067 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:04:29.247984 14798 consensus_queue.cc:1048] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:04:29.254281 14775 consensus_queue.cc:1048] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:04:29.291251  9387 tablet_copy_service.cc:140] P 925acbe78db14db3b9e4cfc857717947: Received BeginTabletCopySession request for tablet 060ae09cf899421ea6057ee5eca95814 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:50568)
I20260709 13:04:29.284566 14735 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:04:29.316210 14775 consensus_queue.cc:1048] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:29.305830 14803 consensus_queue.cc:1048] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:04:29.303310  9387 tablet_copy_service.cc:161] P 925acbe78db14db3b9e4cfc857717947: Beginning new tablet copy session on tablet 060ae09cf899421ea6057ee5eca95814 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:50568: session id = b0812463215649c3b011d36e2f0400c9-060ae09cf899421ea6057ee5eca95814
W20260709 13:04:29.486300  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 73827.4us
I20260709 13:04:29.617267  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:04:29.667989  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 379311us
W20260709 13:04:29.638203 14805 log.cc:927] Time spent T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.245s	user 0.003s	sys 0.000s
I20260709 13:04:29.675487 14768 tablet_bootstrap.cc:700] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9: Time spent opening tablet: real 0.193s	user 0.003s	sys 0.001s
I20260709 13:04:29.666569 14729 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:29.724493 10067 raft_consensus.cc:1217] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.8->[11.9-11.9]   Dedup: 11.9->[]
I20260709 13:04:29.726994  9387 tablet_copy_source_session.cc:215] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:29.803930  9273 catalog_manager.cc:5697] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 16 to 17, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 17 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:29.834111  9371 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:04:29.729806 14729 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:29.840328 14818 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.870965 14818 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:29.913542  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 48306us
I20260709 13:04:29.868592 14729 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:29.932924  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 77184.9us
I20260709 13:04:29.948439  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:04:29.998626  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 58351.3us
W20260709 13:04:30.005584  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 49375.5us
I20260709 13:04:30.032624 14818 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:30.044260  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:04:30.044397  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 102166us
W20260709 13:04:30.051509  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 51494.1us
I20260709 13:04:30.076650 14792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060ae09cf899421ea6057ee5eca95814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:30.105576  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:30.120577 14782 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:30.127784  9377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ad4133883414768941dffb952ca7caf"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:30.128681  9377 raft_consensus.cc:606] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:30.165609  9418 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:30.167280  9370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:30.162057  9274 catalog_manager.cc:5697] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index -1 to 12, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 18 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:30.165639  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 97655.9us
W20260709 13:04:30.172206 14768 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:04:30.171849 14824 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:30.194201 14838 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:30.194891 14838 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:30.198125  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:30.200428 14838 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:30.211467 14754 tablet_bootstrap.cc:492] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:30.212563 14754 tablet_bootstrap.cc:492] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:04:30.213331 14754 ts_tablet_manager.cc:1403] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 1.031s	user 0.043s	sys 0.011s
I20260709 13:04:30.217674  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:30.223249  9275 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43252 (request call id 179) took 1298 ms. Trace:
I20260709 13:04:30.223809  9275 rpcz_store.cc:276] 0709 13:04:28.927590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:28.931162 (+  3572us) service_pool.cc:224] Handling call
0709 13:04:30.223178 (+1292016us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:29.417991 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:29.419079 (+  1088us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:29.419130 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:04:29.419149 (+    19us) tablet.cc:662] Decoding operations
0709 13:04:29.419507 (+   358us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:29.419602 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:29.419639 (+    37us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:29.419846 (+   207us) tablet.cc:701] Row locks acquired
0709 13:04:29.419865 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:04:29.420016 (+   151us) write_op.cc:270] Start()
0709 13:04:29.420149 (+   133us) write_op.cc:276] Timestamp: P: 1783602269419967 usec, L: 0
0709 13:04:29.420175 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:04:29.473790 (+ 53615us) log.cc:844] Serialized 532 byte log entry
0709 13:04:29.785322 (+311532us) op_driver.cc:464] REPLICATION: finished
0709 13:04:29.910746 (+125424us) write_op.cc:301] APPLY: starting
0709 13:04:29.911948 (+  1202us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:30.043041 (+131093us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:30.053907 (+ 10866us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:30.073766 (+ 19859us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:30.073945 (+   179us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:04:30.073993 (+    48us) write_op.cc:312] APPLY: finished
0709 13:04:30.074253 (+   260us) log.cc:844] Serialized 25 byte log entry
0709 13:04:30.074426 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:30.074508 (+    82us) write_op.cc:454] Released schema lock
0709 13:04:30.074553 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:30.075005 (+   452us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:30.075035 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":88020,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":67199,"apply.run_cpu_time_us":5643,"apply.run_wall_time_us":181946,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8297,"num_ops":1,"prepare.queue_time_us":176041,"prepare.run_cpu_time_us":4143,"prepare.run_wall_time_us":75421,"replication_time_us":364904,"thread_start_us":128204,"threads_started":2}]]}
I20260709 13:04:30.244539  9370 raft_consensus.cc:606] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:30.245047  9370 raft_consensus.cc:614] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:30.258762  9343 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:30.273239 14751 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:30.305112  9370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:30.305938  9370 raft_consensus.cc:606] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:30.326156  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 59014.5us
I20260709 13:04:30.334865 14754 raft_consensus.cc:359] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:30.335987 14754 raft_consensus.cc:740] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:04:30.362447  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:30.380321  9490 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:30.336731 14754 consensus_queue.cc:260] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:30.385349 14767 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:30.395310 14754 ts_tablet_manager.cc:1434] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.182s	user 0.008s	sys 0.000s
I20260709 13:04:30.414937 14792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44540 (request call id 504) took 1583 ms. Trace:
I20260709 13:04:30.415428 14792 rpcz_store.cc:276] 0709 13:04:28.831542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:28.831861 (+   319us) service_pool.cc:224] Handling call
0709 13:04:28.983864 (+152003us) ts_tablet_manager.cc:934] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
0709 13:04:30.075229 (+1091365us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:04:30.187963 (+112734us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:30.188112 (+   149us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:04:30.349803 (+161691us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:04:30.350163 (+   360us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:30.414752 (+ 64589us) ts_tablet_manager.cc:989] Replica registered.
0709 13:04:30.414839 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":8840,"spinlock_wait_cycles":880512,"tablet-copy.queue_time_us":84178,"thread_start_us":215821,"threads_started":2}
I20260709 13:04:30.427352 14755 raft_consensus.cc:1064] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:04:30.429666 10064 raft_consensus.cc:1217] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.7->[16.8-16.8]   Dedup: 16.8->[]
I20260709 13:04:30.448369 14792 tablet_copy_client.cc:806] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:30.449132 14792 tablet_copy_client.cc:670] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:30.449183  9373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:30.449966  9373 raft_consensus.cc:606] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:30.450862  9274 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43240 (request call id 198) took 1385 ms. Trace:
I20260709 13:04:30.454869  9271 catalog_manager.cc:5697] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 14 to 15, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 15 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.454721  9274 rpcz_store.cc:276] 0709 13:04:29.065904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.066066 (+   162us) service_pool.cc:224] Handling call
0709 13:04:30.450799 (+1384733us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:30.226949 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:30.245344 (+ 18395us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:30.251819 (+  6475us) write_op.cc:435] Acquired schema lock
0709 13:04:30.255212 (+  3393us) tablet.cc:662] Decoding operations
0709 13:04:30.298388 (+ 43176us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:30.303237 (+  4849us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:30.307431 (+  4194us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:30.319409 (+ 11978us) tablet.cc:701] Row locks acquired
0709 13:04:30.322642 (+  3233us) write_op.cc:260] PREPARE: finished
0709 13:04:30.439751 (+117109us) spinlock_profiling.cc:243] Waited 4.82 ms on lock 0x7b2c000264b8. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb584e63a11 00007fb584e72a0a 00007fb584e72693 00007fb584e72631 00007fb5865a5902 00007fb5865a56dd 00007fb589fa0243 00007fb589f9fd58 00007fb589fa49f1 00007fb589fa49a9 00007fb589fa4939
0709 13:04:30.439817 (+    66us) write_op.cc:270] Start()
0709 13:04:30.440027 (+   210us) write_op.cc:276] Timestamp: P: 1783602270342703 usec, L: 0
0709 13:04:30.440056 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:04:30.440705 (+   649us) log.cc:844] Serialized 587 byte log entry
0709 13:04:30.442880 (+  2175us) op_driver.cc:464] REPLICATION: finished
0709 13:04:30.443312 (+   432us) write_op.cc:301] APPLY: starting
0709 13:04:30.443403 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:30.444219 (+   816us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:30.444242 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:30.444985 (+   743us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:30.445174 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:04:30.445218 (+    44us) write_op.cc:312] APPLY: finished
0709 13:04:30.445430 (+   212us) log.cc:844] Serialized 25 byte log entry
0709 13:04:30.445596 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:30.445679 (+    83us) write_op.cc:454] Released schema lock
0709 13:04:30.445718 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:30.446050 (+   332us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:30.446079 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":55426,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":175,"apply.run_cpu_time_us":2731,"apply.run_wall_time_us":2731,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4170,"num_ops":1,"prepare.queue_time_us":142,"prepare.run_cpu_time_us":5488,"prepare.run_wall_time_us":214049,"replication_time_us":2672,"spinlock_wait_cycles":11079424}]]}
I20260709 13:04:30.453358 14755 consensus_queue.cc:237] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:04:30.468803  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 88553.4us
I20260709 13:04:30.469532  9271 catalog_manager.cc:5697] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 16 to 17, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 17 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.481902  9271 catalog_manager.cc:5697] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 13 to 14, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 14 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.510250  9377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f322b7281d554c459bb8109ed249047b"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:30.511204  9377 raft_consensus.cc:606] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:30.520390  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 44710us
I20260709 13:04:30.523576  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:30.525605  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:04:30.539829  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 46183.3us
I20260709 13:04:30.538486  9387 tablet_copy_service.cc:342] P 925acbe78db14db3b9e4cfc857717947: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-58a6a34a419649a4829c651a0402a5fa received from {username='slave'} at 127.0.0.1:50568
I20260709 13:04:30.549679  9387 tablet_copy_service.cc:434] P 925acbe78db14db3b9e4cfc857717947: ending tablet copy session b0812463215649c3b011d36e2f0400c9-58a6a34a419649a4829c651a0402a5fa on tablet 58a6a34a419649a4829c651a0402a5fa with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:04:30.583680 14751 raft_consensus.cc:993] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:30.584324 14751 raft_consensus.cc:1081] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:30.585716  9271 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43244 (request call id 202) took 1158 ms. Trace:
W20260709 13:04:30.656152  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 121983us
W20260709 13:04:30.662758 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 136960us
I20260709 13:04:30.685909  9443 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51012
I20260709 13:04:30.686518  9443 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:30.686833  9443 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:30.694402  9443 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:30.697111  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 152319us
I20260709 13:04:30.706331  9443 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:30.713775 10064 raft_consensus.cc:1275] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [term 11 LEARNER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:30.715588 14776 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:30.586166  9271 rpcz_store.cc:276] 0709 13:04:29.427124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.427298 (+   174us) service_pool.cc:224] Handling call
0709 13:04:29.686431 (+259133us) spinlock_profiling.cc:243] Waited 66.1 ms on lock 0x7b540016e4d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d4090 00007fb586572f3a 00007fb58c3291cc 00007fb58c42737e 00007fb58a8e82a4 00007fb58a8e8232 00007fb58a8e8161 00007fb58a8e80dc 00007fb58a8e7392 00007fb5848a548c 00007fb5848a48c6
0709 13:04:30.585647 (+899216us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:30.488157 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:30.488770 (+   613us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:30.488811 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:04:30.488831 (+    20us) tablet.cc:662] Decoding operations
0709 13:04:30.489594 (+   763us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:30.492011 (+  2417us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:30.495232 (+  3221us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:04:30.545744 (+ 50512us) tablet.cc:701] Row locks acquired
0709 13:04:30.547510 (+  1766us) write_op.cc:260] PREPARE: finished
0709 13:04:30.555232 (+  7722us) write_op.cc:270] Start()
0709 13:04:30.555434 (+   202us) write_op.cc:276] Timestamp: P: 1783602270555146 usec, L: 0
0709 13:04:30.555504 (+    70us) op_driver.cc:348] REPLICATION: starting
0709 13:04:30.559818 (+  4314us) log.cc:844] Serialized 1290 byte log entry
0709 13:04:30.561848 (+  2030us) op_driver.cc:464] REPLICATION: finished
0709 13:04:30.562375 (+   527us) write_op.cc:301] APPLY: starting
0709 13:04:30.562461 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:30.564425 (+  1964us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:30.564554 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:30.570016 (+  5462us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:30.570210 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:04:30.570259 (+    49us) write_op.cc:312] APPLY: finished
0709 13:04:30.570502 (+   243us) log.cc:844] Serialized 41 byte log entry
0709 13:04:30.571351 (+   849us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:30.571456 (+   105us) write_op.cc:454] Released schema lock
0709 13:04:30.571505 (+    49us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":7,"spinlock_wait_cycles":151961984,"child_traces":[["op",{"apply.queue_time_us":313,"apply.run_cpu_time_us":5711,"apply.run_wall_time_us":15361,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12510,"num_ops":3,"prepare.queue_time_us":125,"prepare.run_cpu_time_us":4724,"prepare.run_wall_time_us":72032,"replication_time_us":6201}]]}
I20260709 13:04:30.724665  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:30.725425  9371 raft_consensus.cc:3055] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:30.725701  9371 raft_consensus.cc:740] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:30.726367  9371 consensus_queue.cc:260] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:30.737751  9371 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:30.740281 14792 tablet_copy_client.cc:538] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:30.767709 14768 tablet_bootstrap.cc:492] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:30.768918 14768 tablet_bootstrap.cc:492] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:04:30.769800 14768 ts_tablet_manager.cc:1403] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 1.596s	user 0.055s	sys 0.049s
I20260709 13:04:30.783018  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:30.783831  9523 raft_consensus.cc:3060] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:30.796306  9443 raft_consensus.cc:1275] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:30.823619  9371 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
I20260709 13:04:30.828557  9377 raft_consensus.cc:1275] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:30.831732  9523 raft_consensus.cc:2468] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
I20260709 13:04:30.840821 14826 raft_consensus.cc:993] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:30.841405 14818 raft_consensus.cc:1081] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:30.843755 14828 raft_consensus.cc:993] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:30.844295 14828 raft_consensus.cc:1081] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:30.853363  9443 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f322b7281d554c459bb8109ed249047b"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51012
I20260709 13:04:30.853987  9443 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:30.854362  9443 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:30.819239 14786 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:04:30.859699 14768 raft_consensus.cc:359] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:30.860635 14768 raft_consensus.cc:740] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:04:30.861683  9445 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ad4133883414768941dffb952ca7caf"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51012
I20260709 13:04:30.862509  9445 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:30.862895  9445 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:30.839723  9418 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:30.877929 14768 consensus_queue.cc:260] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:30.911568 14792 tablet_bootstrap.cc:492] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:04:30.902508 14782 raft_consensus.cc:2804] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:30.914547 14428 raft_consensus.cc:993] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:30.915321 14854 raft_consensus.cc:1081] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:30.949743 14782 raft_consensus.cc:697] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:30.951192 14782 consensus_queue.cc:237] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:30.971359 14768 ts_tablet_manager.cc:1434] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.201s	user 0.009s	sys 0.000s
I20260709 13:04:30.986872  9447 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51012
I20260709 13:04:30.987533  9447 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:30.987896  9447 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:30.995363  9447 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:31.002420  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:31.003129  9377 raft_consensus.cc:3055] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:31.003453  9377 raft_consensus.cc:740] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:31.004179  9377 consensus_queue.cc:260] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:31.005134  9377 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:31.010128  9443 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:31.011370  9448 raft_consensus.cc:1240] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:31.011861  9377 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
I20260709 13:04:31.019884  9445 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:31.022720 14817 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:04:31.031261  9443 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:31.034098  9418 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:31.045789  9449 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 12. Current term is 13. Ops: []
W20260709 13:04:31.043023  9340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.052675 14428 consensus_queue.cc:1059] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:31.034601  9447 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:31.054445 14428 raft_consensus.cc:3055] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:31.054841 14428 raft_consensus.cc:740] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:31.055600 14428 consensus_queue.cc:260] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:31.056480 14428 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:31.056888  9445 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:31.060515  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:31.061196  9522 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:31.061296  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:31.061869  9524 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:31.062736  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:31.063391  9520 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:31.066165  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:31.068269  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:31.068862  9371 raft_consensus.cc:3055] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:31.069459  9371 raft_consensus.cc:740] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:31.070185  9371 consensus_queue.cc:260] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:31.071151  9371 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:31.072376  9524 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
I20260709 13:04:31.061316 14775 raft_consensus.cc:2804] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:31.074522  9522 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
I20260709 13:04:31.075776  9274 catalog_manager.cc:5697] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 15 to 16, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 16 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.089905  9520 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:04:31.099123  9371 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:04:31.095319  9418 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:31.097185  9462 tablet_copy_service.cc:342] P d62c9d5a052b42ce8675f8438f846526: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-5e2df6fa742945289dda523a3fb658b0 received from {username='slave'} at 127.0.0.1:45366
I20260709 13:04:31.126024  9418 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:31.135541 14428 raft_consensus.cc:1064] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:04:31.105446 14775 raft_consensus.cc:697] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:31.127292  9462 tablet_copy_service.cc:434] P d62c9d5a052b42ce8675f8438f846526: ending tablet copy session b0812463215649c3b011d36e2f0400c9-5e2df6fa742945289dda523a3fb658b0 on tablet 5e2df6fa742945289dda523a3fb658b0 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:04:31.149225  9377 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
I20260709 13:04:31.158345  9522 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:31.129850 14736 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:31.145849 14799 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:04:31.198071  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 58036.5us
I20260709 13:04:31.181273 14736 raft_consensus.cc:697] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:31.185139 14799 raft_consensus.cc:697] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:31.140570 14428 consensus_queue.cc:237] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 6, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:31.277463 14736 consensus_queue.cc:237] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:31.272188 14799 consensus_queue.cc:237] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:31.241714 14775 consensus_queue.cc:237] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:31.356370 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 48984.3us
W20260709 13:04:31.399662  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 157708us
I20260709 13:04:31.432710  9447 raft_consensus.cc:2955] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:31.438866 10067 raft_consensus.cc:1275] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:04:31.446754 10067 raft_consensus.cc:2955] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:31.457422 14854 consensus_queue.cc:1048] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:04:31.461187  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 60577.2us
I20260709 13:04:31.372547 14786 raft_consensus.cc:2955] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:04:31.534756  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 149493us
I20260709 13:04:31.558281  9522 raft_consensus.cc:1275] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:04:31.600201 14858 log.cc:927] Time spent T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:04:31.730683 14428 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:31.735404 14428 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:31.743602 10063 raft_consensus.cc:1217] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.13->[17.14-17.14]   Dedup: 17.14->[]
I20260709 13:04:31.749512  9447 raft_consensus.cc:1275] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:04:31.761610 14877 log.cc:927] Time spent T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:04:31.763329 14876 log.cc:927] Time spent T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 13:04:31.769309 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 60873.2us
I20260709 13:04:31.772655 14428 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:31.777631  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:31.781876 14887 consensus_queue.cc:1048] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:04:31.916090  9368 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:04:31.941128 14883 consensus_queue.cc:1048] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:31.948750  9377 raft_consensus.cc:1275] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:31.950910  9522 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:04:31.969904  9520 raft_consensus.cc:1275] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:31.970507  9522 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:04:31.971506  9375 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:04:31.973052 14867 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
W20260709 13:04:32.036500 14873 log.cc:927] Time spent T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.579s	user 0.007s	sys 0.010s
I20260709 13:04:32.048306  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:32.077807 14881 raft_consensus.cc:1064] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:04:32.097849 14854 raft_consensus.cc:2955] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Committing config change with OpId 16.9: config changed from index 8 to 9, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:32.104825 14881 consensus_queue.cc:237] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 12, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:04:32.107393  9416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.107300  9271 catalog_manager.cc:5697] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:32.142274  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:04:32.146958  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 164489us
I20260709 13:04:32.185539  9343 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:32.192634 14848 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:04:32.197467 14887 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:32.210747 14857 consensus_queue.cc:1048] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:32.215758 14802 consensus_queue.cc:1048] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:32.217254 14885 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:32.219092 14823 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:32.231689  9447 raft_consensus.cc:2955] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Committing config change with OpId 16.9: config changed from index 8 to 9, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:32.234648  9368 raft_consensus.cc:2955] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:32.234639 10067 raft_consensus.cc:2955] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Committing config change with OpId 16.9: config changed from index 8 to 9, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:32.239549  9273 catalog_manager.cc:5697] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 12 to 13, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 13 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:32.249884 10063 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:04:32.262962  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 47669.8us
I20260709 13:04:32.381753 14867 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 13:04:32.506918 14889 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:04:32.509387  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 169141us
I20260709 13:04:32.507607 14889 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:32.518162 14889 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:32.520949  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:04:32.573599  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 63391.8us
I20260709 13:04:32.577795  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:04:32.585765 14904 log.cc:927] Time spent T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260709 13:04:32.587867 14903 log.cc:927] Time spent T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:04:32.604400  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 72570.6us
W20260709 13:04:32.667939  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 93595.8us
W20260709 13:04:32.675083  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 69149.7us
I20260709 13:04:32.704360  9343 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:32.719506 14883 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:32.789961  9523 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:04:32.838403  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 120713us
W20260709 13:04:32.871987 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 161458us
I20260709 13:04:32.874202  9518 raft_consensus.cc:2955] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Committing config change with OpId 16.9: config changed from index 8 to 9, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:32.896934  9368 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:04:32.934990 14848 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:04:33.052809  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 47248us
W20260709 13:04:33.054211  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 50395.2us
I20260709 13:04:33.069350 14898 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:33.081732 14898 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:33.084448 14898 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:33.009100 14866 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.064s
W20260709 13:04:33.134351  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 80419.5us
I20260709 13:04:33.060843 14728 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:33.131388 14901 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:33.159554 14728 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:33.160449 14901 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:33.163226 14901 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:33.669076  9517 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.010s	sys 0.005s
W20260709 13:04:33.670079  9517 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.010s	sys 0.007s
W20260709 13:04:33.677417  9417 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.000s	sys 0.016s
W20260709 13:04:33.677961  9417 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.000s	sys 0.016s
I20260709 13:04:33.682525 14933 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:33.684381 14933 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:33.691301  9416 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.006s	sys 0.006s
W20260709 13:04:33.691890  9416 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.007s	sys 0.006s
I20260709 13:04:33.701285 14917 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:33.702389 14917 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:33.705037 14933 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:33.710183 14917 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:33.713088  9415 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.009s	sys 0.025s
W20260709 13:04:33.713634  9415 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.009s	sys 0.025s
I20260709 13:04:33.717854 14824 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:33.719017 14824 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:33.727758 14824 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:33.720881  9343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.016s	sys 0.037s
I20260709 13:04:33.728106 14898 raft_consensus.cc:493] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:33.729090 14898 raft_consensus.cc:515] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:33.731050 14924 raft_consensus.cc:493] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:33.732141 14823 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:33.732434 14898 leader_election.cc:290] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:33.732007 14924 raft_consensus.cc:515] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:33.740325 14924 leader_election.cc:290] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:04:33.733927  9343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.018s	sys 0.037s
I20260709 13:04:33.742389 14823 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:33.745594 14823 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:33.802800 14776 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:33.803841 14776 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:33.806530 14776 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:33.818192 14917 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:33.819116 14917 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:33.821960 14917 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:33.823585 14728 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:33.836767  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:33.845527  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:04:33.860148 14792 log.cc:927] Time spent T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.680s	user 0.004s	sys 0.007s
I20260709 13:04:33.868577 14792 tablet_bootstrap.cc:492] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:33.871065 14792 tablet_bootstrap.cc:492] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:04:33.878988 14792 ts_tablet_manager.cc:1403] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 2.994s	user 0.076s	sys 0.057s
I20260709 13:04:33.887347  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:33.888819  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:33.804854  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:33.902572  9275 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43252 (request call id 183) took 1692 ms. Trace:
I20260709 13:04:33.903312  9275 rpcz_store.cc:276] 0709 13:04:32.210404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.210572 (+   168us) service_pool.cc:224] Handling call
0709 13:04:33.902315 (+1691743us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:04:33.906534  9274 catalog_manager.cc:5697] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 14 to 15, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 15 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:33.909946  9274 catalog_manager.cc:5697] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 15 to 16, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 16 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:33.918054  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:33.954137  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:04:33.962162 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 81227us
I20260709 13:04:33.933580 14792 raft_consensus.cc:359] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:33.964797 14792 raft_consensus.cc:740] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:04:33.965665 14792 consensus_queue.cc:260] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:33.988678 14792 ts_tablet_manager.cc:1434] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.109s	user 0.005s	sys 0.006s
I20260709 13:04:33.988746 14866 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:33.989866 14866 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:33.996299 14716 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:33.997155 14716 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.000000 14716 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:34.008911 14867 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:34.009979 14867 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.013365 14866 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.014202 14799 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:34.015038 14799 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.018702 14799 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.012616 14867 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.048277  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:34.049974 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895d29bbb65c4b67a479a2dc2f3cbb83" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:34.050504 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83531d29bc754f95b7c86cb864a9e096" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:34.066603 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:34.062330  9273 catalog_manager.cc:5697] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 8 to 9, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:34.100555 14736 raft_consensus.cc:2955] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Committing config change with OpId 17.15: config changed from index 14 to 15, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:34.102423  9418 leader_election.cc:304] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:34.105892 14696 raft_consensus.cc:2749] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:34.111472  9418 leader_election.cc:304] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:34.117295 14775 raft_consensus.cc:2749] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:34.117475  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:34.117944 14716 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:34.118770 14716 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.127110  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:34.135259 14786 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:34.136288 14786 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.138087  9520 raft_consensus.cc:2955] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 14 to 15, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:34.141600 14716 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:34.142439  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:34.150357  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.151813 14854 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:04:34.152037  9490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.089s	user 0.020s	sys 0.044s
W20260709 13:04:34.161052  9490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.099s	user 0.020s	sys 0.045s
I20260709 13:04:34.158517 14428 raft_consensus.cc:493] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:34.158344 14786 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:34.180542  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 1.11816e+06us
I20260709 13:04:34.192008 14428 raft_consensus.cc:515] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:34.197815 14866 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:34.198607 14866 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
W20260709 13:04:34.205265  9306 debug-util.cc:398] Leaking SignalData structure 0x7b0800285e80 after lost signal to thread 8212
I20260709 13:04:34.205267  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:04:34.207165  9306 debug-util.cc:398] Leaking SignalData structure 0x7b0800263f00 after lost signal to thread 9309
I20260709 13:04:34.208091 14728 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
W20260709 13:04:34.208590  9306 debug-util.cc:398] Leaking SignalData structure 0x7b0800166d00 after lost signal to thread 9401
I20260709 13:04:34.208779 14728 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.209466 14908 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:34.196498  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.200402  9522 consensus_queue.cc:237] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:34.212824 14428 leader_election.cc:290] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:04:34.231405  9306 debug-util.cc:398] Leaking SignalData structure 0x7b08000352e0 after lost signal to thread 9476
W20260709 13:04:34.232355  9306 debug-util.cc:398] Leaking SignalData structure 0x7b08000352a0 after lost signal to thread 9477
I20260709 13:04:34.221390 14696 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
W20260709 13:04:34.242729  9306 debug-util.cc:398] Leaking SignalData structure 0x7b08003d6340 after lost signal to thread 9550
W20260709 13:04:34.243115  9306 debug-util.cc:398] Leaking SignalData structure 0x7b080034ad80 after lost signal to thread 9551
I20260709 13:04:34.222203 14866 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.210321 14908 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.243988  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:04:34.251824  9306 debug-util.cc:398] Leaking SignalData structure 0x7b0800355440 after lost signal to thread 10094
W20260709 13:04:34.245435  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:34.254122  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.248216 14696 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.234298 14854 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:34.271697  9306 debug-util.cc:398] Leaking SignalData structure 0x7b08003648c0 after lost signal to thread 14892
I20260709 13:04:34.273110 14728 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.276991 14901 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:34.278606  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:34.280738  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:34.281129 14932 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:34.282080  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:34.282002 14932 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:34.283311 14885 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:34.277603  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.267568  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.278381 14901 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.284152 14885 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.297487  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.298309 14885 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.300920  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.307794 14828 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:34.307972  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:34.308673 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:34.309748 10064 raft_consensus.cc:1217] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.11->[18.12-18.12]   Dedup: 18.12->[]
I20260709 13:04:34.314459 14696 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.274694 14818 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:34.314925 14901 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.315886  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:34.316354 14908 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.320995 14932 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:34.336557  9443 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 11.
I20260709 13:04:34.340744  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:34.343493  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.348927 14854 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.351464  9450 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:04:34.353134 14818 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.360054 14855 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:34.365314 14782 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:34.365186 14855 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:34.366030 14782 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.367590 14855 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:34.368373 14871 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:34.369275 14871 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.370132  9386 tablet_copy_service.cc:342] P 925acbe78db14db3b9e4cfc857717947: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-060ae09cf899421ea6057ee5eca95814 received from {username='slave'} at 127.0.0.1:50568
I20260709 13:04:34.372709  9386 tablet_copy_service.cc:434] P 925acbe78db14db3b9e4cfc857717947: ending tablet copy session b0812463215649c3b011d36e2f0400c9-060ae09cf899421ea6057ee5eca95814 on tablet 060ae09cf899421ea6057ee5eca95814 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:04:34.373284 14863 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:34.374172  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.365561 14696 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:34.376690 14696 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.377719 14781 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:34.378106 14802 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:34.373965 14863 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:34.390494  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:34.403321  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:34.407642  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.416229  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.421980  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.418624  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.341804 14828 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:34.402187 14809 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:34.437466 14428 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:34.409191 14854 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:34.378593 14781 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:34.445338  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:34.445684 14809 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:34.446390 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:34.447445 14781 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:34.449153 14890 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:34.449842 14890 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:34.449757 10063 raft_consensus.cc:2955] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 14 to 15, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:34.453611  9375 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
I20260709 13:04:34.453389 14428 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.455777 14428 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.456336 14428 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:34.458482 14863 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:34.459411 14828 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:34.453393 14927 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:34.460938 14854 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:34.461865 14927 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.463230 14809 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.434095 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:34.464505 14927 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.435395 14882 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:34.442301 14741 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:34.442994  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.442797 14802 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:34.443885  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.472963  9377 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:04:34.483680 14741 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:34.489351  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:34.493700 14428 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.466711  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:34.490557 10067 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:04:34.495883  9369 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:04:34.499238  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.503334  9372 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 18.
I20260709 13:04:34.509657  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.517463  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:34.507961  9418 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:34.517046  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:34.521406 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:34.522663  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.524210  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.503497 14882 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.525419  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:34.517463  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.527213 14882 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.518368  9518 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 16.
W20260709 13:04:34.553570 14953 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:04:34.554288 14868 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:34.554960 14868 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.559401 14802 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:34.567987 14741 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.577373 14871 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.549567 14908 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:34.585218 10061 raft_consensus.cc:1275] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:04:34.585932 14782 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.588843  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:34.592607  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.594113 14956 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:34.594911 14956 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.598083 14956 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.600144 14854 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:34.519477 14927 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:34.607375 14927 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.607836 14890 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:34.609967 14927 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.611605 14782 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:34.592882 14818 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.612380 14782 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:34.618482  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 197019us
I20260709 13:04:34.621985 14428 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:34.627920  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 125036us
I20260709 13:04:34.628742  9418 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:34.634838 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:34.629995 14786 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
W20260709 13:04:34.635959  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 76956.9us
I20260709 13:04:34.641268  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:04:34.642325  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 82245us
I20260709 13:04:34.643671 14871 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:04:34.646282 14952 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:04:34.626838 14716 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:34.647506 14716 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.626636 14908 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:34.650995 14908 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.654597 14908 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:34.655642 14955 log.cc:927] Time spent T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:04:34.657269 10027 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:34.659087  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.664824 14961 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:34.669196  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:34.659319 14818 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:34.660430  9274 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43244 (request call id 205) took 2458 ms. Trace:
I20260709 13:04:34.660965 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:34.679800  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:34.681334 14696 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.682638  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:34.631498 14885 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:34.662346 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:34.663576  9490 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:34.676365  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:34.649402 14868 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:34.677995  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:34.687813  9448 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:04:34.682426 14818 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.689800  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:34.691443  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:34.692483 10027 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:34.697036  9418 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:34.689839  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:34.694159  9452 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:04:34.701440 14428 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:34.700773  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:34.702330  9452 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 11.
I20260709 13:04:34.698329 14786 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:34.707796 14786 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:34.708218 14786 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:34.706621  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:34.710525 14915 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:34.710656 14428 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.711426 14915 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:34.712009  9451 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
I20260709 13:04:34.712824 14696 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:34.713043 14428 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.719403 14959 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:34.720093 14959 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.722370 14959 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.722678 14782 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.723722 14885 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.724859  9449 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 16.
I20260709 13:04:34.726091 14885 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.727996  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.729823 14915 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:34.730933 10025 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:34.731077 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:34.734195 14822 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:34.736078 14716 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:34.741535 14818 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.745462  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:34.746204  9452 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 10.
I20260709 13:04:34.671237  9274 rpcz_store.cc:276] 0709 13:04:32.201864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.201986 (+   122us) service_pool.cc:224] Handling call
0709 13:04:34.660339 (+2458353us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:33.961024 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:33.975420 (+ 14396us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:33.975474 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:04:33.975510 (+    36us) tablet.cc:662] Decoding operations
0709 13:04:33.976008 (+   498us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:33.976092 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:33.976127 (+    35us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:04:33.976566 (+   439us) tablet.cc:701] Row locks acquired
0709 13:04:33.976610 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:04:33.976817 (+   207us) write_op.cc:270] Start()
0709 13:04:33.976987 (+   170us) write_op.cc:276] Timestamp: P: 1783602273976745 usec, L: 0
0709 13:04:33.993060 (+ 16073us) op_driver.cc:348] REPLICATION: starting
0709 13:04:33.994328 (+  1268us) log.cc:844] Serialized 911 byte log entry
0709 13:04:34.321188 (+326860us) op_driver.cc:464] REPLICATION: finished
0709 13:04:34.442414 (+121226us) write_op.cc:301] APPLY: starting
0709 13:04:34.442576 (+   162us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:34.492830 (+ 50254us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:34.498168 (+  5338us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:34.534607 (+ 36439us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:34.549228 (+ 14621us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:04:34.549314 (+    86us) write_op.cc:312] APPLY: finished
0709 13:04:34.552737 (+  3423us) log.cc:844] Serialized 33 byte log entry
0709 13:04:34.552975 (+   238us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:34.553093 (+   118us) write_op.cc:454] Released schema lock
0709 13:04:34.553151 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:34.553768 (+   617us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:34.553803 (+    35us) write_op.cc:454] Released schema lock
0709 13:04:34.584756 (+ 30953us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b1800476d40. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb5833f7c0a 00007fb58cb37219 00007fb58347fa40 00007fb58347a4e4 00007fb58347a455 00007fb5864e7190 00007fb5864e0ae7 00007fb5864dfdd9 00007fb5864ea930
Metrics: {"mutex_wait_us":632574,"reported_tablets":4,"spinlock_wait_cycles":55424,"child_traces":[["op",{"apply.queue_time_us":120440,"apply.run_cpu_time_us":9052,"apply.run_wall_time_us":111428,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12467,"mutex_wait_us":167263,"num_ops":2,"prepare.queue_time_us":29366,"prepare.run_cpu_time_us":19967,"prepare.run_wall_time_us":167186,"raft.queue_time_us":458344,"raft.run_cpu_time_us":25167,"raft.run_wall_time_us":106326,"replication_time_us":327856,"spinlock_wait_cycles":60594944,"thread_start_us":267805,"threads_started":4,"wal-append.queue_time_us":118758}]]}
I20260709 13:04:34.705796  9490 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:04:34.752133  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 48326.2us
I20260709 13:04:34.753392  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.754558 14716 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:34.754925 14818 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:34.755606 14818 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.755184 14716 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:34.757197 14716 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:34.758064  9341 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:34.761439  9341 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:34.762960  9341 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:34.763531 14428 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:34.764218 14428 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:34.764631 14428 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:34.758272 14818 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.749105 14961 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:34.765808  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 92241.9us
I20260709 13:04:34.768503  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.769433 14959 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:34.770021 14956 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:34.771026 14956 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:34.771261  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.775033  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.778823  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:34.781208  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:34.782326  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:34.771551 14956 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:34.780422  9341 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:34.787107  9341 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:34.788601  9418 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:34.793352 14882 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:34.793955 14882 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:34.794387 14882 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:34.787457 14927 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:34.795295 14927 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:34.795742 14927 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:34.807446 14786 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.813674  9418 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:34.817512 14848 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:34.822768  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.823145  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.824191  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.826228  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:34.824404 14962 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:34.833652 14962 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:34.838781 14962 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:34.852082 14428 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.855211  9368 raft_consensus.cc:1240] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:34.856827 14848 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:34.860289  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:34.870065 10063 raft_consensus.cc:2955] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:34.874125 14818 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:34.866902 14781 raft_consensus.cc:2955] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:34.889451  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c96d6eb2446529db451af4486b758" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:04:34.890821  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 77273.2us
I20260709 13:04:34.892200  9418 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:34.851477  9274 catalog_manager.cc:5697] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b reported cstate change: config changed from index 14 to 15, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:34.829984 14716 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.882290 14818 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.864547 14956 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.909996 14786 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:34.911631  9492 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:34.915033 14428 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.916781  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:34.918514 14885 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:34.939834  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:34.922205  9418 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:34.922384  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:34.893579 14927 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.931097 14716 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:34.941349  9449 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:34.941859  9418 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:34.942764 14908 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:34.956393  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:34.958021  9451 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:34.948673 14868 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:34.949043 14848 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:34.966094  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:34.966665 14956 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:34.975638  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:34.977402  9492 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:34.976583  9418 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:34.979884  9492 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:34.981189  9275 catalog_manager.cc:5697] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 10 to 11, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New cstate: current_term: 11 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:34.983635  9368 consensus_queue.cc:237] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:34.985864  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:34.987214  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:34.992116  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:35.001822  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4d4b66d6394ace8bb74d9778cbd542" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:34.988966 14925 raft_consensus.cc:2749] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:35.003387  9418 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:35.002846 14848 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:35.007364  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:35.008237 14882 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:34.990166 14786 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:35.017891 14927 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:35.018321 14882 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:35.018800 14848 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:35.023294  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:35.032620  9449 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 12.
I20260709 13:04:35.023450  9418 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:35.035368  9418 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:35.035153  9341 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:35.040911 14428 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:35.042676  9418 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:35.041666 14428 raft_consensus.cc:697] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:35.034018 14885 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:35.048768  9418 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:35.051235  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:35.051445  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:35.049449  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:35.052734  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:04:35.053408  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 51658.1us
I20260709 13:04:35.052733 14428 consensus_queue.cc:237] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:35.047178 14908 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:35.046212 14696 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:35.061136  9451 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 16.
I20260709 13:04:35.064854  9341 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:35.050496 14885 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:35.071805  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:35.057919 14782 raft_consensus.cc:2804] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:35.075906  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:35.073802  9492 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:35.081753  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:35.083985 14781 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:35.085803  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:35.084815  9492 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:35.087328  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:35.083298  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:35.061616 14818 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:35.093845  9359 tablet_service.cc:1558] Processing DeleteTablet for tablet 620e7847d47845ad93329cf9a3a07dba with delete_type TABLET_DATA_TOMBSTONED (TS 925acbe78db14db3b9e4cfc857717947 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:52546
I20260709 13:04:35.098006  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:35.120258  9452 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:35.120913  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:35.121336  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:35.121382  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:35.098412  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:35.123764  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:35.124224  9449 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:35.101251  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:35.102139  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:35.111388 14962 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:35.114960 14786 consensus_queue.cc:1059] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:35.067219 14696 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:35.065869 14908 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:35.128840  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:35.128283  9521 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
I20260709 13:04:35.133601  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:35.075655 14885 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:35.076653 14927 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:35.083009 14782 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:35.140642  9452 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 17.
I20260709 13:04:35.137888 14908 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:35.143151  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:35.148427  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:35.142338  9341 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:35.148839  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:35.149544  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:35.150696  9449 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:04:35.130237 14696 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:35.153515  9341 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:35.156951  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:35.162528 14956 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:35.155722 14818 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:35.168119  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:35.170715  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:35.144490 14782 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:35.144727 14927 raft_consensus.cc:697] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:35.162528  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 620e7847d47845ad93329cf9a3a07dba with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:04:35.178524  9262 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 48455.7us
I20260709 13:04:35.171291 14956 raft_consensus.cc:697] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:35.194481 14956 consensus_queue.cc:237] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:35.177111 14818 raft_consensus.cc:697] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:35.218626  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:35.218091  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:35.221385  9449 consensus_queue.cc:237] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:35.224915  9448 raft_consensus.cc:1240] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 15. Current term is 16. Ops: []
W20260709 13:04:35.265138  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.291597 14927 consensus_queue.cc:237] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:35.299451  9452 raft_consensus.cc:1275] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:04:35.305351  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:35.306322 14970 tablet_replica.cc:333] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:04:35.312285 14965 raft_consensus.cc:3055] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:35.312830 14965 raft_consensus.cc:740] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:35.313742 14965 consensus_queue.cc:260] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:35.315127 14965 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:35.321727 10063 raft_consensus.cc:1275] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:04:35.322996 14885 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:35.324887 14878 consensus_queue.cc:1048] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:35.366281  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:35.392295  9450 raft_consensus.cc:1240] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:35.429095 14428 consensus_queue.cc:1048] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:04:35.461706  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:35.462464  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:35.463897  9449 raft_consensus.cc:1240] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:35.464107  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:35.473734 14782 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:35.478062  9452 raft_consensus.cc:1240] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:35.466260  9444 raft_consensus.cc:1240] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:35.488188 14782 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:35.495677  9451 raft_consensus.cc:1240] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:35.504313  9418 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:35.521692  9518 raft_consensus.cc:1240] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:35.455499 14885 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:35.521549  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:35.545861  9518 raft_consensus.cc:1240] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 15. Current term is 16. Ops: []
W20260709 13:04:35.550041  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.558939 14871 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:35.524134 14782 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:35.594619  9369 raft_consensus.cc:1240] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:35.599771 10067 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:04:35.603238  9377 raft_consensus.cc:1240] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:35.601593  9275 catalog_manager.cc:5697] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 11 to 12, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 12 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:35.596685  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.607756 14908 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:35.519104 14818 consensus_queue.cc:237] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:35.614849 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
W20260709 13:04:35.616506  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 45054.3us
I20260709 13:04:35.626098 14969 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:04:35.637588 10068 raft_consensus.cc:2955] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index 9 to 10, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:35.643028 14696 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:35.645148 14977 raft_consensus.cc:1064] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:04:35.645758 14972 raft_consensus.cc:2955] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Committing config change with OpId 17.16: config changed from index 15 to 16, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:35.648928 14967 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:35.654436 14908 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:35.620797 14428 raft_consensus.cc:2955] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index 9 to 10, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:35.685776 14970 raft_consensus.cc:2243] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.686949 14970 raft_consensus.cc:2272] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.687888 14977 consensus_queue.cc:237] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:35.691484 14970 ts_tablet_manager.cc:1916] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:35.660946 10063 raft_consensus.cc:2955] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Committing config change with OpId 17.16: config changed from index 15 to 16, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:35.667606  9448 raft_consensus.cc:2955] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index 9 to 10, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:35.669467  9449 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:04:35.706164  9450 raft_consensus.cc:1240] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:35.706352  9449 raft_consensus.cc:606] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Received request to transfer leadership to TS 925acbe78db14db3b9e4cfc857717947
W20260709 13:04:35.678006  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 87642.3us
W20260709 13:04:35.678764 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 300211us
I20260709 13:04:35.708930  9343 leader_election.cc:304] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:35.700022 14967 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:35.711207  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 189740us
I20260709 13:04:35.742069  9343 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:35.756702  9343 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:35.756881 14978 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:35.758141 14978 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:35.723237  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.758677 14878 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:35.759317 14878 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:35.728765  9449 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:04:35.761631  9449 raft_consensus.cc:606] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Received request to transfer leadership to TS 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:35.761839 14878 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:35.712424 14927 raft_consensus.cc:2749] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:35.766235  9448 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:04:35.767169  9448 raft_consensus.cc:606] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 22 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:35.772678  9343 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
W20260709 13:04:35.720531  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.775326 14970 ts_tablet_manager.cc:1929] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.10
I20260709 13:04:35.775961 14970 log.cc:1199] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-0-root/wals/620e7847d47845ad93329cf9a3a07dba
I20260709 13:04:35.715368 14696 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:35.779134  9448 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f322b7281d554c459bb8109ed249047b"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:04:35.784721  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:04:35.785382 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 53274.8us
I20260709 13:04:35.780364  9448 raft_consensus.cc:606] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Received request to transfer leadership to TS 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:35.789556  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:04:35.791059  9418 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:35.791515  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:35.795208 14969 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:35.796243  9445 raft_consensus.cc:1275] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:35.799469 14967 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:35.804162 14882 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:35.804899 14882 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:35.805341  9273 catalog_manager.cc:5697] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index 9 to 10, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New cstate: current_term: 16 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:04:35.797694  9343 raft_consensus.cc:2686] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:04:35.814611  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:35.815090  9343 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:35.821447  9368 raft_consensus.cc:1240] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:35.823405  9343 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:35.822326 14878 raft_consensus.cc:2749] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:35.827742 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:35.822688 14927 consensus_queue.cc:1048] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:04:35.836853  9341 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:35.836987 10068 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [term 18 LEARNER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:04:35.837822 14915 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:35.838430 14915 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:35.813019 14882 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:35.839519 14882 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:35.836858  9418 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:35.842090  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:35.842280 14878 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:35.841534 14915 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:35.841761 14927 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:04:35.844038 14969 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:35.844553 14969 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:35.844954 14969 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:35.845453  9418 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:35.844038  9343 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:35.850669  9343 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:35.850890  9418 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:35.852598 14882 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:35.858714 14882 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:35.859156  9448 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:04:35.859273 14885 raft_consensus.cc:993] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:35.852836 14908 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:35.860231  9343 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:35.860438 14908 raft_consensus.cc:1081] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 22 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:35.851792 14983 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:35.866295  9374 raft_consensus.cc:2955] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 14 to 15, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:35.868836 14882 raft_consensus.cc:2749] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:35.870359 14882 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:35.870572 14818 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:35.871178 14818 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:35.874382 14818 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:35.874837 14967 consensus_queue.cc:1059] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:35.876217 14965 raft_consensus.cc:3055] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:35.876621 14965 raft_consensus.cc:740] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:35.876761 14969 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:35.876983  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:35.878021 14965 consensus_queue.cc:260] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:35.879168 14969 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:35.881142  9343 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:35.882844  9343 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:35.884092  9518 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:04:35.885191 14428 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:35.886628  9343 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:35.887580  9490 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:35.897595  9490 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:35.899000  9490 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:35.897625  9343 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:35.900556  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:35.899274  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:35.903780  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:35.886878 14818 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:35.879472 14965 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:35.913285  9418 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:35.911166  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:35.912007  9490 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:35.915736  9418 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:35.917066  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:35.919404  9260 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5e2df6fa742945289dda523a3fb658b0 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:35.920791 14871 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:35.922016  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:35.908202 14868 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:35.908548 14878 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:35.907994 14962 raft_consensus.cc:2749] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:35.925386  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:35.928478  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:35.916033  9490 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:35.896916 14781 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:35.944543 14962 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:35.910161 14959 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:35.946928 14969 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:35.948805  9520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46902
I20260709 13:04:35.957799  9520 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:35.958210  9520 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:35.961758  9418 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:35.926585 14925 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:35.964468  9490 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:35.963136 14967 consensus_queue.cc:1059] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:04:35.990599 14908 raft_consensus.cc:993] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526: : Instructing follower 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:04:35.988962 14925 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:04:35.988660 14782 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:35.988152 14983 raft_consensus.cc:993] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526: : Instructing follower 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:04:36.013686  9418 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:36.006178  9520 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:36.022109  9520 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 23 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:36.012145 14972 raft_consensus.cc:1081] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Signalling peer 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:04:36.028383  9449 raft_consensus.cc:1275] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:36.017975  9262 catalog_manager.cc:5028] TS 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): tablet 620e7847d47845ad93329cf9a3a07dba (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:04:36.039949  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 58a6a34a419649a4829c651a0402a5fa with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:36.004335 14868 consensus_queue.cc:1059] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:04:36.009541 14927 consensus_queue.cc:1059] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:04:36.018689 14878 consensus_queue.cc:1059] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:04:36.032411 14782 raft_consensus.cc:1081] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Signalling peer 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:04:36.070111 14969 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:36.082211 14908 raft_consensus.cc:993] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526: : Instructing follower 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:04:36.117621 14696 raft_consensus.cc:1081] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Signalling peer 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:04:36.046036 14925 consensus_queue.cc:1059] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:04:36.119575 14925 raft_consensus.cc:3055] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:36.120133 14925 raft_consensus.cc:740] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:36.121080 14818 raft_consensus.cc:3055] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:36.121527 14818 raft_consensus.cc:740] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:36.046516 14966 consensus_queue.cc:1059] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:04:36.124101 14966 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:36.124811 14966 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:36.127872 14716 raft_consensus.cc:3055] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:36.128305 14716 raft_consensus.cc:740] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:36.082211 14967 consensus_queue.cc:1059] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:04:36.130712 14967 raft_consensus.cc:3055] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:36.130046 14716 consensus_queue.cc:260] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:36.121562 14925 consensus_queue.cc:260] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:36.131143 14967 raft_consensus.cc:740] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:04:36.135919  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 51970.3us
I20260709 13:04:36.144901  9451 raft_consensus.cc:1240] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:36.149070  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:36.086802 14781 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:36.149768  9449 raft_consensus.cc:1275] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:04:36.149791  9443 raft_consensus.cc:3055] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:04:36.153661  9443 raft_consensus.cc:740] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:36.157771 14716 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:36.157675  9443 consensus_queue.cc:260] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:36.159215  9443 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:36.161350  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:36.162007 14978 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:36.162803 14978 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:36.165438  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:36.171531  9518 raft_consensus.cc:1275] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:04:36.173563  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:36.176170  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:36.176373  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:36.178249  9518 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:04:36.125741 14927 consensus_queue.cc:1048] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:04:36.182143  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:36.142843 14966 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:36.185261  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:04:36.178165 14943 log.cc:927] Time spent T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:04:36.191431  9523 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:04:36.195678  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:36.197608  9418 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:36.178056 14965 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:36.198892  9524 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 23 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 22. Current term is 23. Ops: []
I20260709 13:04:36.201267  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:36.202215  9521 raft_consensus.cc:1275] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:36.206195 14996 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:36.206951 14996 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:36.191972 14977 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:04:36.183400 14781 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:36.214259 14885 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:36.215987 14781 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:36.217216 14882 raft_consensus.cc:3055] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:36.217660 14882 raft_consensus.cc:740] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:36.203423 14967 consensus_queue.cc:260] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:36.218642 14882 consensus_queue.cc:260] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:36.219949 14967 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:36.193589 14925 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:36.222324 14818 consensus_queue.cc:260] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:36.222224 14959 raft_consensus.cc:2955] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:36.224282 14818 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:36.229113  9526 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 17.
W20260709 13:04:36.232725  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.235805  9520 raft_consensus.cc:3055] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:36.235352 14978 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:36.236203  9520 raft_consensus.cc:740] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:36.201160 14965 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:36.240166 14965 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:36.253856  9520 consensus_queue.cc:260] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:36.256839  9373 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:52548
I20260709 13:04:36.257529  9373 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:36.257915  9373 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:36.246176  9449 raft_consensus.cc:2955] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:36.284072  9343 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:36.285601  9520 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:36.285884  9343 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:36.289553  9374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f322b7281d554c459bb8109ed249047b"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:52548
I20260709 13:04:36.290318  9374 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:36.290796  9374 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:36.297482  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:36.204053 15001 raft_consensus.cc:3055] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:36.301316 15001 raft_consensus.cc:740] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:36.302433 15001 consensus_queue.cc:260] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:36.304124 15001 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:36.309556 14927 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:36.311297 14927 raft_consensus.cc:2749] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:36.318867 14996 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:36.323696 14977 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:36.324033  9274 catalog_manager.cc:5697] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 15 to 16, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New cstate: current_term: 17 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:36.326373 14956 consensus_queue.cc:1048] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:36.327638  9343 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:36.330514 14428 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:36.330986 14428 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:36.331391 14428 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:36.337678 14908 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:04:36.337980  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 140426us
I20260709 13:04:36.338846  9418 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:36.341604 15003 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:04:36.344460  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.346239  9418 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:36.347734  9343 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:36.360260  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 290402us
I20260709 13:04:36.312772 14927 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:36.378151  9451 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:36.392707  9518 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:04:36.373641  9373 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:36.377108 14696 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:36.429466  9443 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 23.
I20260709 13:04:36.431030  9520 raft_consensus.cc:1275] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:36.376343 14927 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:36.380836 14999 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:36.449642  9369 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:52548
I20260709 13:04:36.461827  9369 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:36.462414  9369 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:36.464630 14428 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:36.467809 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 189520us
I20260709 13:04:36.468437  9374 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:36.441588  9373 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:04:36.449529 14962 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:04:36.473837  9418 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:36.457758  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:36.488736  9524 raft_consensus.cc:2955] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Committing config change with OpId 17.16: config changed from index 15 to 16, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:36.492323  9374 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:36.454234 14993 log.cc:927] Time spent T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:04:36.493712  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:36.506964 14428 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:36.512889  9375 raft_consensus.cc:1240] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 17. Current term is 18. Ops: []
I20260709 13:04:36.518702  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:36.460832 14927 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:36.531617  9508 tablet_service.cc:1558] Processing DeleteTablet for tablet 58a6a34a419649a4829c651a0402a5fa with delete_type TABLET_DATA_TOMBSTONED (TS 6d50f1c263264b21919230bee398022b not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:54524
I20260709 13:04:36.478984 14972 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:04:36.533185  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:36.528339  9522 raft_consensus.cc:2955] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:36.546036 14882 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:36.553891  9490 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:36.554939 14716 consensus_queue.cc:1059] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:36.555893 15000 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:36.566823  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:36.555588  9490 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:36.556699 15000 raft_consensus.cc:3055] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:36.572535  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:36.574270  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:04:36.644330  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 92577.5us
I20260709 13:04:36.540314 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:36.652935  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:36.591537 15000 raft_consensus.cc:740] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:36.635357 14868 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:36.655575  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:36.661432  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:36.661577  9526 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:36.660276  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:36.662056  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:36.662288  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:36.659957  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:36.664031  9370 raft_consensus.cc:2393] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 17: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:36.653110 10063 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:36.674070  9368 raft_consensus.cc:1240] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 17. Current term is 18. Ops: []
I20260709 13:04:36.674286  9526 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 17.
I20260709 13:04:36.692080 10063 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 18.
I20260709 13:04:36.692876 15011 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:36.693637 15011 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:36.693986  9342 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:36.694720  9375 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:36.696086 15011 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:36.703415  9375 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 23.
W20260709 13:04:36.718187  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 52794.6us
I20260709 13:04:36.719589 15000 consensus_queue.cc:260] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:36.720990 15000 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:36.722074 14882 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:36.724452 14999 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:36.725394  9372 raft_consensus.cc:1240] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:36.727567 10063 raft_consensus.cc:2955] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:36.730947  9443 raft_consensus.cc:3055] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:36.731396  9443 raft_consensus.cc:740] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:36.732257  9443 consensus_queue.cc:260] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:36.742776  9443 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:36.753322  9369 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:36.758075  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 96231us
W20260709 13:04:36.760736 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 242749us
I20260709 13:04:36.768816  9443 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 18.
I20260709 13:04:36.733289 14999 raft_consensus.cc:697] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 18 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:36.772225  9343 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:36.761178 14781 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:36.783100 14781 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:36.759979 14915 consensus_queue.cc:1048] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:04:36.789847 14781 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:36.790441 14999 consensus_queue.cc:237] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:36.761137 14868 raft_consensus.cc:697] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 23 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:36.804996 14868 consensus_queue.cc:237] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:36.807338 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:36.795548 14927 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:36.814543  9369 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:36.825023 14781 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:36.832316 14781 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:36.797731  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:04:36.848351  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:36.827616  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 55480.8us
I20260709 13:04:36.855114  9444 raft_consensus.cc:3055] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:36.841150  9341 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:36.860431  9374 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:36.855724  9444 raft_consensus.cc:740] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:04:36.835654 14959 consensus_meta.cc:287] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947: Time spent flushing consensus metadata: real 0.611s	user 0.005s	sys 0.007s
I20260709 13:04:36.836338 15021 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:36.870563  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:36.871529  9492 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:36.886083  9492 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:36.888422  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:36.891639  9492 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:36.870648 14878 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:04:36.838547 14915 consensus_queue.cc:1059] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:04:36.906462  9451 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:04:36.936985  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:36.889569 14996 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:36.885156  9444 consensus_queue.cc:260] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:36.933679  9443 raft_consensus.cc:2393] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 23: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:36.950977  9444 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:36.939368  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 47925.2us
I20260709 13:04:36.940745  9519 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:36.911635  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:36.889326 14967 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:36.901824 15021 raft_consensus.cc:697] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:36.945916  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:36.952850  9449 raft_consensus.cc:3055] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:36.982676  9449 raft_consensus.cc:740] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:36.952919  9492 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:36.942684  9359 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e2df6fa742945289dda523a3fb658b0 with delete_type TABLET_DATA_TOMBSTONED (TS 925acbe78db14db3b9e4cfc857717947 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:52546
I20260709 13:04:36.991699  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:36.983573  9449 consensus_queue.cc:260] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:37.003070 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 83820.8us
I20260709 13:04:36.943718 14979 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:36.987407 14885 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:37.031185  9449 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:37.006152 14868 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:37.016414 15020 tablet_replica.cc:333] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:04:37.042457  9522 raft_consensus.cc:1240] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:37.064409  9449 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 18.
I20260709 13:04:36.980820 14871 consensus_queue.cc:1059] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:04:37.000967 15011 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:04:37.091483 14428 raft_consensus.cc:3055] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:37.048651 14885 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:37.206225 15027 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:37.389981 15027 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:04:37.257836 15022 log.cc:927] Time spent T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
W20260709 13:04:37.282589 15023 log.cc:927] Time spent T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:04:37.230696 14781 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:37.250166 10063 consensus_meta.cc:287] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9: Time spent flushing consensus metadata: real 0.502s	user 0.013s	sys 0.000s
I20260709 13:04:37.214330 15021 consensus_queue.cc:237] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:37.314158  9417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:37.406891 10067 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:04:37.317894 15000 consensus_meta.cc:287] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.005s
I20260709 13:04:37.350389 15032 tablet_replica.cc:333] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:04:37.378124  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
W20260709 13:04:37.381922  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 334835us
I20260709 13:04:37.383896  9450 raft_consensus.cc:1240] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:37.384486  9519 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 18.
I20260709 13:04:37.384979  9444 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 17.
I20260709 13:04:37.385984 14428 raft_consensus.cc:740] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:37.388079 14871 raft_consensus.cc:3055] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:37.390590 14885 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:37.204931 14927 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:37.400538  9341 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:37.431245  9343 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:37.451092  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:37.426990 14871 raft_consensus.cc:740] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:37.497098 14428 consensus_queue.cc:260] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:37.505240 14428 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:37.510567 15021 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:37.516165 15030 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:37.535404  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:37.432413 14915 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.071s
I20260709 13:04:37.542531 15040 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:37.543495 15040 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:37.556016  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 119593us
I20260709 13:04:37.499436 15000 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:37.616008  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 57992.2us
I20260709 13:04:37.637689  9449 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 23 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:04:37.638090  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:04:37.639416  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 208251us
W20260709 13:04:37.732548  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 94997.1us
I20260709 13:04:37.734340  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:37.688154 15027 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:37.621071 15030 raft_consensus.cc:697] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 18 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:37.822845  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:37.813771  9521 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 12.
I20260709 13:04:37.823112 15030 consensus_queue.cc:237] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:37.762892 15045 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:37.835964  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:37.852985  9375 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:04:37.836997  9372 raft_consensus.cc:1240] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 17. Current term is 18. Ops: []
I20260709 13:04:37.836673  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:37.678397 15020 raft_consensus.cc:2243] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.681286 14956 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:37.789077 14999 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:37.729408  9274 catalog_manager.cc:5697] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 10 to 11, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 11 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:37.640202 15033 consensus_queue.cc:1059] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.213s
I20260709 13:04:37.878908  9274 catalog_manager.cc:5697] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 15 to 16, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 16 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:37.831810  9452 raft_consensus.cc:2393] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 in current term 12: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:37.799911 14966 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:37.718127 15040 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:37.860893  9492 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
W20260709 13:04:37.884605 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 54671.8us
I20260709 13:04:37.891922  9418 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:37.623579 15000 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:37.898068 14966 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:37.886848 15047 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:37.905764 14927 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:37.905651 15047 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:37.906564 14927 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:37.909179 15009 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:37.909971 15009 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:37.911409 15018 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:37.912567 15009 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:37.916467  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:37.917735  9452 raft_consensus.cc:2393] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 17: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:37.933175 15056 raft_consensus.cc:2706] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Received pre-election callback for term 17 while not running: Illegal state: RaftConsensus is not running: State = Stopping
W20260709 13:04:37.934468  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 73715.6us
I20260709 13:04:37.934849  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:37.939431  9522 raft_consensus.cc:2393] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 12: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:37.941532 14915 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:37.942492 14915 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:37.943562 15044 raft_consensus.cc:493] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:37.944166 15044 raft_consensus.cc:515] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:37.946691 15044 leader_election.cc:290] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:37.890852 14781 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:37.957201  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:37.937134 15055 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:37.963639  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:37.908658 15047 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:37.878289 14956 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:37.966614  9451 raft_consensus.cc:2393] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 19: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:37.955327 14927 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:37.881803 14999 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:37.975740  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:37.876508 15045 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:37.977193  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:38.009662  9517 raft_consensus.cc:2393] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 in current term 16: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:37.979434 14868 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:37.981637 15056 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:37.966935 14915 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:37.997618 14978 raft_consensus.cc:493] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:38.001204  9373 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
I20260709 13:04:38.010368  9448 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:04:38.018673 14956 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:38.030691  9373 raft_consensus.cc:1240] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:37.976511 15020 raft_consensus.cc:2272] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.035941  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:38.012346 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:38.037813  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:38.007683 14967 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.043524 15054 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:38.048043  9368 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 23 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:04:37.965533 14781 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:38.058795 15045 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:38.059470 14871 consensus_queue.cc:260] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.047804 14967 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.062204 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:38.075124  9343 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:38.120833 14965 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.049490 10027 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:38.053329 15044 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:38.040071 14978 raft_consensus.cc:515] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:38.054531 15000 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:38.076113 15020 ts_tablet_manager.cc:1916] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:38.147071 14978 leader_election.cc:290] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:38.057132 14999 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:38.144831 14987 raft_consensus.cc:2804] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:38.057859 14966 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:38.147778 14978 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:38.147917 14987 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
W20260709 13:04:38.148345  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 73351.1us
I20260709 13:04:38.087512 15040 raft_consensus.cc:3055] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:38.144766 15044 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.149762 15040 raft_consensus.cc:740] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:38.151062 15040 consensus_queue.cc:260] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.152107 15044 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:38.068511 15006 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.085s
I20260709 13:04:38.108522  9273 catalog_manager.cc:5697] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 12 to 13, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:38.067816 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:38.131347 15002 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.155246 15002 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.096560 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:38.156315 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:38.063130 14967 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:38.090646 15042 log.cc:927] Time spent T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.573s	user 0.003s	sys 0.002s
I20260709 13:04:38.065861 15054 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:38.159725  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:38.160075  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:38.160877  9523 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 18.
I20260709 13:04:38.161752 15054 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:38.061321 14781 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:38.108204 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:38.165848 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:38.064209 14868 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.168710 14868 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.171250 14882 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:38.171846 14868 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:38.171947 14882 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.060966 14871 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:04:38.144484 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 95121.2us
W20260709 13:04:38.210740  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 171066us
I20260709 13:04:38.031163 15056 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:37.970481 15055 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.099963  9446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51016 (request call id 2282) took 1118 ms. Trace:
I20260709 13:04:38.148473 14987 raft_consensus.cc:3060] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:38.174575 14997 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:38.144337 14965 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.181741  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c4416401f2427a9f7e68b64ec6915e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:38.183444  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:38.097810 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:38.191005  9418 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:38.196085  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:38.210299 15002 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:38.218683  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:38.242815  9372 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:04:38.220165  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:38.244155  9369 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:04:38.246893 14882 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:38.221962  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:38.247685  9373 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:04:38.222677  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:38.223207  9492 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:38.249780  9376 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
I20260709 13:04:38.250464 14965 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:38.250391 14997 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:38.251207 14965 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:38.251499  9492 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:38.217120 15040 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:38.252789 14983 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:38.253232 14983 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:38.253744 14983 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:38.257727 14781 raft_consensus.cc:2749] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:38.258976 14781 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:38.220211  9446 rpcz_store.cc:276] 0709 13:04:36.981281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.982226 (+   945us) service_pool.cc:224] Handling call
0709 13:04:36.987676 (+  5450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:37.391154 (+403478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:37.391191 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:37.391247 (+    56us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:04:37.391292 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:38.099398 (+708106us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54001f9fd4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656ae01 00007fb58656983e 00007fb58b52e419 00007fb584aa5bd4 00007fb584aa5b62 00007fb584aa5a91 00007fb584aa5a0c 00007fb584aa4cc2 00007fb5848a548c 00007fb5848a48c6
0709 13:04:38.099478 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:38.099686 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":927382784}
I20260709 13:04:38.212448  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:38.261289  9492 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:38.236088  9341 leader_election.cc:304] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:38.238818  9375 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 23.
W20260709 13:04:38.239065  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 48204.4us
I20260709 13:04:38.241991  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:38.263908 15063 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:38.264629 15063 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.265172 15063 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:38.265712 14978 raft_consensus.cc:2749] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:38.266132 15032 raft_consensus.cc:2243] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.267107 15032 raft_consensus.cc:2272] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.209832 14782 raft_consensus.cc:493] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.270217  9418 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b
I20260709 13:04:38.271067  9446 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:04:38.273481  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:38.274219  9341 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:38.272161  9492 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:38.277261  9418 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:38.279717  9492 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9
I20260709 13:04:38.287578  9492 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:38.238920 15033 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.293560  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:38.292963  9492 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:38.296312  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:04:38.297222  9341 raft_consensus.cc:2686] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:04:38.297464  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:38.297537  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:38.298364  9520 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 19.
I20260709 13:04:38.298484  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70a11c5ae574b43ab50a91cfb6e293c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:38.299181  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:38.301313  9375 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 18.
I20260709 13:04:38.302603  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9721df2c264fa2bc26de02ce5bbe1a" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:38.283665 14696 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:38.299451 15061 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:38.305797  9521 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:04:38.282611 14885 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:38.287354 15054 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:38.308777 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:38.324565  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:38.310753 14848 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:04:38.302573 14967 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:38.293213 14781 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:38.309967 15056 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:38.300103 14979 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.327912  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:38.324205 15054 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.331046 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:38.332401 15055 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:38.317078 14696 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:38.334111 15061 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.349967 15061 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:38.328715 14967 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.350845 14967 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:38.303412 14996 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:38.329053 14848 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.353322 14848 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:38.366209  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:38.330514  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:38.321753  9492 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:38.334343 14997 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:38.287384 14782 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:38.342144  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:38.342625  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:38.302441 15033 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.339248 15054 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:38.373917 14996 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:38.374471 14996 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.374818 14996 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:38.369489 15061 raft_consensus.cc:493] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:38.377481 15061 raft_consensus.cc:515] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:38.378997 15033 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:38.368409  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:38.380543  9445 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 19.
I20260709 13:04:38.369701 14927 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:04:38.369740  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:04:38.370213  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 48574.4us
I20260709 13:04:38.335467 14781 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:38.346179 14696 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:38.379590 15061 leader_election.cc:290] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:38.382310  9449 raft_consensus.cc:2393] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 15: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:38.367036  9452 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 17.
I20260709 13:04:38.383606  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:38.389268  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:38.406672  9450 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:04:38.382309 15032 ts_tablet_manager.cc:1916] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:38.341445 14979 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.437533 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:38.440838  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bfbc64d6af4fe0893109a7008e9b5d" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:38.432395 14987 raft_consensus.cc:515] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:38.442970  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:38.444005  9376 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
I20260709 13:04:38.444133 14782 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:38.445456  9492 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:38.446834 15055 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:38.447290 15055 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.447886 15055 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:38.447333 14987 leader_election.cc:290] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:38.447981 14781 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:38.448740 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 57566.2us
I20260709 13:04:38.447908 14967 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.453495  9523 raft_consensus.cc:2368] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 17. Current term is 18.
I20260709 13:04:38.454279  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:38.454617  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:04:38.445433  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 55543.6us
I20260709 13:04:38.455899  9418 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:38.461781  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:38.462419  9376 raft_consensus.cc:1803] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: voting while tombstoned based on last-logged opid 11.10
I20260709 13:04:38.462779  9376 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 11.
I20260709 13:04:38.467324  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:38.468861  9520 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
I20260709 13:04:38.474033  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:38.474946  9450 raft_consensus.cc:2393] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 in current term 12: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:38.475776  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:38.476418  9368 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
I20260709 13:04:38.477313  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:38.478586 14967 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:38.465883 15018 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:38.483145  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a4f94c156249adab9c2b1ffb00ac46" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:38.495944 15045 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:38.495836 14979 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:38.496807 15045 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.498221 14781 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:38.498945 15045 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:38.500530 14781 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:38.492621 14996 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.504514 14996 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 20 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:38.467247 14696 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.507258 14696 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:38.507990  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:38.508074 15054 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.511178  9343 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:38.512563  9343 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:38.517675  9343 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:38.513417 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:38.513296  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:38.514194 15036 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:38.515895  9519 raft_consensus.cc:2368] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 15. Current term is 16.
I20260709 13:04:38.518707  9368 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:04:38.519049  9518 raft_consensus.cc:2468] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 12.
I20260709 13:04:38.520504 10027 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:38.516508 15054 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:38.531090  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:38.435171 14983 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.539433 14428 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:38.539933 14428 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:38.539989  9343 leader_election.cc:304] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:38.540427 14428 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:38.544425  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:38.546419  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:38.552090  9418 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:38.466532 14882 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:38.480554 15067 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:38.554168 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620e7847d47845ad93329cf9a3a07dba" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:38.557796  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:38.570292  9451 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:04:38.576035 14428 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.586458 14428 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 19 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:38.551296 15030 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:38.589900  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:38.590459  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:38.590673  9449 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:38.591234  9446 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:38.591425  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:38.555915 14967 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:38.592521  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:38.590715  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:38.598625  9444 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:38.594221 14428 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.561760 14997 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:38.576776 15050 raft_consensus.cc:2804] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:38.606525  9449 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 18.
I20260709 13:04:38.619935  9343 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:38.600658 14428 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.620245  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:38.623862  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:38.630174  9445 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
I20260709 13:04:38.631083  9343 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:38.586030 15011 raft_consensus.cc:2749] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:38.624198 14997 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.646241 14997 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:38.658083 15050 raft_consensus.cc:697] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [term 12 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:04:38.659169 15050 consensus_queue.cc:237] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:38.664644  9343 leader_election.cc:304] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:38.664669 14959 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:38.666911 14959 raft_consensus.cc:2749] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:38.667228  9343 leader_election.cc:400] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 17. Current term is 18.
I20260709 13:04:38.667599  9343 leader_election.cc:403] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:38.580161 14848 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.671532 15030 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:38.668183 14997 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.673768  9444 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
I20260709 13:04:38.675716  9448 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 24 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 13:04:38.676581  9368 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 18.
I20260709 13:04:38.573518 14882 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.704099  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:38.705142  9376 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
I20260709 13:04:38.600927 14908 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:38.672947 14848 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 24 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:38.622013 14967 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.591501 15067 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.698470 15006 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 17. Current term is 18.
I20260709 13:04:38.673629 15031 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.123s
I20260709 13:04:38.738045  9446 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 20.
I20260709 13:04:38.723537 14908 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.730171 14983 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:04:38.742051  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 165068us
I20260709 13:04:38.747365  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:38.747474  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:38.749634  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77c45e065544a6cb4ff451f91a27cd1" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:38.751619  9368 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:38.748631  9492 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:38.751708  9375 raft_consensus.cc:3060] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:04:38.734238 14997 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:38.752115  9490 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:38.759183 15055 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.760540  9521 raft_consensus.cc:2368] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 16. Current term is 17.
I20260709 13:04:38.763165  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:38.764093  9369 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:38.767095  9492 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:38.777279 15054 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:38.776569  9368 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 20.
I20260709 13:04:38.774645 15000 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:38.783346 15000 raft_consensus.cc:697] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 18 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:38.793843  9490 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:38.796770 14967 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:38.805503 15000 consensus_queue.cc:237] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.807328  9418 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:38.808758 14908 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:38.816157  9418 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:38.809554 14781 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:38.834440 14882 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:38.765201 15063 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.836884 15063 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:38.837306 14997 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:38.838124 14997 raft_consensus.cc:697] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:38.839260 14997 consensus_queue.cc:237] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.854460 15067 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:38.863827  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:38.865096  9369 raft_consensus.cc:2468] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 17.
I20260709 13:04:38.869289  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:38.869890  9446 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:38.870298  9375 raft_consensus.cc:2468] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
I20260709 13:04:38.873227  9524 raft_consensus.cc:1275] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:04:38.824831 15076 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:38.889647  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:38.890704  9446 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:04:38.891525  9525 raft_consensus.cc:2368] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 19. Current term is 20.
I20260709 13:04:38.829552 14983 raft_consensus.cc:2749] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:38.891340  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:38.894047  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:38.896083  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:38.919726 14878 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:04:38.924335  9452 raft_consensus.cc:1275] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:04:38.933751  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:38.934816  9446 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 18.
I20260709 13:04:38.956303  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:38.956658  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:38.957202  9526 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:04:38.958808  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:38.960127  9523 raft_consensus.cc:2368] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 12. Current term is 13.
W20260709 13:04:38.961490  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 194482us
I20260709 13:04:38.962162  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:38.956527  9490 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:38.969022  9417 leader_election.cc:304] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:38.898274 15055 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:38.979517  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:38.980429  9369 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:38.981359  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:38.985430  9376 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 12.
I20260709 13:04:38.994459  9526 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 17.
I20260709 13:04:38.994984  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:38.976369 14782 raft_consensus.cc:2749] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:38.987509  9492 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:39.006189 15055 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:39.006675 15020 ts_tablet_manager.cc:1929] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.9
I20260709 13:04:39.006907 15055 raft_consensus.cc:697] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:39.007326 15020 log.cc:1199] T 58a6a34a419649a4829c651a0402a5fa P 6d50f1c263264b21919230bee398022b: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-2-root/wals/58a6a34a419649a4829c651a0402a5fa
I20260709 13:04:39.018615 15055 consensus_queue.cc:237] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:38.997119 14979 raft_consensus.cc:2804] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:39.022399 14979 raft_consensus.cc:697] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:39.023940  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836716b8e044849b07461ac40f5f1a6" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:39.023427 14979 consensus_queue.cc:237] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:39.007916  9492 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:39.028052 15083 raft_consensus.cc:2804] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:39.028702 15083 raft_consensus.cc:697] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 17 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:39.029621 15083 consensus_queue.cc:237] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:39.036600 14428 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:39.037707 14868 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:39.038311 14868 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:39.001963  9369 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 17.
I20260709 13:04:39.054147  9341 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:39.058153 14428 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:39.061995  9418 leader_election.cc:400] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 12. Current term is 13.
I20260709 13:04:39.062537  9418 leader_election.cc:403] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:04:39.063643  9526 raft_consensus.cc:1240] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Rejecting Update request from peer b0812463215649c3b011d36e2f0400c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:39.069304  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:39.078375  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:39.084407  9418 leader_election.cc:400] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 16. Current term is 17.
I20260709 13:04:39.087721  9343 leader_election.cc:400] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 19 election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 19. Current term is 20.
I20260709 13:04:39.090119  9343 leader_election.cc:403] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 13:04:39.090758  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 101890us
I20260709 13:04:39.099545  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4df305315b74f329792b6a1f9a5e4db" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:39.100335  9373 raft_consensus.cc:3060] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:39.094949  9490 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:39.105788  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:39.092926  9418 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:39.089774 14983 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for earlier term 12. Current term is 13.
I20260709 13:04:39.096333 14878 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:04:39.119990  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 49395.4us
I20260709 13:04:39.119962 14966 raft_consensus.cc:2804] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:39.153769  9343 leader_election.cc:400] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 15. Current term is 16.
I20260709 13:04:39.154158  9343 leader_election.cc:403] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:39.156351  9445 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:04:39.157059  9445 raft_consensus.cc:606] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:39.133853 14871 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:39.161557 15030 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 15. Current term is 16.
I20260709 13:04:39.148546 15032 ts_tablet_manager.cc:1929] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.15
I20260709 13:04:39.165446 15032 log.cc:1199] T 5e2df6fa742945289dda523a3fb658b0 P 925acbe78db14db3b9e4cfc857717947: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-0-root/wals/5e2df6fa742945289dda523a3fb658b0
I20260709 13:04:39.166813 15032 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52546 (request call id 81) took 2227 ms. Trace:
I20260709 13:04:39.167635 14728 raft_consensus.cc:993] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:39.168134 14728 raft_consensus.cc:1081] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:39.136857 14878 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.169404 14878 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:39.152599 15020 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54524 (request call id 9) took 2685 ms. Trace:
I20260709 13:04:39.170349 14871 raft_consensus.cc:697] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:39.134109 14977 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) with higher term. Message: Invalid argument: T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 for earlier term 19. Current term is 20.
I20260709 13:04:39.171635  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:39.119006 15067 consensus_queue.cc:1059] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:04:39.187355  9373 raft_consensus.cc:2468] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:04:39.187152 15002 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:04:39.197459  9418 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:39.172080 14966 raft_consensus.cc:697] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:39.202752 14966 consensus_queue.cc:237] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:39.205129 14969 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:04:39.196377 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 59500.8us
I20260709 13:04:39.216116 14961 consensus_queue.cc:1059] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:39.218132 15078 raft_consensus.cc:3055] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:39.218659 15078 raft_consensus.cc:740] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:04:39.229976  9273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 110) took 1343 ms. Trace:
I20260709 13:04:39.287442  9445 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:04:39.288203  9445 raft_consensus.cc:606] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Received request to transfer leadership to TS 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:39.288295 14878 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:39.230562  9273 rpcz_store.cc:276] 0709 13:04:37.886671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.886817 (+   146us) service_pool.cc:224] Handling call
0709 13:04:39.229891 (+1343074us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:38.330338 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:38.391829 (+ 61491us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:38.391866 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:04:38.391889 (+    23us) tablet.cc:662] Decoding operations
0709 13:04:38.392262 (+   373us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:38.392313 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:38.392346 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:38.392526 (+   180us) tablet.cc:701] Row locks acquired
0709 13:04:38.392544 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:04:38.392681 (+   137us) write_op.cc:270] Start()
0709 13:04:38.392793 (+   112us) write_op.cc:276] Timestamp: P: 1783602278392639 usec, L: 0
0709 13:04:38.392815 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:04:38.656808 (+263993us) log.cc:844] Serialized 587 byte log entry
0709 13:04:38.803690 (+146882us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b540016e4d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb586565e28 00007fb589fa0581 00007fb589f9fd58 00007fb589fa49f1 00007fb589fa49a9 00007fb589fa4939 00007fb589fa4901 00007fb589fa3b2d 000000000038f354 000000000038f199
0709 13:04:38.872470 (+ 68780us) op_driver.cc:464] REPLICATION: finished
0709 13:04:39.009068 (+136598us) write_op.cc:301] APPLY: starting
0709 13:04:39.010419 (+  1351us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:39.011707 (+  1288us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:39.011743 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:39.012585 (+   842us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:39.012816 (+   231us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:04:39.012882 (+    66us) write_op.cc:312] APPLY: finished
0709 13:04:39.021275 (+  8393us) log.cc:844] Serialized 25 byte log entry
0709 13:04:39.022150 (+   875us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:39.022250 (+   100us) write_op.cc:454] Released schema lock
0709 13:04:39.022298 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:39.022735 (+   437us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:39.022770 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4792,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":114251,"apply.run_cpu_time_us":3739,"apply.run_wall_time_us":24043,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8297,"num_ops":1,"prepare.queue_time_us":133033,"prepare.run_cpu_time_us":7771,"prepare.run_wall_time_us":479281,"replication_time_us":439611,"spinlock_wait_cycles":417304448,"thread_start_us":93750,"threads_started":1}]]}
I20260709 13:04:39.301875  9519 raft_consensus.cc:1275] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:04:39.167174 15032 rpcz_store.cc:276] 0709 13:04:36.939095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.941197 (+  2102us) service_pool.cc:224] Handling call
0709 13:04:37.349849 (+408652us) ts_tablet_manager.cc:1151] Deleting tablet 5e2df6fa742945289dda523a3fb658b0
0709 13:04:37.349941 (+    92us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:04:38.641354 (+1291413us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:39.136697 (+495343us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:39.166725 (+ 30028us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":801503,"tablet-delete.queue_time_us":358896,"thread_start_us":182885,"threads_started":1}
I20260709 13:04:39.314368 14868 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:39.169977 15020 rpcz_store.cc:276] 0709 13:04:36.447864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.473176 (+ 25312us) service_pool.cc:224] Handling call
0709 13:04:36.944263 (+471087us) ts_tablet_manager.cc:1151] Deleting tablet 58a6a34a419649a4829c651a0402a5fa
0709 13:04:36.963801 (+ 19538us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:04:38.280356 (+1316555us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:39.006521 (+726165us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:39.132611 (+126090us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":353744,"tablet-delete.queue_time_us":395823,"thread_start_us":227258,"threads_started":1}
I20260709 13:04:39.322485  9451 raft_consensus.cc:1275] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:04:39.191501 14871 consensus_queue.cc:237] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:39.339607 15078 consensus_queue.cc:260] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:39.384152  9523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46902
I20260709 13:04:39.384927  9523 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:39.385349  9523 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:39.389246  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:04:39.392082  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 238440us
I20260709 13:04:39.395298  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:39.396606  9446 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:04:39.429039  9450 raft_consensus.cc:1240] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 24 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 23. Current term is 24. Ops: [23.13-23.13]
W20260709 13:04:39.450366 10024 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.415074 14981 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:04:39.471115  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:39.472863  9373 raft_consensus.cc:2393] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 14: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:39.480046  9492 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:39.458735  9490 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:39.483165  9526 raft_consensus.cc:1240] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 17 LEADER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:39.484375 14987 consensus_queue.cc:1048] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:04:39.482837 15083 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:39.487368 14868 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:39.489831 14781 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:39.519347  9492 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:39.507169 14997 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.030s	sys 0.019s
I20260709 13:04:39.515127 14965 consensus_queue.cc:1059] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
W20260709 13:04:39.540134 14997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.030s	sys 0.019s
I20260709 13:04:39.540443 14965 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:39.544138 15083 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:39.563468  9523 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:39.598088  9452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:04:39.599056  9452 raft_consensus.cc:606] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:39.549703 14781 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:39.613977 14781 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:39.660862  9523 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:39.673959 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 112611us
I20260709 13:04:39.659614  9450 raft_consensus.cc:2955] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:04:39.688614  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 149544us
I20260709 13:04:39.693498  9377 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:04:39.697893  9445 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:04:39.698616  9445 raft_consensus.cc:606] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Received request to transfer leadership to TS 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:39.698956  9445 raft_consensus.cc:614] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:39.701586  9377 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:04:39.725308  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:04:39.730558  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:39.731401  9368 raft_consensus.cc:2368] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 18. Current term is 19.
I20260709 13:04:39.728498 15105 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:04:39.747102 14781 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:39.758533  9492 leader_election.cc:400] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 18. Current term is 19.
I20260709 13:04:39.759246  9492 leader_election.cc:403] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:39.762658  9368 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:04:39.758703 15105 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:04:39.772507 15002 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:39.788506 15002 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:39.790853 15002 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:39.780793 14781 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:39.800148  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:39.770005 14967 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:04:39.820825  9377 raft_consensus.cc:2393] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 14: Already voted for candidate 925acbe78db14db3b9e4cfc857717947 in this term.
I20260709 13:04:39.857146  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:39.857908  9519 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:04:39.859855 15063 raft_consensus.cc:3055] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:04:39.860357 15063 raft_consensus.cc:740] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:39.861292 15063 consensus_queue.cc:260] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:39.862787 15063 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:04:39.876703 15099 log.cc:927] Time spent T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:04:39.892177  9341 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:39.894601  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:39.951870  9445 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:39.895398 15000 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:39.909150  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:39.910274  9275 catalog_manager.cc:5697] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 22 to 23, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 23 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:39.413604  9262 catalog_manager.cc:5028] TS 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): tablet 5e2df6fa742945289dda523a3fb658b0 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:04:39.914945  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:39.958268  9374 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:39.958196  9262 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 544557us
I20260709 13:04:39.917692  9274 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43244 (request call id 210) took 2991 ms. Trace:
I20260709 13:04:39.931037  9371 raft_consensus.cc:1240] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:39.907245  9273 catalog_manager.cc:5697] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 11 to 12, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 12 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:39.960505  9273 catalog_manager.cc:5697] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 17 to 18, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 18 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:39.952469  9526 raft_consensus.cc:1240] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:39.956148  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:39.900661 15078 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:39.964531  9418 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:39.969527  9262 catalog_manager.cc:5028] TS 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): tablet 58a6a34a419649a4829c651a0402a5fa (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
W20260709 13:04:39.975410  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 83307.5us
I20260709 13:04:39.963376  9275 catalog_manager.cc:5697] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 16 to 17, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 17 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:39.959458  9274 rpcz_store.cc:276] 0709 13:04:36.926588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.935107 (+  8519us) service_pool.cc:224] Handling call
0709 13:04:39.917585 (+2982478us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:37.970646 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:38.016756 (+ 46110us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:38.016807 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:04:38.016839 (+    32us) tablet.cc:662] Decoding operations
0709 13:04:38.017308 (+   469us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:38.017390 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:38.017420 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:04:38.017732 (+   312us) tablet.cc:701] Row locks acquired
0709 13:04:38.017750 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:04:38.017990 (+   240us) write_op.cc:270] Start()
0709 13:04:38.018109 (+   119us) write_op.cc:276] Timestamp: P: 1783602278017933 usec, L: 0
0709 13:04:38.018131 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:04:38.018949 (+   818us) log.cc:844] Serialized 911 byte log entry
0709 13:04:38.391774 (+372825us) op_driver.cc:464] REPLICATION: finished
0709 13:04:38.603091 (+211317us) write_op.cc:301] APPLY: starting
0709 13:04:38.626158 (+ 23067us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:38.788084 (+161926us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b1800476560. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb58c345de1 00007fb58c3525b1 00007fb5861124bc 00007fb58346048b 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347a455 00007fb5864e7190 00007fb5864e0ae7 00007fb5864dfdd9
0709 13:04:38.843232 (+ 55148us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:38.843260 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:38.844869 (+  1609us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:38.883365 (+ 38496us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:04:38.890434 (+  7069us) write_op.cc:312] APPLY: finished
0709 13:04:38.960891 (+ 70457us) log.cc:844] Serialized 33 byte log entry
0709 13:04:38.978568 (+ 17677us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:38.986497 (+  7929us) write_op.cc:454] Released schema lock
0709 13:04:38.997442 (+ 10945us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:39.013331 (+ 15889us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:39.013375 (+    44us) write_op.cc:454] Released schema lock
0709 13:04:39.671044 (+657669us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b540016e4d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb58656732a 00007fb5864ecf14 00007fb5864ecec3 00007fb5864ece38 00007fb5864ecdf3 00007fb5864ec0dc 00007fb586515e16 00007fb5864fdcbb 00007fb5864e839d 00007fb5864ebd75
Metrics: {"mutex_wait_us":188531,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":190966,"apply.run_cpu_time_us":6806,"apply.run_wall_time_us":422756,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12467,"num_ops":2,"prepare.queue_time_us":23856,"prepare.run_cpu_time_us":31041,"prepare.run_wall_time_us":341651,"raft.queue_time_us":153529,"raft.run_cpu_time_us":54042,"raft.run_wall_time_us":1049604,"replication_time_us":373479,"spinlock_wait_cycles":36850432,"thread_start_us":523058,"threads_started":4,"wal-append.queue_time_us":220626}]]}
I20260709 13:04:39.978348 14997 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:39.984597 15011 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:39.974705 14969 consensus_queue.cc:1059] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:04:40.023779  9374 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:04:40.029445  9492 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:40.034104  9526 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:04:40.046515 15107 raft_consensus.cc:2804] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:40.047691 15107 raft_consensus.cc:697] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 8 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:40.028874 15002 consensus_queue.cc:1059] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:04:40.016494 14997 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:40.053333 14997 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:40.071136 15083 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:40.074393 14969 consensus_queue.cc:1243] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer 6d50f1c263264b21919230bee398022b log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:04:40.075095 14969 raft_consensus.cc:3055] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:40.075433 14969 raft_consensus.cc:740] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:40.076234 14969 consensus_queue.cc:260] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:40.079059 15002 raft_consensus.cc:3055] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:40.079514 15002 raft_consensus.cc:740] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:04:40.050009 15112 log.cc:927] Time spent T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:04:40.080328 15002 consensus_queue.cc:260] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:40.101969 14878 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 19 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:40.104902  9373 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:04:40.107223  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:40.114763 15002 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:40.048921 15107 consensus_queue.cc:237] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:40.158674 15105 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:40.190224  9445 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 19.
I20260709 13:04:40.201774  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:40.147164 14969 raft_consensus.cc:3060] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:40.213837  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:40.217054  9447 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:04:40.219924  9448 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:04:40.232738  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:40.233660  9443 raft_consensus.cc:2368] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 18. Current term is 19.
I20260709 13:04:40.241568  9370 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:04:40.247334  9445 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:04:40.251659  9444 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:04:40.232609 14818 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.276219 14818 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:40.285665 14818 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:40.286777  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:40.287845  9524 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
I20260709 13:04:40.274024  9341 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:40.289562  9343 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:40.291680  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:40.292449  9444 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
I20260709 13:04:40.308367 14908 raft_consensus.cc:993] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:40.313262 14818 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:40.314023 14818 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.314503 14818 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:40.325580 14997 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:40.297874 14915 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:04:40.334205 15122 log.cc:927] Time spent T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:04:40.341178 14997 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:40.375277 15003 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:04:40.382860 14818 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:40.378170 14782 raft_consensus.cc:1081] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:40.356256 14915 raft_consensus.cc:697] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 19 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:40.425830 14818 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:40.429100  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:40.430032  9444 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:40.433641  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:40.434633  9525 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:40.449105 14915 consensus_queue.cc:237] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:40.467502 15046 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
W20260709 13:04:40.438328 15116 log.cc:927] Time spent T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 13:04:40.477721  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 242057us
W20260709 13:04:40.473112 14967 consensus_meta.cc:287] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.656s	user 0.011s	sys 0.002s
I20260709 13:04:40.482372  9444 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
I20260709 13:04:40.486686  9341 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:40.497859 15107 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:40.498420 14959 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:40.499155 14959 raft_consensus.cc:697] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:40.499877 15107 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:40.500204 14959 consensus_queue.cc:237] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:40.502952  9446 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:04:40.503368  9446 pending_rounds.cc:85] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526: Aborting all ops after (but not including) 8
I20260709 13:04:40.503595  9446 pending_rounds.cc:107] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:04:40.503898  9446 raft_consensus.cc:2889] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:40.468546 15046 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:40.507937 15046 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:40.510059 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:40.510967 10063 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:04:40.512694  9342 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:40.513660 15046 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:40.514096 15046 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:40.514526 15046 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:40.518640  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:40.519550  9524 raft_consensus.cc:2393] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 11: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:40.537526 15046 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:40.550005  9490 leader_election.cc:400] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 18. Current term is 19.
I20260709 13:04:40.553267  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:40.553349  9490 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:40.562608  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:40.566298 15063 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:40.487166 14967 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) with higher term. Message: Invalid argument: T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 18. Current term is 19.
I20260709 13:04:40.554311  9451 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 8.
I20260709 13:04:40.589432  9524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46902
I20260709 13:04:40.590085  9524 raft_consensus.cc:493] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:40.590482  9524 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:40.592111  9444 raft_consensus.cc:1275] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:40.548965 15000 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:04:40.585188 14882 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:40.587509 15119 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:04:40.599589 15083 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.641438  9524 raft_consensus.cc:515] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:40.641122  9418 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:40.646740  9522 raft_consensus.cc:1240] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:40.674149  9524 leader_election.cc:290] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:40.610436 15000 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:40.680912 15000 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:40.683125 15003 raft_consensus.cc:993] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526: : Instructing follower 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:04:40.686045 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:40.688076  9517 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 19.
I20260709 13:04:40.644776 14967 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:04:40.633260 15128 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:04:40.694173 15003 raft_consensus.cc:1081] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Signalling peer 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:04:40.685230 15114 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:40.653076 15083 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:40.701716  9372 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:52548
I20260709 13:04:40.702322  9372 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:40.702708  9372 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:40.708199  9525 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
I20260709 13:04:40.634553 14882 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:40.712386 14868 raft_consensus.cc:2764] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:04:40.712602 14966 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.708182 14969 consensus_queue.cc:1059] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:04:40.713269 14966 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:40.713699 14882 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:40.714038 15046 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:40.709903 15083 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:40.716840 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:40.641961 15119 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:40.719901 15119 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:40.726684 14969 raft_consensus.cc:3055] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:40.727325 14969 raft_consensus.cc:740] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:40.730245 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:40.715806 14966 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:40.728489 14969 consensus_queue.cc:260] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:40.736346 14969 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:40.748805  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:40.766283 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:04:40.757229  9372 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:40.775957  9418 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
W20260709 13:04:40.777887  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 140917us
I20260709 13:04:40.787878  9451 raft_consensus.cc:1240] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:40.792661  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:40.793182  9372 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:40.794055  9444 raft_consensus.cc:2393] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 24: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:40.805457  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:40.782544 15045 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:40.809091  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:04:40.810096 15126 log.cc:927] Time spent T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:04:40.784730 14966 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:04:40.816457 10063 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 11.
I20260709 13:04:40.820333  9342 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:40.822023 14999 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:40.822683 14999 raft_consensus.cc:697] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:40.823666 14999 consensus_queue.cc:237] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:40.830129  9446 raft_consensus.cc:1275] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:40.834925  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:40.838315  9522 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 24.
I20260709 13:04:40.851514 15129 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.852113 15129 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:40.854667 15129 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:40.855474  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:40.856611  9372 raft_consensus.cc:2410] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 25 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 13:04:40.857641  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:40.858512  9517 raft_consensus.cc:2410] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d62c9d5a052b42ce8675f8438f846526 for term 25 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 13:04:40.859030  9490 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:40.860188  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:40.820397  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:40.865989  9523 raft_consensus.cc:2393] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 11: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
I20260709 13:04:40.871757  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b1affc9131446038db1c8ad10108ab0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:40.874588  9372 raft_consensus.cc:3060] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:40.885309  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:40.898727  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:40.898743  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:40.903529  9374 raft_consensus.cc:1275] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:40.908012  9443 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
I20260709 13:04:40.913288  9372 raft_consensus.cc:2468] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
I20260709 13:04:40.867067 15067 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:40.917819  9447 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:04:40.925540 15140 consensus_queue.cc:1059] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:40.919502 14967 consensus_queue.cc:1048] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:04:40.901399 15130 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:40.931929 15021 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:40.923599  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:40.933157  9443 raft_consensus.cc:3055] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:40.933583  9443 raft_consensus.cc:740] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:40.936734 14959 raft_consensus.cc:3055] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:40.938313 14959 raft_consensus.cc:740] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:40.939121 14959 consensus_queue.cc:260] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:40.940115  9443 consensus_queue.cc:260] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:40.942051  9443 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:40.947638  9490 leader_election.cc:304] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:40.950038  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:40.950719  9520 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:40.951515 15067 raft_consensus.cc:2804] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:40.952075 15067 raft_consensus.cc:697] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:40.952983 15067 consensus_queue.cc:237] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:40.937839  9492 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:40.954879  9524 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:04:40.956404 15000 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:40.940469 14959 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:40.957041 14967 consensus_queue.cc:1048] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:40.956341  9492 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:04:40.961133 15104 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:40.966548  9343 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:40.967581  9520 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 18.
I20260709 13:04:40.973191 15021 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:04:40.976197 15021 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:04:40.976922 15021 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:40.986198  9273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 111) took 1570 ms. Trace:
I20260709 13:04:41.012264  9443 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 18.
I20260709 13:04:41.017057  9275 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43252 (request call id 188) took 2183 ms. Trace:
W20260709 13:04:41.018286  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 48051.6us
I20260709 13:04:40.987193  9273 rpcz_store.cc:276] 0709 13:04:39.414507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.414670 (+   163us) service_pool.cc:224] Handling call
0709 13:04:40.985198 (+1570528us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:40.288810 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:40.316831 (+ 28021us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:40.316872 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:04:40.316891 (+    19us) tablet.cc:662] Decoding operations
0709 13:04:40.317424 (+   533us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:40.317496 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:40.317526 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:04:40.317882 (+   356us) tablet.cc:701] Row locks acquired
0709 13:04:40.317903 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:04:40.318058 (+   155us) write_op.cc:270] Start()
0709 13:04:40.318176 (+   118us) write_op.cc:276] Timestamp: P: 1783602280318006 usec, L: 0
0709 13:04:40.318199 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:04:40.318904 (+   705us) log.cc:844] Serialized 901 byte log entry
0709 13:04:40.645571 (+326667us) op_driver.cc:464] REPLICATION: finished
0709 13:04:40.861960 (+216389us) write_op.cc:301] APPLY: starting
0709 13:04:40.862050 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:40.864305 (+  2255us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:40.864462 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:40.944903 (+ 80441us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:40.945157 (+   254us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:04:40.945208 (+    51us) write_op.cc:312] APPLY: finished
0709 13:04:40.945442 (+   234us) log.cc:844] Serialized 33 byte log entry
0709 13:04:40.945628 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:40.945715 (+    87us) write_op.cc:454] Released schema lock
0709 13:04:40.945761 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:40.946160 (+   399us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:40.946195 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":448361,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":216160,"apply.run_cpu_time_us":6669,"apply.run_wall_time_us":84185,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12467,"num_ops":2,"prepare.queue_time_us":293066,"prepare.run_cpu_time_us":27023,"prepare.run_wall_time_us":204177,"raft.queue_time_us":119634,"raft.run_cpu_time_us":18150,"raft.run_wall_time_us":133663,"replication_time_us":327248,"spinlock_wait_cycles":3968,"thread_start_us":569614,"threads_started":4,"wal-append.queue_time_us":192797}]]}
I20260709 13:04:41.026557  9341 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:04:41.053630  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 52724.1us
I20260709 13:04:41.034711  9274 catalog_manager.cc:5697] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 16 to 17, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 17 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:41.057960  9274 catalog_manager.cc:5697] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 17 to 18, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 18 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:41.017560  9275 rpcz_store.cc:276] 0709 13:04:38.833229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:38.842102 (+  8873us) service_pool.cc:224] Handling call
0709 13:04:39.038114 (+196012us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b540016e4d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d4090 00007fb586572f3a 00007fb58c3291cc 00007fb58c42737e 00007fb58a8e82a4 00007fb58a8e8232 00007fb58a8e8161 00007fb58a8e80dc 00007fb58a8e7392 00007fb5848a548c 00007fb5848a48c6
0709 13:04:41.016894 (+1978780us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:40.567421 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:40.642660 (+ 75239us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:40.642710 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:04:40.642739 (+    29us) tablet.cc:662] Decoding operations
0709 13:04:40.643283 (+   544us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:40.643343 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:40.643368 (+    25us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:04:40.707411 (+ 64043us) tablet.cc:701] Row locks acquired
0709 13:04:40.711371 (+  3960us) write_op.cc:260] PREPARE: finished
0709 13:04:40.766829 (+ 55458us) write_op.cc:270] Start()
0709 13:04:40.779665 (+ 12836us) write_op.cc:276] Timestamp: P: 1783602280761846 usec, L: 0
0709 13:04:40.783977 (+  4312us) op_driver.cc:348] REPLICATION: starting
0709 13:04:40.812752 (+ 28775us) log.cc:844] Serialized 911 byte log entry
0709 13:04:40.840826 (+ 28074us) op_driver.cc:464] REPLICATION: finished
0709 13:04:40.946605 (+105779us) write_op.cc:301] APPLY: starting
0709 13:04:40.946686 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:40.963665 (+ 16979us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:40.963759 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:40.978873 (+ 15114us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:40.979058 (+   185us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:04:40.979105 (+    47us) write_op.cc:312] APPLY: finished
0709 13:04:40.979344 (+   239us) log.cc:844] Serialized 33 byte log entry
0709 13:04:40.980212 (+   868us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:40.980310 (+    98us) write_op.cc:454] Released schema lock
0709 13:04:40.980355 (+    45us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":836211,"reported_tablets":7,"spinlock_wait_cycles":346709248,"child_traces":[["op",{"apply.queue_time_us":105581,"apply.run_cpu_time_us":5468,"apply.run_wall_time_us":34104,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8340,"num_ops":2,"prepare.queue_time_us":563298,"prepare.run_cpu_time_us":4375,"prepare.run_wall_time_us":265179,"replication_time_us":56701,"thread_start_us":193066,"threads_started":1}]]}
I20260709 13:04:41.063829 14882 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:41.067570 15046 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:41.086798  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:41.155437  9449 raft_consensus.cc:1275] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:04:41.101737 14882 raft_consensus.cc:697] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 18 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:04:41.179261  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 46486.4us
I20260709 13:04:41.215265 15096 consensus_queue.cc:1048] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:41.271112 14882 consensus_queue.cc:237] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:41.314695  9523 raft_consensus.cc:1275] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:04:41.323614  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 162605us
I20260709 13:04:41.375223 15139 consensus_queue.cc:1048] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:41.396063 15021 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:41.443356  9368 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:04:41.495508 14868 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:41.518968  9523 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:04:41.523388 10068 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:04:41.534729 14999 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:04:41.554986  9450 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:04:41.564568  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:41.565794  9450 raft_consensus.cc:2393] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 925acbe78db14db3b9e4cfc857717947 in current term 24: Already voted for candidate d62c9d5a052b42ce8675f8438f846526 in this term.
I20260709 13:04:41.566213 15083 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:04:41.580282 15021 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 24 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:41.550678 15139 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:04:41.606540  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:41.612429  9274 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43240 (request call id 207) took 1549 ms. Trace:
I20260709 13:04:41.623162  9274 rpcz_store.cc:276] 0709 13:04:40.063075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.065143 (+  2068us) service_pool.cc:224] Handling call
0709 13:04:41.612357 (+1547214us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:41.207380 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:41.213686 (+  6306us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:41.213725 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:04:41.213744 (+    19us) tablet.cc:662] Decoding operations
0709 13:04:41.214173 (+   429us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:41.214234 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:41.214265 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:04:41.214617 (+   352us) tablet.cc:701] Row locks acquired
0709 13:04:41.214640 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:04:41.214789 (+   149us) write_op.cc:270] Start()
0709 13:04:41.214918 (+   129us) write_op.cc:276] Timestamp: P: 1783602281214738 usec, L: 0
0709 13:04:41.214970 (+    52us) op_driver.cc:348] REPLICATION: starting
0709 13:04:41.215652 (+   682us) log.cc:844] Serialized 911 byte log entry
0709 13:04:41.222484 (+  6832us) op_driver.cc:464] REPLICATION: finished
0709 13:04:41.222951 (+   467us) write_op.cc:301] APPLY: starting
0709 13:04:41.223045 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:41.225053 (+  2008us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:41.225182 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:41.228681 (+  3499us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:41.228910 (+   229us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:04:41.229114 (+   204us) write_op.cc:312] APPLY: finished
0709 13:04:41.229358 (+   244us) log.cc:844] Serialized 33 byte log entry
0709 13:04:41.230216 (+   858us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:41.230327 (+   111us) write_op.cc:454] Released schema lock
0709 13:04:41.230371 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:41.230858 (+   487us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:41.230894 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":155,"apply.run_cpu_time_us":5515,"apply.run_wall_time_us":7878,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12467,"num_ops":2,"prepare.queue_time_us":119,"prepare.run_cpu_time_us":3019,"prepare.run_wall_time_us":24226,"replication_time_us":7385}]]}
I20260709 13:04:41.623178  9271 catalog_manager.cc:5697] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 15 to 17, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 17 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:41.617686  9374 consensus_queue.cc:237] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:41.778626  9523 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 24.
W20260709 13:04:41.780998  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 96853.3us
I20260709 13:04:41.836203  9445 raft_consensus.cc:1275] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:04:41.836710 10068 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:04:41.845762  9443 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:04:41.847615 14915 consensus_queue.cc:1048] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:04:41.852505 14978 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
W20260709 13:04:41.845072 15131 log.cc:927] Time spent T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:04:41.869611 14999 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:04:41.945791  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 95188.2us
W20260709 13:04:41.948597  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 135637us
W20260709 13:04:42.014510 15167 log.cc:927] Time spent T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.106s	user 0.002s	sys 0.000s
I20260709 13:04:42.015005  9524 raft_consensus.cc:1275] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
W20260709 13:04:42.017077 15163 log.cc:927] Time spent T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.109s	user 0.000s	sys 0.002s
I20260709 13:04:42.025998  9343 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:42.023909  9274 catalog_manager.cc:5697] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 10 to 11, leader changed from b0812463215649c3b011d36e2f0400c9 (127.8.4.68) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 11 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:42.054162 14999 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:42.080358 14999 raft_consensus.cc:697] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 24 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:42.081499 14999 consensus_queue.cc:237] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:42.112632 15157 consensus_queue.cc:1048] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:04:42.106473 15006 raft_consensus.cc:2955] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:42.189169 10063 raft_consensus.cc:2955] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:04:42.213469  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 56149.2us
I20260709 13:04:42.247562  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 060ae09cf899421ea6057ee5eca95814 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:42.272097  9443 raft_consensus.cc:2955] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:42.311232 14997 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.311798 14997 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:42.314252 14997 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:42.316859  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:42.317611  9374 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 14.
I20260709 13:04:42.327831  9418 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:42.332283  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:04:42.340107 14997 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:42.349419 14997 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:42.372898  9271 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43244 (request call id 211) took 1806 ms. Trace:
I20260709 13:04:42.373739  9273 catalog_manager.cc:5697] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:42.375819  9273 catalog_manager.cc:5697] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:42.349974 14997 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:42.410248  9274 catalog_manager.cc:5697] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 13 to 14, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New cstate: current_term: 18 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:42.434545  9273 catalog_manager.cc:5697] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:42.463783 14997 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:42.466302 14965 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:04:42.467368 14965 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:42.482739  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:42.485878  9374 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:42.439877  9273 catalog_manager.cc:5697] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 17 to 19, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 19 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:42.373450  9271 rpcz_store.cc:276] 0709 13:04:40.566498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.566820 (+   322us) service_pool.cc:224] Handling call
0709 13:04:40.607333 (+ 40513us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b540016e4d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d4090 00007fb586572f3a 00007fb58c3291cc 00007fb58c42737e 00007fb58a8e82a4 00007fb58a8e8232 00007fb58a8e8161 00007fb58a8e80dc 00007fb58a8e7392 00007fb5848a548c 00007fb5848a48c6
0709 13:04:42.372816 (+1765483us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:41.788506 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:41.920026 (+131520us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:41.921516 (+  1490us) write_op.cc:435] Acquired schema lock
0709 13:04:41.921540 (+    24us) tablet.cc:662] Decoding operations
0709 13:04:41.964179 (+ 42639us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:41.976978 (+ 12799us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:41.981929 (+  4951us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:42.033377 (+ 51448us) tablet.cc:701] Row locks acquired
0709 13:04:42.034050 (+   673us) write_op.cc:260] PREPARE: finished
0709 13:04:42.035522 (+  1472us) write_op.cc:270] Start()
0709 13:04:42.035671 (+   149us) write_op.cc:276] Timestamp: P: 1783602282035464 usec, L: 0
0709 13:04:42.035694 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:04:42.036411 (+   717us) log.cc:844] Serialized 532 byte log entry
0709 13:04:42.231337 (+194926us) op_driver.cc:464] REPLICATION: finished
0709 13:04:42.309206 (+ 77869us) write_op.cc:301] APPLY: starting
0709 13:04:42.309305 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:42.310821 (+  1516us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:42.318073 (+  7252us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:42.319024 (+   951us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:42.319263 (+   239us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:04:42.319325 (+    62us) write_op.cc:312] APPLY: finished
0709 13:04:42.319543 (+   218us) log.cc:844] Serialized 25 byte log entry
0709 13:04:42.319751 (+   208us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:42.319844 (+    93us) write_op.cc:454] Released schema lock
0709 13:04:42.319896 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:42.320365 (+   469us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:42.320396 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":24412,"reported_tablets":11,"spinlock_wait_cycles":3289856,"child_traces":[["op",{"apply.queue_time_us":72649,"apply.run_cpu_time_us":4036,"apply.run_wall_time_us":11151,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8297,"num_ops":1,"prepare.queue_time_us":66683,"prepare.run_cpu_time_us":4979,"prepare.run_wall_time_us":255484,"replication_time_us":195462,"thread_start_us":31316,"threads_started":1}]]}
I20260709 13:04:42.492477  9273 catalog_manager.cc:5697] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 11 to 13, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 13 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:42.503727  9273 catalog_manager.cc:5697] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 7 to 8, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 8 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:42.512880  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:04:42.512069  9273 catalog_manager.cc:5697] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 15 to 17, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 17 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:42.524613  9273 catalog_manager.cc:5697] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 15 to 16, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 16 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:42.540061  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:42.540781  9517 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:04:42.546845  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:04:42.547773  9450 raft_consensus.cc:2368] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 14. Current term is 15.
I20260709 13:04:42.549186  9490 leader_election.cc:400] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 14. Current term is 15.
I20260709 13:04:42.553815  9490 leader_election.cc:403] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:42.538683 14997 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:42.564792  9374 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
I20260709 13:04:42.545830 14965 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:42.572507  9418 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:42.576572  9517 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
I20260709 13:04:42.583034 14997 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:42.585187 15173 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) with higher term. Message: Invalid argument: T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b for earlier term 14. Current term is 15.
I20260709 13:04:42.630754 14997 raft_consensus.cc:697] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:42.632400 14997 consensus_queue.cc:237] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:42.622664  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:42.653594  9508 tablet_service.cc:1558] Processing DeleteTablet for tablet 060ae09cf899421ea6057ee5eca95814 with delete_type TABLET_DATA_TOMBSTONED (TS 6d50f1c263264b21919230bee398022b not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:54524
I20260709 13:04:42.718004  9445 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 24 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:04:42.724663 14959 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.019s
W20260709 13:04:42.777480  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 83277.3us
I20260709 13:04:42.811414 15185 tablet_replica.cc:333] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:04:42.813078 15185 raft_consensus.cc:2243] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:42.815171 15185 raft_consensus.cc:2272] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:42.823158  9523 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 24 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:04:42.846804 15185 ts_tablet_manager.cc:1916] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:42.852391  9374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:42.855970  9374 raft_consensus.cc:606] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:42.856339  9374 raft_consensus.cc:614] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:42.863052  9273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43252 (request call id 189) took 1415 ms. Trace:
I20260709 13:04:42.874428 15044 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:04:42.878557 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 137759us
I20260709 13:04:42.883311  9374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:42.884184  9374 raft_consensus.cc:606] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:42.871608  9273 rpcz_store.cc:276] 0709 13:04:41.447754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.447945 (+   191us) service_pool.cc:224] Handling call
0709 13:04:42.856531 (+1408586us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:42.580128 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:42.580643 (+   515us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:42.580682 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:04:42.580700 (+    18us) tablet.cc:662] Decoding operations
0709 13:04:42.626271 (+ 45571us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:42.626327 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:42.626367 (+    40us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:04:42.627640 (+  1273us) tablet.cc:701] Row locks acquired
0709 13:04:42.627658 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:04:42.627797 (+   139us) write_op.cc:270] Start()
0709 13:04:42.628088 (+   291us) write_op.cc:276] Timestamp: P: 1783602282627755 usec, L: 0
0709 13:04:42.628114 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:04:42.637736 (+  9622us) log.cc:844] Serialized 3186 byte log entry
0709 13:04:42.656955 (+ 19219us) op_driver.cc:464] REPLICATION: finished
0709 13:04:42.659993 (+  3038us) write_op.cc:301] APPLY: starting
0709 13:04:42.660087 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:42.685763 (+ 25676us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:42.685923 (+   160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:42.763878 (+ 77955us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:42.764215 (+   337us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:04:42.764272 (+    57us) write_op.cc:312] APPLY: finished
0709 13:04:42.764582 (+   310us) log.cc:844] Serialized 81 byte log entry
0709 13:04:42.776349 (+ 11767us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:42.781288 (+  4939us) write_op.cc:454] Released schema lock
0709 13:04:42.782172 (+   884us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:42.784532 (+  2360us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:42.784637 (+   105us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":72152,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":2752,"apply.run_cpu_time_us":17630,"apply.run_wall_time_us":124508,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33360,"num_ops":8,"prepare.queue_time_us":338,"prepare.run_cpu_time_us":5034,"prepare.run_wall_time_us":57935,"replication_time_us":28712}]]}
I20260709 13:04:42.897938  9368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:42.916179  9368 raft_consensus.cc:606] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:42.867867  9275 catalog_manager.cc:5697] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 13 to 15, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 15 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:42.933082  9368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "807906edc34d41589d9b860b72f70e16"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:42.933812  9368 raft_consensus.cc:606] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:42.933787  9275 catalog_manager.cc:5697] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 17 to 18, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 18 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:42.951150  9368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:42.953409  9368 raft_consensus.cc:606] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:42.957434  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:42.959450  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:42.991752 15044 raft_consensus.cc:993] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:42.992529 15044 raft_consensus.cc:1081] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:42.994457 15139 raft_consensus.cc:993] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:42.998798 15139 raft_consensus.cc:1081] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:43.001531  9443 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51012
I20260709 13:04:43.002301  9443 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.003237  9443 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:43.045199  9517 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46894
I20260709 13:04:43.045929  9517 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.046289  9517 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:43.057750  9368 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:43.060387 14997 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:43.069334  9517 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:43.079736  9273 catalog_manager.cc:5697] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 23 to 24, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 24 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } }
I20260709 13:04:43.086751 15006 raft_consensus.cc:993] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:43.087332 15006 raft_consensus.cc:1081] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:43.089727  9275 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43240 (request call id 208) took 1093 ms. Trace:
I20260709 13:04:43.101505  9275 rpcz_store.cc:276] 0709 13:04:41.996691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.996860 (+   169us) service_pool.cc:224] Handling call
0709 13:04:43.089660 (+1092800us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:43.012492 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:43.013183 (+   691us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:43.013222 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:04:43.013238 (+    16us) tablet.cc:662] Decoding operations
0709 13:04:43.013645 (+   407us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:43.013704 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:43.013738 (+    34us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:04:43.014105 (+   367us) tablet.cc:701] Row locks acquired
0709 13:04:43.014119 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:04:43.014265 (+   146us) write_op.cc:270] Start()
0709 13:04:43.014404 (+   139us) write_op.cc:276] Timestamp: P: 1783602283014213 usec, L: 0
0709 13:04:43.014422 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:04:43.015235 (+   813us) log.cc:844] Serialized 911 byte log entry
0709 13:04:43.017302 (+  2067us) op_driver.cc:464] REPLICATION: finished
0709 13:04:43.017809 (+   507us) write_op.cc:301] APPLY: starting
0709 13:04:43.017896 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:43.019320 (+  1424us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:43.019444 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:43.020932 (+  1488us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:43.021160 (+   228us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:04:43.021217 (+    57us) write_op.cc:312] APPLY: finished
0709 13:04:43.021467 (+   250us) log.cc:844] Serialized 33 byte log entry
0709 13:04:43.021660 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:43.021782 (+   122us) write_op.cc:454] Released schema lock
0709 13:04:43.021830 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:43.022256 (+   426us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:43.022289 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":37085,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":262,"apply.run_cpu_time_us":4419,"apply.run_wall_time_us":4419,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8340,"num_ops":2,"prepare.queue_time_us":1191,"prepare.run_cpu_time_us":3270,"prepare.run_wall_time_us":3270,"replication_time_us":2749}]]}
I20260709 13:04:43.106709  9443 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:43.110013  9517 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:43.109881  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:43.110755  9370 raft_consensus.cc:3055] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:43.111097  9370 raft_consensus.cc:740] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:43.112213  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:43.112640  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:43.113166  9520 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:43.113405  9374 raft_consensus.cc:3055] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:43.114008  9374 raft_consensus.cc:740] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:43.113060  9370 consensus_queue.cc:260] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:43.115867  9443 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 18 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:43.116183  9370 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:43.117257  9523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "807906edc34d41589d9b860b72f70e16"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46894
I20260709 13:04:43.117828  9523 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.118491  9523 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:43.119405  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:43.119467  9374 consensus_queue.cc:260] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:43.120163  9450 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:43.128078  9520 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 18.
I20260709 13:04:43.129840  9418 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:43.129822  9274 catalog_manager.cc:5697] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 13 to 15, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 15 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:43.132506 15189 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:43.133263 15189 raft_consensus.cc:697] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 18 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:43.134567 15189 consensus_queue.cc:237] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:43.132458  9374 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:43.164259  9450 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
W20260709 13:04:43.168442  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 47614.7us
I20260709 13:04:43.160786  9523 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:43.174153  9526 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:43.184124 14997 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:43.185053 15139 raft_consensus.cc:993] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:43.185580 15139 raft_consensus.cc:1081] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:43.187071 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: true dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:43.187623 10063 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:43.189052  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:43.189805  9375 raft_consensus.cc:3055] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:43.190129  9375 raft_consensus.cc:740] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:43.191026  9375 consensus_queue.cc:260] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:43.192334  9375 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:43.186604  9523 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:43.205515  9370 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:04:43.197378 10063 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:04:43.176855  9374 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 18.
I20260709 13:04:43.209105  9491 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:43.213287 14965 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:43.213591  9492 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:43.213965 14965 raft_consensus.cc:697] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:43.215214 15173 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:43.214869 14965 consensus_queue.cc:237] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:43.215785 15173 raft_consensus.cc:697] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:43.216684 15173 consensus_queue.cc:237] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:43.225749 15185 ts_tablet_manager.cc:1929] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.13
I20260709 13:04:43.227470 15185 log.cc:1199] T 060ae09cf899421ea6057ee5eca95814 P 6d50f1c263264b21919230bee398022b: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-2-root/wals/060ae09cf899421ea6057ee5eca95814
I20260709 13:04:43.230805  9520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46894
I20260709 13:04:43.231660  9520 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.232151  9520 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:43.236049  9262 catalog_manager.cc:5028] TS 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): tablet 060ae09cf899421ea6057ee5eca95814 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:04:43.246282  9275 catalog_manager.cc:5697] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 17 to 18, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 18 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:43.252314  9520 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:43.238296  9375 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:04:43.285575  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:43.286154  9375 raft_consensus.cc:3055] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:43.286422  9375 raft_consensus.cc:740] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:43.287130  9375 consensus_queue.cc:260] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:43.287992  9375 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:43.289785  9520 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:43.284409 15197 log.cc:927] Time spent T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.065s	user 0.003s	sys 0.018s
I20260709 13:04:43.291591  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:43.292448  9450 raft_consensus.cc:3060] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:43.293794 15198 log.cc:927] Time spent T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.080s	user 0.004s	sys 0.008s
W20260709 13:04:43.304409 15199 log.cc:927] Time spent T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.084s	user 0.000s	sys 0.012s
I20260709 13:04:43.310463  9450 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:04:43.303593  9375 raft_consensus.cc:2468] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 12.
I20260709 13:04:43.328299  9492 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:43.330479 15174 raft_consensus.cc:2804] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:43.331059 15174 raft_consensus.cc:697] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:43.331903 15174 consensus_queue.cc:237] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:43.345875  9274 catalog_manager.cc:5697] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 11 to 12, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 12 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:43.347724  9274 catalog_manager.cc:5697] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 13 to 14, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 14 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:43.385852  9274 catalog_manager.cc:5697] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 11 to 12, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 12 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:43.654784  9370 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:04:43.698385 15128 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:43.734189  9374 raft_consensus.cc:1275] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:04:43.735996 15168 consensus_queue.cc:1048] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:04:43.744400 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 117149us
I20260709 13:04:43.786870  9444 raft_consensus.cc:1275] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:04:43.787104  9374 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:04:43.796044 15055 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:43.802068 10063 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:04:43.811669 15173 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:43.849336 14965 consensus_queue.cc:1048] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:04:43.933163  9517 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:04:43.935564  9369 raft_consensus.cc:1275] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:04:43.962598 15128 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:43.973308  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:44.001099 15173 consensus_queue.cc:1048] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:04:44.005264  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 84010.1us
W20260709 13:04:44.216889  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 89752.2us
W20260709 13:04:44.224344  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 65270.6us
W20260709 13:04:44.366825  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 75593.4us
W20260709 13:04:44.374606 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 104355us
I20260709 13:04:44.549845  9450 raft_consensus.cc:1275] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:04:44.632722  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 155954us
I20260709 13:04:44.689821  9525 consensus_queue.cc:237] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
W20260709 13:04:44.745211  9491 consensus_peers.cc:597] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 522dd78118a14f5783e99d5dc43c9308. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:44.745388  9370 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:04:44.747633 15225 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:44.757166 15225 consensus_queue.cc:1048] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:04:44.778501  9444 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:04:44.790362 15235 raft_consensus.cc:2955] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:44.793095  9371 raft_consensus.cc:2955] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:44.833817 15223 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:44.842645  9271 catalog_manager.cc:5697] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index -1 to 13, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 20 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:44.852478  9371 consensus_queue.cc:237] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:44.871716  9444 raft_consensus.cc:2955] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
W20260709 13:04:44.899622  9342 consensus_peers.cc:597] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5154ade768f425fa43369d9709e66a4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:44.902770  9520 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:04:44.914126 15240 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:04:44.917141  9444 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:04:44.925173 15242 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:45.110836 15242 raft_consensus.cc:2955] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
W20260709 13:04:45.143760  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 70601.7us
I20260709 13:04:45.153903  9444 raft_consensus.cc:2955] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:45.169394  9524 raft_consensus.cc:2955] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:45.211069  9445 consensus_queue.cc:237] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:45.230052 15258 ts_tablet_manager.cc:933] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:45.283818  9525 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:04:45.291791  9373 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:04:45.287662 15258 tablet_copy_client.cc:323] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.67:35929
I20260709 13:04:45.298947 15239 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:04:45.301047  9535 tablet_copy_service.cc:140] P 6d50f1c263264b21919230bee398022b: Received BeginTabletCopySession request for tablet 522dd78118a14f5783e99d5dc43c9308 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:52502)
I20260709 13:04:45.301566 15238 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:45.301906  9535 tablet_copy_service.cc:161] P 6d50f1c263264b21919230bee398022b: Beginning new tablet copy session on tablet 522dd78118a14f5783e99d5dc43c9308 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:52502: session id = b0812463215649c3b011d36e2f0400c9-522dd78118a14f5783e99d5dc43c9308
W20260709 13:04:45.303160  9417 consensus_peers.cc:597] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a3b5c7847cbc42538f7f07cceeb9c125. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:45.316298  9274 catalog_manager.cc:5697] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 17 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:45.380020  9535 tablet_copy_source_session.cc:215] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:45.409132 15258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522dd78118a14f5783e99d5dc43c9308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.492334  9373 raft_consensus.cc:2955] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:45.483999 15239 raft_consensus.cc:2955] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:45.519994 15263 ts_tablet_manager.cc:933] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
I20260709 13:04:45.561386  9520 raft_consensus.cc:2955] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:45.576463 15263 tablet_copy_client.cc:323] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.65:37547
I20260709 13:04:45.579797  9386 tablet_copy_service.cc:140] P 925acbe78db14db3b9e4cfc857717947: Received BeginTabletCopySession request for tablet b5154ade768f425fa43369d9709e66a4 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:50568)
I20260709 13:04:45.580756  9386 tablet_copy_service.cc:161] P 925acbe78db14db3b9e4cfc857717947: Beginning new tablet copy session on tablet b5154ade768f425fa43369d9709e66a4 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:50568: session id = b0812463215649c3b011d36e2f0400c9-b5154ade768f425fa43369d9709e66a4
I20260709 13:04:45.590250  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:45.613826  9386 tablet_copy_source_session.cc:215] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:45.629554 15258 tablet_copy_client.cc:806] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:45.629411  9525 consensus_queue.cc:237] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:45.634261 15263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5154ade768f425fa43369d9709e66a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.630427 15258 tablet_copy_client.cc:670] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:45.642576  9271 catalog_manager.cc:5697] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 17 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:45.647692 15258 tablet_copy_client.cc:538] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:45.675580 15258 tablet_bootstrap.cc:492] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
W20260709 13:04:45.714036  9491 consensus_peers.cc:597] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d4df305315b74f329792b6a1f9a5e4db. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:45.714373  9445 raft_consensus.cc:1275] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:45.729411 15222 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:45.731678  9375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:45.732962  9375 raft_consensus.cc:606] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
W20260709 13:04:45.768973  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 61728us
I20260709 13:04:45.805855  9375 raft_consensus.cc:1275] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:04:45.807998  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 98433.3us
I20260709 13:04:45.809846 15228 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:04:45.850030 15263 tablet_copy_client.cc:806] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
W20260709 13:04:45.880734  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 43998.1us
I20260709 13:04:45.881645 15263 tablet_copy_client.cc:670] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:45.921342 15139 raft_consensus.cc:993] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:45.921412 15269 ts_tablet_manager.cc:933] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:45.922058 15139 raft_consensus.cc:1081] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:45.928215  9449 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51012
I20260709 13:04:45.929400  9449 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:45.929945  9449 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:45.961849  9449 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:45.974172 15273 raft_consensus.cc:2955] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:45.978803  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:45.979787  9525 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:45.968453  9449 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:45.987377  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:45.993183  9371 raft_consensus.cc:3055] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:45.998693 15263 tablet_copy_client.cc:538] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:46.000355 15269 tablet_copy_client.cc:323] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.66:45279
I20260709 13:04:46.003410  9462 tablet_copy_service.cc:140] P d62c9d5a052b42ce8675f8438f846526: Received BeginTabletCopySession request for tablet a3b5c7847cbc42538f7f07cceeb9c125 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:45366)
I20260709 13:04:46.004364  9462 tablet_copy_service.cc:161] P d62c9d5a052b42ce8675f8438f846526: Beginning new tablet copy session on tablet a3b5c7847cbc42538f7f07cceeb9c125 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:45366: session id = b0812463215649c3b011d36e2f0400c9-a3b5c7847cbc42538f7f07cceeb9c125
I20260709 13:04:45.993510  9371 raft_consensus.cc:740] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:46.008858  9525 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
I20260709 13:04:46.010133  9371 consensus_queue.cc:260] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:46.011546  9371 raft_consensus.cc:3060] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:46.040736  9375 raft_consensus.cc:2955] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:46.064033  9418 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:46.072911 15218 raft_consensus.cc:2804] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:46.119804  9274 catalog_manager.cc:5697] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index -1 to 9, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 13 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
W20260709 13:04:46.122696 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 47215us
I20260709 13:04:46.101889 15218 raft_consensus.cc:697] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:46.158452  9371 raft_consensus.cc:2468] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
I20260709 13:04:46.160794  9449 raft_consensus.cc:2955] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:46.176321 15263 tablet_bootstrap.cc:492] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:04:46.177525  9525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f"
dest_uuid: "6d50f1c263264b21919230bee398022b"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:46908
I20260709 13:04:46.178185  9525 raft_consensus.cc:606] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 18 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:46.200162  9371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:46.201380  9371 raft_consensus.cc:606] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:46.211949 15218 consensus_queue.cc:237] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:46.199940  9462 tablet_copy_source_session.cc:215] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:04:46.229332  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 68969.8us
I20260709 13:04:46.253789  9517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "807906edc34d41589d9b860b72f70e16"
dest_uuid: "6d50f1c263264b21919230bee398022b"
mode: GRACEFUL
new_leader_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:46908
I20260709 13:04:46.256942  9517 raft_consensus.cc:606] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Received request to transfer leadership to TS 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:46.328567  9273 catalog_manager.cc:5697] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 14 to 15, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 15 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:46.361917  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:04:46.363879  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:46.356536 15269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b5c7847cbc42538f7f07cceeb9c125. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:46.390941  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 48680us
I20260709 13:04:46.400640 15273 raft_consensus.cc:993] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:46.401562 15273 raft_consensus.cc:1081] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 18 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:46.427697 15242 raft_consensus.cc:993] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:46.428542 15242 raft_consensus.cc:1081] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:46.431521  9445 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51012
I20260709 13:04:46.432268  9445 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:46.432670  9445 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:46.432689  9449 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51016
I20260709 13:04:46.441351  9449 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:46.441779  9449 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:46.456442  9445 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:46.460688  9445 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:46.464668  9449 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:46.471285  9449 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:46.503168 15293 ts_tablet_manager.cc:933] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:46.504841  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:46.505625  9525 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:46.505681  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:46.506289  9372 raft_consensus.cc:3055] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:46.506594  9372 raft_consensus.cc:740] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:46.507407  9372 consensus_queue.cc:260] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:46.508628  9372 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:46.514653  9525 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:04:46.527391  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:46.528147  9526 raft_consensus.cc:3055] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:46.528486  9526 raft_consensus.cc:740] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:46.529709  9526 consensus_queue.cc:260] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:46.531452  9526 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:04:46.533457  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 44077.3us
I20260709 13:04:46.539839  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:46.540580  9370 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:46.541678  9418 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:46.546594 15218 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:46.550923 15218 raft_consensus.cc:697] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:46.551954 15218 consensus_queue.cc:237] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:46.541324 15293 tablet_copy_client.cc:323] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.67:35929
I20260709 13:04:46.556243  9535 tablet_copy_service.cc:140] P 6d50f1c263264b21919230bee398022b: Received BeginTabletCopySession request for tablet d4df305315b74f329792b6a1f9a5e4db from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:52502)
I20260709 13:04:46.556951  9535 tablet_copy_service.cc:161] P 6d50f1c263264b21919230bee398022b: Beginning new tablet copy session on tablet d4df305315b74f329792b6a1f9a5e4db from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:52502: session id = b0812463215649c3b011d36e2f0400c9-d4df305315b74f329792b6a1f9a5e4db
I20260709 13:04:46.559074  9372 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 13.
I20260709 13:04:46.597862  9370 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 19.
I20260709 13:04:46.610854  9535 tablet_copy_source_session.cc:215] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:46.611186  9418 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:46.625644  9526 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 19.
I20260709 13:04:46.626507 15238 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:46.649529 15274 raft_consensus.cc:993] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b: : Instructing follower 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:04:46.650202 15274 raft_consensus.cc:1081] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Signalling peer 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:04:46.666750  9375 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "807906edc34d41589d9b860b72f70e16"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:52562
I20260709 13:04:46.667418  9375 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:46.667826  9375 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:46.643282 15238 raft_consensus.cc:697] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 19 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
W20260709 13:04:46.727598 15297 log.cc:927] Time spent T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:04:46.744869 15238 consensus_queue.cc:237] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:46.777139  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 107194us
I20260709 13:04:46.812484  9370 raft_consensus.cc:1275] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:46.740733 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44546 (request call id 298) took 1015 ms. Trace:
I20260709 13:04:46.833861 15293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4df305315b74f329792b6a1f9a5e4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.848256  9273 catalog_manager.cc:5697] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 12 to 13, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 13 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:46.826941 15269 rpcz_store.cc:276] 0709 13:04:45.718360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.718522 (+   162us) service_pool.cc:224] Handling call
0709 13:04:45.922089 (+203567us) ts_tablet_manager.cc:934] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
0709 13:04:46.279688 (+357599us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:04:46.602836 (+323148us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:46.602972 (+   136us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:04:46.620965 (+ 17993us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:04:46.643045 (+ 22080us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:46.729951 (+ 86906us) ts_tablet_manager.cc:989] Replica registered.
0709 13:04:46.734130 (+  4179us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":8704,"tablet-copy.queue_time_us":113182,"thread_start_us":159304,"threads_started":2}
W20260709 13:04:46.852293 15258 log.cc:927] Time spent T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:04:46.854866 15258 tablet_bootstrap.cc:492] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:46.855320  9526 raft_consensus.cc:1275] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:46.855912 15258 tablet_bootstrap.cc:492] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:04:46.852753 15269 tablet_copy_client.cc:806] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:46.856734 15258 ts_tablet_manager.cc:1403] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 1.196s	user 0.052s	sys 0.021s
I20260709 13:04:46.860431 15269 tablet_copy_client.cc:670] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:46.865784 15264 consensus_queue.cc:1048] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:46.873656 15291 consensus_queue.cc:1048] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:46.892491  9375 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:46.860224 15258 raft_consensus.cc:359] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:46.902426  9375 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:04:46.939154  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 44389.2us
I20260709 13:04:46.913763 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: true dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:46.940783 10063 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:46.900034 15258 raft_consensus.cc:740] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:04:46.965677  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:46.979010  9525 raft_consensus.cc:3055] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:46.979377  9525 raft_consensus.cc:740] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:46.998878 15258 consensus_queue.cc:260] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:47.003109  9525 consensus_queue.cc:260] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:47.004443  9525 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:47.016939 10063 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
W20260709 13:04:47.017720  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.018759  9342 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:47.022379 15267 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:47.033656 15267 raft_consensus.cc:697] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:47.035015 15267 consensus_queue.cc:237] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:47.046905  9525 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 13.
I20260709 13:04:47.104403 15269 tablet_copy_client.cc:538] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:47.118211 15258 ts_tablet_manager.cc:1434] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.261s	user 0.009s	sys 0.001s
I20260709 13:04:47.132521  9520 raft_consensus.cc:1275] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:47.139525  9375 raft_consensus.cc:1275] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:47.139984 15301 consensus_queue.cc:1048] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:47.144235 15301 consensus_queue.cc:1048] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:47.149149 15293 tablet_copy_client.cc:806] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:47.182492 15293 tablet_copy_client.cc:670] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
W20260709 13:04:47.212384 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 434943us
W20260709 13:04:47.221112  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 209470us
I20260709 13:04:47.231424  9273 catalog_manager.cc:5697] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 18 to 19, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 19 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:47.239501 15305 log.cc:927] Time spent T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.158s	user 0.000s	sys 0.002s
W20260709 13:04:47.254490  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 45167.2us
I20260709 13:04:47.259344  9377 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:04:47.262759 15286 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:04:47.230379 15306 log.cc:927] Time spent T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.150s	user 0.001s	sys 0.003s
I20260709 13:04:47.273772  9535 tablet_copy_service.cc:342] P 6d50f1c263264b21919230bee398022b: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-522dd78118a14f5783e99d5dc43c9308 received from {username='slave'} at 127.0.0.1:52502
I20260709 13:04:47.274391  9535 tablet_copy_service.cc:434] P 6d50f1c263264b21919230bee398022b: ending tablet copy session b0812463215649c3b011d36e2f0400c9-522dd78118a14f5783e99d5dc43c9308 on tablet 522dd78118a14f5783e99d5dc43c9308 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:04:47.275239 15269 tablet_bootstrap.cc:492] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:04:47.314617  9275 catalog_manager.cc:5697] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 12 to 13, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 13 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:47.332681 15263 tablet_bootstrap.cc:492] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:47.377480 15293 tablet_copy_client.cc:538] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:47.390657 15263 tablet_bootstrap.cc:492] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:04:47.391659 15263 ts_tablet_manager.cc:1403] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 1.216s	user 0.052s	sys 0.029s
I20260709 13:04:47.365026  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:47.397511 15263 raft_consensus.cc:359] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:47.413743 15263 raft_consensus.cc:740] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:04:47.417944 15263 consensus_queue.cc:260] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:47.431294 15263 ts_tablet_manager.cc:1434] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 13:04:47.410776 15293 tablet_bootstrap.cc:492] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
W20260709 13:04:47.434333 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 47181.7us
W20260709 13:04:47.446018  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 65865.9us
I20260709 13:04:47.459470  9525 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:04:47.505494 10063 raft_consensus.cc:1217] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.9->[17.10-17.10]   Dedup: 17.10->[]
I20260709 13:04:47.530246 15300 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:04:47.555917  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 71264.4us
W20260709 13:04:47.563126  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 85276.6us
W20260709 13:04:47.655680  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 164232us
W20260709 13:04:47.727294 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 230685us
I20260709 13:04:47.735929  9525 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 13:04:47.741041 10068 raft_consensus.cc:1217] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 [term 20 LEARNER]: Deduplicated request from leader. Original: 20.12->[20.13-20.13]   Dedup: 20.13->[]
I20260709 13:04:47.763338  9386 tablet_copy_service.cc:342] P 925acbe78db14db3b9e4cfc857717947: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-b5154ade768f425fa43369d9709e66a4 received from {username='slave'} at 127.0.0.1:50568
I20260709 13:04:47.763926  9386 tablet_copy_service.cc:434] P 925acbe78db14db3b9e4cfc857717947: ending tablet copy session b0812463215649c3b011d36e2f0400c9-b5154ade768f425fa43369d9709e66a4 on tablet b5154ade768f425fa43369d9709e66a4 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:04:47.766338 10063 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 13:04:47.796608 15267 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:04:47.804101  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 43686.1us
W20260709 13:04:47.859318 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 48370.8us
I20260709 13:04:47.902667 15325 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:04:47.943756  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 48824.6us
I20260709 13:04:47.985524 15303 raft_consensus.cc:1064] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
W20260709 13:04:48.009377 15326 log.cc:927] Time spent T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:04:48.026301 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 126668us
W20260709 13:04:48.060230  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 82366.4us
W20260709 13:04:48.068185  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 52213.8us
W20260709 13:04:48.108155  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 52631.3us
W20260709 13:04:48.160451  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 97357.8us
W20260709 13:04:48.169030  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 60087.5us
W20260709 13:04:48.184966  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.204268 15269 tablet_bootstrap.cc:492] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=2 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:48.245230 15269 tablet_bootstrap.cc:492] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:04:48.250046 15269 ts_tablet_manager.cc:1403] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.975s	user 0.062s	sys 0.031s
I20260709 13:04:48.313304 15303 consensus_queue.cc:237] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:48.314252 15337 raft_consensus.cc:1064] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:04:48.357766 15269 raft_consensus.cc:359] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:48.379457 15293 tablet_bootstrap.cc:492] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:48.370410 15269 raft_consensus.cc:740] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:04:48.385308  9520 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:04:48.384236 15269 consensus_queue.cc:260] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:48.381960 15293 tablet_bootstrap.cc:492] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:04:48.389897 15337 consensus_queue.cc:237] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 11, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:48.407804 15293 ts_tablet_manager.cc:1403] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.995s	user 0.055s	sys 0.029s
I20260709 13:04:48.423950 15334 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:48.429312  9446 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:04:48.430100 15269 ts_tablet_manager.cc:1434] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.173s	user 0.007s	sys 0.001s
I20260709 13:04:48.444063  9462 tablet_copy_service.cc:342] P d62c9d5a052b42ce8675f8438f846526: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-a3b5c7847cbc42538f7f07cceeb9c125 received from {username='slave'} at 127.0.0.1:45366
I20260709 13:04:48.444773  9462 tablet_copy_service.cc:434] P d62c9d5a052b42ce8675f8438f846526: ending tablet copy session b0812463215649c3b011d36e2f0400c9-a3b5c7847cbc42538f7f07cceeb9c125 on tablet a3b5c7847cbc42538f7f07cceeb9c125 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:04:48.449254 10063 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:04:48.450901 15334 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:48.453764 15253 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:48.524376 15293 raft_consensus.cc:359] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:48.554469  9449 raft_consensus.cc:2955] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:48.549144 15293 raft_consensus.cc:740] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:04:48.557567 15293 consensus_queue.cc:260] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:48.544497 15253 raft_consensus.cc:2955] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:48.554612 10063 raft_consensus.cc:2955] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:48.586777 15293 ts_tablet_manager.cc:1434] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.178s	user 0.008s	sys 0.000s
I20260709 13:04:48.588972  9535 tablet_copy_service.cc:342] P 6d50f1c263264b21919230bee398022b: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-d4df305315b74f329792b6a1f9a5e4db received from {username='slave'} at 127.0.0.1:52502
I20260709 13:04:48.589576  9535 tablet_copy_service.cc:434] P 6d50f1c263264b21919230bee398022b: ending tablet copy session b0812463215649c3b011d36e2f0400c9-d4df305315b74f329792b6a1f9a5e4db on tablet d4df305315b74f329792b6a1f9a5e4db with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:04:48.614153 10068 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 [term 20 LEARNER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:04:48.616070 15275 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:04:48.641191 15348 log.cc:927] Time spent T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:04:48.643199  9275 catalog_manager.cc:5697] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:48.656024  9375 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:04:48.658118  9443 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:04:48.658918 15275 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:48.660019  9525 raft_consensus.cc:2955] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:48.682485 15337 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:48.724607 10063 raft_consensus.cc:1217] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 13:04:48.774088  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:48.866138 15223 raft_consensus.cc:2955] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:04:48.882787  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 103577us
I20260709 13:04:48.906291  9449 raft_consensus.cc:2955] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:48.920950 10063 raft_consensus.cc:1217] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.9->[17.10-17.10]   Dedup: 17.10->[]
I20260709 13:04:49.048734 10063 raft_consensus.cc:2955] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:49.070436  9371 raft_consensus.cc:2955] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:49.108774  9371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "807906edc34d41589d9b860b72f70e16"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:49.109454  9371 raft_consensus.cc:606] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:49.113808  9444 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:04:49.114614  9444 raft_consensus.cc:606] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 18 LEADER]: Received request to transfer leadership to TS 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:49.117268  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:49.119019  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:49.158058  9371 consensus_queue.cc:237] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:49.168704 10068 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:04:49.170920 15334 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:49.178746  9271 catalog_manager.cc:5697] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:49.185448 15335 raft_consensus.cc:2955] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:04:49.204147  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 67741.9us
I20260709 13:04:49.187471 10068 raft_consensus.cc:2955] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:49.242062  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b5154ade768f425fa43369d9709e66a4 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:49.319790 15282 raft_consensus.cc:1064] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
W20260709 13:04:49.320638  9262 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet b5154ade768f425fa43369d9709e66a4 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER failed with leader 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 11 but the committed config has opid_index of 12
I20260709 13:04:49.322800 15282 consensus_queue.cc:237] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:49.324992  9271 catalog_manager.cc:5697] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 11 to 12, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New cstate: current_term: 17 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:04:49.348630  9490 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.8.4.126:34725, user_credentials={real_user=slave}} blocked reactor thread for 54445.3us
I20260709 13:04:49.368559  9520 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:04:49.395288 10068 raft_consensus.cc:1275] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9 [term 13 LEARNER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:04:49.391775 15342 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:04:49.403501  9446 raft_consensus.cc:1275] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:04:49.415210  9525 consensus_queue.cc:237] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:49.416585 15354 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:49.448369  9435 tablet_service.cc:1558] Processing DeleteTablet for tablet b5154ade768f425fa43369d9709e66a4 with delete_type TABLET_DATA_TOMBSTONED (TS d62c9d5a052b42ce8675f8438f846526 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:51006
I20260709 13:04:49.471019 15337 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:49.482923 15218 raft_consensus.cc:1064] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:04:49.497263 15218 consensus_queue.cc:237] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:49.502023 10067 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 [term 20 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:04:49.503991 15282 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:49.519104 15282 raft_consensus.cc:2955] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 14 to 15, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:49.525290  9444 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:04:49.545964  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 159009us
I20260709 13:04:49.552327  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 522dd78118a14f5783e99d5dc43c9308 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:49.580325 10067 raft_consensus.cc:2955] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:04:49.585210  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 55884.1us
I20260709 13:04:49.621563  9371 raft_consensus.cc:1275] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:04:49.623155  9525 raft_consensus.cc:2955] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:49.640343 15364 tablet_replica.cc:333] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:04:49.641726 15364 raft_consensus.cc:2243] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:49.642946 15364 raft_consensus.cc:2272] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:49.641469 15337 raft_consensus.cc:2955] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:49.593207 15282 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 13:04:49.651734 15275 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:49.654052 15242 raft_consensus.cc:993] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:49.654796 15242 raft_consensus.cc:1081] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:49.665526  9520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "807906edc34d41589d9b860b72f70e16"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46894
I20260709 13:04:49.665103  9271 catalog_manager.cc:5697] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 14 to 15, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New cstate: current_term: 20 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:49.666133  9520 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:49.666584  9520 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:49.678323  9445 raft_consensus.cc:2955] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:49.682412  9520 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:49.699386  9370 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:04:49.701920  9524 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:04:49.702215 15332 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:49.703404 15239 raft_consensus.cc:993] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526: : Instructing follower 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:04:49.704794 15301 raft_consensus.cc:1081] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 18 LEADER]: Signalling peer 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:04:49.705926 15332 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:49.709432 15364 ts_tablet_manager.cc:1916] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:49.710337  9370 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:52548
I20260709 13:04:49.710916  9370 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:49.711272  9370 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:49.731508  9520 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:49.727514  9370 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:49.740692 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: true dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:49.741434 10067 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:49.741362 10068 raft_consensus.cc:2955] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:49.770143  9370 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 19 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:49.771838 10068 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:04:49.779870  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 129000us
I20260709 13:04:49.781447 10067 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:04:49.796854  9491 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:04:49.798753  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:49.799388  9445 raft_consensus.cc:3055] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:49.799751  9445 raft_consensus.cc:740] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:49.782135 15332 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:04:49.804144  9274 catalog_manager.cc:5697] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:49.884634  9445 consensus_queue.cc:260] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:49.907824  9445 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:49.947216  9445 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 19.
W20260709 13:04:49.953377  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 157068us
W20260709 13:04:49.958482  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 161717us
I20260709 13:04:49.969861  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:49.970911  9526 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:49.951777 15370 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:04:49.983117  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 43499.9us
W20260709 13:04:50.028513 15372 log.cc:927] Time spent T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:04:50.049439 15371 log.cc:927] Time spent T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:04:50.052958  9526 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 19.
I20260709 13:04:50.007112 15370 raft_consensus.cc:697] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:50.069586 15370 consensus_queue.cc:237] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:04:50.102674  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 312739us
I20260709 13:04:50.108422  9341 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:50.120105  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:50.145092 10068 raft_consensus.cc:1240] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 14 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:50.123570 15242 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:50.154889 15362 consensus_queue.cc:1059] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:04:50.157742  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:50.158404  9368 raft_consensus.cc:3055] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:50.158718  9368 raft_consensus.cc:740] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:50.159488  9368 consensus_queue.cc:260] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:50.160614  9368 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:50.174629 15242 raft_consensus.cc:697] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 19 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
W20260709 13:04:50.219161  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.201087  9370 raft_consensus.cc:2955] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:50.257333 15242 consensus_queue.cc:237] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:50.271852  9368 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
W20260709 13:04:50.273154 15362 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:04:50.275642  9359 tablet_service.cc:1558] Processing DeleteTablet for tablet 522dd78118a14f5783e99d5dc43c9308 with delete_type TABLET_DATA_TOMBSTONED (TS 925acbe78db14db3b9e4cfc857717947 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:52546
I20260709 13:04:50.291972  9445 raft_consensus.cc:2955] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:50.301550  9520 raft_consensus.cc:1240] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 13. Current term is 14. Ops: []
W20260709 13:04:50.366160 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 65689.2us
I20260709 13:04:50.366811 15364 ts_tablet_manager.cc:1929] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.11
I20260709 13:04:50.367415 15364 log.cc:1199] T b5154ade768f425fa43369d9709e66a4 P d62c9d5a052b42ce8675f8438f846526: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-1-root/wals/b5154ade768f425fa43369d9709e66a4
W20260709 13:04:50.397162  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.479106 10067 raft_consensus.cc:2955] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:50.486655 15364 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51006 (request call id 74) took 1038 ms. Trace:
I20260709 13:04:50.487311 15397 tablet_replica.cc:333] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:04:50.487223 15364 rpcz_store.cc:276] 0709 13:04:49.447687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.448085 (+   398us) service_pool.cc:224] Handling call
0709 13:04:49.639941 (+191856us) ts_tablet_manager.cc:1151] Deleting tablet b5154ade768f425fa43369d9709e66a4
0709 13:04:49.640030 (+    89us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:04:50.058926 (+418896us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:50.366617 (+307691us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:50.486411 (+119794us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":190819,"thread_start_us":138603,"threads_started":1}
I20260709 13:04:50.475667 15239 raft_consensus.cc:2955] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:04:50.517941  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 121838us
I20260709 13:04:50.522058 15397 raft_consensus.cc:2243] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.522934  9274 catalog_manager.cc:5697] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 13 to 14, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 14 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:50.530988 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 117576us
I20260709 13:04:50.535269  9273 catalog_manager.cc:5697] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 18 to 19, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 19 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:50.537724 15397 raft_consensus.cc:2272] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.544559 15397 ts_tablet_manager.cc:1916] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:50.574764  9271 catalog_manager.cc:5697] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:50.697125  9375 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 14 index: 15. (index mismatch)
I20260709 13:04:50.705206 15397 ts_tablet_manager.cc:1929] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.14
I20260709 13:04:50.707252 15397 log.cc:1199] T 522dd78118a14f5783e99d5dc43c9308 P 925acbe78db14db3b9e4cfc857717947: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-0-root/wals/522dd78118a14f5783e99d5dc43c9308
I20260709 13:04:50.723927 10067 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 14 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 14 index: 15. (index mismatch)
I20260709 13:04:50.731079  9262 catalog_manager.cc:5028] TS 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): tablet 522dd78118a14f5783e99d5dc43c9308 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:04:50.738027 15337 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:50.759361  9370 raft_consensus.cc:2955] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:50.771310  9260 catalog_manager.cc:5028] TS d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): tablet b5154ade768f425fa43369d9709e66a4 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:04:50.814414 15401 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:50.918129  9446 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:04:50.956432 15375 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:50.970006  9526 raft_consensus.cc:2955] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:04:51.010206  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 66147.6us
W20260709 13:04:51.028508 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 94368.6us
I20260709 13:04:51.038267  9525 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:04:50.888705  9522 consensus_queue.cc:237] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:51.072006  9377 raft_consensus.cc:1275] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:51.098237  9449 consensus_queue.cc:237] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:51.106213 15375 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:51.122303 10067 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:04:51.125718 15332 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:51.137912 10068 raft_consensus.cc:1275] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:51.141183 15235 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:04:51.143687  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 67849.7us
I20260709 13:04:51.144840 15384 raft_consensus.cc:2955] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:51.147818 15223 consensus_queue.cc:1048] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:04:51.153024  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 44741.8us
I20260709 13:04:51.152725 10063 raft_consensus.cc:2955] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:04:51.238595  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 125446us
W20260709 13:04:51.239013 15403 log.cc:927] Time spent T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:04:51.275978  9274 catalog_manager.cc:5697] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New cstate: current_term: 17 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:51.297210 15370 raft_consensus.cc:2955] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:51.356547 10067 raft_consensus.cc:2955] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:04:51.339964 15415 log.cc:927] Time spent T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 13:04:51.395244  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 144372us
I20260709 13:04:51.439284  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d4df305315b74f329792b6a1f9a5e4db with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:51.445423  9374 raft_consensus.cc:2955] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:51.461411  9523 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:04:51.472239  9260 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a3b5c7847cbc42538f7f07cceeb9c125 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:51.479938  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:51.491495  9275 catalog_manager.cc:5697] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b reported cstate change: config changed from index 10 to 11, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New cstate: current_term: 13 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:51.502395  9359 tablet_service.cc:1558] Processing DeleteTablet for tablet a3b5c7847cbc42538f7f07cceeb9c125 with delete_type TABLET_DATA_TOMBSTONED (TS 925acbe78db14db3b9e4cfc857717947 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:52546
W20260709 13:04:51.509232  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 44200us
I20260709 13:04:51.582427 15420 tablet_replica.cc:333] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:04:51.583665 15420 raft_consensus.cc:2243] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.584515 15420 raft_consensus.cc:2272] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.600801 15420 ts_tablet_manager.cc:1916] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:51.607316 15332 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:51.637115  9523 raft_consensus.cc:2955] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:51.653718  9435 tablet_service.cc:1558] Processing DeleteTablet for tablet d4df305315b74f329792b6a1f9a5e4db with delete_type TABLET_DATA_TOMBSTONED (TS d62c9d5a052b42ce8675f8438f846526 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:51006
I20260709 13:04:51.670293  9520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f"
dest_uuid: "6d50f1c263264b21919230bee398022b"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:46908
I20260709 13:04:51.671167  9520 raft_consensus.cc:606] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:51.675659  9376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:51.676249  9376 raft_consensus.cc:606] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:51.677975  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:51.680243  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:51.699318 15421 tablet_replica.cc:333] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:04:51.707273 15421 raft_consensus.cc:2243] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.708298 15421 raft_consensus.cc:2272] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.723733 15421 ts_tablet_manager.cc:1916] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:51.727826 15235 raft_consensus.cc:993] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:51.728533 15401 raft_consensus.cc:1081] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:51.737524  9445 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51016
I20260709 13:04:51.738124  9445 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:51.738504  9445 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:51.746439  9445 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:51.758473  9445 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:51.770167  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:51.770823  9523 raft_consensus.cc:3055] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:51.771149  9523 raft_consensus.cc:740] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:51.774760  9523 consensus_queue.cc:260] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:51.776067  9523 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:51.777119 15420 ts_tablet_manager.cc:1929] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.11
I20260709 13:04:51.769490  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:51.778192  9375 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:51.777634 15420 log.cc:1199] T a3b5c7847cbc42538f7f07cceeb9c125 P 925acbe78db14db3b9e4cfc857717947: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-0-root/wals/a3b5c7847cbc42538f7f07cceeb9c125
I20260709 13:04:51.785233  9262 catalog_manager.cc:5028] TS 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): tablet a3b5c7847cbc42538f7f07cceeb9c125 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:04:51.805751  9375 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
I20260709 13:04:51.807410  9418 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:51.808310 15412 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:51.808868 15412 raft_consensus.cc:697] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:51.809870 15412 consensus_queue.cc:237] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:51.814641  9523 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
I20260709 13:04:51.848387 15421 ts_tablet_manager.cc:1929] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 13:04:51.849033 15421 log.cc:1199] T d4df305315b74f329792b6a1f9a5e4db P d62c9d5a052b42ce8675f8438f846526: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-1-root/wals/d4df305315b74f329792b6a1f9a5e4db
I20260709 13:04:51.854496  9260 catalog_manager.cc:5028] TS d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): tablet d4df305315b74f329792b6a1f9a5e4db (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:04:51.870767  9275 catalog_manager.cc:5697] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 14 to 15, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 15 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.076198 15375 raft_consensus.cc:993] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:52.077374 15303 raft_consensus.cc:1081] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:52.080018  9443 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51012
I20260709 13:04:52.081046  9443 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:52.081499  9443 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:52.093693  9443 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:52.099690  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:52.099857 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2e1b1ef6540b1915f1dda8f95e81b" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:04:52.100489  9376 raft_consensus.cc:3055] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:52.100571 10067 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:52.101070  9443 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:04:52.101092  9376 raft_consensus.cc:740] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:52.106554  9376 consensus_queue.cc:260] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:52.108167  9376 raft_consensus.cc:3060] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:52.128300 10067 raft_consensus.cc:2468] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:04:52.143618  9417 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:52.146844 15332 raft_consensus.cc:2804] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:52.147647 15332 raft_consensus.cc:697] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:52.148767 15332 consensus_queue.cc:237] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:52.175832  9376 raft_consensus.cc:2468] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 9.
I20260709 13:04:52.216566  9275 catalog_manager.cc:5697] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 8 to 9, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 9 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.236238  9520 raft_consensus.cc:1275] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:04:52.257165 15332 consensus_queue.cc:1048] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:04:52.367657  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 48802.6us
I20260709 13:04:52.432302  9375 raft_consensus.cc:1275] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:04:52.479589 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 95556.9us
I20260709 13:04:52.475657 15332 consensus_queue.cc:1048] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 13:04:52.597373  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 54094.8us
I20260709 13:04:52.646998  9375 raft_consensus.cc:1275] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:52.650223 15412 consensus_queue.cc:1048] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:52.681540  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:52.721995 10067 raft_consensus.cc:1275] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:52.724359 15412 consensus_queue.cc:1048] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:52.974138  9376 consensus_queue.cc:237] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:53.034778  9526 raft_consensus.cc:1275] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:04:53.038055  9342 consensus_peers.cc:597] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3ad4133883414768941dffb952ca7caf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:53.040508 15375 consensus_queue.cc:1048] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:04:53.043713  9445 raft_consensus.cc:1275] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:53.047278 15441 consensus_queue.cc:1048] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:53.092026 15375 raft_consensus.cc:2955] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:53.100090  9526 raft_consensus.cc:2955] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:53.114763  9443 raft_consensus.cc:2955] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:53.130937  9275 catalog_manager.cc:5697] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b reported cstate change: config changed from index -1 to 9, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 15 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:53.158198  9376 consensus_queue.cc:237] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
W20260709 13:04:53.214061  9342 consensus_peers.cc:597] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a8c41deeda674b9b8d27e72d70e96e79. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:53.214903  9526 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:53.219012  9445 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:53.219270 15375 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:53.221990 15375 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:53.256955 15441 raft_consensus.cc:2955] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:53.262696  9526 raft_consensus.cc:2955] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:53.270403  9445 raft_consensus.cc:2955] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:53.303510  9446 consensus_queue.cc:237] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
W20260709 13:04:53.325575  9417 consensus_peers.cc:597] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 71ffe24ed6cf41c5b150d5ed4fa28c44. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:53.332296  9523 raft_consensus.cc:1275] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:53.335285 15412 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:53.336016  9273 catalog_manager.cc:5697] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index -1 to 9, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 13 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:53.352622  9376 raft_consensus.cc:1275] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:53.364665 15224 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:53.368395 15425 raft_consensus.cc:2955] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:53.391673  9520 raft_consensus.cc:2955] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:53.401878  9376 raft_consensus.cc:2955] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:53.414772  9273 catalog_manager.cc:5697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 15 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:53.519721 15456 log.cc:927] Time spent T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.051s	user 0.002s	sys 0.000s
W20260709 13:04:53.561654  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 51971.1us
I20260709 13:04:53.612721 15460 ts_tablet_manager.cc:933] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
I20260709 13:04:53.629639  9446 consensus_queue.cc:237] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:53.642488 15460 tablet_copy_client.cc:323] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.65:37547
I20260709 13:04:53.657373  9386 tablet_copy_service.cc:140] P 925acbe78db14db3b9e4cfc857717947: Received BeginTabletCopySession request for tablet 3ad4133883414768941dffb952ca7caf from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:50568)
I20260709 13:04:53.658313  9386 tablet_copy_service.cc:161] P 925acbe78db14db3b9e4cfc857717947: Beginning new tablet copy session on tablet 3ad4133883414768941dffb952ca7caf from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:50568: session id = b0812463215649c3b011d36e2f0400c9-3ad4133883414768941dffb952ca7caf
I20260709 13:04:53.673198  9386 tablet_copy_source_session.cc:215] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:04:53.682049  9417 consensus_peers.cc:597] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 084579f9b3b648f0bff0a7e9cdc1669b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:53.683688 15460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ad4133883414768941dffb952ca7caf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:53.753947  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 70831us
W20260709 13:04:53.755199  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 72257.1us
I20260709 13:04:53.880139  9376 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:04:53.897537  9526 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:04:53.942783  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:54.147747 15467 ts_tablet_manager.cc:933] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:54.164474  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 226609us
I20260709 13:04:54.198836 15460 tablet_copy_client.cc:806] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:54.205849 15460 tablet_copy_client.cc:670] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:54.229367 15478 ts_tablet_manager.cc:933] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:54.262357  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 179982us
I20260709 13:04:54.267747 15458 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:04:54.309540 15460 tablet_copy_client.cc:538] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:54.322055 15467 tablet_copy_client.cc:323] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.66:45279
I20260709 13:04:54.325289  9462 tablet_copy_service.cc:140] P d62c9d5a052b42ce8675f8438f846526: Received BeginTabletCopySession request for tablet 71ffe24ed6cf41c5b150d5ed4fa28c44 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:45366)
I20260709 13:04:54.326261  9462 tablet_copy_service.cc:161] P d62c9d5a052b42ce8675f8438f846526: Beginning new tablet copy session on tablet 71ffe24ed6cf41c5b150d5ed4fa28c44 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:45366: session id = b0812463215649c3b011d36e2f0400c9-71ffe24ed6cf41c5b150d5ed4fa28c44
I20260709 13:04:54.335286 15478 tablet_copy_client.cc:323] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.66:45279
I20260709 13:04:54.337659  9461 tablet_copy_service.cc:140] P d62c9d5a052b42ce8675f8438f846526: Received BeginTabletCopySession request for tablet 084579f9b3b648f0bff0a7e9cdc1669b from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:45366)
I20260709 13:04:54.338389  9461 tablet_copy_service.cc:161] P d62c9d5a052b42ce8675f8438f846526: Beginning new tablet copy session on tablet 084579f9b3b648f0bff0a7e9cdc1669b from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:45366: session id = b0812463215649c3b011d36e2f0400c9-084579f9b3b648f0bff0a7e9cdc1669b
I20260709 13:04:54.361370 15480 ts_tablet_manager.cc:933] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
I20260709 13:04:54.368048  9462 tablet_copy_source_session.cc:215] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:54.391283 15467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ffe24ed6cf41c5b150d5ed4fa28c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.401537  9461 tablet_copy_source_session.cc:215] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:54.360693 15460 tablet_bootstrap.cc:492] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:04:54.418288 15480 tablet_copy_client.cc:323] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.65:37547
I20260709 13:04:54.426257 15478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 084579f9b3b648f0bff0a7e9cdc1669b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.431998  9386 tablet_copy_service.cc:140] P 925acbe78db14db3b9e4cfc857717947: Received BeginTabletCopySession request for tablet a8c41deeda674b9b8d27e72d70e96e79 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:50568)
I20260709 13:04:54.433198  9386 tablet_copy_service.cc:161] P 925acbe78db14db3b9e4cfc857717947: Beginning new tablet copy session on tablet a8c41deeda674b9b8d27e72d70e96e79 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:50568: session id = b0812463215649c3b011d36e2f0400c9-a8c41deeda674b9b8d27e72d70e96e79
I20260709 13:04:54.434718 15471 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:54.457465  9386 tablet_copy_source_session.cc:215] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:54.482438  9445 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:04:54.483340  9445 raft_consensus.cc:606] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Received request to transfer leadership to TS 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:54.488737  9446 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:04:54.489459  9446 raft_consensus.cc:606] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 19 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:54.493397  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:54.495183  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:54.498052 15480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c41deeda674b9b8d27e72d70e96e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.505219 15467 tablet_copy_client.cc:806] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:54.506057 15467 tablet_copy_client.cc:670] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:54.513410 15458 raft_consensus.cc:993] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526: : Instructing follower 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:04:54.513912 15467 tablet_copy_client.cc:538] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:54.514060 15458 raft_consensus.cc:1081] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Signalling peer 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:04:54.528182 15471 raft_consensus.cc:2955] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:54.544117 15467 tablet_bootstrap.cc:492] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:04:54.554841 15478 tablet_copy_client.cc:806] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:54.573349  9376 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:52548
I20260709 13:04:54.574191  9376 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:54.574618  9376 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:54.581635 15478 tablet_copy_client.cc:670] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:54.588686  9375 raft_consensus.cc:2955] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:54.610062  9376 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:54.612016  9523 raft_consensus.cc:2955] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:54.607673 15478 tablet_copy_client.cc:538] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:54.651484 15480 tablet_copy_client.cc:806] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:54.652323 15480 tablet_copy_client.cc:670] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:54.669260 15480 tablet_copy_client.cc:538] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:54.694515 15480 tablet_bootstrap.cc:492] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:04:54.713848  9273 catalog_manager.cc:5697] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 13 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:54.726294  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:54.727113  9523 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:54.733129  9376 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:54.734306  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:54.734987  9445 raft_consensus.cc:3055] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:54.735293  9445 raft_consensus.cc:740] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:54.736196  9445 consensus_queue.cc:260] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
I20260709 13:04:54.736968 15478 tablet_bootstrap.cc:492] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:04:54.737622  9445 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:54.736169  9523 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 16.
I20260709 13:04:54.746768  9343 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:04:54.748322  9445 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 16.
I20260709 13:04:54.749387 15440 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:54.750027 15440 raft_consensus.cc:697] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:54.751201 15440 consensus_queue.cc:237] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } }
W20260709 13:04:54.873247 15467 log.cc:927] Time spent T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.062s	user 0.003s	sys 0.000s
I20260709 13:04:54.919868 15460 tablet_bootstrap.cc:492] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:54.942551 15458 raft_consensus.cc:993] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:54.943228 15458 raft_consensus.cc:1081] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 19 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:54.950438  9525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46902
I20260709 13:04:54.951063  9525 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:54.951442  9525 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:54.953859 15460 tablet_bootstrap.cc:492] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:04:54.954766 15460 ts_tablet_manager.cc:1403] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.614s	user 0.046s	sys 0.028s
I20260709 13:04:54.971566  9525 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:54.964339 15460 raft_consensus.cc:359] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:54.977548 15467 tablet_bootstrap.cc:492] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:54.984822 15460 raft_consensus.cc:740] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:04:55.006291 15467 tablet_bootstrap.cc:492] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:04:55.027608 15467 ts_tablet_manager.cc:1403] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.484s	user 0.062s	sys 0.004s
I20260709 13:04:55.025851 15480 tablet_bootstrap.cc:492] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:55.034816 15480 tablet_bootstrap.cc:492] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:04:55.035815 15480 ts_tablet_manager.cc:1403] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.342s	user 0.057s	sys 0.021s
I20260709 13:04:55.032862 15467 raft_consensus.cc:359] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:55.049202 15467 raft_consensus.cc:740] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:04:55.050118 15467 consensus_queue.cc:260] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:55.042191 15480 raft_consensus.cc:359] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:55.044018 15460 consensus_queue.cc:260] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:55.058301 15480 raft_consensus.cc:740] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:04:55.063725 15460 ts_tablet_manager.cc:1434] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.109s	user 0.009s	sys 0.001s
I20260709 13:04:55.066533  9386 tablet_copy_service.cc:342] P 925acbe78db14db3b9e4cfc857717947: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-3ad4133883414768941dffb952ca7caf received from {username='slave'} at 127.0.0.1:50568
I20260709 13:04:55.067088  9386 tablet_copy_service.cc:434] P 925acbe78db14db3b9e4cfc857717947: ending tablet copy session b0812463215649c3b011d36e2f0400c9-3ad4133883414768941dffb952ca7caf on tablet 3ad4133883414768941dffb952ca7caf with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:04:55.067996  9525 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 20 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:55.071539  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:55.073487  9446 raft_consensus.cc:3055] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:04:55.073971  9446 raft_consensus.cc:740] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:55.074383 15467 ts_tablet_manager.cc:1434] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.004s
I20260709 13:04:55.077971 15480 consensus_queue.cc:260] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:55.083540  9446 consensus_queue.cc:260] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:55.086158  9446 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:55.090881  9461 tablet_copy_service.cc:342] P d62c9d5a052b42ce8675f8438f846526: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-71ffe24ed6cf41c5b150d5ed4fa28c44 received from {username='slave'} at 127.0.0.1:45366
I20260709 13:04:55.092270  9461 tablet_copy_service.cc:434] P d62c9d5a052b42ce8675f8438f846526: ending tablet copy session b0812463215649c3b011d36e2f0400c9-71ffe24ed6cf41c5b150d5ed4fa28c44 on tablet 71ffe24ed6cf41c5b150d5ed4fa28c44 with peer b0812463215649c3b011d36e2f0400c9
W20260709 13:04:55.120803  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 43592.4us
I20260709 13:04:55.127940  9446 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 20.
I20260709 13:04:55.129485  9490 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:55.129482  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:55.130690  9372 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:55.131652 15498 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:55.132251 15498 raft_consensus.cc:697] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:55.134087 15498 consensus_queue.cc:237] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:55.149427  9372 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 20.
I20260709 13:04:55.145467 15480 ts_tablet_manager.cc:1434] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.109s	user 0.011s	sys 0.000s
I20260709 13:04:55.171150  9386 tablet_copy_service.cc:342] P 925acbe78db14db3b9e4cfc857717947: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-a8c41deeda674b9b8d27e72d70e96e79 received from {username='slave'} at 127.0.0.1:50568
I20260709 13:04:55.171722  9386 tablet_copy_service.cc:434] P 925acbe78db14db3b9e4cfc857717947: ending tablet copy session b0812463215649c3b011d36e2f0400c9-a8c41deeda674b9b8d27e72d70e96e79 on tablet a8c41deeda674b9b8d27e72d70e96e79 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:04:55.256017  9446 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:04:55.260387 15492 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:55.292873  9273 catalog_manager.cc:5697] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 15 to 16, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 16 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.299642  9523 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:04:55.297510  9274 catalog_manager.cc:5697] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 19 to 20, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 20 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:55.314175 15499 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:04:55.297363 15478 log.cc:927] Time spent T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:04:55.343448 15478 tablet_bootstrap.cc:492] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=2 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:04:55.344842 15478 tablet_bootstrap.cc:492] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:04:55.346103 15478 ts_tablet_manager.cc:1403] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.609s	user 0.042s	sys 0.021s
I20260709 13:04:55.419312 10067 raft_consensus.cc:1217] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 13:04:55.436486 15478 raft_consensus.cc:359] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9 [term 13 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:55.439626 15478 raft_consensus.cc:740] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:04:55.440524 15478 consensus_queue.cc:260] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:55.519646  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:55.524593 15478 ts_tablet_manager.cc:1434] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.178s	user 0.013s	sys 0.006s
I20260709 13:04:55.566017 10063 raft_consensus.cc:1217] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.8->[15.9-15.9]   Dedup: 15.9->[]
I20260709 13:04:55.565912 10067 raft_consensus.cc:1217] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
W20260709 13:04:55.590370  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 96774.2us
I20260709 13:04:55.701650  9372 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:04:55.725890  9461 tablet_copy_service.cc:342] P d62c9d5a052b42ce8675f8438f846526: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-084579f9b3b648f0bff0a7e9cdc1669b received from {username='slave'} at 127.0.0.1:45366
I20260709 13:04:55.726405  9461 tablet_copy_service.cc:434] P d62c9d5a052b42ce8675f8438f846526: ending tablet copy session b0812463215649c3b011d36e2f0400c9-084579f9b3b648f0bff0a7e9cdc1669b on tablet 084579f9b3b648f0bff0a7e9cdc1669b with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:04:55.730795 15509 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:55.810065 15514 raft_consensus.cc:1064] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:04:55.825906 15514 consensus_queue.cc:237] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:55.830332 10067 raft_consensus.cc:1217] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 13:04:55.831229 10067 raft_consensus.cc:2955] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9 [term 13 LEARNER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:04:55.852682  9443 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:04:55.887360 15475 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:55.979523  9375 raft_consensus.cc:1275] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:04:55.980768  9523 raft_consensus.cc:1275] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:04:55.981112 10067 raft_consensus.cc:1275] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 [term 15 LEARNER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:04:55.984431 15473 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:04:55.992259 15516 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:55.993875 15474 raft_consensus.cc:1064] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:04:55.993736 15224 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:56.006683 15474 consensus_queue.cc:237] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:04:56.038828 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 45137.8us
I20260709 13:04:56.041107 15473 raft_consensus.cc:2955] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:56.047395 15440 raft_consensus.cc:1064] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:04:56.052028 15440 consensus_queue.cc:237] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 7, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:56.070811  9517 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:04:56.114171 15375 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:56.105633 10063 raft_consensus.cc:2955] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:56.058089  9375 raft_consensus.cc:2955] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:04:56.178459  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 49573.8us
I20260709 13:04:56.138269  9273 catalog_manager.cc:5697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:56.225428  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 47030.8us
W20260709 13:04:56.231709  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 52192.6us
W20260709 13:04:56.275379  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 45507.9us
I20260709 13:04:56.288359 10067 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [term 13 LEARNER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:04:56.301606 15492 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:56.312989  9517 raft_consensus.cc:2955] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:56.386837  9445 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:04:56.412474 15530 raft_consensus.cc:1064] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:04:56.444213 15441 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:56.436826 15530 consensus_queue.cc:237] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:56.482712 10068 raft_consensus.cc:1275] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9 [term 15 LEARNER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:56.483040  9443 raft_consensus.cc:1275] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:56.484773 15440 consensus_queue.cc:1048] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:56.486025 15533 consensus_queue.cc:1048] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:56.542966  9443 consensus_queue.cc:237] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:56.546998 10068 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9 [term 13 LEARNER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:56.547416 15493 raft_consensus.cc:2955] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:56.552088 15492 raft_consensus.cc:2955] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:56.548702 15515 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:04:56.565833 10068 raft_consensus.cc:2955] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:56.574038 10067 raft_consensus.cc:1275] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:04:56.575846 15516 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:56.580313  9517 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:56.585435  9376 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:56.585939 10067 raft_consensus.cc:2955] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:56.591480 15517 raft_consensus.cc:2955] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:56.592808 10063 raft_consensus.cc:2955] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:56.616019  9523 raft_consensus.cc:1275] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:56.622313  9523 raft_consensus.cc:1275] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:04:56.621445 15530 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:56.627024  9443 raft_consensus.cc:2955] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:56.631812 15516 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:56.638788  9445 raft_consensus.cc:2955] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:56.637264 15515 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:56.664637  9273 catalog_manager.cc:5697] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.666100  9523 raft_consensus.cc:2955] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:56.675640  9260 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 71ffe24ed6cf41c5b150d5ed4fa28c44 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:56.676115  9525 raft_consensus.cc:2955] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:56.698800 15530 raft_consensus.cc:2955] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:56.701882  9517 raft_consensus.cc:2955] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:56.763007  9376 raft_consensus.cc:2955] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:56.769918 10067 raft_consensus.cc:2955] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:56.800501  9275 catalog_manager.cc:5697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New cstate: current_term: 15 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.842173  9274 catalog_manager.cc:5697] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:56.854804  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:56.879957 15492 consensus_queue.cc:1048] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:56.886266  9271 catalog_manager.cc:5697] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b reported cstate change: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:56.962682  9359 tablet_service.cc:1558] Processing DeleteTablet for tablet 71ffe24ed6cf41c5b150d5ed4fa28c44 with delete_type TABLET_DATA_TOMBSTONED (TS 925acbe78db14db3b9e4cfc857717947 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:52546
I20260709 13:04:56.971810  9375 consensus_queue.cc:237] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:56.984014 10067 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:56.987355 15440 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:57.005631 15542 raft_consensus.cc:2955] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:57.024379 15551 tablet_replica.cc:333] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:04:57.029066  9525 raft_consensus.cc:2955] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:57.036798  9526 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:57.037681 10067 raft_consensus.cc:2955] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:57.081990  9273 catalog_manager.cc:5697] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index 10 to 11, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New cstate: current_term: 13 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.097769 15551 raft_consensus.cc:2243] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:57.105908 15550 log.cc:927] Time spent T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.079s	user 0.002s	sys 0.000s
I20260709 13:04:57.113169 15551 raft_consensus.cc:2272] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.114774 15440 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:04:57.117944  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a8c41deeda674b9b8d27e72d70e96e79 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:57.118853  9443 consensus_queue.cc:237] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:57.122840  9375 consensus_queue.cc:237] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:04:57.165673  9526 raft_consensus.cc:2955] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:57.182840 10067 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:04:57.188841  9523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043"
dest_uuid: "6d50f1c263264b21919230bee398022b"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:46908
I20260709 13:04:57.189707  9523 raft_consensus.cc:606] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:04:57.190835 10067 raft_consensus.cc:1275] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:04:57.195851 15542 consensus_queue.cc:1048] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:57.197232  9445 raft_consensus.cc:1275] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:04:57.199215 15492 consensus_queue.cc:1048] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:57.201691  9374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:04:57.202468  9374 raft_consensus.cc:606] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 18 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:57.205345 15224 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:57.206178  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
W20260709 13:04:57.206576  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 50810.1us
I20260709 13:04:57.210659  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:57.215754  9374 raft_consensus.cc:1275] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:04:57.228117 10067 raft_consensus.cc:2955] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:57.233985 15551 ts_tablet_manager.cc:1916] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:57.234138  9435 tablet_service.cc:1558] Processing DeleteTablet for tablet a8c41deeda674b9b8d27e72d70e96e79 with delete_type TABLET_DATA_TOMBSTONED (TS d62c9d5a052b42ce8675f8438f846526 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:51006
I20260709 13:04:57.240242 15515 consensus_queue.cc:1048] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:57.240828  9443 raft_consensus.cc:2955] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:57.224933 15224 raft_consensus.cc:2955] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:57.252472 10063 raft_consensus.cc:2955] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:57.272929  9375 raft_consensus.cc:2955] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:57.233281 15542 raft_consensus.cc:2955] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:57.315580  9273 catalog_manager.cc:5697] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 11 to 12, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New cstate: current_term: 13 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:57.346087  9260 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 084579f9b3b648f0bff0a7e9cdc1669b with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:04:57.373790  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 58907.1us
I20260709 13:04:57.404678 15554 tablet_replica.cc:333] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:04:57.581867 15554 raft_consensus.cc:2243] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.582907 15554 raft_consensus.cc:2272] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:57.604851  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 96385.8us
W20260709 13:04:57.616607  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 107210us
I20260709 13:04:57.662675 15492 raft_consensus.cc:993] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:57.663265 15492 raft_consensus.cc:1081] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 18 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:57.588956 15551 ts_tablet_manager.cc:1929] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 13:04:57.665515 15551 log.cc:1199] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 925acbe78db14db3b9e4cfc857717947: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-0-root/wals/71ffe24ed6cf41c5b150d5ed4fa28c44
W20260709 13:04:57.674219  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 45882.2us
I20260709 13:04:57.675345 15554 ts_tablet_manager.cc:1916] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:57.677487  9525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46894
I20260709 13:04:57.678361  9525 raft_consensus.cc:493] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:57.678831  9525 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:04:57.682888 15494 log.cc:927] Time spent T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:04:57.684746  9262 catalog_manager.cc:5028] TS 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): tablet 71ffe24ed6cf41c5b150d5ed4fa28c44 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:04:57.726977  9525 raft_consensus.cc:515] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:04:57.771651  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 149912us
I20260709 13:04:57.814783 15498 raft_consensus.cc:993] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:57.815459 15498 raft_consensus.cc:1081] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:04:57.826306  9447 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51016
I20260709 13:04:57.826967  9447 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:57.827378  9447 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:57.843081  9447 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:57.847870  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:57.848606  9375 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:04:57.852972  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 335738us
W20260709 13:04:57.877998  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 145157us
I20260709 13:04:57.880410  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3ad4133883414768941dffb952ca7caf with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:57.915076  9525 leader_election.cc:290] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:04:57.939435  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:57.940130  9445 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:57.956902  9447 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 21 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:57.963271  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55d9be5c0db4ab3a575698dea3014ba" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:57.964051  9372 raft_consensus.cc:3055] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:57.964430  9372 raft_consensus.cc:740] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:57.965323  9372 consensus_queue.cc:260] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:57.966732  9372 raft_consensus.cc:3060] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:57.976724  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aada562be2484a8fb8aac8e7f9348043" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:57.977712  9526 raft_consensus.cc:3055] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:04:57.978073  9526 raft_consensus.cc:740] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:57.978878  9526 consensus_queue.cc:260] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:57.980549  9526 raft_consensus.cc:3060] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:57.991519  9445 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 19.
I20260709 13:04:57.995219  9375 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 21.
I20260709 13:04:57.998198  9372 raft_consensus.cc:2468] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 19.
I20260709 13:04:58.003069  9490 leader_election.cc:304] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:57.995055  9526 raft_consensus.cc:2468] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 21.
I20260709 13:04:58.030730  9508 tablet_service.cc:1558] Processing DeleteTablet for tablet 084579f9b3b648f0bff0a7e9cdc1669b with delete_type TABLET_DATA_TOMBSTONED (TS 6d50f1c263264b21919230bee398022b not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:54524
I20260709 13:04:58.015353  9271 catalog_manager.cc:5697] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 10 to 11, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New cstate: current_term: 15 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:04:58.035918  9368 raft_consensus.cc:1240] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 20. Current term is 21. Ops: []
I20260709 13:04:58.046439 15509 raft_consensus.cc:2804] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:58.047232 15509 raft_consensus.cc:697] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 19 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:58.048261 15509 consensus_queue.cc:237] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:58.051050  9418 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:58.051964 15566 raft_consensus.cc:2804] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:04:58.052547 15566 raft_consensus.cc:697] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 21 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:58.053442 15566 consensus_queue.cc:237] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:58.072404  9516 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ad4133883414768941dffb952ca7caf with delete_type TABLET_DATA_TOMBSTONED (TS 6d50f1c263264b21919230bee398022b not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:54524
I20260709 13:04:58.086805 15554 ts_tablet_manager.cc:1929] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 13:04:58.098757 15579 tablet_replica.cc:333] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:04:58.100219 15579 raft_consensus.cc:2243] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.101375 15579 raft_consensus.cc:2272] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.104846 15579 ts_tablet_manager.cc:1916] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:58.112605  9271 catalog_manager.cc:5697] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 20 to 21, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 21 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:58.147881 15554 log.cc:1199] T a8c41deeda674b9b8d27e72d70e96e79 P d62c9d5a052b42ce8675f8438f846526: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-1-root/wals/a8c41deeda674b9b8d27e72d70e96e79
I20260709 13:04:58.164772  9260 catalog_manager.cc:5028] TS d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): tablet a8c41deeda674b9b8d27e72d70e96e79 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:04:58.212786  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:58.213757 15579 ts_tablet_manager.cc:1929] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 13:04:58.214428 15579 log.cc:1199] T 084579f9b3b648f0bff0a7e9cdc1669b P 6d50f1c263264b21919230bee398022b: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-2-root/wals/084579f9b3b648f0bff0a7e9cdc1669b
I20260709 13:04:58.218708  9274 catalog_manager.cc:5697] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 18 to 19, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 19 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:58.226003  9262 catalog_manager.cc:5028] TS 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): tablet 084579f9b3b648f0bff0a7e9cdc1669b (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:04:58.227113 15579 tablet_replica.cc:333] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:04:58.235476 15579 raft_consensus.cc:2243] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.242300 15579 raft_consensus.cc:2272] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.284672 15579 ts_tablet_manager.cc:1916] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:58.436805 15579 ts_tablet_manager.cc:1929] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.10
I20260709 13:04:58.437652 15579 log.cc:1199] T 3ad4133883414768941dffb952ca7caf P 6d50f1c263264b21919230bee398022b: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-2-root/wals/3ad4133883414768941dffb952ca7caf
I20260709 13:04:58.451820  9262 catalog_manager.cc:5028] TS 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): tablet 3ad4133883414768941dffb952ca7caf (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:04:58.474407  9447 raft_consensus.cc:1275] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:04:58.479071 15538 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:58.581127  9372 raft_consensus.cc:1275] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:04:58.583300 15509 consensus_queue.cc:1048] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:58.619635  9375 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:04:58.622444 15515 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:58.644901  9526 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:04:58.647583 15515 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:59.363365  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:59.574858  9526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137"
dest_uuid: "6d50f1c263264b21919230bee398022b"
mode: GRACEFUL
new_leader_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:46908
I20260709 13:04:59.577616  9526 raft_consensus.cc:606] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 8 LEADER]: Received request to transfer leadership to TS 925acbe78db14db3b9e4cfc857717947
I20260709 13:04:59.588361  9443 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7a866663507456b9442af6c42748c5f"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:04:59.589421  9443 raft_consensus.cc:606] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:04:59.592033  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:59.594628  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:59.670102 15475 raft_consensus.cc:993] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b: : Instructing follower 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:04:59.670796 15475 raft_consensus.cc:1081] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 8 LEADER]: Signalling peer 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:04:59.672847  9375 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:52562
I20260709 13:04:59.673508  9375 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:59.673882  9375 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:59.677574  9372 consensus_queue.cc:237] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:04:59.685878 15566 raft_consensus.cc:993] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:59.686473 15566 raft_consensus.cc:1081] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:04:59.697201  9526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7a866663507456b9442af6c42748c5f"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46902
I20260709 13:04:59.697886  9526 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:59.699607  9526 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:59.696734  9375 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:59.702277  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:59.702847  9443 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:59.718461  9443 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:04:59.719956  9341 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:04:59.721947 15560 raft_consensus.cc:2804] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:59.722594 15560 raft_consensus.cc:697] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:04:59.723570 15560 consensus_queue.cc:237] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:59.728430  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:04:59.729144  9520 raft_consensus.cc:3055] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:59.729432  9520 raft_consensus.cc:740] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:04:59.730226  9520 consensus_queue.cc:260] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:59.731393  9520 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:59.734619  9375 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 9 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:04:59.751502  9520 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 9.
I20260709 13:04:59.804251  9271 catalog_manager.cc:5697] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 8 to 9, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 9 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:59.827827  9342 consensus_peers.cc:597] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 31f9d5965eae4c788eb6a40e856cadc7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.828637  9447 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:04:59.830529 15533 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:59.857789  9520 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:04:59.864364 15533 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:59.873176  9526 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:59.884006  9526 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:04:59.919771  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 98884.8us
I20260709 13:04:59.919953  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:04:59.922964  9375 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:59.964665  9375 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:04:59.970039  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:04:59.970916  9450 raft_consensus.cc:3055] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:59.971320  9450 raft_consensus.cc:740] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:04:59.972340  9450 consensus_queue.cc:260] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:04:59.987672  9450 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:00.011883  9450 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
W20260709 13:05:00.017198  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 63125.2us
I20260709 13:05:00.018911  9492 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
W20260709 13:05:00.029237  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 73254.7us
I20260709 13:05:00.022301 15538 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:00.018801 15577 raft_consensus.cc:2955] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
W20260709 13:05:00.081271  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 47563us
I20260709 13:05:00.132781  9447 raft_consensus.cc:2955] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:00.128841 15538 raft_consensus.cc:697] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
W20260709 13:05:00.152510  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 113072us
W20260709 13:05:00.156404  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 62340.8us
W20260709 13:05:00.173893  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 88969us
I20260709 13:05:00.162231 15538 consensus_queue.cc:237] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:00.274971  9520 consensus_queue.cc:237] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:00.286909  9271 catalog_manager.cc:5697] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index -1 to 12, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 16 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:00.300709  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 123755us
W20260709 13:05:00.310155  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 149882us
I20260709 13:05:00.344537  9519 raft_consensus.cc:2955] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:00.394179  9526 raft_consensus.cc:1275] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:05:00.413849  9450 raft_consensus.cc:1275] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:05:00.415980  9374 raft_consensus.cc:1275] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:00.420866 15608 consensus_queue.cc:1048] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:00.458896 15630 ts_tablet_manager.cc:933] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
I20260709 13:05:00.456086  9271 catalog_manager.cc:5697] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 14 to 15, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 15 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:00.442385 15533 consensus_queue.cc:1048] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:05:00.468135  9444 raft_consensus.cc:1275] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:00.441418 15614 consensus_queue.cc:1048] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
W20260709 13:05:00.513630  9491 consensus_peers.cc:597] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6836716b8e044849b07461ac40f5f1a6. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:00.514426  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 58754.1us
W20260709 13:05:00.537879 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 71417.7us
I20260709 13:05:00.585511 15630 tablet_copy_client.cc:323] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.65:37547
I20260709 13:05:00.587381 15612 raft_consensus.cc:2955] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:00.595800  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:00.599833  9368 raft_consensus.cc:2955] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:00.601253  9386 tablet_copy_service.cc:140] P 925acbe78db14db3b9e4cfc857717947: Received BeginTabletCopySession request for tablet 31f9d5965eae4c788eb6a40e856cadc7 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:50568)
I20260709 13:05:00.601949  9386 tablet_copy_service.cc:161] P 925acbe78db14db3b9e4cfc857717947: Beginning new tablet copy session on tablet 31f9d5965eae4c788eb6a40e856cadc7 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:50568: session id = b0812463215649c3b011d36e2f0400c9-31f9d5965eae4c788eb6a40e856cadc7
I20260709 13:05:00.643464  9386 tablet_copy_source_session.cc:215] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:00.655663 15630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31f9d5965eae4c788eb6a40e856cadc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:00.645090 15626 consensus_queue.cc:1048] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:05:00.682483  9375 raft_consensus.cc:1275] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:00.685487 15610 consensus_queue.cc:1048] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:05:00.690907 15636 log.cc:927] Time spent T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:05:00.734993  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 49115.3us
I20260709 13:05:00.791693  9274 catalog_manager.cc:5697] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 15 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:00.796867  9374 consensus_queue.cc:237] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:00.811043 15630 tablet_copy_client.cc:806] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:00.811945 15630 tablet_copy_client.cc:670] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:00.815721  9447 raft_consensus.cc:1275] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:00.821594 15630 tablet_copy_client.cc:538] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:00.864996 15630 tablet_bootstrap.cc:492] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:05:00.898139 15475 consensus_queue.cc:1048] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:00.905864  9443 raft_consensus.cc:2955] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
W20260709 13:05:00.927670  9342 consensus_peers.cc:597] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7201bcdf8f724879b727639e6e67e31e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:00.928936  9524 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:05:00.930553 15533 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:00.941520  9444 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:05:00.943526 15620 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:01.014434 15644 ts_tablet_manager.cc:933] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:01.029160 15577 raft_consensus.cc:2955] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:01.049186  9524 raft_consensus.cc:2955] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:01.061084  9444 raft_consensus.cc:2955] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:01.078495  9519 consensus_queue.cc:237] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:01.081984 15644 tablet_copy_client.cc:323] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.67:35929
I20260709 13:05:01.088310  9535 tablet_copy_service.cc:140] P 6d50f1c263264b21919230bee398022b: Received BeginTabletCopySession request for tablet 6836716b8e044849b07461ac40f5f1a6 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:52502)
I20260709 13:05:01.088996  9535 tablet_copy_service.cc:161] P 6d50f1c263264b21919230bee398022b: Beginning new tablet copy session on tablet 6836716b8e044849b07461ac40f5f1a6 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:52502: session id = b0812463215649c3b011d36e2f0400c9-6836716b8e044849b07461ac40f5f1a6
I20260709 13:05:01.087366  9274 catalog_manager.cc:5697] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b reported cstate change: config changed from index -1 to 13, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 19 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:01.108698  9535 tablet_copy_source_session.cc:215] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:01.115269 15644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6836716b8e044849b07461ac40f5f1a6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:01.152851  9491 consensus_peers.cc:597] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8cb1b08cec264585b21aa628ca12e206. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:01.160331  9368 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:05:01.163968 15637 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:01.165199  9443 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:05:01.168324 15538 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:01.238979 15625 raft_consensus.cc:2955] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 17 LEADER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:01.245327  9443 raft_consensus.cc:2955] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:01.265533 15644 tablet_copy_client.cc:806] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:01.266280 15644 tablet_copy_client.cc:670] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:01.282428 15644 tablet_copy_client.cc:538] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:01.296707  9375 raft_consensus.cc:2955] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:01.299752 15644 tablet_bootstrap.cc:492] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:05:01.314469  9274 catalog_manager.cc:5697] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 17 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
W20260709 13:05:01.376850  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 67903us
W20260709 13:05:01.462387  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 78588.2us
I20260709 13:05:01.588186 15630 tablet_bootstrap.cc:492] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:05:01.587814  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 45515.5us
W20260709 13:05:01.638899  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 152498us
I20260709 13:05:01.639279 15630 tablet_bootstrap.cc:492] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
W20260709 13:05:01.654135 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 141646us
I20260709 13:05:01.742532  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:01.745639 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 93359.8us
W20260709 13:05:01.765391 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 110517us
I20260709 13:05:01.826700 15670 ts_tablet_manager.cc:933] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
I20260709 13:05:01.733966 15630 ts_tablet_manager.cc:1403] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.869s	user 0.054s	sys 0.014s
I20260709 13:05:02.016146 15670 tablet_copy_client.cc:323] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.65:37547
I20260709 13:05:02.202926 15630 raft_consensus.cc:359] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:02.211721 15630 raft_consensus.cc:740] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:05:02.223182 15630 consensus_queue.cc:260] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
W20260709 13:05:02.253018  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 57983.3us
W20260709 13:05:02.326045  9418 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.009s	sys 0.011s
W20260709 13:05:02.326792  9418 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.009s	sys 0.011s
I20260709 13:05:02.389159 15691 ts_tablet_manager.cc:933] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:02.390288  9526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "807906edc34d41589d9b860b72f70e16"
dest_uuid: "6d50f1c263264b21919230bee398022b"
mode: GRACEFUL
new_leader_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:46908
I20260709 13:05:02.391045  9526 raft_consensus.cc:606] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Received request to transfer leadership to TS 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:02.436865  9375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:05:02.438509  9375 raft_consensus.cc:606] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 19 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
W20260709 13:05:02.450171 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 45370.7us
I20260709 13:05:02.457621 15630 ts_tablet_manager.cc:1434] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.620s	user 0.012s	sys 0.002s
W20260709 13:05:02.458938 15630 ts_tablet_manager.cc:1467] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9: Tablet startup took 629ms
I20260709 13:05:02.455822  9386 tablet_copy_service.cc:140] P 925acbe78db14db3b9e4cfc857717947: Received BeginTabletCopySession request for tablet 7201bcdf8f724879b727639e6e67e31e from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:50568)
I20260709 13:05:02.495448  9386 tablet_copy_service.cc:161] P 925acbe78db14db3b9e4cfc857717947: Beginning new tablet copy session on tablet 7201bcdf8f724879b727639e6e67e31e from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:50568: session id = b0812463215649c3b011d36e2f0400c9-7201bcdf8f724879b727639e6e67e31e
I20260709 13:05:02.502521  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
W20260709 13:05:02.460331 15630 ts_tablet_manager.cc:1469] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9: Trace:
0709 13:05:00.423848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.424028 (+   180us) service_pool.cc:224] Handling call
0709 13:05:00.459823 (+ 35795us) ts_tablet_manager.cc:934] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
0709 13:05:00.653756 (+193933us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:05:00.765460 (+111704us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:00.765816 (+   356us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:05:00.806985 (+ 41169us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:05:00.807358 (+   373us) tablet_replica.cc:206] Creating consensus instance
0709 13:05:00.810050 (+  2692us) ts_tablet_manager.cc:989] Replica registered.
0709 13:05:00.810160 (+   110us) inbound_call.cc:177] Queueing success response
0709 13:05:00.864564 (+ 54404us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:05:01.850622 (+986058us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:05:01.920563 (+ 69941us) tablet_replica.cc:261] Starting instrumentation
0709 13:05:02.095683 (+175120us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":9231,"mutex_wait_us":104294,"raft.queue_time_us":3072,"raft.run_cpu_time_us":685,"raft.run_wall_time_us":42881,"tablet-copy.queue_time_us":34339,"tablet-download-pool.queue_time_us":118,"tablet-download-pool.run_cpu_time_us":1176,"tablet-download-pool.run_wall_time_us":8749,"thread_start_us":65544,"threads_started":2}
I20260709 13:05:02.539438  9387 tablet_copy_service.cc:342] P 925acbe78db14db3b9e4cfc857717947: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-31f9d5965eae4c788eb6a40e856cadc7 received from {username='slave'} at 127.0.0.1:50568
I20260709 13:05:02.539970  9387 tablet_copy_service.cc:434] P 925acbe78db14db3b9e4cfc857717947: ending tablet copy session b0812463215649c3b011d36e2f0400c9-31f9d5965eae4c788eb6a40e856cadc7 on tablet 31f9d5965eae4c788eb6a40e856cadc7 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:05:02.540344 15659 raft_consensus.cc:993] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b: : Instructing follower 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:05:02.541648 15691 tablet_copy_client.cc:323] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.67:35929
I20260709 13:05:02.545555  9535 tablet_copy_service.cc:140] P 6d50f1c263264b21919230bee398022b: Received BeginTabletCopySession request for tablet 8cb1b08cec264585b21aa628ca12e206 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:52502)
I20260709 13:05:02.546253  9535 tablet_copy_service.cc:161] P 6d50f1c263264b21919230bee398022b: Beginning new tablet copy session on tablet 8cb1b08cec264585b21aa628ca12e206 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:52502: session id = b0812463215649c3b011d36e2f0400c9-8cb1b08cec264585b21aa628ca12e206
W20260709 13:05:02.550494  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 55770.8us
I20260709 13:05:02.573078 15659 raft_consensus.cc:1081] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Signalling peer 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:05:02.595498  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:02.656621  9386 tablet_copy_source_session.cc:215] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:02.658665  9535 tablet_copy_source_session.cc:215] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:05:02.676327  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 52140.1us
I20260709 13:05:02.686276 15665 raft_consensus.cc:993] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:05:02.686851 15665 raft_consensus.cc:1081] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 19 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:05:02.711606 15670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7201bcdf8f724879b727639e6e67e31e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:02.756215 15691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cb1b08cec264585b21aa628ca12e206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:02.760900  9525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46894
I20260709 13:05:02.761564  9525 raft_consensus.cc:493] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:02.761924  9525 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:02.764109  9372 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "807906edc34d41589d9b860b72f70e16"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:52562
I20260709 13:05:02.764763  9372 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:02.765720  9372 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:02.791555  9525 raft_consensus.cc:515] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:02.795619  9372 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:02.802536  9525 leader_election.cc:290] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 20 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:02.807165  9372 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 election: Requested vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:02.820111  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:05:02.821116  9525 raft_consensus.cc:3055] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:02.821446  9525 raft_consensus.cc:740] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:05:02.822249  9525 consensus_queue.cc:260] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 14.15, Last appended by leader: 15, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:02.820298  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:05:02.825354  9372 raft_consensus.cc:3055] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:02.825508 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: true dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:05:02.825992  9372 raft_consensus.cc:740] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:05:02.826195 10063 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:02.829370  9525 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:02.843343  9525 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
I20260709 13:05:02.851039  9343 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:05:02.852422 15675 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:02.853080 15675 raft_consensus.cc:697] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:05:02.857450 15675 consensus_queue.cc:237] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 14.15, Last appended by leader: 15, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:02.860605 10067 raft_consensus.cc:1217] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.11->[16.12-16.12]   Dedup: 16.12->[]
I20260709 13:05:02.839224  9372 consensus_queue.cc:260] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:02.872373 10063 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 15.
W20260709 13:05:02.881692  9343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:02.887714  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 105740us
I20260709 13:05:02.901458  9372 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:02.945669 15670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44540 (request call id 807) took 1289 ms. Trace:
I20260709 13:05:02.946353 15670 rpcz_store.cc:276] 0709 13:05:01.655973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.656151 (+   178us) service_pool.cc:224] Handling call
0709 13:05:01.827388 (+171237us) ts_tablet_manager.cc:934] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
0709 13:05:02.709699 (+882311us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:05:02.848158 (+138459us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:02.848343 (+   185us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:05:02.940458 (+ 92115us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:05:02.940962 (+   504us) tablet_replica.cc:206] Creating consensus instance
0709 13:05:02.945466 (+  4504us) ts_tablet_manager.cc:989] Replica registered.
0709 13:05:02.945554 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":1183,"tablet-copy.queue_time_us":169650,"thread_start_us":322698,"threads_started":2}
I20260709 13:05:02.921474  9372 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 20.
I20260709 13:05:02.957578  9492 leader_election.cc:304] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:05:02.961238 15637 raft_consensus.cc:2804] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:02.961812 15637 raft_consensus.cc:697] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:05:02.962736 15637 consensus_queue.cc:237] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:02.963647 15670 tablet_copy_client.cc:806] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:02.964283 15670 tablet_copy_client.cc:670] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:02.962653 15691 tablet_copy_client.cc:806] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:02.967402 15691 tablet_copy_client.cc:670] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:02.984201  9446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3280937dd84fa789b7a8c362985847" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:05:02.984990  9446 raft_consensus.cc:3060] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:02.977584 15691 tablet_copy_client.cc:538] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:02.973703  9275 catalog_manager.cc:5697] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 14 to 15, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 15 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:02.971405 15670 tablet_copy_client.cc:538] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:02.970921 15644 tablet_bootstrap.cc:492] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=2 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:03.021648  9446 raft_consensus.cc:2468] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 20.
I20260709 13:05:03.097155 15644 tablet_bootstrap.cc:492] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:05:03.180994  9271 catalog_manager.cc:5697] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 19 to 20, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 20 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:03.181588 15644 ts_tablet_manager.cc:1403] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 1.882s	user 0.071s	sys 0.026s
W20260709 13:05:03.225638  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 190580us
I20260709 13:05:03.257704 15644 raft_consensus.cc:359] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:03.259065 15644 raft_consensus.cc:740] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:05:03.259972 15644 consensus_queue.cc:260] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:03.263249 15644 ts_tablet_manager.cc:1434] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:05:03.287817 15691 tablet_bootstrap.cc:492] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:05:03.306559 10063 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 14 index: 15. Preceding OpId from leader: term: 15 index: 16. (index mismatch)
I20260709 13:05:03.315248  9535 tablet_copy_service.cc:342] P 6d50f1c263264b21919230bee398022b: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-6836716b8e044849b07461ac40f5f1a6 received from {username='slave'} at 127.0.0.1:52502
I20260709 13:05:03.316015  9535 tablet_copy_service.cc:434] P 6d50f1c263264b21919230bee398022b: ending tablet copy session b0812463215649c3b011d36e2f0400c9-6836716b8e044849b07461ac40f5f1a6 on tablet 6836716b8e044849b07461ac40f5f1a6 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:05:03.324720 15706 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:05:03.369114 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 59977.9us
W20260709 13:05:03.448395  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 44710.2us
I20260709 13:05:03.466349 15707 raft_consensus.cc:1064] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:05:03.403877 15670 tablet_bootstrap.cc:492] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:05:03.487294 15707 consensus_queue.cc:237] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:03.498090  9520 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 14 index: 15. Preceding OpId from leader: term: 15 index: 16. (index mismatch)
W20260709 13:05:03.556988  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 62202us
I20260709 13:05:03.563791  9446 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:05:03.570108 10067 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:03.573056 15693 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:03.580384  9446 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:03.583467 15665 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:05:03.584792  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 72014.2us
I20260709 13:05:03.588698 15665 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:05:03.607117 15712 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:03.618855  9520 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:03.624239  9375 raft_consensus.cc:1275] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:05:03.628974  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:03.630004 15693 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:03.653103 15475 consensus_queue.cc:1048] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:05:03.771106  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 124551us
W20260709 13:05:03.959523  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 76756.1us
W20260709 13:05:03.964576  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 107975us
W20260709 13:05:04.029214 15719 log.cc:927] Time spent T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
W20260709 13:05:04.066752 15714 log.cc:927] Time spent T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
W20260709 13:05:04.082180 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 112674us
W20260709 13:05:04.102480 15717 log.cc:927] Time spent T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260709 13:05:04.229645 15670 log.cc:927] Time spent T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.096s	user 0.002s	sys 0.000s
W20260709 13:05:04.350046 15691 log.cc:927] Time spent T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.147s	user 0.001s	sys 0.001s
W20260709 13:05:04.381206  9375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.015s	sys 0.013s
W20260709 13:05:04.381917  9375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.015s	sys 0.013s
I20260709 13:05:04.511440 10064 raft_consensus.cc:1217] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 13:05:04.660458 15665 raft_consensus.cc:2955] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:05:04.727465  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 117975us
W20260709 13:05:04.732023  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 84260.9us
W20260709 13:05:04.766528 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 51676.8us
I20260709 13:05:04.816273 10063 raft_consensus.cc:2955] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:04.827309 15732 raft_consensus.cc:493] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:05:04.828584 15732 raft_consensus.cc:515] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:04.828929 15691 tablet_bootstrap.cc:492] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=2 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:04.835538 15691 tablet_bootstrap.cc:492] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:05:04.836691 15691 ts_tablet_manager.cc:1403] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 1.552s	user 0.100s	sys 0.092s
W20260709 13:05:04.855815 15736 log.cc:927] Time spent T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:05:04.857281  9375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52562 (request call id 3104) took 1057 ms. Trace:
I20260709 13:05:04.857671  9375 rpcz_store.cc:276] 0709 13:05:03.800387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.800779 (+   392us) service_pool.cc:224] Handling call
0709 13:05:03.812046 (+ 11267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:03.812402 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:03.812430 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:03.830115 (+ 17685us) log.cc:844] Serialized 26 byte log entry
0709 13:05:04.382854 (+552739us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:04.382991 (+   137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.383161 (+   170us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:04.856985 (+473824us) raft_consensus.cc:1685] finished
0709 13:05:04.857028 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:04.857191 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":539,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":24164,"thread_start_us":515283,"threads_started":1,"wal-append.queue_time_us":825244}
W20260709 13:05:04.863546 15744 log.cc:927] Time spent T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:05:04.922866  9447 raft_consensus.cc:2955] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:04.940331 15626 raft_consensus.cc:1064] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:05:04.954159 15732 leader_election.cc:290] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:04.962487  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:05:05.016438 15670 tablet_bootstrap.cc:492] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:05.017882 15670 tablet_bootstrap.cc:492] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:05:05.019026 15670 ts_tablet_manager.cc:1403] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 1.650s	user 0.077s	sys 0.041s
I20260709 13:05:05.012343 15626 consensus_queue.cc:237] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:05:05.032199  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 140903us
W20260709 13:05:05.068692  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:05.102890  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 61991us
W20260709 13:05:05.131366  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 124091us
I20260709 13:05:05.126428 15691 raft_consensus.cc:359] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:05.149874 15691 raft_consensus.cc:740] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:05:05.150786 15691 consensus_queue.cc:260] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:05.152855 15691 ts_tablet_manager.cc:1434] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.312s	user 0.005s	sys 0.005s
I20260709 13:05:05.201679  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8897d3859c4aa692a409afb3f57944" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:05:05.223176  9535 tablet_copy_service.cc:342] P 6d50f1c263264b21919230bee398022b: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-8cb1b08cec264585b21aa628ca12e206 received from {username='slave'} at 127.0.0.1:52502
I20260709 13:05:05.224000  9535 tablet_copy_service.cc:434] P 6d50f1c263264b21919230bee398022b: ending tablet copy session b0812463215649c3b011d36e2f0400c9-8cb1b08cec264585b21aa628ca12e206 on tablet 8cb1b08cec264585b21aa628ca12e206 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:05:05.247289 15670 raft_consensus.cc:359] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:05.268721 15670 raft_consensus.cc:740] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:05:05.272473 15670 consensus_queue.cc:260] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:05.296942 15670 ts_tablet_manager.cc:1434] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.264s	user 0.014s	sys 0.001s
I20260709 13:05:05.301338 10068 raft_consensus.cc:1217] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.12->[19.13-19.13]   Dedup: 19.13->[]
W20260709 13:05:05.302515  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 104273us
I20260709 13:05:05.324770  9386 tablet_copy_service.cc:342] P 925acbe78db14db3b9e4cfc857717947: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-7201bcdf8f724879b727639e6e67e31e received from {username='slave'} at 127.0.0.1:50568
I20260709 13:05:05.325750  9386 tablet_copy_service.cc:434] P 925acbe78db14db3b9e4cfc857717947: ending tablet copy session b0812463215649c3b011d36e2f0400c9-7201bcdf8f724879b727639e6e67e31e on tablet 7201bcdf8f724879b727639e6e67e31e with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:05:05.306417  9418 leader_election.cc:304] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:05.325029  9271 catalog_manager.cc:5697] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index 12 to 13, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:05.326756  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 83967.1us
I20260709 13:05:05.329397 15726 raft_consensus.cc:2749] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:05.358491 15758 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:05.359344 15758 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:05.372346 15727 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:05.373720 15727 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:05.383380 15748 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:05.385980 15475 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:05.422830  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:05:05.452301 15720 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:05:05.458065  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 53749.3us
I20260709 13:05:05.384959 15748 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:05.505297 15755 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:05.513839 15727 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:05.547881 15755 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:05.543177  9525 raft_consensus.cc:2955] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:05.534111 15475 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:05.498875 15720 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:05.604190 15475 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:05.764515 15748 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:05.786026  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 134625us
I20260709 13:05:05.775301 15720 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:05.816723 15758 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:05.894312  9447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:05.926960  9451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:05.929324  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:05.930064  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:05.930754  9449 raft_consensus.cc:1275] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:05:05.931461  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:05.934018 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:05:05.926957 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 16 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:05:05.959784  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 47019.3us
I20260709 13:05:05.959297  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:05:05.970507  9490 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:05:05.963014  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 47350us
I20260709 13:05:05.999886 15475 consensus_queue.cc:1048] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:05:06.012007  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:05:06.022886 10066 raft_consensus.cc:1275] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9 [term 15 LEARNER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:05:06.033722 10067 raft_consensus.cc:1217] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.9->[17.10-17.10]   Dedup: 17.10->[]
I20260709 13:05:06.035174  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:05:06.010741 15689 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:06.053512 15689 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:06.001911 15772 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:06.072865 15665 raft_consensus.cc:1064] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:05:06.079334  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:05:06.082285  9368 raft_consensus.cc:1275] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:05:06.111466 15769 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:06.151014 15745 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:06.150847 15769 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:06.151865 15745 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:06.153276  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:06.154461 15769 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:06.154577 15665 consensus_queue.cc:237] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:05:06.160068  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 49706us
I20260709 13:05:06.163265  9491 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:06.163314 15776 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:06.165700 15776 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:06.168886 15776 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:06.174849  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 16 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:05:06.193166  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 165938us
I20260709 13:05:06.194622 15755 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:06.199393  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:05:06.205740 15689 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:06.224926 15786 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:06.228175 15745 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:06.235524  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
W20260709 13:05:06.245251  9341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:06.269397  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 75327.1us
I20260709 13:05:06.271733 15758 consensus_queue.cc:1048] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:05:06.275251  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 76739.4us
I20260709 13:05:06.277182  9492 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:06.279506 15764 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:06.282925  9492 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:06.283895 15786 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:06.267414  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:06.289878 15786 consensus_queue.cc:1048] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:06.309327  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:05:06.313534  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 60400us
I20260709 13:05:06.320048  9492 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:05:06.324170 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:05:06.331370 10025 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:06.333237 15705 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:06.342751 10025 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:06.365387  9370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:05:06.364454  9490 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:06.377071  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:05:06.395905 15758 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:06.397311 15592 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:06.399698 15784 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:06.404981  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:05:06.439854  9274 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43244 (request call id 288) took 1076 ms. Trace:
I20260709 13:05:06.440327  9274 rpcz_store.cc:276] 0709 13:05:05.364072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.405676 (+ 41604us) service_pool.cc:224] Handling call
0709 13:05:06.439663 (+1033987us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16961,"reported_tablets":1,"spinlock_wait_cycles":943872}
I20260709 13:05:06.459297  9524 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:05:06.467558  9271 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43240 (request call id 276) took 1214 ms. Trace:
I20260709 13:05:06.468039  9271 rpcz_store.cc:276] 0709 13:05:05.253337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.253821 (+   484us) service_pool.cc:224] Handling call
0709 13:05:06.467460 (+1213639us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:05.819791 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:05.820737 (+   946us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:05.820794 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:05:05.820830 (+    36us) tablet.cc:662] Decoding operations
0709 13:05:05.821359 (+   529us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:05.821445 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:05.821480 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:05:05.821826 (+   346us) tablet.cc:701] Row locks acquired
0709 13:05:05.821877 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:05:05.822086 (+   209us) write_op.cc:270] Start()
0709 13:05:05.822260 (+   174us) write_op.cc:276] Timestamp: P: 1783602305822009 usec, L: 0
0709 13:05:05.822297 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:05:05.823153 (+   856us) log.cc:844] Serialized 583 byte log entry
0709 13:05:06.209582 (+386429us) op_driver.cc:464] REPLICATION: finished
0709 13:05:06.251040 (+ 41458us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb5834600ac 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb589fa0ef0
0709 13:05:06.402421 (+151381us) write_op.cc:301] APPLY: starting
0709 13:05:06.402688 (+   267us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:06.406426 (+  3738us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:06.406468 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:06.407333 (+   865us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:06.408044 (+   711us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:05:06.408522 (+   478us) write_op.cc:312] APPLY: finished
0709 13:05:06.408833 (+   311us) log.cc:844] Serialized 25 byte log entry
0709 13:05:06.409042 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:06.409128 (+    86us) write_op.cc:454] Released schema lock
0709 13:05:06.409184 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:06.409772 (+   588us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:06.409798 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":192296,"apply.run_cpu_time_us":7261,"apply.run_wall_time_us":7352,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8297,"num_ops":1,"prepare.queue_time_us":337344,"prepare.run_cpu_time_us":18875,"prepare.run_wall_time_us":137640,"raft.queue_time_us":198103,"raft.run_cpu_time_us":24068,"raft.run_wall_time_us":183568,"replication_time_us":387084,"spinlock_wait_cycles":8918272,"thread_start_us":699514,"threads_started":4,"wal-append.queue_time_us":116413}]]}
I20260709 13:05:06.473400  9275 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 173) took 1024 ms. Trace:
I20260709 13:05:06.474391  9275 rpcz_store.cc:276] 0709 13:05:05.448627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.448849 (+   222us) service_pool.cc:224] Handling call
0709 13:05:06.473184 (+1024335us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":49152}
I20260709 13:05:06.486166  9418 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:06.492942 10070 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [term 19 LEARNER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:05:06.506445  9418 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:05:06.511123 15769 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:06.512652 15742 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:05:06.530942  9376 consensus_queue.cc:237] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:05:06.544296  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 49152.4us
I20260709 13:05:06.541741 15732 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:06.569309 15787 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:05:06.612156 15792 raft_consensus.cc:2955] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:05:06.648824  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 67501.5us
I20260709 13:05:06.672257  9443 raft_consensus.cc:2955] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:05:06.719028  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 47683.7us
I20260709 13:05:06.719700 15748 raft_consensus.cc:1064] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
W20260709 13:05:06.802296  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 73999.8us
W20260709 13:05:06.872274 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 66916.1us
W20260709 13:05:06.884279  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 143420us
I20260709 13:05:06.929811 10068 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:05:06.936156 15742 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:05:06.966820  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 92444.3us
I20260709 13:05:06.979692 10063 raft_consensus.cc:2955] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:07.022221  9518 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:05:07.029767 15799 log.cc:927] Time spent T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:05:07.032876 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 67155.3us
W20260709 13:05:07.062777  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 92552.4us
W20260709 13:05:07.066854  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 81889.9us
I20260709 13:05:07.091811  9448 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:05:07.116808 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 145972us
W20260709 13:05:07.122392 15792 consensus_meta.cc:287] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b: Time spent flushing consensus metadata: real 0.500s	user 0.011s	sys 0.002s
I20260709 13:05:07.122133 15742 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:05:07.127096  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 56237.4us
I20260709 13:05:07.127372  9376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:05:07.133448  9376 raft_consensus.cc:606] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 18 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:07.123935 15783 raft_consensus.cc:2955] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:05:07.219075  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 74177.7us
I20260709 13:05:07.152209  9521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e30c155cba64357ae275b3366772777"
dest_uuid: "6d50f1c263264b21919230bee398022b"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:46908
W20260709 13:05:07.227248  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 53771.7us
I20260709 13:05:07.228559  9521 raft_consensus.cc:606] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:07.150595 10067 raft_consensus.cc:2955] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:05:07.242273  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 166387us
W20260709 13:05:07.247969  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 268504us
I20260709 13:05:07.249341  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:07.255159  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:07.265393 15813 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:05:07.300522 15803 raft_consensus.cc:2955] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:07.328687 15782 raft_consensus.cc:993] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:05:07.348533 15775 raft_consensus.cc:1081] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 18 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
W20260709 13:05:07.369179  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.408006  9450 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51012
I20260709 13:05:07.408708  9450 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:07.409121  9450 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:07.396448  9274 catalog_manager.cc:5697] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:07.418184  9452 raft_consensus.cc:2955] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:07.445295  9371 raft_consensus.cc:2955] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:07.457732 15787 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:05:07.458485 15787 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:05:07.463572  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.472081  9275 catalog_manager.cc:5697] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index 13 to 14, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New cstate: current_term: 16 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:07.460767 15787 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:07.487435  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:07.492486  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 31f9d5965eae4c788eb6a40e856cadc7 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:07.497553  9524 raft_consensus.cc:2955] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:07.512459  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:05:07.472975 15786 raft_consensus.cc:993] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:05:07.513490 15786 raft_consensus.cc:1081] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
W20260709 13:05:07.547223  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 47091.9us
I20260709 13:05:07.552531  9452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e30c155cba64357ae275b3366772777"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51016
I20260709 13:05:07.553612 10063 raft_consensus.cc:2955] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:07.553375  9452 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:07.563980  9452 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:07.566299  9343 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:07.569303 15777 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:07.524971  9518 raft_consensus.cc:2955] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:07.625276 15748 consensus_queue.cc:237] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:07.660002  9452 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:07.676689  9452 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:07.681938  9450 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:07.705161  9448 raft_consensus.cc:1240] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Rejecting Update request from peer 925acbe78db14db3b9e4cfc857717947 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:07.715967 15777 consensus_queue.cc:1059] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:07.748688 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:05:07.749468 10063 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:07.750941 15742 raft_consensus.cc:3055] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:07.752030 15742 raft_consensus.cc:740] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:05:07.761094  9450 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:07.767812 10063 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 19.
I20260709 13:05:07.776006  9417 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:05:07.779229 15709 raft_consensus.cc:2804] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:07.779889 15709 raft_consensus.cc:697] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 19 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:05:07.787370 15742 consensus_queue.cc:260] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:07.790088 15742 raft_consensus.cc:3060] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:07.780905 15709 consensus_queue.cc:237] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:05:07.817353  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 123212us
I20260709 13:05:07.826671  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:05:07.826859  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:05:07.827739  9524 raft_consensus.cc:3055] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:07.827917  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ae09cf899421ea6057ee5eca95814" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:05:07.829192  9524 raft_consensus.cc:740] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:05:07.830513  9377 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:07.837059  9524 consensus_queue.cc:260] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:07.843538 15774 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:07.844273 15774 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:07.845634  9524 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:07.847718 15774 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:07.849622 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:05:07.862718  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:05:07.864593  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:05:07.865665  9377 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
I20260709 13:05:07.876947  9524 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
I20260709 13:05:07.882021  9418 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:05:07.889679 15737 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:07.890173  9418 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:07.890291 15737 raft_consensus.cc:697] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:05:07.892112 15690 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:07.892020 15737 consensus_queue.cc:237] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:07.992523 10067 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:07.995220 15784 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:08.023713  9376 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:08.033829  9448 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:08.033516 15761 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:05:08.136723  9374 raft_consensus.cc:2468] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 19.
I20260709 13:05:08.148919 15828 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:08.166536  9435 tablet_service.cc:1558] Processing DeleteTablet for tablet 31f9d5965eae4c788eb6a40e856cadc7 with delete_type TABLET_DATA_TOMBSTONED (TS d62c9d5a052b42ce8675f8438f846526 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:51006
I20260709 13:05:08.230998 15809 raft_consensus.cc:2955] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:08.254352 15833 tablet_replica.cc:333] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:08.246876  9377 raft_consensus.cc:2955] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:08.255945 15833 raft_consensus.cc:2243] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:08.265163 15833 raft_consensus.cc:2272] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:08.262593  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:08.267774 10067 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:05:08.269702 15821 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:08.276425 15833 ts_tablet_manager.cc:1916] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:08.263214 10063 raft_consensus.cc:2955] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:08.284488  9452 raft_consensus.cc:2955] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:08.285815  9271 catalog_manager.cc:5697] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:08.357980  9518 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:08.363355 15737 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:08.391335 15833 ts_tablet_manager.cc:1929] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.13
I20260709 13:05:08.403810  9274 catalog_manager.cc:5697] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 18 to 19, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 19 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.405781  9274 catalog_manager.cc:5697] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 15 to 16, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 16 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.392148 15833 log.cc:1199] T 31f9d5965eae4c788eb6a40e856cadc7 P d62c9d5a052b42ce8675f8438f846526: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-1-root/wals/31f9d5965eae4c788eb6a40e856cadc7
I20260709 13:05:08.463567  9377 consensus_queue.cc:237] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:08.482599  9374 raft_consensus.cc:1275] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:05:08.487520  9260 catalog_manager.cc:5028] TS d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): tablet 31f9d5965eae4c788eb6a40e856cadc7 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:05:08.490409 15703 consensus_queue.cc:1048] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:08.499665  9376 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:08.499665 10068 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:05:08.516850 15737 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:05:08.555764 15742 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
W20260709 13:05:08.589711  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 83305.5us
W20260709 13:05:08.620237 15838 log.cc:927] Time spent T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:05:08.635177  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 47867.3us
W20260709 13:05:08.719784  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 65973.4us
W20260709 13:05:08.720798  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 55145.7us
W20260709 13:05:08.769451  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 130562us
W20260709 13:05:08.778589  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 58070.4us
W20260709 13:05:08.780062  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 57102.4us
I20260709 13:05:08.799201  9271 catalog_manager.cc:5697] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:08.986913  9445 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:05:08.993135  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 58118.1us
W20260709 13:05:09.246639 15863 log.cc:927] Time spent T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:05:09.266664  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 107292us
W20260709 13:05:09.270463  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 75077.5us
I20260709 13:05:09.276189 15801 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 13:05:09.320406 15852 raft_consensus.cc:2955] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:05:09.326829 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 385348us
I20260709 13:05:09.382175  9273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43252 (request call id 268) took 1133 ms. Trace:
I20260709 13:05:09.382880  9273 rpcz_store.cc:276] 0709 13:05:08.240061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.240243 (+   182us) service_pool.cc:224] Handling call
0709 13:05:08.253786 (+ 13543us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b540016e4d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d4090 00007fb586572f3a 00007fb58c3291cc 00007fb58c42737e 00007fb58a8e82a4 00007fb58a8e8232 00007fb58a8e8161 00007fb58a8e80dc 00007fb58a8e7392 00007fb5848a548c 00007fb5848a48c6
0709 13:05:09.373661 (+1119875us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":15778048}
W20260709 13:05:09.409682  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 127115us
W20260709 13:05:09.417794  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 147671us
W20260709 13:05:09.422950  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 148410us
I20260709 13:05:09.428378  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7201bcdf8f724879b727639e6e67e31e with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:09.458060  9275 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 176) took 1224 ms. Trace:
I20260709 13:05:09.458506  9275 rpcz_store.cc:276] 0709 13:05:08.233497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.233682 (+   185us) service_pool.cc:224] Handling call
0709 13:05:08.260864 (+ 27182us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b540016e4d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d4090 00007fb586572f3a 00007fb58c3291cc 00007fb58c42737e 00007fb58a8e82a4 00007fb58a8e8232 00007fb58a8e8161 00007fb58a8e80dc 00007fb58a8e7392 00007fb5848a548c 00007fb5848a48c6
0709 13:05:09.457986 (+1197122us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":33145216}
W20260709 13:05:09.468971  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:09.492934  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:09.494585 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 53719.9us
I20260709 13:05:09.474624 15809 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:09.525162 15809 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:09.552616 15809 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:09.557281 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:05:09.560818  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 67972.2us
I20260709 13:05:09.565822  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:05:09.597810  9491 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:05:09.589845  9524 consensus_queue.cc:237] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:09.606103 15809 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:05:09.622219  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:09.624234  9519 consensus_queue.cc:237] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:09.601929 10067 raft_consensus.cc:2955] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:09.653618 10068 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:09.655916 15809 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:09.663946  9443 raft_consensus.cc:2955] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:09.679344  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:09.686959  9450 raft_consensus.cc:1275] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:09.697984  9450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36e88678fcd042e78609b17fe3521242"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:05:09.706204  9450 raft_consensus.cc:606] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 18 LEADER]: Received request to transfer leadership to TS 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:09.720171  9450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:05:09.721750  9450 raft_consensus.cc:606] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:05:09.734302  9275 catalog_manager.cc:5697] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index 14 to 15, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New cstate: current_term: 19 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:09.736750 15876 raft_consensus.cc:2955] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:09.764389 10063 raft_consensus.cc:1275] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:09.740720 10068 raft_consensus.cc:2955] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:09.785293 15854 consensus_queue.cc:1048] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:09.802587  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:09.804666  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:09.822242  9450 raft_consensus.cc:1275] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:09.825824 15809 consensus_queue.cc:1048] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:05:09.891901  9444 raft_consensus.cc:2955] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:09.905373 15877 consensus_queue.cc:1048] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
W20260709 13:05:10.100931 15888 log.cc:927] Time spent T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.132s	user 0.001s	sys 0.001s
I20260709 13:05:10.152257 10070 raft_consensus.cc:2955] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:10.136132 15809 raft_consensus.cc:2955] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:10.177456 15858 raft_consensus.cc:993] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526: : Instructing follower 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:05:10.178196 15858 raft_consensus.cc:1081] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 18 LEADER]: Signalling peer 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:05:10.205577  9374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36e88678fcd042e78609b17fe3521242"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:52548
I20260709 13:05:10.206302  9374 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:10.206796  9374 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:10.212033 15858 raft_consensus.cc:993] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:05:10.215134 15851 raft_consensus.cc:1081] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:05:10.237699  9519 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46902
I20260709 13:05:10.238384  9519 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:10.238795  9519 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:10.243310  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6836716b8e044849b07461ac40f5f1a6 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:10.247553  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8cb1b08cec264585b21aa628ca12e206 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:10.254438  9374 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:10.278338  9271 catalog_manager.cc:5697] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b reported cstate change: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New cstate: current_term: 17 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:10.303435  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:05:10.304101  9443 raft_consensus.cc:3055] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:10.304378  9443 raft_consensus.cc:740] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:05:10.305161  9443 consensus_queue.cc:260] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:10.306339  9443 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:10.313171  9374 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 19 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:10.337508  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:05:10.338157  9521 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:10.340816  9444 raft_consensus.cc:2955] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:10.342212  9443 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 19.
I20260709 13:05:10.352051 15866 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:05:10.353083 15866 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:10.356930  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:10.365252 10070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:05:10.368722  9342 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:10.371932 15866 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:10.375080  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb1b08cec264585b21aa628ca12e206" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:05:10.348774  9519 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:10.377921  9521 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 19.
I20260709 13:05:10.383256 15878 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:10.383939  9341 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:05:10.385206 15801 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:10.385996 15801 raft_consensus.cc:697] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 19 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:05:10.386973 15801 consensus_queue.cc:237] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:10.397958  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:05:10.398620  9374 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:10.408085  9519 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:10.413195  9374 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
I20260709 13:05:10.416730  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:05:10.417573  9443 raft_consensus.cc:3055] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:10.418152  9443 raft_consensus.cc:740] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:05:10.417559  9492 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:05:10.423106  9443 consensus_queue.cc:260] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:10.426800 15865 raft_consensus.cc:2804] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:10.428197 15865 raft_consensus.cc:697] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:05:10.432701  9443 raft_consensus.cc:3060] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:10.435248 15865 consensus_queue.cc:237] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:10.466463  9443 raft_consensus.cc:2468] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
I20260709 13:05:10.503328  9508 tablet_service.cc:1558] Processing DeleteTablet for tablet 7201bcdf8f724879b727639e6e67e31e with delete_type TABLET_DATA_TOMBSTONED (TS 6d50f1c263264b21919230bee398022b not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:54524
I20260709 13:05:10.530414  9275 catalog_manager.cc:5697] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New cstate: current_term: 15 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:10.537386  9271 catalog_manager.cc:5697] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 18 to 19, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 19 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:10.546501  9359 tablet_service.cc:1558] Processing DeleteTablet for tablet 8cb1b08cec264585b21aa628ca12e206 with delete_type TABLET_DATA_TOMBSTONED (TS 925acbe78db14db3b9e4cfc857717947 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:52546
I20260709 13:05:10.560563 15896 tablet_replica.cc:333] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:10.578617 15896 raft_consensus.cc:2243] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:10.579989 15896 raft_consensus.cc:2272] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:10.583915 15896 ts_tablet_manager.cc:1916] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:10.602213  9363 tablet_service.cc:1558] Processing DeleteTablet for tablet 6836716b8e044849b07461ac40f5f1a6 with delete_type TABLET_DATA_TOMBSTONED (TS 925acbe78db14db3b9e4cfc857717947 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:52546
I20260709 13:05:10.637670  9271 catalog_manager.cc:5697] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 15 to 16, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 16 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:10.657817 15897 tablet_replica.cc:333] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:10.659384 15897 raft_consensus.cc:2243] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:10.660436 15897 raft_consensus.cc:2272] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:10.677367 15897 ts_tablet_manager.cc:1916] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:10.712731 15896 ts_tablet_manager.cc:1929] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.14
I20260709 13:05:10.713274 15896 log.cc:1199] T 7201bcdf8f724879b727639e6e67e31e P 6d50f1c263264b21919230bee398022b: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-2-root/wals/7201bcdf8f724879b727639e6e67e31e
I20260709 13:05:10.737310  9262 catalog_manager.cc:5028] TS 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): tablet 7201bcdf8f724879b727639e6e67e31e (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:05:10.778355 15897 ts_tablet_manager.cc:1929] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.11
I20260709 13:05:10.781358 15897 log.cc:1199] T 8cb1b08cec264585b21aa628ca12e206 P 925acbe78db14db3b9e4cfc857717947: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-0-root/wals/8cb1b08cec264585b21aa628ca12e206
I20260709 13:05:10.794173  9262 catalog_manager.cc:5028] TS 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): tablet 8cb1b08cec264585b21aa628ca12e206 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:05:10.795811 15897 tablet_replica.cc:333] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:10.797468 15897 raft_consensus.cc:2243] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:10.798761 15897 raft_consensus.cc:2272] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:10.802681 15897 ts_tablet_manager.cc:1916] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:10.805819  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:10.806196  9519 raft_consensus.cc:1275] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:05:10.808245 15801 consensus_queue.cc:1048] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:10.944429  9450 raft_consensus.cc:1275] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:05:10.953329 15872 consensus_queue.cc:1048] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:10.969179  9374 raft_consensus.cc:1275] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:05:10.983950  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 46981.2us
I20260709 13:05:10.985713 15865 consensus_queue.cc:1048] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:05:11.033502 15897 ts_tablet_manager.cc:1929] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 13:05:11.034265 15897 log.cc:1199] T 6836716b8e044849b07461ac40f5f1a6 P 925acbe78db14db3b9e4cfc857717947: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-0-root/wals/6836716b8e044849b07461ac40f5f1a6
I20260709 13:05:11.038527  9262 catalog_manager.cc:5028] TS 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): tablet 6836716b8e044849b07461ac40f5f1a6 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:05:11.061918  9450 raft_consensus.cc:1275] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:05:11.075981 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 49436.4us
I20260709 13:05:11.112653 15908 consensus_queue.cc:1048] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:05:11.185686 15901 log.cc:927] Time spent T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 13:05:11.195508  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 94378.6us
W20260709 13:05:11.204526  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 104485us
W20260709 13:05:11.333487  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 113030us
W20260709 13:05:11.437359  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 102341us
W20260709 13:05:11.437314  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 44143.7us
W20260709 13:05:11.513411  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 74856.5us
W20260709 13:05:11.555718  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 149448us
W20260709 13:05:11.684810 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 351947us
I20260709 13:05:12.017525  9443 consensus_queue.cc:237] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:12.028172  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:12.103547  9371 raft_consensus.cc:1275] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:05:12.105146  9417 consensus_peers.cc:597] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 09bfbc64d6af4fe0893109a7008e9b5d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:12.109408 15869 consensus_queue.cc:1048] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:12.109838  9519 raft_consensus.cc:1275] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:12.122596  9373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ad4133883414768941dffb952ca7caf"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:05:12.123220  9373 raft_consensus.cc:606] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:12.128775 15914 consensus_queue.cc:1048] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:12.134619  9519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7a866663507456b9442af6c42748c5f"
dest_uuid: "6d50f1c263264b21919230bee398022b"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:46908
I20260709 13:05:12.135607  9519 raft_consensus.cc:606] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:12.140857  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:12.145605  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:12.150192 15914 raft_consensus.cc:2955] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:12.157775  9374 raft_consensus.cc:2955] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:12.179219  9524 raft_consensus.cc:2955] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
W20260709 13:05:12.212733  9323 auto_rebalancer.cc:629] Failed to schedule move for tablet d7a866663507456b9442af6c42748c5f: Remote error: Service unavailable: leader transfer in progress
I20260709 13:05:12.206589  9273 catalog_manager.cc:5697] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b reported cstate change: config changed from index -1 to 7, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 11 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:12.219564  9444 consensus_queue.cc:237] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:12.283993 15918 raft_consensus.cc:993] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:05:12.284560 15918 raft_consensus.cc:1081] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:05:12.289685  9450 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ad4133883414768941dffb952ca7caf"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51012
I20260709 13:05:12.290392  9450 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:12.290819  9450 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:12.337078  9450 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:12.343329 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:05:12.344022 10068 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:12.354588  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:05:12.355484  9373 raft_consensus.cc:3055] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:12.355859  9373 raft_consensus.cc:740] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:05:12.356642  9373 consensus_queue.cc:260] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:12.362030  9373 raft_consensus.cc:3060] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:12.371699 10068 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
I20260709 13:05:12.377203  9450 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:12.378437  9417 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:05:12.381672  9374 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:05:12.382185  9519 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:05:12.408769 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 76273.9us
W20260709 13:05:12.415761  9417 consensus_peers.cc:597] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7a4d4b66d6394ace8bb74d9778cbd542. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:12.409902  9373 raft_consensus.cc:2468] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
I20260709 13:05:12.421329 15869 raft_consensus.cc:2804] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:12.431955 15869 raft_consensus.cc:697] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:05:12.433027 15869 consensus_queue.cc:237] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:12.426184 15840 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
W20260709 13:05:12.473810  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 60294.3us
I20260709 13:05:12.482860 15912 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
W20260709 13:05:12.516031  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 88174.8us
W20260709 13:05:12.524509  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 114798us
I20260709 13:05:12.583415 15936 raft_consensus.cc:993] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:05:12.583940 15936 raft_consensus.cc:1081] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
W20260709 13:05:12.601590 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 137168us
I20260709 13:05:12.632310  9271 catalog_manager.cc:5697] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 15 to 16, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 16 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.646121  9452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7a866663507456b9442af6c42748c5f"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51016
I20260709 13:05:12.646797  9452 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:12.647220  9452 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:12.745740  9452 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:12.775712  9452 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:12.761651 15956 ts_tablet_manager.cc:933] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:12.788564 15858 raft_consensus.cc:2955] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:12.833904 10063 raft_consensus.cc:1275] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:05:12.835816 15949 consensus_queue.cc:1048] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:12.839318  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:05:12.839318  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a866663507456b9442af6c42748c5f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:05:12.840199  9371 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:12.840269  9525 raft_consensus.cc:3055] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:12.840790  9525 raft_consensus.cc:740] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:05:12.841589  9525 consensus_queue.cc:260] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:12.842860  9525 raft_consensus.cc:3060] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:12.851394  9371 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
I20260709 13:05:12.851450  9525 raft_consensus.cc:2468] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
I20260709 13:05:12.858049  9371 raft_consensus.cc:2955] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:12.868506  9525 consensus_queue.cc:237] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:12.875841  9418 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:05:12.885450 15956 tablet_copy_client.cc:323] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.66:45279
W20260709 13:05:12.888758  9491 consensus_peers.cc:597] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6d1dd60ff2744b109e2d3f9d61d2702f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:12.897694 15858 raft_consensus.cc:2804] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:12.898368 15858 raft_consensus.cc:697] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:05:12.900264  9371 raft_consensus.cc:1275] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:12.903280  9461 tablet_copy_service.cc:140] P d62c9d5a052b42ce8675f8438f846526: Received BeginTabletCopySession request for tablet 09bfbc64d6af4fe0893109a7008e9b5d from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:45366)
I20260709 13:05:12.904006  9461 tablet_copy_service.cc:161] P d62c9d5a052b42ce8675f8438f846526: Beginning new tablet copy session on tablet 09bfbc64d6af4fe0893109a7008e9b5d from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:45366: session id = b0812463215649c3b011d36e2f0400c9-09bfbc64d6af4fe0893109a7008e9b5d
I20260709 13:05:12.904524 15858 consensus_queue.cc:237] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:12.901371  9271 catalog_manager.cc:5697] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index -1 to 12, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 16 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.910245 15924 consensus_queue.cc:1048] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:12.942922  9519 raft_consensus.cc:2955] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:12.949939  9452 raft_consensus.cc:1275] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:12.961989  9371 raft_consensus.cc:1275] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:05:12.971511 15855 consensus_queue.cc:1048] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:05:12.971156 15947 consensus_queue.cc:1048] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:05:13.006826 15936 raft_consensus.cc:2955] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:13.016745  9375 raft_consensus.cc:2955] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:13.035079 15965 ts_tablet_manager.cc:933] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:13.036921 15965 tablet_copy_client.cc:323] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.66:45279
I20260709 13:05:13.039264  9462 tablet_copy_service.cc:140] P d62c9d5a052b42ce8675f8438f846526: Received BeginTabletCopySession request for tablet 7a4d4b66d6394ace8bb74d9778cbd542 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:45366)
I20260709 13:05:13.039882  9462 tablet_copy_service.cc:161] P d62c9d5a052b42ce8675f8438f846526: Beginning new tablet copy session on tablet 7a4d4b66d6394ace8bb74d9778cbd542 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:45366: session id = b0812463215649c3b011d36e2f0400c9-7a4d4b66d6394ace8bb74d9778cbd542
I20260709 13:05:13.048265  9462 tablet_copy_source_session.cc:215] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:12.998845  9461 tablet_copy_source_session.cc:215] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:05:13.053447 15955 log.cc:927] Time spent T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.082s	user 0.004s	sys 0.000s
I20260709 13:05:13.070200 15956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09bfbc64d6af4fe0893109a7008e9b5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:13.108431  9271 catalog_manager.cc:5697] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 15 to 16, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 16 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.140977 15965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4d4b66d6394ace8bb74d9778cbd542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:13.147573  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:13.256413  9444 raft_consensus.cc:2955] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:13.281926  9273 catalog_manager.cc:5697] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b reported cstate change: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 16 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.292948 15956 tablet_copy_client.cc:806] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:13.293804 15956 tablet_copy_client.cc:670] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:13.294462  9519 raft_consensus.cc:1275] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:13.300988 15956 tablet_copy_client.cc:538] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:13.315913 15869 consensus_queue.cc:1048] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:13.320422 15956 tablet_bootstrap.cc:492] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:05:13.337200 15965 tablet_copy_client.cc:806] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:13.346321  9371 raft_consensus.cc:1275] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:13.378554 15965 tablet_copy_client.cc:670] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:13.386934 15965 tablet_copy_client.cc:538] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:13.425120 15858 consensus_queue.cc:1048] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:13.432266 15956 tablet_bootstrap.cc:492] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=2 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:13.457773 15956 tablet_bootstrap.cc:492] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:05:13.459297 15956 ts_tablet_manager.cc:1403] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.139s	user 0.035s	sys 0.015s
I20260709 13:05:13.480412 15956 raft_consensus.cc:359] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:13.481500 15956 raft_consensus.cc:740] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:05:13.497797 15956 consensus_queue.cc:260] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:13.522931 15956 ts_tablet_manager.cc:1434] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.062s	user 0.004s	sys 0.004s
I20260709 13:05:13.541877  9462 tablet_copy_service.cc:342] P d62c9d5a052b42ce8675f8438f846526: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-09bfbc64d6af4fe0893109a7008e9b5d received from {username='slave'} at 127.0.0.1:45366
I20260709 13:05:13.542441  9462 tablet_copy_service.cc:434] P d62c9d5a052b42ce8675f8438f846526: ending tablet copy session b0812463215649c3b011d36e2f0400c9-09bfbc64d6af4fe0893109a7008e9b5d on tablet 09bfbc64d6af4fe0893109a7008e9b5d with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:05:13.546746 15974 ts_tablet_manager.cc:933] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:13.559262 15965 tablet_bootstrap.cc:492] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:05:13.569010 15974 tablet_copy_client.cc:323] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.67:35929
I20260709 13:05:13.571419  9535 tablet_copy_service.cc:140] P 6d50f1c263264b21919230bee398022b: Received BeginTabletCopySession request for tablet 6d1dd60ff2744b109e2d3f9d61d2702f from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:52502)
I20260709 13:05:13.572083  9535 tablet_copy_service.cc:161] P 6d50f1c263264b21919230bee398022b: Beginning new tablet copy session on tablet 6d1dd60ff2744b109e2d3f9d61d2702f from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:52502: session id = b0812463215649c3b011d36e2f0400c9-6d1dd60ff2744b109e2d3f9d61d2702f
I20260709 13:05:13.593211 10064 raft_consensus.cc:1217] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.6->[11.7-11.7]   Dedup: 11.7->[]
I20260709 13:05:13.611799  9535 tablet_copy_source_session.cc:215] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:13.647104 15974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d1dd60ff2744b109e2d3f9d61d2702f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:13.693179 15974 tablet_copy_client.cc:806] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:13.693826 15974 tablet_copy_client.cc:670] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:13.714156 15974 tablet_copy_client.cc:538] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:13.744262 15974 tablet_bootstrap.cc:492] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:05:13.812994 15965 tablet_bootstrap.cc:492] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:13.814219 15965 tablet_bootstrap.cc:492] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:05:13.815099 15965 ts_tablet_manager.cc:1403] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.256s	user 0.037s	sys 0.027s
I20260709 13:05:13.879264 15965 raft_consensus.cc:359] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:13.880354 15965 raft_consensus.cc:740] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:05:13.881912 15965 consensus_queue.cc:260] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:13.900959 10067 raft_consensus.cc:1217] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.11->[16.12-16.12]   Dedup: 16.12->[]
I20260709 13:05:13.906591 15965 ts_tablet_manager.cc:1434] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.003s
I20260709 13:05:13.921027  9462 tablet_copy_service.cc:342] P d62c9d5a052b42ce8675f8438f846526: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-7a4d4b66d6394ace8bb74d9778cbd542 received from {username='slave'} at 127.0.0.1:45366
I20260709 13:05:13.921559  9462 tablet_copy_service.cc:434] P d62c9d5a052b42ce8675f8438f846526: ending tablet copy session b0812463215649c3b011d36e2f0400c9-7a4d4b66d6394ace8bb74d9778cbd542 on tablet 7a4d4b66d6394ace8bb74d9778cbd542 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:05:13.937335 15974 tablet_bootstrap.cc:492] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:13.938592 15974 tablet_bootstrap.cc:492] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:05:13.945889 15974 ts_tablet_manager.cc:1403] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.202s	user 0.046s	sys 0.005s
I20260709 13:05:13.956305 15974 raft_consensus.cc:359] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:13.961212 15974 raft_consensus.cc:740] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:05:13.962147 15974 consensus_queue.cc:260] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:13.973565 15974 ts_tablet_manager.cc:1434] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:05:13.990142  9535 tablet_copy_service.cc:342] P 6d50f1c263264b21919230bee398022b: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-6d1dd60ff2744b109e2d3f9d61d2702f received from {username='slave'} at 127.0.0.1:52502
I20260709 13:05:13.990715  9535 tablet_copy_service.cc:434] P 6d50f1c263264b21919230bee398022b: ending tablet copy session b0812463215649c3b011d36e2f0400c9-6d1dd60ff2744b109e2d3f9d61d2702f on tablet 6d1dd60ff2744b109e2d3f9d61d2702f with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:05:14.006243 10064 raft_consensus.cc:1217] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.9->[16.10-16.10]   Dedup: 16.10->[]
W20260709 13:05:14.013988  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 82671.7us
I20260709 13:05:14.149037 15858 raft_consensus.cc:1064] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:05:14.152087 15858 consensus_queue.cc:237] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 5, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:14.193676 10064 raft_consensus.cc:1275] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [term 11 LEARNER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:05:14.193908  9519 raft_consensus.cc:1275] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:05:14.196601 15912 consensus_queue.cc:1048] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:14.199005 15912 consensus_queue.cc:1048] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:14.200557  9375 raft_consensus.cc:1275] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:05:14.213418 15949 consensus_queue.cc:1048] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:14.245636 15981 raft_consensus.cc:2955] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index 7 to 8, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:14.252579  9525 raft_consensus.cc:2955] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:14.267294 10064 raft_consensus.cc:2955] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:14.295680  9371 raft_consensus.cc:2955] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:14.314888  9275 catalog_manager.cc:5697] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b reported cstate change: config changed from index 7 to 8, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:05:14.424752  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 84661.7us
I20260709 13:05:14.693898 15840 raft_consensus.cc:1064] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
W20260709 13:05:14.766839  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 198869us
I20260709 13:05:14.833041  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:14.846570 15840 consensus_queue.cc:237] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:05:14.951202 16006 log.cc:927] Time spent T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e: Append to log took a long time: real 0.081s	user 0.001s	sys 0.001s
W20260709 13:05:14.956453  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 79568.3us
W20260709 13:05:15.005410  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 58790.1us
I20260709 13:05:15.033802  9373 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:15.035746 15840 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:05:15.061439 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 47356.2us
I20260709 13:05:15.094383 10068 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:15.114713  9519 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:15.119581 15988 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:05:15.126322 15840 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:15.156250 16009 raft_consensus.cc:1064] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:05:15.164220 16009 consensus_queue.cc:237] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:05:15.231124  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 67753.6us
I20260709 13:05:15.327145  9275 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43252 (request call id 283) took 1016 ms. Trace:
W20260709 13:05:15.350751  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 72644.2us
W20260709 13:05:15.371176  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 71683.4us
W20260709 13:05:15.434355  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 77759.8us
W20260709 13:05:15.443710  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 79897.5us
I20260709 13:05:15.505177 16022 raft_consensus.cc:2955] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:05:15.507535 16017 log.cc:927] Time spent T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.089s	user 0.001s	sys 0.002s
W20260709 13:05:15.570462  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 60174.6us
W20260709 13:05:15.636919  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 64265.8us
I20260709 13:05:15.676429  9273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51440 (request call id 190) took 1135 ms. Trace:
I20260709 13:05:15.677295  9271 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43244 (request call id 311) took 1098 ms. Trace:
I20260709 13:05:15.677706  9271 rpcz_store.cc:276] 0709 13:05:14.497894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.498476 (+   582us) service_pool.cc:224] Handling call
0709 13:05:15.595897 (+1097421us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4093,"reported_tablets":1}
W20260709 13:05:15.689589  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 60476.9us
I20260709 13:05:15.328154  9275 rpcz_store.cc:276] 0709 13:05:14.310281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.310439 (+   158us) service_pool.cc:224] Handling call
0709 13:05:15.326896 (+1016457us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:14.442191 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:14.448864 (+  6673us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:14.448898 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:05:14.448916 (+    18us) tablet.cc:662] Decoding operations
0709 13:05:14.449314 (+   398us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:14.449388 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:14.449413 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:05:14.449925 (+   512us) tablet.cc:701] Row locks acquired
0709 13:05:14.449938 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:05:14.450165 (+   227us) write_op.cc:270] Start()
0709 13:05:14.450271 (+   106us) write_op.cc:276] Timestamp: P: 1783602314450066 usec, L: 0
0709 13:05:14.450297 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:05:14.577390 (+127093us) log.cc:844] Serialized 587 byte log entry
0709 13:05:14.683354 (+105964us) spinlock_profiling.cc:243] Waited 8.1 ms on lock 0x7b4400022b4c. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb583305db1 00007fb5833a3c85 00007fb5833a46a2 00007fb5861161db 00007fb586111aaf 00007fb5834600ac 00007fb58c2baab9 00007fb58347c69b 00007fb58347a93f 00007fb58347cc02 00007fb58610420b
0709 13:05:14.859562 (+176208us) spinlock_profiling.cc:243] Waited 98.6 ms on lock 0x7b540016e4d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb586565e28 00007fb589fa0581 00007fb589f9fd58 00007fb589fa49f1 00007fb589fa49a9 00007fb589fa4939 00007fb589fa4901 00007fb589fa3b2d 000000000038f354 000000000038f199
0709 13:05:15.057226 (+197664us) op_driver.cc:464] REPLICATION: finished
0709 13:05:15.128868 (+ 71642us) write_op.cc:301] APPLY: starting
0709 13:05:15.129037 (+   169us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:15.209195 (+ 80158us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:15.209241 (+    46us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:15.244602 (+ 35361us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:15.244943 (+   341us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:05:15.244992 (+    49us) write_op.cc:312] APPLY: finished
0709 13:05:15.245302 (+   310us) log.cc:844] Serialized 25 byte log entry
0709 13:05:15.274767 (+ 29465us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:15.285368 (+ 10601us) write_op.cc:454] Released schema lock
0709 13:05:15.285454 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:15.286148 (+   694us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:15.286190 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":361856,"child_traces":[["op",{"apply.queue_time_us":71220,"apply.run_cpu_time_us":7342,"apply.run_wall_time_us":157282,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8297,"num_ops":1,"prepare.queue_time_us":120428,"prepare.run_cpu_time_us":18002,"prepare.run_wall_time_us":420529,"raft.queue_time_us":103503,"raft.run_cpu_time_us":31644,"raft.run_wall_time_us":63223,"replication_time_us":606511,"spinlock_wait_cycles":245452416,"thread_start_us":529669,"threads_started":4,"wal-append.queue_time_us":291616}]]}
I20260709 13:05:15.676924  9273 rpcz_store.cc:276] 0709 13:05:14.486811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.491353 (+  4542us) service_pool.cc:224] Handling call
0709 13:05:14.517288 (+ 25935us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b540016e4d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d4090 00007fb586572f3a 00007fb58c3291cc 00007fb58c42737e 00007fb58a8e82a4 00007fb58a8e8232 00007fb58a8e8161 00007fb58a8e80dc 00007fb58a8e7392 00007fb5848a548c 00007fb5848a48c6
0709 13:05:15.621556 (+1104268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27459,"reported_tablets":1,"spinlock_wait_cycles":47197056}
W20260709 13:05:15.750468  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 61867.7us
I20260709 13:05:15.749231 10064 raft_consensus.cc:2955] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:15.764499  9448 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e30c155cba64357ae275b3366772777"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:05:15.765799  9448 raft_consensus.cc:606] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Received request to transfer leadership to TS 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:15.780612  9450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:05:15.781775  9450 raft_consensus.cc:606] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 20 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:05:15.886582  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:15.888571  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:15.896507  9273 catalog_manager.cc:5697] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 12 to 13, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:05:15.903129  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 459593us
W20260709 13:05:15.943440  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 59690.4us
I20260709 13:05:15.950157 10064 raft_consensus.cc:1275] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:15.968909 16007 consensus_queue.cc:1048] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:15.976332  9452 consensus_queue.cc:237] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:16.015625  9371 raft_consensus.cc:2955] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:16.039208  9525 raft_consensus.cc:2955] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:16.040961  9370 raft_consensus.cc:1275] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:16.048640 15840 raft_consensus.cc:993] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526: : Instructing follower 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:05:16.049464 15840 raft_consensus.cc:1081] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Signalling peer 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:05:16.090111 10068 raft_consensus.cc:1275] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:05:16.107856 15840 consensus_queue.cc:1048] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:16.122284 16002 consensus_queue.cc:1048] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:05:16.175776  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 139693us
I20260709 13:05:16.230643  9449 raft_consensus.cc:1275] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:16.253176  9376 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e30c155cba64357ae275b3366772777"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:52548
I20260709 13:05:16.253932  9376 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:16.254312  9376 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:16.254734 15840 raft_consensus.cc:993] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:05:16.255358 15840 raft_consensus.cc:1081] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 20 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:05:16.292426  9374 raft_consensus.cc:1275] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:05:16.314108 16036 log.cc:927] Time spent T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:05:16.296357  9376 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:16.324891  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:05:16.325878  9450 raft_consensus.cc:3055] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:16.326249  9450 raft_consensus.cc:740] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:05:16.327597  9450 consensus_queue.cc:260] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:16.332031  9450 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:16.356988 15840 raft_consensus.cc:2955] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:16.363088 10063 raft_consensus.cc:2955] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:16.324883  9376 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:05:16.389813  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 95403.2us
I20260709 13:05:16.390669 16002 raft_consensus.cc:2955] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:16.400333  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:05:16.404526  9519 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:16.429288  9519 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 17.
I20260709 13:05:16.443676 10068 raft_consensus.cc:2955] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:16.500799 16008 consensus_queue.cc:1048] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:05:16.515269  9376 raft_consensus.cc:2955] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:16.515594  9343 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:05:16.549978 15992 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:16.550779 15992 raft_consensus.cc:697] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:05:16.551957 15992 consensus_queue.cc:237] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:16.472575  9450 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 17.
I20260709 13:05:16.557428  9273 catalog_manager.cc:5697] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b reported cstate change: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.558760  9519 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46902
I20260709 13:05:16.559481  9519 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:16.559895  9519 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:16.573616  9519 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:05:16.577178  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 61662.4us
W20260709 13:05:16.588802  9415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.592217  9519 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 21 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:16.601624  9275 catalog_manager.cc:5697] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index 8 to 9, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New cstate: current_term: 11 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.606797  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
W20260709 13:05:16.646179  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 45563us
W20260709 13:05:16.647461  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 48736.1us
W20260709 13:05:16.647686  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 45759us
I20260709 13:05:16.656641 16038 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:05:16.657361 16038 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:16.671768 16038 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:16.684229 16033 consensus_queue.cc:1048] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:16.696420  9508 tablet_service.cc:1558] Processing DeleteTablet for tablet 09bfbc64d6af4fe0893109a7008e9b5d with delete_type TABLET_DATA_TOMBSTONED (TS 6d50f1c263264b21919230bee398022b not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:54524
I20260709 13:05:16.701838  9273 catalog_manager.cc:5697] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 16 to 17, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 17 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:16.725904  9449 consensus_queue.cc:237] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:16.796389 16045 tablet_replica.cc:333] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:16.797984 16045 raft_consensus.cc:2243] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:16.799747 16045 raft_consensus.cc:2272] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:16.806242 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 81823.1us
I20260709 13:05:16.843394 10068 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:05:16.849030  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:05:16.849656  9450 raft_consensus.cc:3055] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:16.850185  9450 raft_consensus.cc:740] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:05:16.855458 15981 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:16.874240  9260 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 09bfbc64d6af4fe0893109a7008e9b5d with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:16.876828  9450 consensus_queue.cc:260] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:16.878175  9450 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:16.890202  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:16.896960  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 55558.7us
W20260709 13:05:16.929433 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 76174.9us
I20260709 13:05:16.931396  9450 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 21.
I20260709 13:05:16.939221  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:05:16.941031  9371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1dd60ff2744b109e2d3f9d61d2702f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:05:16.947403  9525 raft_consensus.cc:1240] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Rejecting Update request from peer d62c9d5a052b42ce8675f8438f846526 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:16.948061  9373 raft_consensus.cc:1275] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:05:16.985321 16045 ts_tablet_manager.cc:1916] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:16.933408  9448 raft_consensus.cc:2955] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:17.003420  9369 raft_consensus.cc:2955] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:17.008355  9450 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:05:17.017361 16047 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:17.027789 16022 raft_consensus.cc:2955] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:17.029779  9520 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:05:17.031558 10067 raft_consensus.cc:2955] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:17.034281  9490 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:17.037797 15840 consensus_queue.cc:1048] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:17.055676 15936 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:17.056303 15936 raft_consensus.cc:697] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 21 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:05:17.057296 15936 consensus_queue.cc:237] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:17.063916 16047 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:17.096275  9271 catalog_manager.cc:5697] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 20 to 21, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 21 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:17.093361  9418 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:17.107797 15840 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:17.156173  9369 raft_consensus.cc:2955] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:17.171103 16045 ts_tablet_manager.cc:1929] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.8
I20260709 13:05:17.171849 16045 log.cc:1199] T 09bfbc64d6af4fe0893109a7008e9b5d P 6d50f1c263264b21919230bee398022b: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-2-root/wals/09bfbc64d6af4fe0893109a7008e9b5d
I20260709 13:05:17.143704  9275 catalog_manager.cc:5697] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 13 to 14, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New cstate: current_term: 16 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:17.174383  9262 catalog_manager.cc:5028] TS 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): tablet 09bfbc64d6af4fe0893109a7008e9b5d (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:05:17.176329  9260 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7a4d4b66d6394ace8bb74d9778cbd542 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:17.218314  9508 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a4d4b66d6394ace8bb74d9778cbd542 with delete_type TABLET_DATA_TOMBSTONED (TS 6d50f1c263264b21919230bee398022b not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:54524
I20260709 13:05:17.220307 16045 tablet_replica.cc:333] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:17.221750 16045 raft_consensus.cc:2243] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.223263 16045 raft_consensus.cc:2272] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.288134 16045 ts_tablet_manager.cc:1916] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:17.356484 16045 ts_tablet_manager.cc:1929] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.13
I20260709 13:05:17.357098 16045 log.cc:1199] T 7a4d4b66d6394ace8bb74d9778cbd542 P 6d50f1c263264b21919230bee398022b: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-2-root/wals/7a4d4b66d6394ace8bb74d9778cbd542
I20260709 13:05:17.358887  9262 catalog_manager.cc:5028] TS 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): tablet 7a4d4b66d6394ace8bb74d9778cbd542 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:05:17.450450  9525 consensus_queue.cc:237] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:17.455547  9452 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 21 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:05:17.459548 16020 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:17.506350 10067 raft_consensus.cc:1275] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:05:17.508327 15987 consensus_queue.cc:1048] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:17.521055  9369 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:17.540963  9369 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:05:17.560231 16020 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:17.562704  9450 raft_consensus.cc:1275] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:05:17.573133 15936 consensus_queue.cc:1048] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:17.651417 16004 raft_consensus.cc:2955] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:17.669965  9448 raft_consensus.cc:2955] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:17.684422 10068 raft_consensus.cc:2955] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:17.709941  9275 catalog_manager.cc:5697] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New cstate: current_term: 16 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:05:17.743649  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 87774.6us
W20260709 13:05:17.757925  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 56034.9us
I20260709 13:05:17.783488  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6d1dd60ff2744b109e2d3f9d61d2702f with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:18.009861  9359 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d1dd60ff2744b109e2d3f9d61d2702f with delete_type TABLET_DATA_TOMBSTONED (TS 925acbe78db14db3b9e4cfc857717947 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:52546
I20260709 13:05:18.120443 16070 tablet_replica.cc:333] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:18.121769 16070 raft_consensus.cc:2243] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.122874 16070 raft_consensus.cc:2272] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.142222 16070 ts_tablet_manager.cc:1916] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:18.248636  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:18.284734 16070 ts_tablet_manager.cc:1929] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 13:05:18.301402 16070 log.cc:1199] T 6d1dd60ff2744b109e2d3f9d61d2702f P 925acbe78db14db3b9e4cfc857717947: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-0-root/wals/6d1dd60ff2744b109e2d3f9d61d2702f
I20260709 13:05:18.303771  9262 catalog_manager.cc:5028] TS 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): tablet 6d1dd60ff2744b109e2d3f9d61d2702f (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:05:18.320019  9376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:05:18.320726  9376 raft_consensus.cc:606] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 19 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:18.324918  9519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79"
dest_uuid: "6d50f1c263264b21919230bee398022b"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:46908
I20260709 13:05:18.325580  9519 raft_consensus.cc:606] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 21 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:18.332782  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:18.334767  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:18.517674 15990 raft_consensus.cc:993] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:05:18.518362 15990 raft_consensus.cc:1081] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 19 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:05:18.520848  9448 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51012
I20260709 13:05:18.521530  9448 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:18.522099  9448 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:18.530882  9448 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:18.539238  9448 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 20 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:18.540843 10068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:05:18.541675 10068 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:18.538932  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201bcdf8f724879b727639e6e67e31e" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:05:18.546036  9376 raft_consensus.cc:3055] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:18.546408  9376 raft_consensus.cc:740] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:05:18.547312  9376 consensus_queue.cc:260] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:18.559847 16067 raft_consensus.cc:993] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:05:18.560642 16063 raft_consensus.cc:1081] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 21 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:05:18.565507  9449 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51016
I20260709 13:05:18.566244  9449 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:18.566665  9449 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:18.548573  9376 raft_consensus.cc:3060] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:18.668429 10068 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 20.
I20260709 13:05:18.682446  9417 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:05:18.683615 15981 raft_consensus.cc:2804] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:18.684499 15981 raft_consensus.cc:697] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 20 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:05:18.685829 15981 consensus_queue.cc:237] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:18.737313  9376 raft_consensus.cc:2468] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 20.
I20260709 13:05:18.673630  9449 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:18.799770  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:05:18.800043  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:05:18.800555  9369 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:18.800649  9519 raft_consensus.cc:3055] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:18.801175  9519 raft_consensus.cc:740] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:05:18.801986  9519 consensus_queue.cc:260] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:18.803220  9519 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:18.809073  9369 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 22.
I20260709 13:05:18.813860  9418 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:05:18.815407 16016 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:18.819481 16016 raft_consensus.cc:697] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 22 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:05:18.820693 16016 consensus_queue.cc:237] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:18.881047  9449 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 22 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:18.899710  9519 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 22.
I20260709 13:05:18.921141  9275 catalog_manager.cc:5697] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 19 to 20, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 20 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.388593 10068 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [term 20 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:05:19.391760 16085 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:05:19.421110  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:19.541730  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 59158.2us
I20260709 13:05:19.564949  9373 raft_consensus.cc:1275] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:05:19.569890  9368 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 22 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:05:19.604498  9519 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 22 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:05:19.616472 16086 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:19.652544  9271 catalog_manager.cc:5697] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 21 to 22, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 22 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.665966 16089 consensus_queue.cc:1048] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:05:19.688784 16084 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 13:05:19.951195  9369 consensus_queue.cc:237] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:20.079299  9519 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:05:20.079628  9342 consensus_peers.cc:597] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f322b7281d554c459bb8109ed249047b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:20.081980 16109 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:20.085711  9449 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:20.114779 16031 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:20.160785 16109 raft_consensus.cc:2955] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:20.178663  9449 raft_consensus.cc:2955] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:20.226927  9525 raft_consensus.cc:2955] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:20.249681  9519 consensus_queue.cc:237] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:20.255064  9271 catalog_manager.cc:5697] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index -1 to 12, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 17 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:20.317199  9368 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:05:20.319001  9491 consensus_peers.cc:597] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b77c45e065544a6cb4ff451f91a27cd1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:20.319772 16067 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:20.329809  9449 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:05:20.331565 16082 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:20.347875 16082 raft_consensus.cc:2955] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Committing config change with OpId 16.9: config changed from index -1 to 9, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:20.350965  9368 raft_consensus.cc:2955] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Committing config change with OpId 16.9: config changed from index -1 to 9, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
W20260709 13:05:20.361107 10091 debug-util.cc:398] Leaking SignalData structure 0x7b080036a6a0 after lost signal to thread 8212
W20260709 13:05:20.362414 10091 debug-util.cc:398] Leaking SignalData structure 0x7b0800341900 after lost signal to thread 9309
W20260709 13:05:20.363893 10091 debug-util.cc:398] Leaking SignalData structure 0x7b080033d2e0 after lost signal to thread 9401
W20260709 13:05:20.365410 10091 debug-util.cc:398] Leaking SignalData structure 0x7b08002bcfc0 after lost signal to thread 9476
W20260709 13:05:20.366743 10091 debug-util.cc:398] Leaking SignalData structure 0x7b08003322a0 after lost signal to thread 9550
W20260709 13:05:20.368180 10091 debug-util.cc:398] Leaking SignalData structure 0x7b080024df00 after lost signal to thread 10094
I20260709 13:05:20.389927  9271 catalog_manager.cc:5697] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b reported cstate change: config changed from index -1 to 9, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 16 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:20.402346  9451 consensus_queue.cc:237] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:20.410017  9449 raft_consensus.cc:2955] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Committing config change with OpId 16.9: config changed from index -1 to 9, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
W20260709 13:05:20.450148  9417 consensus_peers.cc:597] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ffaf31f504f540dc957e0b558c940f79. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:20.456684  9369 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 22 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:05:20.462028  9525 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 22 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:05:20.465179 16086 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:20.478158 16073 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:20.509618 16073 raft_consensus.cc:2955] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:20.512466  9369 raft_consensus.cc:2955] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:20.529141  9525 raft_consensus.cc:2955] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:20.572854  9271 catalog_manager.cc:5697] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b reported cstate change: config changed from index -1 to 15, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 22 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:20.600880  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:20.670073  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 63796.2us
I20260709 13:05:20.764602  9449 consensus_queue.cc:237] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:20.765733 16119 ts_tablet_manager.cc:933] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
I20260709 13:05:20.771943 16121 ts_tablet_manager.cc:933] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:20.817484 16121 tablet_copy_client.cc:323] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.67:35929
I20260709 13:05:20.819898  9535 tablet_copy_service.cc:140] P 6d50f1c263264b21919230bee398022b: Received BeginTabletCopySession request for tablet b77c45e065544a6cb4ff451f91a27cd1 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:52502)
I20260709 13:05:20.820662  9535 tablet_copy_service.cc:161] P 6d50f1c263264b21919230bee398022b: Beginning new tablet copy session on tablet b77c45e065544a6cb4ff451f91a27cd1 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:52502: session id = b0812463215649c3b011d36e2f0400c9-b77c45e065544a6cb4ff451f91a27cd1
I20260709 13:05:20.829454 16119 tablet_copy_client.cc:323] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.65:37547
I20260709 13:05:20.833096  9386 tablet_copy_service.cc:140] P 925acbe78db14db3b9e4cfc857717947: Received BeginTabletCopySession request for tablet f322b7281d554c459bb8109ed249047b from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:50568)
I20260709 13:05:20.833818  9386 tablet_copy_service.cc:161] P 925acbe78db14db3b9e4cfc857717947: Beginning new tablet copy session on tablet f322b7281d554c459bb8109ed249047b from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:50568: session id = b0812463215649c3b011d36e2f0400c9-f322b7281d554c459bb8109ed249047b
I20260709 13:05:20.836048  9535 tablet_copy_source_session.cc:215] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:20.842445 16121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b77c45e065544a6cb4ff451f91a27cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.845388  9386 tablet_copy_source_session.cc:215] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:20.849922 16119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f322b7281d554c459bb8109ed249047b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.858179 16124 ts_tablet_manager.cc:933] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:20.869354  9417 consensus_peers.cc:597] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aada562be2484a8fb8aac8e7f9348043. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:20.885526 16124 tablet_copy_client.cc:323] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.66:45279
I20260709 13:05:20.887622  9462 tablet_copy_service.cc:140] P d62c9d5a052b42ce8675f8438f846526: Received BeginTabletCopySession request for tablet ffaf31f504f540dc957e0b558c940f79 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:45366)
I20260709 13:05:20.888288  9462 tablet_copy_service.cc:161] P d62c9d5a052b42ce8675f8438f846526: Beginning new tablet copy session on tablet ffaf31f504f540dc957e0b558c940f79 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:45366: session id = b0812463215649c3b011d36e2f0400c9-ffaf31f504f540dc957e0b558c940f79
I20260709 13:05:20.895750  9525 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:05:20.899008 16119 tablet_copy_client.cc:806] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:20.899789 16119 tablet_copy_client.cc:670] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:20.912897  9462 tablet_copy_source_session.cc:215] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:20.918210 16124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffaf31f504f540dc957e0b558c940f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.898828  9368 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:05:20.922927 16121 tablet_copy_client.cc:806] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:20.923681 16121 tablet_copy_client.cc:670] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:20.935678 16119 tablet_copy_client.cc:538] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:20.939389 16121 tablet_copy_client.cc:538] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:20.936014 16022 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:05:20.940668 16086 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:20.952966 16119 tablet_bootstrap.cc:492] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:05:20.957840 16121 tablet_bootstrap.cc:492] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:05:20.996615  9450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:05:20.997383  9450 raft_consensus.cc:606] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Received request to transfer leadership to TS 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:21.011087 16073 raft_consensus.cc:2955] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 21 LEADER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:21.018750  9449 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:05:21.017925  9525 raft_consensus.cc:2955] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:21.019511  9449 raft_consensus.cc:606] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 22 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:05:21.023442  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:21.024938  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:21.038420 16097 raft_consensus.cc:993] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:05:21.039008 16097 raft_consensus.cc:1081] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 22 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:05:21.044873  9519 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46902
I20260709 13:05:21.045595  9519 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:21.046018  9519 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:21.048496  9273 catalog_manager.cc:5697] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b reported cstate change: config changed from index -1 to 13, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 21 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:21.090138  9449 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51006
I20260709 13:05:21.090921  9449 raft_consensus.cc:606] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 22 LEADER]: Received request to transfer leadership
W20260709 13:05:21.093641  9260 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for ffaf31f504f540dc957e0b558c940f79 already in progress [suppressed 1 similar messages]
W20260709 13:05:21.098697 16126 log.cc:927] Time spent T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:05:21.099298  9519 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:21.105485  9377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:05:21.106215  9377 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:21.105768  9369 raft_consensus.cc:2955] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:21.122529  9519 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 23 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:21.124532  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:05:21.125262  9449 raft_consensus.cc:3055] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:21.125608  9449 raft_consensus.cc:740] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:05:21.126163  9377 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 23.
I20260709 13:05:21.126691  9449 consensus_queue.cc:260] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:21.128225  9449 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:21.130929  9492 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:05:21.133883 16063 raft_consensus.cc:2804] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:21.134445 16063 raft_consensus.cc:697] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 23 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:05:21.140458  9449 raft_consensus.cc:2468] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 23.
I20260709 13:05:21.141649  9450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51006
I20260709 13:05:21.142510  9450 raft_consensus.cc:606] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 23 FOLLOWER]: Received request to transfer leadership
I20260709 13:05:21.142947  9450 raft_consensus.cc:614] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:21.135393 16063 consensus_queue.cc:237] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:21.161796 16124 tablet_copy_client.cc:806] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:21.161242  9271 catalog_manager.cc:5697] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 22 to 23, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 23 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.162762 16124 tablet_copy_client.cc:670] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
W20260709 13:05:21.182011  9323 auto_rebalancer.cc:893] Removing replace marker failed: Replica d62c9d5a052b42ce8675f8438f846526 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 23 committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
W20260709 13:05:21.182634  9323 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:05:21.182931  9323 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:05:21.191380 16124 tablet_copy_client.cc:538] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:21.310861 16124 tablet_bootstrap.cc:492] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:05:21.327257 16086 raft_consensus.cc:993] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526: : Instructing follower 925acbe78db14db3b9e4cfc857717947 to start an election
W20260709 13:05:21.349494  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 58361us
I20260709 13:05:21.358414 16086 raft_consensus.cc:1081] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Signalling peer 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:05:21.361802  9369 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:52548
I20260709 13:05:21.362419  9369 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:21.362780  9369 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:21.400630  9369 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:21.421368  9369 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:21.421515  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:05:21.434667  9449 raft_consensus.cc:3055] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:21.435322 16136 ts_tablet_manager.cc:933] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:21.435289  9449 raft_consensus.cc:740] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:05:21.437991  9449 consensus_queue.cc:260] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:21.439311  9449 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:21.446954  9449 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
I20260709 13:05:21.448310  9341 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:05:21.449378 16101 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:21.449889 16101 raft_consensus.cc:697] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:05:21.450738 16101 consensus_queue.cc:237] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:21.459662 16121 tablet_bootstrap.cc:492] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:21.460835 16121 tablet_bootstrap.cc:492] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:05:21.480577  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:05:21.501654  9519 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:21.480695 16121 ts_tablet_manager.cc:1403] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.523s	user 0.037s	sys 0.022s
I20260709 13:05:21.527341  9519 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 14.
W20260709 13:05:21.531757 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 81705.9us
I20260709 13:05:21.538679  9271 catalog_manager.cc:5697] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 13 to 14, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 14 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:21.581717  9491 consensus_peers.cc:597] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:21.588359  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 77607.4us
W20260709 13:05:21.592597  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 93822us
W20260709 13:05:21.668411  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 69095.9us
I20260709 13:05:21.678848  9372 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 23 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:05:21.699949 16119 tablet_bootstrap.cc:492] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:21.687392 16136 tablet_copy_client.cc:323] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.66:45279
I20260709 13:05:21.700973 16119 tablet_bootstrap.cc:492] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:05:21.711397 16119 ts_tablet_manager.cc:1403] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.759s	user 0.064s	sys 0.027s
I20260709 13:05:21.716513  9449 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 23 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:05:21.723958  9462 tablet_copy_service.cc:140] P d62c9d5a052b42ce8675f8438f846526: Received BeginTabletCopySession request for tablet aada562be2484a8fb8aac8e7f9348043 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:45366)
I20260709 13:05:21.724727 16121 raft_consensus.cc:359] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:21.725903 16121 raft_consensus.cc:740] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:05:21.726758 16121 consensus_queue.cc:260] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:21.724902  9462 tablet_copy_service.cc:161] P d62c9d5a052b42ce8675f8438f846526: Beginning new tablet copy session on tablet aada562be2484a8fb8aac8e7f9348043 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:45366: session id = b0812463215649c3b011d36e2f0400c9-aada562be2484a8fb8aac8e7f9348043
I20260709 13:05:21.730494 16121 ts_tablet_manager.cc:1434] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.216s	user 0.008s	sys 0.000s
I20260709 13:05:21.737293 16063 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:05:21.755923  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 114413us
W20260709 13:05:21.765105  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 114342us
I20260709 13:05:21.776243  9462 tablet_copy_source_session.cc:215] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:21.778316  9535 tablet_copy_service.cc:342] P 6d50f1c263264b21919230bee398022b: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-b77c45e065544a6cb4ff451f91a27cd1 received from {username='slave'} at 127.0.0.1:52502
I20260709 13:05:21.778831  9535 tablet_copy_service.cc:434] P 6d50f1c263264b21919230bee398022b: ending tablet copy session b0812463215649c3b011d36e2f0400c9-b77c45e065544a6cb4ff451f91a27cd1 on tablet b77c45e065544a6cb4ff451f91a27cd1 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:05:21.780135 16136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aada562be2484a8fb8aac8e7f9348043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:21.772408 16119 raft_consensus.cc:359] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:21.795951 16119 raft_consensus.cc:740] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:05:21.801774 16153 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 13:05:21.817986 10067 raft_consensus.cc:1217] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.8->[16.9-16.9]   Dedup: 16.9->[]
I20260709 13:05:21.818017 16119 consensus_queue.cc:260] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:21.852852 16119 ts_tablet_manager.cc:1434] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.141s	user 0.010s	sys 0.000s
I20260709 13:05:21.855214  9386 tablet_copy_service.cc:342] P 925acbe78db14db3b9e4cfc857717947: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-f322b7281d554c459bb8109ed249047b received from {username='slave'} at 127.0.0.1:50568
I20260709 13:05:21.855736  9386 tablet_copy_service.cc:434] P 925acbe78db14db3b9e4cfc857717947: ending tablet copy session b0812463215649c3b011d36e2f0400c9-f322b7281d554c459bb8109ed249047b on tablet f322b7281d554c459bb8109ed249047b with peer b0812463215649c3b011d36e2f0400c9
W20260709 13:05:21.857390 16155 log.cc:927] Time spent T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:05:21.993762 16136 tablet_copy_client.cc:806] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:21.994426 16136 tablet_copy_client.cc:670] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:22.000680 16136 tablet_copy_client.cc:538] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:22.026090  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:22.059234  9450 raft_consensus.cc:1275] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:22.059857 16136 tablet_bootstrap.cc:492] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:05:22.061378 16140 consensus_queue.cc:1048] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:22.065028  9519 raft_consensus.cc:1275] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:22.073624 16140 consensus_queue.cc:1048] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:22.261052 16124 tablet_bootstrap.cc:492] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=2 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.262100 16124 tablet_bootstrap.cc:492] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:05:22.262823 16124 ts_tablet_manager.cc:1403] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.952s	user 0.073s	sys 0.016s
I20260709 13:05:22.294809 16067 raft_consensus.cc:1064] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:05:22.316568 10067 raft_consensus.cc:1217] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.11->[17.12-17.12]   Dedup: 17.12->[]
I20260709 13:05:22.297818 16067 consensus_queue.cc:237] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 7, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:22.311647 16124 raft_consensus.cc:359] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9 [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:22.322690 16124 raft_consensus.cc:740] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9 [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:05:22.339197 16124 consensus_queue.cc:260] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:22.343477 16124 ts_tablet_manager.cc:1434] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 13:05:22.356242  9462 tablet_copy_service.cc:342] P d62c9d5a052b42ce8675f8438f846526: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-ffaf31f504f540dc957e0b558c940f79 received from {username='slave'} at 127.0.0.1:45366
I20260709 13:05:22.356778  9462 tablet_copy_service.cc:434] P d62c9d5a052b42ce8675f8438f846526: ending tablet copy session b0812463215649c3b011d36e2f0400c9-ffaf31f504f540dc957e0b558c940f79 on tablet ffaf31f504f540dc957e0b558c940f79 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:05:22.386076 10067 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:22.387203  9451 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:22.391537 16152 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:22.392078 16136 tablet_bootstrap.cc:492] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.393399 16136 tablet_bootstrap.cc:492] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:05:22.394200 16136 ts_tablet_manager.cc:1403] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.335s	user 0.051s	sys 0.010s
I20260709 13:05:22.394445  9377 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:22.396256 16154 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:22.400619 16067 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:05:22.478334 16136 raft_consensus.cc:359] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:22.486891 16136 raft_consensus.cc:740] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:05:22.497483 10067 raft_consensus.cc:3060] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9 [term 22 LEARNER]: Advancing to term 23
I20260709 13:05:22.487684 16136 consensus_queue.cc:260] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:22.549245 16154 raft_consensus.cc:2955] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:22.565557 16136 ts_tablet_manager.cc:1434] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.171s	user 0.008s	sys 0.001s
I20260709 13:05:22.584563  9451 raft_consensus.cc:2955] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:22.658617  9462 tablet_copy_service.cc:342] P d62c9d5a052b42ce8675f8438f846526: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-aada562be2484a8fb8aac8e7f9348043 received from {username='slave'} at 127.0.0.1:45366
I20260709 13:05:22.659296  9462 tablet_copy_service.cc:434] P d62c9d5a052b42ce8675f8438f846526: ending tablet copy session b0812463215649c3b011d36e2f0400c9-aada562be2484a8fb8aac8e7f9348043 on tablet aada562be2484a8fb8aac8e7f9348043 with peer b0812463215649c3b011d36e2f0400c9
W20260709 13:05:22.709688  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 206931us
I20260709 13:05:22.716125 10064 raft_consensus.cc:2955] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:22.750747  9369 raft_consensus.cc:2955] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:22.789083  9271 catalog_manager.cc:5697] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 9 to 10, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:22.820453 16145 raft_consensus.cc:1064] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:05:22.830502 16145 consensus_queue.cc:237] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:22.908412  9519 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:22.911365 16143 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:22.921263 10064 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:22.923007 16140 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:22.923799  9451 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:22.933328 16145 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:23.012024 16145 raft_consensus.cc:2955] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:23.014685 10064 raft_consensus.cc:2955] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:23.031526  9519 raft_consensus.cc:2955] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:23.049876 10070 raft_consensus.cc:1217] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [term 21 LEARNER]: Deduplicated request from leader. Original: 21.12->[21.13-21.13]   Dedup: 21.13->[]
I20260709 13:05:23.082338  9275 catalog_manager.cc:5697] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index 12 to 13, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:23.113548  9372 consensus_queue.cc:237] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:23.127023 16152 raft_consensus.cc:1064] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:05:23.131361 16152 consensus_queue.cc:237] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 15, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:23.147508  9525 consensus_queue.cc:237] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:23.164640 10064 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:05:23.206779  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 64229.6us
I20260709 13:05:23.213897  9372 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:23.214977 10064 raft_consensus.cc:1275] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:23.218202 16168 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:23.220249 16169 consensus_queue.cc:1048] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:23.182034 16175 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:05:23.261632 16145 raft_consensus.cc:2955] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:23.266348 16168 raft_consensus.cc:2955] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:23.277519  9525 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:05:23.277706 10064 raft_consensus.cc:2955] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:23.278141 10070 raft_consensus.cc:2955] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:23.318670  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:23.331434  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 102007us
I20260709 13:05:23.289557 16175 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:05:23.357527  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b77c45e065544a6cb4ff451f91a27cd1 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:23.383814 10064 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9 [term 23 LEARNER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:05:23.400596  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 87142.5us
I20260709 13:05:23.439744 16067 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:05:23.443431  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f322b7281d554c459bb8109ed249047b with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:23.451695  9273 catalog_manager.cc:5697] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 10 to 11, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New cstate: current_term: 16 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:23.503401  9519 raft_consensus.cc:2955] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:05:23.515890  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 81858.6us
I20260709 13:05:23.548017  9377 raft_consensus.cc:2955] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:23.548887  9271 catalog_manager.cc:5697] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index 13 to 14, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New cstate: current_term: 17 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:23.573953  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 83374.3us
I20260709 13:05:23.597508  9377 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 23 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:05:23.649055  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 87547.5us
I20260709 13:05:23.663090 16171 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.012s
W20260709 13:05:23.691888  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 66387.6us
I20260709 13:05:23.725986  9520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f"
dest_uuid: "6d50f1c263264b21919230bee398022b"
mode: GRACEFUL
new_leader_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:46908
I20260709 13:05:23.726715  9520 raft_consensus.cc:606] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Received request to transfer leadership to TS d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:23.865872  9435 tablet_service.cc:1558] Processing DeleteTablet for tablet b77c45e065544a6cb4ff451f91a27cd1 with delete_type TABLET_DATA_TOMBSTONED (TS d62c9d5a052b42ce8675f8438f846526 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:51006
I20260709 13:05:23.870342  9449 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 23 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:05:23.907747  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 212577us
I20260709 13:05:23.917280 16203 raft_consensus.cc:1064] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:05:23.931334 16225 tablet_replica.cc:333] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:23.959071 16214 raft_consensus.cc:2955] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 23 LEADER]: Committing config change with OpId 23.17: config changed from index 15 to 17, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:23.977730 16203 consensus_queue.cc:237] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 11, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:23.982766  9369 raft_consensus.cc:2955] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 15 to 17, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:23.993201  9369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f322b7281d554c459bb8109ed249047b"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
W20260709 13:05:23.996937  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 55681.8us
I20260709 13:05:23.994053  9369 raft_consensus.cc:606] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:05:24.057243  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:24.077750 16225 raft_consensus.cc:2243] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:24.080868  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 95475.9us
I20260709 13:05:24.082338  9435 tablet_service.cc:1558] Processing DeleteTablet for tablet f322b7281d554c459bb8109ed249047b with delete_type TABLET_DATA_TOMBSTONED (TS d62c9d5a052b42ce8675f8438f846526 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:51006
I20260709 13:05:24.089458 16225 raft_consensus.cc:2272] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.037884 10070 raft_consensus.cc:2955] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9 [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 15 to 17, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:24.092861 16225 ts_tablet_manager.cc:1916] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:24.111702  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:24.171833 16214 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:05:24.187229 16225 ts_tablet_manager.cc:1929] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.10
I20260709 13:05:24.193794 10067 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [term 21 LEARNER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:05:24.195379 16203 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:24.194680 16225 log.cc:1199] T b77c45e065544a6cb4ff451f91a27cd1 P d62c9d5a052b42ce8675f8438f846526: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-1-root/wals/b77c45e065544a6cb4ff451f91a27cd1
W20260709 13:05:24.212282  9418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.237403  9260 catalog_manager.cc:5028] TS d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): tablet b77c45e065544a6cb4ff451f91a27cd1 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:05:24.241216  9377 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:05:24.244563  9273 catalog_manager.cc:5697] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index 15 to 17, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:24.249433 16225 tablet_replica.cc:333] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:24.276516 16225 raft_consensus.cc:2243] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.282459 16154 raft_consensus.cc:993] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b: : Instructing follower d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:05:24.285465 16154 raft_consensus.cc:1081] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Signalling peer d62c9d5a052b42ce8675f8438f846526 to start an election
I20260709 13:05:24.289915 16194 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:05:24.296615 16225 pending_rounds.cc:70] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526: Trying to abort 1 pending ops.
I20260709 13:05:24.297068 16225 pending_rounds.cc:77] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526: Aborting op as it isn't in flight: id { term: 17 index: 13 } timestamp: 7305635114305581056 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "f322b7281d554c459bb8109ed249047b" old_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } } new_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } } }
I20260709 13:05:24.298321 16225 raft_consensus.cc:2917] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Aborting config change with OpId 17.13: Aborted: Op aborted
I20260709 13:05:24.298774 16225 raft_consensus.cc:2889] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:05:24.299126 16225 raft_consensus.cc:2272] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.303746 16208 raft_consensus.cc:993] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:05:24.304193 16208 raft_consensus.cc:1081] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:05:24.320779  9449 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
 from {username='slave'} at 127.0.0.1:51016
I20260709 13:05:24.321625  9449 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:24.322116  9449 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:24.324747 16225 ts_tablet_manager.cc:1916] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:24.351289  9449 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:24.357461  9368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:05:24.358089  9368 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:24.359957  9343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 58480.8us
I20260709 13:05:24.370436  9449 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 21 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:24.377627  9519 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f322b7281d554c459bb8109ed249047b"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46894
I20260709 13:05:24.378290  9519 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:24.378638  9519 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:24.380599  9368 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 21.
I20260709 13:05:24.382609  9372 raft_consensus.cc:1240] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Rejecting Update request from peer 6d50f1c263264b21919230bee398022b for earlier term 20. Current term is 21. Ops: []
W20260709 13:05:24.388367  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 167981us
I20260709 13:05:24.383318  9418 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:05:24.397938  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e9c36ec724a60ac9a7846d6491c9f" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:05:24.398605  9521 raft_consensus.cc:3055] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:24.398903  9521 raft_consensus.cc:740] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:05:24.399672  9521 consensus_queue.cc:260] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:24.400775  9521 raft_consensus.cc:3060] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:24.402319  9524 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:05:24.405156 16150 raft_consensus.cc:2804] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:24.406587  9519 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:24.416121  9369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:05:24.416958  9369 raft_consensus.cc:3055] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:24.417552  9369 raft_consensus.cc:740] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:05:24.418497  9369 consensus_queue.cc:260] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:24.419667  9369 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:24.421855 16150 raft_consensus.cc:697] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 21 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:05:24.422881 16150 consensus_queue.cc:237] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:24.425987  9519 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:24.427161  9369 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 18.
I20260709 13:05:24.441323  9444 raft_consensus.cc:2955] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 15 to 17, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:05:24.448084  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 51751.8us
I20260709 13:05:24.455549  9521 raft_consensus.cc:2468] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 21.
I20260709 13:05:24.460239  9492 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947; no voters: 
I20260709 13:05:24.461184 16214 raft_consensus.cc:2804] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:24.461730 16214 raft_consensus.cc:697] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 18 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:05:24.462647 16214 consensus_queue.cc:237] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:24.461771 10067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322b7281d554c459bb8109ed249047b" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:05:24.463934 10067 raft_consensus.cc:3060] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:24.482400 10067 raft_consensus.cc:2468] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 18.
W20260709 13:05:24.466609 16234 log.cc:927] Time spent T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:05:24.508276 16225 ts_tablet_manager.cc:1929] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.13
I20260709 13:05:24.508847 16225 log.cc:1199] T f322b7281d554c459bb8109ed249047b P d62c9d5a052b42ce8675f8438f846526: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-1-root/wals/f322b7281d554c459bb8109ed249047b
I20260709 13:05:24.518379 16096 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:24.542865  9260 catalog_manager.cc:5028] TS d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): tablet f322b7281d554c459bb8109ed249047b (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:05:24.643143  9369 raft_consensus.cc:2955] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:24.650059 16149 raft_consensus.cc:2955] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:24.655560 10070 raft_consensus.cc:2955] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:24.699431  9519 raft_consensus.cc:2955] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:24.788111  9275 catalog_manager.cc:5697] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 20 to 21, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 21 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:24.936077 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 61865.1us
W20260709 13:05:24.960325  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 90617.9us
I20260709 13:05:24.985846 10067 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:05:24.986717  9374 raft_consensus.cc:1275] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:05:24.988636 16168 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:24.991401 16206 consensus_queue.cc:1048] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:25.040766  9373 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:05:25.083832  9273 catalog_manager.cc:5697] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:25.113343  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:25.238549 16226 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:25.244930  9274 catalog_manager.cc:5697] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 17 to 18, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 18 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:25.304590  9444 consensus_queue.cc:237] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:25.314455 10064 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:05:25.316399 16096 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:25.326066 16194 raft_consensus.cc:2955] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index 14 to 15, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:25.333434  9525 consensus_queue.cc:237] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:25.354391 10064 raft_consensus.cc:2955] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:25.384637  9260 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aada562be2484a8fb8aac8e7f9348043 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:25.385830  9373 raft_consensus.cc:1275] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:05:25.433369 16194 consensus_queue.cc:1048] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:25.432706  9271 catalog_manager.cc:5697] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index 14 to 15, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New cstate: current_term: 21 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:25.479525  9369 raft_consensus.cc:2955] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:05:25.484750  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.486189  9519 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:05:25.502214 16226 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:05:25.531859 10064 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9 [term 23 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:05:25.553920  9508 tablet_service.cc:1558] Processing DeleteTablet for tablet aada562be2484a8fb8aac8e7f9348043 with delete_type TABLET_DATA_TOMBSTONED (TS 6d50f1c263264b21919230bee398022b not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:54524
I20260709 13:05:25.554950 16214 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.018s
I20260709 13:05:25.577430  9373 raft_consensus.cc:1275] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 23 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
W20260709 13:05:25.624241  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 74719.1us
I20260709 13:05:25.602200 16168 consensus_queue.cc:1048] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.017s
I20260709 13:05:25.635097 16256 tablet_replica.cc:333] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
W20260709 13:05:25.703020 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 83895.1us
I20260709 13:05:25.712568 10064 raft_consensus.cc:2955] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9 [term 23 FOLLOWER]: Committing config change with OpId 23.18: config changed from index 17 to 18, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:25.723477 16214 raft_consensus.cc:2955] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 23 LEADER]: Committing config change with OpId 23.18: config changed from index 17 to 18, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:25.769416 16256 raft_consensus.cc:2243] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.770864 16256 raft_consensus.cc:2272] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:25.758625  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 86278.6us
I20260709 13:05:25.771548  9273 catalog_manager.cc:5697] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 17 to 18, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New cstate: current_term: 23 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:25.792168 16256 ts_tablet_manager.cc:1916] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:25.819026  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ffaf31f504f540dc957e0b558c940f79 with cas_config_opid_index 17: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:25.825173  9369 raft_consensus.cc:2955] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 23 FOLLOWER]: Committing config change with OpId 23.18: config changed from index 17 to 18, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:25.826658  9435 tablet_service.cc:1558] Processing DeleteTablet for tablet ffaf31f504f540dc957e0b558c940f79 with delete_type TABLET_DATA_TOMBSTONED (TS d62c9d5a052b42ce8675f8438f846526 not found in new config with opid_index 18) from {username='slave'} at 127.0.0.1:51006
I20260709 13:05:25.837939 16265 tablet_replica.cc:333] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:25.839339 16265 raft_consensus.cc:2243] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.846007 16265 raft_consensus.cc:2272] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.850433 16265 ts_tablet_manager.cc:1916] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:25.935118 16256 ts_tablet_manager.cc:1929] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.14
I20260709 13:05:25.935964 16256 log.cc:1199] T aada562be2484a8fb8aac8e7f9348043 P 6d50f1c263264b21919230bee398022b: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-2-root/wals/aada562be2484a8fb8aac8e7f9348043
I20260709 13:05:25.938525  9262 catalog_manager.cc:5028] TS 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): tablet aada562be2484a8fb8aac8e7f9348043 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:05:25.954859 16265 ts_tablet_manager.cc:1929] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 23.17
I20260709 13:05:25.955580 16265 log.cc:1199] T ffaf31f504f540dc957e0b558c940f79 P d62c9d5a052b42ce8675f8438f846526: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-1-root/wals/ffaf31f504f540dc957e0b558c940f79
I20260709 13:05:25.958070  9260 catalog_manager.cc:5028] TS d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): tablet ffaf31f504f540dc957e0b558c940f79 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:05:26.875674  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:27.041652  9449 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44"
dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
mode: GRACEFUL
new_leader_uuid: "b0812463215649c3b011d36e2f0400c9"
 from {username='slave'} at 127.0.0.1:34968
I20260709 13:05:27.042371  9449 raft_consensus.cc:606] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Received request to transfer leadership to TS b0812463215649c3b011d36e2f0400c9
I20260709 13:05:27.054322  9520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7"
dest_uuid: "6d50f1c263264b21919230bee398022b"
mode: GRACEFUL
new_leader_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:46908
I20260709 13:05:27.054987  9520 raft_consensus.cc:606] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Received request to transfer leadership to TS 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:27.056916  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:27.056979  9519 consensus_queue.cc:237] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:27.058810  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:05:27.073411  9491 consensus_peers.cc:597] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 897f815762f54948b7f3aea4ee0c84f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.073400  9449 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:27.076344  9369 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:27.078523 16231 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:27.087814 16154 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:27.149819 16154 raft_consensus.cc:2955] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:27.155656  9369 raft_consensus.cc:2955] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:27.173326  9448 raft_consensus.cc:2955] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:27.239979  9520 consensus_queue.cc:237] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:27.236526  9273 catalog_manager.cc:5697] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b reported cstate change: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 15 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:27.311770  9491 consensus_peers.cc:597] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b1affc9131446038db1c8ad10108ab0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.314472  9373 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:27.314905  9449 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:27.316187 16255 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:27.322259 16255 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:27.377952 16154 raft_consensus.cc:2955] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index -1 to 13, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:27.396844  9448 raft_consensus.cc:2955] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index -1 to 13, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:27.399348 16231 raft_consensus.cc:993] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b: : Instructing follower 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:05:27.399892 16231 raft_consensus.cc:1081] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Signalling peer 925acbe78db14db3b9e4cfc857717947 to start an election
I20260709 13:05:27.401605  9374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
 from {username='slave'} at 127.0.0.1:52562
I20260709 13:05:27.402275  9374 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:27.402642  9374 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:27.422343  9374 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:27.437068  9374 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:27.439167  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:05:27.439935  9520 raft_consensus.cc:3055] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:27.440315  9520 raft_consensus.cc:740] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:05:27.443290  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:05:27.446290  9449 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:27.445451  9520 consensus_queue.cc:260] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:27.452917  9520 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:27.484022  9374 raft_consensus.cc:2955] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index -1 to 13, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
W20260709 13:05:27.504451 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 48844.9us
I20260709 13:05:27.511644  9449 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 16.
I20260709 13:05:27.522815  9520 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 925acbe78db14db3b9e4cfc857717947 in term 16.
W20260709 13:05:27.529131 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 53177us
I20260709 13:05:27.533806  9341 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:05:27.535053 16145 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:27.535557 16145 raft_consensus.cc:697] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Becoming Leader. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:05:27.536301 16145 consensus_queue.cc:237] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:27.552042 16267 raft_consensus.cc:993] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526: : Instructing follower b0812463215649c3b011d36e2f0400c9 to start an election
I20260709 13:05:27.553265 16226 raft_consensus.cc:1081] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Signalling peer b0812463215649c3b011d36e2f0400c9 to start an election
I20260709 13:05:27.552035 16281 ts_tablet_manager.cc:933] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:27.558005 10064 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44"
dest_uuid: "b0812463215649c3b011d36e2f0400c9"
 from {username='slave'} at 127.0.0.1:44546
I20260709 13:05:27.558852 10064 raft_consensus.cc:493] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:27.559386 10064 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:27.574621 10064 raft_consensus.cc:515] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:27.578722  9374 consensus_queue.cc:237] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:27.572849 16281 tablet_copy_client.cc:323] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.67:35929
I20260709 13:05:27.587569  9535 tablet_copy_service.cc:140] P 6d50f1c263264b21919230bee398022b: Received BeginTabletCopySession request for tablet 897f815762f54948b7f3aea4ee0c84f0 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:52502)
I20260709 13:05:27.588234  9535 tablet_copy_service.cc:161] P 6d50f1c263264b21919230bee398022b: Beginning new tablet copy session on tablet 897f815762f54948b7f3aea4ee0c84f0 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:52502: session id = b0812463215649c3b011d36e2f0400c9-897f815762f54948b7f3aea4ee0c84f0
I20260709 13:05:27.607955  9535 tablet_copy_source_session.cc:215] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:27.615618 10064 leader_election.cc:290] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 16 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:27.617337  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:05:27.617923  9520 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:27.616663  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ffe24ed6cf41c5b150d5ed4fa28c44" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:05:27.619696  9449 raft_consensus.cc:3055] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:27.619956  9449 raft_consensus.cc:740] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:05:27.621124  9449 consensus_queue.cc:260] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:27.622519  9449 raft_consensus.cc:3060] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:27.627924 16281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 897f815762f54948b7f3aea4ee0c84f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.620118  9274 catalog_manager.cc:5697] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index -1 to 13, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 16 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:27.630745  9274 catalog_manager.cc:5697] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: term changed from 15 to 16, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to 925acbe78db14db3b9e4cfc857717947 (127.8.4.65). New cstate: current_term: 16 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:27.633142  9520 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 16.
I20260709 13:05:27.634522 10027 leader_election.cc:304] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:05:27.638314  9449 raft_consensus.cc:2468] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 16.
I20260709 13:05:27.639959 16266 raft_consensus.cc:2804] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:27.640564 16266 raft_consensus.cc:697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 [term 16 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:05:27.641506 16266 consensus_queue.cc:237] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:27.658900  9520 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:05:27.660501 16145 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:27.661065  9449 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:05:27.661638  9342 consensus_peers.cc:597] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e30c155cba64357ae275b3366772777. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.663089 16235 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:27.744068  9273 catalog_manager.cc:5697] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 15 to 16, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 16 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:27.753454 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 61670.6us
I20260709 13:05:27.788733 16235 raft_consensus.cc:2955] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Committing config change with OpId 17.15: config changed from index -1 to 15, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:27.792405 16281 tablet_copy_client.cc:806] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:27.797204 16281 tablet_copy_client.cc:670] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:27.796838  9449 raft_consensus.cc:2955] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index -1 to 15, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:27.804708 16281 tablet_copy_client.cc:538] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:27.796859  9525 raft_consensus.cc:2955] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index -1 to 15, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:27.831692 16281 tablet_bootstrap.cc:492] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:05:27.837808  9273 catalog_manager.cc:5697] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index -1 to 15, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 17 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:27.871292  9449 consensus_queue.cc:237] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
W20260709 13:05:27.904240  9417 consensus_peers.cc:597] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 -> Peer b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623): Couldn't send request to peer b0812463215649c3b011d36e2f0400c9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 605e9c36ec724a60ac9a7846d6491c9f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.905478  9374 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:05:27.908041  9525 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:05:27.915606 16267 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:27.919565 16267 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:27.976315 16292 ts_tablet_manager.cc:933] T 5b1affc9131446038db1c8ad10108ab0 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:27.977109 16289 raft_consensus.cc:2955] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 21 LEADER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:27.979140  9520 raft_consensus.cc:2955] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:27.982211  9373 raft_consensus.cc:2955] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:27.999265 16292 tablet_copy_client.cc:323] T 5b1affc9131446038db1c8ad10108ab0 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.67:35929
I20260709 13:05:28.009181  9274 catalog_manager.cc:5697] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index -1 to 13, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 21 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:28.037684  9535 tablet_copy_service.cc:140] P 6d50f1c263264b21919230bee398022b: Received BeginTabletCopySession request for tablet 5b1affc9131446038db1c8ad10108ab0 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:52502)
I20260709 13:05:28.038354  9535 tablet_copy_service.cc:161] P 6d50f1c263264b21919230bee398022b: Beginning new tablet copy session on tablet 5b1affc9131446038db1c8ad10108ab0 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:52502: session id = b0812463215649c3b011d36e2f0400c9-5b1affc9131446038db1c8ad10108ab0
I20260709 13:05:28.062386 16281 tablet_bootstrap.cc:492] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=2 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:28.065737  9449 raft_consensus.cc:1275] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:28.066022  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:28.066435 16281 tablet_bootstrap.cc:492] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:05:28.062422  9535 tablet_copy_source_session.cc:215] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:28.088948 16281 ts_tablet_manager.cc:1403] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.258s	user 0.040s	sys 0.008s
I20260709 13:05:28.093076 16292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b1affc9131446038db1c8ad10108ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.097088  9449 raft_consensus.cc:1275] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:28.098969 16185 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:28.081272 16175 consensus_queue.cc:1048] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:28.109711 16281 raft_consensus.cc:359] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:28.110911 16281 raft_consensus.cc:740] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:05:28.111742 16281 consensus_queue.cc:260] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:28.113576  9520 raft_consensus.cc:1275] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:28.119048 16175 consensus_queue.cc:1048] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:05:28.133078 16281 ts_tablet_manager.cc:1434] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.004s
I20260709 13:05:28.154788  9535 tablet_copy_service.cc:342] P 6d50f1c263264b21919230bee398022b: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-897f815762f54948b7f3aea4ee0c84f0 received from {username='slave'} at 127.0.0.1:52502
I20260709 13:05:28.155386  9535 tablet_copy_service.cc:434] P 6d50f1c263264b21919230bee398022b: ending tablet copy session b0812463215649c3b011d36e2f0400c9-897f815762f54948b7f3aea4ee0c84f0 on tablet 897f815762f54948b7f3aea4ee0c84f0 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:05:28.200449 16300 ts_tablet_manager.cc:933] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547)
I20260709 13:05:28.247583  9525 raft_consensus.cc:1275] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:05:28.275321 16298 log.cc:927] Time spent T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:05:28.288000 16185 consensus_queue.cc:1048] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:28.413295 16292 tablet_copy_client.cc:806] T 5b1affc9131446038db1c8ad10108ab0 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:28.414044 16292 tablet_copy_client.cc:670] T 5b1affc9131446038db1c8ad10108ab0 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:28.480561 16300 tablet_copy_client.cc:323] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.65:37547
I20260709 13:05:28.485369  9386 tablet_copy_service.cc:140] P 925acbe78db14db3b9e4cfc857717947: Received BeginTabletCopySession request for tablet 0e30c155cba64357ae275b3366772777 from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:50568)
I20260709 13:05:28.486117  9386 tablet_copy_service.cc:161] P 925acbe78db14db3b9e4cfc857717947: Beginning new tablet copy session on tablet 0e30c155cba64357ae275b3366772777 from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:50568: session id = b0812463215649c3b011d36e2f0400c9-0e30c155cba64357ae275b3366772777
I20260709 13:05:28.494656 16292 tablet_copy_client.cc:538] T 5b1affc9131446038db1c8ad10108ab0 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:28.527905  9386 tablet_copy_source_session.cc:215] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:28.529937 16281 ts_tablet_manager.cc:933] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9: Initiating tablet copy from peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:28.534516 16300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e30c155cba64357ae275b3366772777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.542572 10064 raft_consensus.cc:1217] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 13:05:28.573930 16292 tablet_bootstrap.cc:492] T 5b1affc9131446038db1c8ad10108ab0 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:05:28.579963 16281 tablet_copy_client.cc:323] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.4.66:45279
I20260709 13:05:28.582202  9462 tablet_copy_service.cc:140] P d62c9d5a052b42ce8675f8438f846526: Received BeginTabletCopySession request for tablet 605e9c36ec724a60ac9a7846d6491c9f from peer b0812463215649c3b011d36e2f0400c9 ({username='slave'} at 127.0.0.1:45366)
I20260709 13:05:28.582804  9462 tablet_copy_service.cc:161] P d62c9d5a052b42ce8675f8438f846526: Beginning new tablet copy session on tablet 605e9c36ec724a60ac9a7846d6491c9f from peer b0812463215649c3b011d36e2f0400c9 at {username='slave'} at 127.0.0.1:45366: session id = b0812463215649c3b011d36e2f0400c9-605e9c36ec724a60ac9a7846d6491c9f
I20260709 13:05:28.591648  9462 tablet_copy_source_session.cc:215] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:28.595911 16281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605e9c36ec724a60ac9a7846d6491c9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.684993 16300 tablet_copy_client.cc:806] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:28.689545 16300 tablet_copy_client.cc:670] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:28.695411 16300 tablet_copy_client.cc:538] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:28.698233 16281 tablet_copy_client.cc:806] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:28.704821 16281 tablet_copy_client.cc:670] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:28.733103 16281 tablet_copy_client.cc:538] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:28.787550 16281 tablet_bootstrap.cc:492] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:05:28.806751 16300 tablet_bootstrap.cc:492] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9: Bootstrap starting.
I20260709 13:05:29.015969 16281 tablet_bootstrap.cc:492] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=3 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:29.017127 16281 tablet_bootstrap.cc:492] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:05:29.020798 16281 ts_tablet_manager.cc:1403] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.233s	user 0.043s	sys 0.011s
I20260709 13:05:29.063601 16281 raft_consensus.cc:359] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:29.089205 16281 raft_consensus.cc:740] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
W20260709 13:05:29.085445 16292 log.cc:927] Time spent T 5b1affc9131446038db1c8ad10108ab0 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:05:29.096444 16292 tablet_bootstrap.cc:492] T 5b1affc9131446038db1c8ad10108ab0 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:29.097493 16281 consensus_queue.cc:260] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
W20260709 13:05:29.100426  9492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 52169.6us
I20260709 13:05:29.111104 16281 ts_tablet_manager.cc:1434] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.088s	user 0.004s	sys 0.005s
I20260709 13:05:29.112874  9462 tablet_copy_service.cc:342] P d62c9d5a052b42ce8675f8438f846526: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-605e9c36ec724a60ac9a7846d6491c9f received from {username='slave'} at 127.0.0.1:45366
I20260709 13:05:29.113428  9462 tablet_copy_service.cc:434] P d62c9d5a052b42ce8675f8438f846526: ending tablet copy session b0812463215649c3b011d36e2f0400c9-605e9c36ec724a60ac9a7846d6491c9f on tablet 605e9c36ec724a60ac9a7846d6491c9f with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:05:29.139290 10064 raft_consensus.cc:1217] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [term 21 LEARNER]: Deduplicated request from leader. Original: 21.12->[21.13-21.13]   Dedup: 21.13->[]
I20260709 13:05:29.124017 16292 tablet_bootstrap.cc:492] T 5b1affc9131446038db1c8ad10108ab0 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:05:29.157824 16292 ts_tablet_manager.cc:1403] T 5b1affc9131446038db1c8ad10108ab0 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.584s	user 0.036s	sys 0.023s
I20260709 13:05:29.175853 16292 raft_consensus.cc:359] T 5b1affc9131446038db1c8ad10108ab0 P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:29.185182 16292 raft_consensus.cc:740] T 5b1affc9131446038db1c8ad10108ab0 P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
W20260709 13:05:29.186340  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 57144.6us
I20260709 13:05:29.205760 16314 raft_consensus.cc:1064] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:05:29.208786 16314 consensus_queue.cc:237] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:29.229732 16292 consensus_queue.cc:260] T 5b1affc9131446038db1c8ad10108ab0 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:29.257469 16292 ts_tablet_manager.cc:1434] T 5b1affc9131446038db1c8ad10108ab0 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.099s	user 0.007s	sys 0.001s
I20260709 13:05:29.263909  9535 tablet_copy_service.cc:342] P 6d50f1c263264b21919230bee398022b: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-5b1affc9131446038db1c8ad10108ab0 received from {username='slave'} at 127.0.0.1:52502
I20260709 13:05:29.264462  9535 tablet_copy_service.cc:434] P 6d50f1c263264b21919230bee398022b: ending tablet copy session b0812463215649c3b011d36e2f0400c9-5b1affc9131446038db1c8ad10108ab0 on tablet 5b1affc9131446038db1c8ad10108ab0 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:05:29.283962  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:29.347107 16300 log.cc:927] Time spent T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9: Append to log took a long time: real 0.121s	user 0.002s	sys 0.000s
I20260709 13:05:29.386792 10064 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9 [term 15 LEARNER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:05:29.389972 16299 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:29.409920  9449 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:05:29.414553  9374 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:05:29.419989 16303 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:05:29.437738 16317 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:05:29.474762 10064 raft_consensus.cc:1217] T 5b1affc9131446038db1c8ad10108ab0 P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.12->[16.13-16.13]   Dedup: 16.13->[]
I20260709 13:05:29.506325  9449 raft_consensus.cc:2955] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:29.503932 16282 raft_consensus.cc:2955] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:29.510610 10063 raft_consensus.cc:2955] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:29.519151  9373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4"
dest_uuid: "925acbe78db14db3b9e4cfc857717947"
mode: GRACEFUL
new_leader_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:52636
I20260709 13:05:29.519783  9373 raft_consensus.cc:606] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Received request to transfer leadership to TS 6d50f1c263264b21919230bee398022b
I20260709 13:05:29.521809  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:05:29.523499  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:29.572365 16235 raft_consensus.cc:993] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947: : Instructing follower 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:05:29.572898 16235 raft_consensus.cc:1081] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Signalling peer 6d50f1c263264b21919230bee398022b to start an election
I20260709 13:05:29.577710  9520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4"
dest_uuid: "6d50f1c263264b21919230bee398022b"
 from {username='slave'} at 127.0.0.1:46894
I20260709 13:05:29.578286  9520 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:29.578625  9520 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:29.586673  9274 catalog_manager.cc:5697] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:29.635844  9520 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:05:29.645030  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 93102.7us
I20260709 13:05:29.688510  9374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "925acbe78db14db3b9e4cfc857717947"
I20260709 13:05:29.689386  9374 raft_consensus.cc:3055] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:29.689677  9374 raft_consensus.cc:740] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 925acbe78db14db3b9e4cfc857717947, State: Running, Role: LEADER
I20260709 13:05:29.690333  9374 consensus_queue.cc:260] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:29.712132 16300 tablet_bootstrap.cc:492] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:29.713670 16300 tablet_bootstrap.cc:492] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9: Bootstrap complete.
I20260709 13:05:29.725464  9520 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:29.726215  9374 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:29.806532 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5154ade768f425fa43369d9709e66a4" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:05:29.807505 10063 raft_consensus.cc:3060] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:29.782724 16300 ts_tablet_manager.cc:1403] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9: Time spent bootstrapping tablet: real 0.976s	user 0.067s	sys 0.000s
I20260709 13:05:29.829831  9374 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 18.
I20260709 13:05:29.839267 16300 raft_consensus.cc:359] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:29.840348 16300 raft_consensus.cc:740] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Initialized, Role: LEARNER
I20260709 13:05:29.843704 16300 consensus_queue.cc:260] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
I20260709 13:05:29.847167 16300 ts_tablet_manager.cc:1434] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
W20260709 13:05:29.850660 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 63368.6us
W20260709 13:05:29.922968  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 132069us
W20260709 13:05:29.926170  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 134058us
W20260709 13:05:29.932998  9342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.938958 10063 raft_consensus.cc:2468] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 18.
I20260709 13:05:29.964865  9386 tablet_copy_service.cc:342] P 925acbe78db14db3b9e4cfc857717947: Request end of tablet copy session b0812463215649c3b011d36e2f0400c9-0e30c155cba64357ae275b3366772777 received from {username='slave'} at 127.0.0.1:50568
W20260709 13:05:30.061265  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 76933.2us
W20260709 13:05:30.071555 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 87954.3us
I20260709 13:05:30.070004  9386 tablet_copy_service.cc:434] P 925acbe78db14db3b9e4cfc857717947: ending tablet copy session b0812463215649c3b011d36e2f0400c9-0e30c155cba64357ae275b3366772777 on tablet 0e30c155cba64357ae275b3366772777 with peer b0812463215649c3b011d36e2f0400c9
I20260709 13:05:30.293974 10063 raft_consensus.cc:1217] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.14->[17.15-17.15]   Dedup: 17.15->[]
W20260709 13:05:30.325450  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 184827us
I20260709 13:05:30.407217  9491 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:05:30.416580 16303 raft_consensus.cc:2804] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:30.420083 16303 raft_consensus.cc:697] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 18 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:05:30.421157 16303 consensus_queue.cc:237] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:30.476732 16337 raft_consensus.cc:1064] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:05:30.479544 16337 consensus_queue.cc:237] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:30.521509  9377 raft_consensus.cc:2955] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:30.524698  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:30.531805 16335 raft_consensus.cc:1064] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:05:30.535390 16335 consensus_queue.cc:237] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 11, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:30.557986 10067 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P b0812463215649c3b011d36e2f0400c9 [term 16 LEARNER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:05:30.560458  9450 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:05:30.567061 16303 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:30.568470 16337 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:30.575994  9373 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:05:30.597069 16368 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:05:30.592645  9274 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43244 (request call id 364) took 1008 ms. Trace:
I20260709 13:05:30.631633  9519 consensus_queue.cc:237] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:30.609972  9274 rpcz_store.cc:276] 0709 13:05:29.583826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.583953 (+   127us) service_pool.cc:224] Handling call
0709 13:05:30.592583 (+1008630us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:29.816839 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:29.830108 (+ 13269us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:29.830145 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:05:29.830162 (+    17us) tablet.cc:662] Decoding operations
0709 13:05:29.830493 (+   331us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:29.830571 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:29.830607 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:05:29.830806 (+   199us) tablet.cc:701] Row locks acquired
0709 13:05:29.830823 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:05:29.830972 (+   149us) write_op.cc:270] Start()
0709 13:05:29.831083 (+   111us) write_op.cc:276] Timestamp: P: 1783602329830923 usec, L: 0
0709 13:05:29.831103 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:05:30.017540 (+186437us) log.cc:844] Serialized 587 byte log entry
0709 13:05:30.376120 (+358580us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b540016e4d4. stack: 00007fb58344b343 00007fb58344b240 00007fb582dda1d4 00007fb58cb18304 00007fb58cb18299 00007fb5864d3571 00007fb586565e28 00007fb589fa0581 00007fb589f9fd58 00007fb589fa49f1 00007fb589fa49a9 00007fb589fa4939 00007fb589fa4901 00007fb589fa3b2d 000000000038f354 000000000038f199
0709 13:05:30.472818 (+ 96698us) op_driver.cc:464] REPLICATION: finished
0709 13:05:30.526231 (+ 53413us) write_op.cc:301] APPLY: starting
0709 13:05:30.526322 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:30.527405 (+  1083us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:30.527427 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:30.528103 (+   676us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:30.528294 (+   191us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:05:30.528350 (+    56us) write_op.cc:312] APPLY: finished
0709 13:05:30.542041 (+ 13691us) log.cc:844] Serialized 25 byte log entry
0709 13:05:30.556766 (+ 14725us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:30.556851 (+    85us) write_op.cc:454] Released schema lock
0709 13:05:30.565454 (+  8603us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:30.592948 (+ 27494us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:30.592980 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":53155,"apply.run_cpu_time_us":3149,"apply.run_wall_time_us":65771,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8297,"num_ops":1,"prepare.queue_time_us":197403,"prepare.run_cpu_time_us":14632,"prepare.run_wall_time_us":587147,"raft.queue_time_us":189367,"raft.run_cpu_time_us":7960,"raft.run_wall_time_us":26713,"replication_time_us":641538,"spinlock_wait_cycles":41866624,"thread_start_us":466475,"threads_started":4,"wal-append.queue_time_us":241985}]]}
I20260709 13:05:30.639819 16329 raft_consensus.cc:1027] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 21 LEADER]: attempt to promote peer b0812463215649c3b011d36e2f0400c9: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:05:30.641816 10064 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [term 21 LEARNER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:05:30.643610 16335 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:05:30.646567  9373 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:05:30.660858 16289 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:30.661504  9518 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:05:30.662874 16366 raft_consensus.cc:1064] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
I20260709 13:05:30.692813 16289 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:05:30.700253  9274 catalog_manager.cc:5697] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 17 to 18, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 18 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.730279 10067 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:30.734874 16357 raft_consensus.cc:2955] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Committing config change with OpId 16.14: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:30.738385  9444 raft_consensus.cc:1275] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:30.747371 16317 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:30.703840 16366 consensus_queue.cc:237] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 13, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:30.764099 16368 consensus_queue.cc:1048] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:30.772140  9444 raft_consensus.cc:2955] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:30.793584  9369 raft_consensus.cc:2955] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:30.828246  9274 catalog_manager.cc:5697] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:30.877300 10067 raft_consensus.cc:2955] T 5b1affc9131446038db1c8ad10108ab0 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:30.961844 16303 raft_consensus.cc:2955] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:05:31.180042  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 303434us
I20260709 13:05:31.218426 10070 raft_consensus.cc:2955] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:31.226184 10060 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [term 17 LEARNER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:05:31.251924 16235 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:05:31.437577  9525 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:05:31.443624 16235 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:05:31.444281  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 563084us
I20260709 13:05:31.475965 16348 raft_consensus.cc:2955] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:31.481617  9525 raft_consensus.cc:2955] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:31.529760 16338 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:31.530874 16338 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:31.532833 16338 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:31.547068  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 76833.8us
I20260709 13:05:31.553653  9374 raft_consensus.cc:2955] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:31.581631 16337 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:31.582351 16337 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:31.584473 16337 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:31.596720  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 65108.9us
I20260709 13:05:31.626506  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 897f815762f54948b7f3aea4ee0c84f0 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:31.629616  9372 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:31.645776  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:05:31.656174  9517 consensus_queue.cc:237] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:31.648077 10060 raft_consensus.cc:2955] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:31.653414  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "925acbe78db14db3b9e4cfc857717947" is_pre_election: true
I20260709 13:05:31.671617 10070 raft_consensus.cc:1275] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:31.673417 10070 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:05:31.685714  9448 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:05:31.689355 16235 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:05:31.665207 16337 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:05:31.691787  9271 catalog_manager.cc:5697] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index 13 to 14, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:31.697134  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a868ddd7e47e2bf15bb4c000634d0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:31.698402 16390 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:31.697162 16387 consensus_queue.cc:1048] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:05:31.725207 16235 raft_consensus.cc:2955] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Committing config change with OpId 17.16: config changed from index 15 to 16, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:31.721607  9273 catalog_manager.cc:5697] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New cstate: current_term: 15 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:31.721961  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:31.710119  9452 raft_consensus.cc:2955] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:31.749469  9449 raft_consensus.cc:1275] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:05:31.785851 16387 raft_consensus.cc:2955] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Committing config change with OpId 16.15: config changed from index 14 to 15, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:31.792354 10064 raft_consensus.cc:2955] T 5b1affc9131446038db1c8ad10108ab0 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Committing config change with OpId 16.15: config changed from index 14 to 15, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:31.804148  9448 raft_consensus.cc:2955] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Committing config change with OpId 17.16: config changed from index 15 to 16, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:31.810154  9490 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:31.815295 10069 raft_consensus.cc:2955] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Committing config change with OpId 17.16: config changed from index 15 to 16, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:31.821210  9490 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:31.828303 16396 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:31.862984 16394 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:31.862854 16396 consensus_queue.cc:1048] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:31.887032  9520 raft_consensus.cc:2955] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Committing config change with OpId 17.16: config changed from index 15 to 16, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:31.904490  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5b1affc9131446038db1c8ad10108ab0 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:05:31.941742 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 100093us
I20260709 13:05:32.022943 16366 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:05:32.023692 16366 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } attrs { replace: true } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:32.032543  9452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:32.058310 16366 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:32.059764 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:05:32.061838  9342 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:32.063964 16369 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:32.101531  9448 raft_consensus.cc:2955] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Committing config change with OpId 16.15: config changed from index 14 to 15, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:32.104290  9359 tablet_service.cc:1558] Processing DeleteTablet for tablet 897f815762f54948b7f3aea4ee0c84f0 with delete_type TABLET_DATA_TOMBSTONED (TS 925acbe78db14db3b9e4cfc857717947 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:52546
I20260709 13:05:32.119176  9452 consensus_queue.cc:237] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:05:32.121722  9262 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 5b1affc9131446038db1c8ad10108ab0 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER failed with leader 6d50f1c263264b21919230bee398022b (127.8.4.67:35929) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 14 but the committed config has opid_index of 15
I20260709 13:05:32.129331 10064 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:05:32.130617  9373 raft_consensus.cc:1275] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:05:32.131167 16328 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:32.132973 16324 consensus_queue.cc:1048] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:32.141425 16267 raft_consensus.cc:2955] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index 14 to 15, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:32.116811  9271 catalog_manager.cc:5697] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 reported cstate change: config changed from index 15 to 16, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:32.144196  9373 raft_consensus.cc:2955] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:32.172777 10064 raft_consensus.cc:2955] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:32.178575  9260 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 605e9c36ec724a60ac9a7846d6491c9f with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:32.199249  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:32.244467  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897f815762f54948b7f3aea4ee0c84f0" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:05:32.253629  9373 consensus_queue.cc:237] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:32.260902  9272 catalog_manager.cc:5697] T 5b1affc9131446038db1c8ad10108ab0 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 14 to 15, VOTER 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) evicted. New cstate: current_term: 16 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:32.263447 10069 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 17 index: 17. (index mismatch)
I20260709 13:05:32.266506 16343 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:05:32.274601 16369 raft_consensus.cc:2955] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Committing config change with OpId 17.17: config changed from index 16 to 17, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:32.279606 10060 raft_consensus.cc:2955] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Committing config change with OpId 17.17: config changed from index 16 to 17, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:05:32.305474  9260 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 605e9c36ec724a60ac9a7846d6491c9f with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER failed with leader d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 14 but the committed config has opid_index of 15
I20260709 13:05:32.312927  9273 catalog_manager.cc:5697] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index 14 to 15, VOTER 6d50f1c263264b21919230bee398022b (127.8.4.67) evicted. New cstate: current_term: 21 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:32.325906 16412 tablet_replica.cc:333] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:32.337894  9359 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b1affc9131446038db1c8ad10108ab0 with delete_type TABLET_DATA_TOMBSTONED (TS 925acbe78db14db3b9e4cfc857717947 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:52546
I20260709 13:05:32.343950 16412 raft_consensus.cc:2243] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:32.344976 16412 raft_consensus.cc:2272] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:32.353363 16412 ts_tablet_manager.cc:1916] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:32.356233  9262 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0e30c155cba64357ae275b3366772777 with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:32.358561  9517 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer 925acbe78db14db3b9e4cfc857717947: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 17 index: 17. (index mismatch)
W20260709 13:05:32.359786  9473 debug-util.cc:398] Leaking SignalData structure 0x7b08003aa700 after lost signal to thread 8212
W20260709 13:05:32.360934  9473 debug-util.cc:398] Leaking SignalData structure 0x7b08001e4300 after lost signal to thread 9309
W20260709 13:05:32.362248  9473 debug-util.cc:398] Leaking SignalData structure 0x7b08003a5ea0 after lost signal to thread 9401
W20260709 13:05:32.363364  9473 debug-util.cc:398] Leaking SignalData structure 0x7b08000c9240 after lost signal to thread 9476
I20260709 13:05:32.364406  9508 tablet_service.cc:1558] Processing DeleteTablet for tablet 605e9c36ec724a60ac9a7846d6491c9f with delete_type TABLET_DATA_TOMBSTONED (TS 6d50f1c263264b21919230bee398022b not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:54524
W20260709 13:05:32.366156  9473 debug-util.cc:398] Leaking SignalData structure 0x7b08002c2c80 after lost signal to thread 9550
W20260709 13:05:32.367251  9473 debug-util.cc:398] Leaking SignalData structure 0x7b08003ab4c0 after lost signal to thread 10094
I20260709 13:05:32.377481 16366 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:05:32.376796  9271 catalog_manager.cc:5697] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 reported cstate change: config changed from index 16 to 17, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New cstate: current_term: 17 leader_uuid: "925acbe78db14db3b9e4cfc857717947" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:32.398110 16413 tablet_replica.cc:333] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:32.403734  9435 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e30c155cba64357ae275b3366772777 with delete_type TABLET_DATA_TOMBSTONED (TS d62c9d5a052b42ce8675f8438f846526 not found in new config with opid_index 17) from {username='slave'} at 127.0.0.1:51006
I20260709 13:05:32.416716 16413 raft_consensus.cc:2243] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:32.423499  9526 raft_consensus.cc:2955] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Committing config change with OpId 17.17: config changed from index 16 to 17, VOTER d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:32.426719 16413 raft_consensus.cc:2272] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:32.454972  9525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308"
dest_uuid: "6d50f1c263264b21919230bee398022b"
mode: GRACEFUL
new_leader_uuid: "b0812463215649c3b011d36e2f0400c9"
 from {username='slave'} at 127.0.0.1:46908
I20260709 13:05:32.455725  9525 raft_consensus.cc:606] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Received request to transfer leadership to TS b0812463215649c3b011d36e2f0400c9
I20260709 13:05:32.459129  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:05:32.460915  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:32.471503 16413 ts_tablet_manager.cc:1916] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:32.489152 16414 tablet_replica.cc:333] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:32.490285 16414 raft_consensus.cc:2243] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:32.491027 16414 raft_consensus.cc:2272] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:32.513188 16412 ts_tablet_manager.cc:1929] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 13:05:32.513708 16412 log.cc:1199] T 897f815762f54948b7f3aea4ee0c84f0 P 925acbe78db14db3b9e4cfc857717947: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-0-root/wals/897f815762f54948b7f3aea4ee0c84f0
I20260709 13:05:32.531163  9262 catalog_manager.cc:5028] TS 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): tablet 897f815762f54948b7f3aea4ee0c84f0 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:05:32.534063 16414 ts_tablet_manager.cc:1916] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:32.535581 16385 raft_consensus.cc:993] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b: : Instructing follower b0812463215649c3b011d36e2f0400c9 to start an election
I20260709 13:05:32.536130 16385 raft_consensus.cc:1081] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Signalling peer b0812463215649c3b011d36e2f0400c9 to start an election
I20260709 13:05:32.545509 16412 tablet_replica.cc:333] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:32.546617 16412 raft_consensus.cc:2243] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:32.553618 10060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308"
dest_uuid: "b0812463215649c3b011d36e2f0400c9"
 from {username='slave'} at 127.0.0.1:45690
I20260709 13:05:32.554373 10060 raft_consensus.cc:493] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:32.554790 10060 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:32.551705 16412 raft_consensus.cc:2272] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:32.572508 16412 ts_tablet_manager.cc:1916] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:32.577106 10060 raft_consensus.cc:515] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:32.593317 10060 leader_election.cc:290] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 21 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:32.596159  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:05:32.596812  9443 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:32.602450  9526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522dd78118a14f5783e99d5dc43c9308" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:05:32.603168  9526 raft_consensus.cc:3055] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:32.603579  9526 raft_consensus.cc:740] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:05:32.604470  9526 consensus_queue.cc:260] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:32.606119  9526 raft_consensus.cc:3060] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:32.611720  9443 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 21.
I20260709 13:05:32.618415 10025 leader_election.cc:304] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:05:32.619885 16305 raft_consensus.cc:2804] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:32.620398 16305 raft_consensus.cc:697] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 [term 21 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:05:32.621335 16305 consensus_queue.cc:237] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:32.662907  9526 raft_consensus.cc:2468] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 21.
I20260709 13:05:32.689977  9271 catalog_manager.cc:5697] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 20 to 21, leader changed from 6d50f1c263264b21919230bee398022b (127.8.4.67) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 21 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:32.709043 16413 ts_tablet_manager.cc:1929] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.14
I20260709 13:05:32.710829 16413 log.cc:1199] T 605e9c36ec724a60ac9a7846d6491c9f P 6d50f1c263264b21919230bee398022b: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-2-root/wals/605e9c36ec724a60ac9a7846d6491c9f
I20260709 13:05:32.715000  9262 catalog_manager.cc:5028] TS 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): tablet 605e9c36ec724a60ac9a7846d6491c9f (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:05:32.720458 16414 ts_tablet_manager.cc:1929] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.16
I20260709 13:05:32.733258 16414 log.cc:1199] T 0e30c155cba64357ae275b3366772777 P d62c9d5a052b42ce8675f8438f846526: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-1-root/wals/0e30c155cba64357ae275b3366772777
I20260709 13:05:32.738721  9260 catalog_manager.cc:5028] TS d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): tablet 0e30c155cba64357ae275b3366772777 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:05:32.753661 16412 ts_tablet_manager.cc:1929] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.14
I20260709 13:05:32.768978 16412 log.cc:1199] T 5b1affc9131446038db1c8ad10108ab0 P 925acbe78db14db3b9e4cfc857717947: Deleting WAL directory at /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602095438975-8209-0/minicluster-data/ts-0-root/wals/5b1affc9131446038db1c8ad10108ab0
I20260709 13:05:32.772326  9262 catalog_manager.cc:5028] TS 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): tablet 5b1affc9131446038db1c8ad10108ab0 (table test-workload [id=ad24b7a1dd5d49feb1f11a697af3157b]) successfully deleted
I20260709 13:05:33.085194  9525 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:05:33.090444 16404 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:05:33.237625 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 83518.4us
I20260709 13:05:33.259960  9443 raft_consensus.cc:1275] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 21 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:05:33.289429 16422 consensus_queue.cc:1048] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:05:33.462577  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:33.697377  8209 tablet_server.cc:179] TabletServer@127.8.4.65:0 shutting down...
W20260709 13:05:33.710075 10027 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:05:33.727090 10027 consensus_peers.cc:597] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:33.735713  9418 consensus_peers.cc:597] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:33.738147 10027 consensus_peers.cc:597] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:33.802825  9323 auto_rebalancer.cc:629] Failed to schedule move for tablet 7f7d9e2ac04d41d69afab7dd1be321e2: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:05:33.803447  9492 consensus_peers.cc:597] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:33.807776  9492 consensus_peers.cc:597] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:33.828166  9492 consensus_peers.cc:597] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:33.885185  9448 consensus_queue.cc:237] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } }
W20260709 13:05:33.885691 10027 consensus_peers.cc:597] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:33.886529  9418 consensus_peers.cc:597] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:33.887167  9418 consensus_peers.cc:597] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:33.887693  9418 consensus_peers.cc:597] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:33.888161  9418 consensus_peers.cc:597] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:33.910162  9418 consensus_peers.cc:597] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:33.931056 10064 raft_consensus.cc:3060] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9 [term 10 LEARNER]: Advancing to term 15
I20260709 13:05:33.943724 10064 raft_consensus.cc:1275] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9 [term 15 LEARNER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:33.945989 16328 consensus_queue.cc:1048] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:33.947053 16328 consensus_queue.cc:1243] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Peer b0812463215649c3b011d36e2f0400c9 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:05:33.949262  9526 raft_consensus.cc:1275] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:33.951200 16416 consensus_queue.cc:1048] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:33.955457 10064 pending_rounds.cc:85] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9: Aborting all ops after (but not including) 5
I20260709 13:05:33.961148 10064 pending_rounds.cc:107] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 9.6
I20260709 13:05:33.961563 10064 raft_consensus.cc:2917] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9 [term 15 LEARNER]: Aborting config change with OpId 9.6: Aborted: Op aborted by new leader
I20260709 13:05:33.963395 10064 raft_consensus.cc:2889] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9 [term 15 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:33.972395 10027 consensus_peers.cc:597] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:33.973712  9418 consensus_peers.cc:597] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:34.000849 10027 consensus_peers.cc:597] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:34.005560  9492 consensus_peers.cc:597] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:34.012629  9418 consensus_peers.cc:597] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:34.051251  9492 consensus_peers.cc:597] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:34.065233  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:34.066690  8209 tablet_replica.cc:333] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.060986 16416 raft_consensus.cc:2955] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
I20260709 13:05:34.067689  8209 raft_consensus.cc:2243] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:05:34.081806  8209 raft_consensus.cc:2272] T 10c8ef1923f34ce1befc8604db656137 P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.084693  8209 tablet_replica.cc:333] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.085579  8209 raft_consensus.cc:2243] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:34.089951  9418 consensus_peers.cc:597] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:34.090737  9526 raft_consensus.cc:2955] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
W20260709 13:05:34.096321  9492 consensus_peers.cc:597] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:34.097848  8209 raft_consensus.cc:2272] T f322b7281d554c459bb8109ed249047b P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:34.099511  9418 consensus_peers.cc:597] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:34.119623  8209 tablet_replica.cc:333] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
W20260709 13:05:34.139446  9492 consensus_peers.cc:597] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:34.152325  8209 raft_consensus.cc:2243] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:34.144352  9492 consensus_peers.cc:597] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:34.167167  8209 raft_consensus.cc:2272] T b5154ade768f425fa43369d9709e66a4 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:34.193814  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 51429.7us
I20260709 13:05:34.193372 10064 raft_consensus.cc:2955] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9 [term 15 LEARNER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } } }
W20260709 13:05:34.196763 10027 consensus_peers.cc:597] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:34.204473  9418 consensus_peers.cc:597] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:34.199236  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 77916.9us
W20260709 13:05:34.206312  9418 consensus_peers.cc:597] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:34.244043  8209 tablet_replica.cc:333] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.255636  8209 raft_consensus.cc:2243] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.285424  8209 raft_consensus.cc:2272] T 7a4d4b66d6394ace8bb74d9778cbd542 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.314355  9272 catalog_manager.cc:5697] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 reported cstate change: config changed from index -1 to 10, NON_VOTER b0812463215649c3b011d36e2f0400c9 (127.8.4.68) added. New cstate: current_term: 15 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: NON_VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.342191 16433 raft_consensus.cc:1064] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526: attempting to promote NON_VOTER b0812463215649c3b011d36e2f0400c9 to VOTER
W20260709 13:05:34.342525  9492 consensus_peers.cc:597] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:34.343578  9492 consensus_peers.cc:597] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:34.347736 16433 consensus_queue.cc:237] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:34.362259  8209 tablet_replica.cc:333] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.363364  8209 raft_consensus.cc:2243] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.370831  8209 raft_consensus.cc:2272] T 605e9c36ec724a60ac9a7846d6491c9f P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.374001  8209 tablet_replica.cc:333] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.375231  9525 raft_consensus.cc:1275] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:05:34.380522 16433 consensus_queue.cc:1048] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:05:34.389286 10027 consensus_peers.cc:597] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:34.392964  9417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 90845.3us
I20260709 13:05:34.393751  8209 raft_consensus.cc:2243] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.396049 10069 raft_consensus.cc:1275] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9 [term 15 LEARNER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:05:34.398093  8209 raft_consensus.cc:2272] T f70a11c5ae574b43ab50a91cfb6e293c P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:34.400925  9341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 163937us
I20260709 13:05:34.405114  8209 tablet_replica.cc:333] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.407119  8209 raft_consensus.cc:2243] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.408015  8209 raft_consensus.cc:2272] T 1e9721df2c264fa2bc26de02ce5bbe1a P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.408262 16433 consensus_queue.cc:1048] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:34.411520  8209 tablet_replica.cc:333] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.413775  8209 raft_consensus.cc:2243] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.423243 16433 raft_consensus.cc:2955] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:34.426903  8209 raft_consensus.cc:2272] T 9c4c96d6eb2446529db451af4486b758 P 925acbe78db14db3b9e4cfc857717947 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.440166 10060 raft_consensus.cc:2955] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
W20260709 13:05:34.445600  9418 consensus_peers.cc:597] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:34.447619  9418 consensus_peers.cc:597] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:34.449955  9418 consensus_peers.cc:597] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:34.457567  8209 tablet_replica.cc:333] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.458781  8209 raft_consensus.cc:2243] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.459614  8209 raft_consensus.cc:2272] T d4df305315b74f329792b6a1f9a5e4db P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.479374  8209 tablet_replica.cc:333] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.480398  8209 raft_consensus.cc:2243] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.482175  8209 raft_consensus.cc:2272] T d7a866663507456b9442af6c42748c5f P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.490935  9525 raft_consensus.cc:2955] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:34.509518  8209 tablet_replica.cc:333] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.517544  8209 raft_consensus.cc:2243] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:05:34.525563  8209 raft_consensus.cc:2272] T c70c7dbdc8034cefbfa29154c4082cc7 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.548493  8209 tablet_replica.cc:333] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.549495  8209 raft_consensus.cc:2243] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.550382  8209 raft_consensus.cc:2272] T aada562be2484a8fb8aac8e7f9348043 P 925acbe78db14db3b9e4cfc857717947 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.553426  8209 tablet_replica.cc:333] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.554462  8209 raft_consensus.cc:2243] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.555375  8209 raft_consensus.cc:2272] T 99c4416401f2427a9f7e68b64ec6915e P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.570011  8209 tablet_replica.cc:333] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.571552  8209 raft_consensus.cc:2243] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:05:34.573181  8209 raft_consensus.cc:2272] T dc4ed6b5107b44b2bf1844daec23e8dd P 925acbe78db14db3b9e4cfc857717947 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.555847  9271 catalog_manager.cc:5697] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b reported cstate change: config changed from index 10 to 11, b0812463215649c3b011d36e2f0400c9 (127.8.4.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } } }
I20260709 13:05:34.576205  8209 tablet_replica.cc:333] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.578025  8209 raft_consensus.cc:2243] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:05:34.579545  8209 raft_consensus.cc:2272] T 807906edc34d41589d9b860b72f70e16 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.592401  8209 tablet_replica.cc:333] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.593513  8209 raft_consensus.cc:2243] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.597095  8209 raft_consensus.cc:2272] T 09bfbc64d6af4fe0893109a7008e9b5d P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.602986  8209 tablet_replica.cc:333] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.607972  8209 raft_consensus.cc:2243] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.621708  8209 raft_consensus.cc:2272] T 7260766fbe5c43b1aab09346a89d9ac6 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.625916  8209 tablet_replica.cc:333] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.633690  8209 raft_consensus.cc:2243] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.634419  8209 raft_consensus.cc:2272] T 7f6a0746767b404997bb10c4d3ecd42c P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.639145  8209 tablet_replica.cc:333] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.640205  8209 raft_consensus.cc:2243] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:05:34.641305  8209 raft_consensus.cc:2272] T 0e30c155cba64357ae275b3366772777 P 925acbe78db14db3b9e4cfc857717947 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.653635  8209 tablet_replica.cc:333] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.654621  8209 raft_consensus.cc:2243] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.655375  8209 raft_consensus.cc:2272] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.658903  8209 tablet_replica.cc:333] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.659756  8209 raft_consensus.cc:2243] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.661305  8209 raft_consensus.cc:2272] T b77c45e065544a6cb4ff451f91a27cd1 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.675886  8209 tablet_replica.cc:333] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.677021  8209 raft_consensus.cc:2243] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.677637  8209 raft_consensus.cc:2272] T f7b2e1b1ef6540b1915f1dda8f95e81b P 925acbe78db14db3b9e4cfc857717947 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.680496  8209 tablet_replica.cc:333] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.698323  8209 raft_consensus.cc:2243] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.699126  8209 raft_consensus.cc:2272] T 7201bcdf8f724879b727639e6e67e31e P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.710239  8209 tablet_replica.cc:333] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.731077  8209 raft_consensus.cc:2243] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:05:34.732340  8209 raft_consensus.cc:2272] T 23a88c5000a045dbb65387d4da0a378c P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.746737  8209 tablet_replica.cc:333] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.749066  8209 raft_consensus.cc:2243] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.754887  8209 raft_consensus.cc:2272] T 060ae09cf899421ea6057ee5eca95814 P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.757647  8209 tablet_replica.cc:333] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.762380  8209 raft_consensus.cc:2243] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:05:34.763474  8209 raft_consensus.cc:2272] T 58a6a34a419649a4829c651a0402a5fa P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.774602  8209 tablet_replica.cc:333] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.775488  8209 raft_consensus.cc:2243] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.776229  8209 raft_consensus.cc:2272] T 45a4f94c156249adab9c2b1ffb00ac46 P 925acbe78db14db3b9e4cfc857717947 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.780846  8209 tablet_replica.cc:333] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.782418  8209 raft_consensus.cc:2243] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.791816 16449 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:34.792476 16449 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:34.794945 16449 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:34.796028  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:34.798729 10060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084579f9b3b648f0bff0a7e9cdc1669b" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:05:34.800614  9342 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:34.804657  8209 raft_consensus.cc:2272] T 9e3280937dd84fa789b7a8c362985847 P 925acbe78db14db3b9e4cfc857717947 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.804374 16449 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:34.809319  8209 tablet_replica.cc:333] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.813915  8209 raft_consensus.cc:2243] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:05:34.815162  8209 raft_consensus.cc:2272] T 2d995bd1db654f5db92b8452f148c18a P 925acbe78db14db3b9e4cfc857717947 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.823701  8209 tablet_replica.cc:333] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.824802  8209 raft_consensus.cc:2243] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.825613  8209 raft_consensus.cc:2272] T 084579f9b3b648f0bff0a7e9cdc1669b P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.853313 16451 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:34.854131 16451 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:34.858724 16451 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:34.858913  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:05:34.860841  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "001ad880018f49e5bec36246253efa0f" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:34.862581  9341 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:34.863415 16451 raft_consensus.cc:2749] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:34.869421  8209 tablet_replica.cc:333] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.870559  8209 raft_consensus.cc:2243] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:05:34.871840  8209 raft_consensus.cc:2272] T 82949cde879a425f9973e01e26ea0b69 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.874625  8209 tablet_replica.cc:333] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.875555  8209 raft_consensus.cc:2243] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:05:34.882974  8209 raft_consensus.cc:2272] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.886780 16451 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:05:34.887446 16451 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:34.889979  8209 tablet_replica.cc:333] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.891434  8209 raft_consensus.cc:2243] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.893489  8209 raft_consensus.cc:2272] T 7f8897d3859c4aa692a409afb3f57944 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.896765  8209 tablet_replica.cc:333] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.977607  8209 raft_consensus.cc:2243] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.983387  8209 raft_consensus.cc:2272] T d55d9be5c0db4ab3a575698dea3014ba P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.988651  8209 tablet_replica.cc:333] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:34.990273  8209 raft_consensus.cc:2243] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:34.900565  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:05:34.897471 10060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf31f504f540dc957e0b558c940f79" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:05:34.995775  8209 raft_consensus.cc:2272] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:34.911386 16449 raft_consensus.cc:493] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:05:35.002068 16449 raft_consensus.cc:515] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:34.899116 16451 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:35.044317  9342 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:05:35.060513 16449 leader_election.cc:290] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d50f1c263264b21919230bee398022b (127.8.4.67:35929), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:05:35.110769  9342 raft_consensus.cc:2686] T ffaf31f504f540dc957e0b558c940f79 P 925acbe78db14db3b9e4cfc857717947: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:05:35.134388  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:05:35.182238  9342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 171252us
I20260709 13:05:35.191818 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a0d9dc457d47bc801e795a2a573601" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:05:35.193224  8209 tablet_replica.cc:333] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:35.198516  8209 raft_consensus.cc:2243] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:05:35.227319  8209 raft_consensus.cc:2272] T a8c41deeda674b9b8d27e72d70e96e79 P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:35.229681  9342 leader_election.cc:304] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9
I20260709 13:05:35.247577 16449 raft_consensus.cc:2749] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:35.347442  8209 tablet_replica.cc:333] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:35.351631  8209 raft_consensus.cc:2243] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:35.383067 16437 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:35.384232 16437 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:35.389180 16451 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:35.390064 16451 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:35.393435 16440 raft_consensus.cc:493] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:05:35.394347 16440 raft_consensus.cc:515] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:35.397657 16440 leader_election.cc:290] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:35.399997 16440 raft_consensus.cc:493] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0812463215649c3b011d36e2f0400c9)
I20260709 13:05:35.403082 16440 raft_consensus.cc:515] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:35.405911  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:35.407456  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:35.414054 16451 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:35.402362  8209 raft_consensus.cc:2272] T f6a0d9dc457d47bc801e795a2a573601 P 925acbe78db14db3b9e4cfc857717947 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:35.422577 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f1f59b3d149e09a5d394c216144b9" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:05:35.423350 10060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad4133883414768941dffb952ca7caf" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
W20260709 13:05:35.452400  9492 leader_election.cc:336] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:35.425922 16437 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:35.472651  9341 leader_election.cc:304] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
W20260709 13:05:35.473161  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 189977us
I20260709 13:05:35.474311  9341 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:35.473802  8209 tablet_replica.cc:333] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:35.476322 16449 raft_consensus.cc:2749] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:35.478092  8209 raft_consensus.cc:2243] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:05:35.493336  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:35.494321  9448 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 9.
I20260709 13:05:35.494517 16467 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:35.498965 10060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:05:35.505347 16440 leader_election.cc:290] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:35.522210  9490 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:35.523455 16459 raft_consensus.cc:2804] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:35.523895 16459 raft_consensus.cc:493] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:35.524250 16459 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:35.532052  8209 raft_consensus.cc:2272] T 31f9d5965eae4c788eb6a40e856cadc7 P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:35.543301  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a227bc15c0427bbed0fbbe37f826f1" candidate_uuid: "925acbe78db14db3b9e4cfc857717947" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:35.545559  8209 tablet_replica.cc:333] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
W20260709 13:05:35.546093 10025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 76886.6us
I20260709 13:05:35.548405  9341 leader_election.cc:304] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 925acbe78db14db3b9e4cfc857717947; no voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:35.554584 16451 raft_consensus.cc:2749] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:35.555513  8209 raft_consensus.cc:2243] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:05:35.566184  8209 raft_consensus.cc:2272] T a326e6d2c4664dbe9374e92fa4c42c93 P 925acbe78db14db3b9e4cfc857717947 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:35.553257 16459 raft_consensus.cc:515] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:05:35.583607  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 57982.4us
I20260709 13:05:35.586251  8209 tablet_replica.cc:333] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:35.613231  8209 raft_consensus.cc:2243] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:35.615188  8209 raft_consensus.cc:2272] T 001ad880018f49e5bec36246253efa0f P 925acbe78db14db3b9e4cfc857717947 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:35.619185  8209 tablet_replica.cc:333] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
W20260709 13:05:35.628671  9492 leader_election.cc:336] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:35.638808 16459 leader_election.cc:290] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:35.640344  8209 raft_consensus.cc:2243] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:05:35.642176  8209 raft_consensus.cc:2272] T aad3a86fe3f14e62819801e837794bfb P 925acbe78db14db3b9e4cfc857717947 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:35.645696  8209 tablet_replica.cc:333] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:35.660399  8209 raft_consensus.cc:2243] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:05:35.662536  8209 raft_consensus.cc:2272] T 36e88678fcd042e78609b17fe3521242 P 925acbe78db14db3b9e4cfc857717947 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:35.666584  8209 tablet_replica.cc:333] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:35.667492  8209 raft_consensus.cc:2243] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:35.668373  8209 raft_consensus.cc:2272] T 6e8f1f59b3d149e09a5d394c216144b9 P 925acbe78db14db3b9e4cfc857717947 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:35.688145  8209 tablet_replica.cc:333] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:35.689121  8209 raft_consensus.cc:2243] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:35.689913  8209 raft_consensus.cc:2272] T 3ad4133883414768941dffb952ca7caf P 925acbe78db14db3b9e4cfc857717947 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:35.694527  8209 tablet_replica.cc:333] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947: stopping tablet replica
I20260709 13:05:35.710614  8209 raft_consensus.cc:2243] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:35.714342  8209 raft_consensus.cc:2272] T b5a227bc15c0427bbed0fbbe37f826f1 P 925acbe78db14db3b9e4cfc857717947 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:35.754455  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c8ef1923f34ce1befc8604db656137" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:05:35.755127  9448 raft_consensus.cc:3060] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:35.769948  9448 raft_consensus.cc:2468] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 10.
I20260709 13:05:35.801842  9490 leader_election.cc:304] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:35.803362 16441 raft_consensus.cc:2804] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:35.804035 16441 raft_consensus.cc:697] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:05:35.806335 16441 consensus_queue.cc:237] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:35.813663 16459 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:35.814374 16459 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:05:35.821813  9492 leader_election.cc:336] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:35.822932 16456 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:35.816776 16459 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:35.823657 16456 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:35.826014 16456 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:35.826771  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:05:35.833040  9492 leader_election.cc:336] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:35.833148  9490 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:35.834641 16437 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:35.837177  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:35.841147 16471 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:35.847888 16459 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:35.842250 16471 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:35.863332  9490 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:35.864475 16456 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:35.866487 10027 leader_election.cc:336] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:35.849993 16459 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:35.872493 16459 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:35.876340 16471 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:05:35.877697  9492 leader_election.cc:336] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:35.877966  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 17 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:05:35.879875 10027 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:35.881060 16471 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:35.895442  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:35.897333 16468 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:35.899030 16468 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:35.908704  9490 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:35.909996 16456 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:35.911258 16446 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:35.911965 16446 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:35.914394 16446 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:35.917089 16456 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:35.917868 16456 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:35.918573 16446 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:35.920360 16458 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:35.922135 16468 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:35.922415 16458 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:05:35.924407  9492 leader_election.cc:336] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:35.924955 16458 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:35.926067 16446 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:35.927119 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 16 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:05:35.927656 16456 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:35.927976  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 16 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:05:35.930620 10064 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:05:35.931320  9521 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 15.
I20260709 13:05:35.929598  9271 catalog_manager.cc:5697] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 9 to 10, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 10 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:35.931864  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:05:35.933941 10027 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:05:35.933346  9491 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947
W20260709 13:05:35.938714 10027 leader_election.cc:336] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:05:35.941408 16473 log.cc:927] Time spent T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:05:35.941514  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:05:35.942422  9524 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 24.
I20260709 13:05:35.943842 16446 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:35.946980  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:05:35.938241 16471 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:35.946661 16441 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:35.951473 16441 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:35.951843 16441 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:35.950192 16471 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:35.958467 16471 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:35.948559  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:05:35.965276 16459 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:35.967866 16459 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:35.968184 16463 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:05:35.970851  9418 leader_election.cc:336] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:35.975149  9418 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:35.968739 16463 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:05:35.977712  9418 leader_election.cc:336] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:35.977815 16463 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:35.981204 16468 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:35.981915 16459 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:35.982029 16456 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:35.982767 16456 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:35.985394 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 17 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:05:35.986151 10064 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 17.
I20260709 13:05:35.981943 16468 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:35.988891  9491 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:05:35.989693 16468 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:05:35.994416  9492 leader_election.cc:336] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:35.997926 16456 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:35.998700 16456 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:36.003901  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:05:36.008105  9492 leader_election.cc:336] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:35.971949 16441 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:35.985453 16446 raft_consensus.cc:2749] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:35.999931 16456 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.018921  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:36.022535 16471 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:05:36.029937  9492 leader_election.cc:336] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:36.030685  9443 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
I20260709 13:05:36.034337 16471 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 16 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:36.018483 16456 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:36.037194 16441 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:36.041909  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 16 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:05:36.043416  9524 raft_consensus.cc:2393] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b0812463215649c3b011d36e2f0400c9 in current term 16: Already voted for candidate 6d50f1c263264b21919230bee398022b in this term.
W20260709 13:05:36.045476  9418 leader_election.cc:336] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:36.046046  9418 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:36.047024 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 16 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:05:36.051218  9490 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
W20260709 13:05:36.047188 10027 leader_election.cc:336] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:36.055811 10069 raft_consensus.cc:2393] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d50f1c263264b21919230bee398022b in current term 16: Already voted for candidate b0812463215649c3b011d36e2f0400c9 in this term.
I20260709 13:05:36.056286 10027 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:36.056517 16437 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:36.059808 16463 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:36.060238 16471 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:36.060340 16437 raft_consensus.cc:493] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.060870 16437 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:36.062518 16463 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 25 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:05:36.068291  9418 leader_election.cc:336] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:36.070468  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4ed6b5107b44b2bf1844daec23e8dd" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:05:36.071271  9524 raft_consensus.cc:3060] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:36.073976  9491 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, b0812463215649c3b011d36e2f0400c9
I20260709 13:05:36.080298 16441 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:36.081934  9524 raft_consensus.cc:2468] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 25.
I20260709 13:05:36.083791  9418 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:36.085210 16477 raft_consensus.cc:2804] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:05:36.058852 16475 raft_consensus.cc:2749] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:36.085865 16468 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.086407 16477 raft_consensus.cc:697] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 25 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:05:36.086627 16468 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:36.087728 16477 consensus_queue.cc:237] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:36.091248 16468 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:36.093209 10027 leader_election.cc:336] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:36.093657 10027 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:36.094291 16445 raft_consensus.cc:2749] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:36.095351  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:36.100761 16476 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.101533 16476 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:05:36.104784  9492 consensus_peers.cc:597] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:36.100700 10027 leader_election.cc:336] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:36.108738 10027 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:36.111346 16445 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:36.116252 16437 raft_consensus.cc:515] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:36.108238 16456 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:36.123274 16456 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:05:36.127696  9492 leader_election.cc:336] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:36.145229 16456 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.146727 16476 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:36.146196 16456 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:36.152598 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e30c155cba64357ae275b3366772777" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 17 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:05:36.153306 10069 raft_consensus.cc:3060] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:36.154657 16441 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.155527 16441 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:36.157640 16437 leader_election.cc:290] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:36.159868 16441 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:36.161796  9492 leader_election.cc:336] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:36.163334  9273 catalog_manager.cc:5697] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 24 to 25, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 25 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:36.165455  9418 leader_election.cc:336] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:05:36.166064  9492 leader_election.cc:336] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:36.174302  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:05:36.175089  9521 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
W20260709 13:05:36.180586  9492 leader_election.cc:336] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:36.180920 10069 raft_consensus.cc:2468] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 18.
I20260709 13:05:36.182029  9418 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:36.183522 16458 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:36.184000 16458 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.184427 16458 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:36.188401  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c70c7dbdc8034cefbfa29154c4082cc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:05:36.188417  9448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:36.189666  9448 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:05:36.190115  9491 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:36.190438  9443 raft_consensus.cc:3060] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:36.194007  9490 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:36.196375 16441 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:36.196866 16441 raft_consensus.cc:493] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.197300 16441 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:36.200177  9492 consensus_peers.cc:597] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:36.200958  9492 consensus_peers.cc:597] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:36.201432 16470 raft_consensus.cc:2804] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:36.202013 16470 raft_consensus.cc:697] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 18 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:05:36.202544  9443 raft_consensus.cc:2468] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 17.
I20260709 13:05:36.203022 16470 consensus_queue.cc:237] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 17.17, Last appended by leader: 17, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:36.207239  9490 leader_election.cc:304] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:36.208770 16441 raft_consensus.cc:515] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:36.209358 16437 raft_consensus.cc:2804] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:36.212340 16437 raft_consensus.cc:697] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 17 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:05:36.213263 16441 leader_election.cc:290] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:36.214632  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7d9e2ac04d41d69afab7dd1be321e2" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:05:36.214433 16437 consensus_queue.cc:237] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:36.215313  9443 raft_consensus.cc:3060] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:36.220504  9492 leader_election.cc:336] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:36.220520 16456 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:36.237303  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:36.238078  9450 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 18.
I20260709 13:05:36.243106  9490 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:36.245047 16456 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:36.246085 16456 raft_consensus.cc:493] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.246510 16456 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:36.253989  9443 raft_consensus.cc:2468] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:05:36.260123 16456 raft_consensus.cc:515] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:36.262259 16476 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.262966 16476 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:36.263447 16456 leader_election.cc:290] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:36.265820 16476 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:36.262401  9490 leader_election.cc:304] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
W20260709 13:05:36.267175  9492 leader_election.cc:336] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:05:36.271103 10027 consensus_peers.cc:597] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:36.271306  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:05:36.272107  9521 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 15.
I20260709 13:05:36.274901 16437 raft_consensus.cc:2804] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:36.275597 16437 raft_consensus.cc:697] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:05:36.277387  9450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a88c5000a045dbb65387d4da0a378c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:05:36.278031  9450 raft_consensus.cc:3060] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:36.278400  9273 catalog_manager.cc:5697] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 17 to 18, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 18 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:36.282363  9418 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:05:36.283190 16475 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:36.283641 16475 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.284003 16475 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:36.285372  9418 leader_election.cc:336] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:36.276572 16437 consensus_queue.cc:237] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:36.291565 16477 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.292261 16477 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:36.303989 16477 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:05:36.310441  9418 consensus_peers.cc:597] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:36.310593  9450 raft_consensus.cc:2468] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 19.
W20260709 13:05:36.311110  9418 consensus_peers.cc:597] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:36.311583  9418 leader_election.cc:336] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:36.313835 16470 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.314299 10060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:05:36.314468 16470 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:36.314976 10060 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
I20260709 13:05:36.317220  9417 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
W20260709 13:05:36.319480  9492 leader_election.cc:336] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:36.320214 16477 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:36.320657  9490 leader_election.cc:304] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:36.270131 16458 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:36.320619 16477 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.322340 16477 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:36.322793 10060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:05:36.323455 16458 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:36.323797 10060 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
I20260709 13:05:36.325632 16481 raft_consensus.cc:2804] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:36.327621  9491 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:36.326998 16481 raft_consensus.cc:697] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 19 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:05:36.328435 16456 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:36.328959 16456 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.329373 16456 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:36.335398 16477 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:36.335646 16481 consensus_queue.cc:237] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:36.339416 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a6a34a419649a4829c651a0402a5fa" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:05:36.340072 10069 raft_consensus.cc:3060] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:36.352349  9492 consensus_peers.cc:597] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:36.342568 16470 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:36.363845  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82949cde879a425f9973e01e26ea0b69" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:05:36.364516  9521 raft_consensus.cc:3060] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:36.366073  9450 raft_consensus.cc:1275] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:05:36.368316 16475 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:05:36.384094 10027 consensus_peers.cc:597] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:36.384305  9521 raft_consensus.cc:2468] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 17.
W20260709 13:05:36.387346 10027 consensus_peers.cc:597] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:36.381775 16477 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:36.409878 16475 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:36.388854 16441 consensus_queue.cc:1048] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:05:36.416229 10069 raft_consensus.cc:2468] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 17.
I20260709 13:05:36.379271 16456 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:05:36.422139  9492 leader_election.cc:336] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:36.422320  9417 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:05:36.423529 16458 raft_consensus.cc:2804] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:36.426707 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c41deeda674b9b8d27e72d70e96e79" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:05:36.427467 10069 raft_consensus.cc:3060] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:36.434530 16458 raft_consensus.cc:697] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:05:36.435853 16458 consensus_queue.cc:237] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:36.390058  9418 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
W20260709 13:05:36.445178  9418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 55250us
I20260709 13:05:36.434585 16456 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:36.446974 16475 raft_consensus.cc:2804] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:36.447849 16475 raft_consensus.cc:697] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:05:36.448799 16475 consensus_queue.cc:237] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:36.454716  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d995bd1db654f5db92b8452f148c18a" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:05:36.455437  9521 raft_consensus.cc:3060] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:36.463892  9273 catalog_manager.cc:5697] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 14 to 15, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 15 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:36.466452  9273 catalog_manager.cc:5697] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 16 to 17, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 17 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:36.468204  9273 catalog_manager.cc:5697] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 18 to 19, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 19 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:36.474720  9418 consensus_peers.cc:597] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:36.474776  9271 catalog_manager.cc:5697] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 16 to 17, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 17 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:36.475538  9418 leader_election.cc:336] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:05:36.487403  9418 consensus_peers.cc:597] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:36.488909  9521 raft_consensus.cc:2468] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 16.
W20260709 13:05:36.493368  9418 leader_election.cc:336] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:36.495460 10069 raft_consensus.cc:2468] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:05:36.503428  9491 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:36.504354 16481 raft_consensus.cc:2804] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:36.504973 16481 raft_consensus.cc:697] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:05:36.505990 16481 consensus_queue.cc:237] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:05:36.533958 10027 consensus_peers.cc:597] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:36.544766  9492 consensus_peers.cc:597] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:36.549247  9418 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:05:36.552439 16477 raft_consensus.cc:2804] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:36.553283 16477 raft_consensus.cc:697] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:05:36.555753 16477 consensus_queue.cc:237] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:05:36.562505  9418 connection.cc:769] client connection to 127.8.4.65:37547 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:05:36.583982  9418 consensus_peers.cc:597] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:36.590837  9418 leader_election.cc:336] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:05:36.591071  9492 consensus_peers.cc:597] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:36.595562  9492 consensus_peers.cc:597] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:36.587929  9271 catalog_manager.cc:5697] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 13 to 14, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 14 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:36.598564  9273 catalog_manager.cc:5697] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 16 to 17, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 17 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:36.609509  9492 consensus_peers.cc:597] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:36.663659  9443 raft_consensus.cc:1275] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:36.690953  9271 catalog_manager.cc:5697] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 15 to 16, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 16 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:36.722922 16456 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.724457 16456 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:36.726395 16437 consensus_queue.cc:1048] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:36.726698 16468 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.727393 16468 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:36.729602 16468 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:36.726903 16456 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:36.734777  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:05:36.738201  9492 consensus_peers.cc:597] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:36.743563  9492 consensus_peers.cc:597] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:36.744132  9492 leader_election.cc:336] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
W20260709 13:05:36.776566 10027 consensus_peers.cc:597] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:36.777132 10027 leader_election.cc:336] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:36.777513 10027 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:36.779974 16445 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:36.786899  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
W20260709 13:05:36.787213  9492 consensus_peers.cc:597] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:36.795900  9492 consensus_peers.cc:597] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:36.800273 10027 consensus_peers.cc:597] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:36.804471  9521 raft_consensus.cc:1275] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 25 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 13:05:36.816695  9492 consensus_peers.cc:597] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:36.826303 10060 raft_consensus.cc:1275] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 17 index: 17. Preceding OpId from leader: term: 18 index: 18. (index mismatch)
I20260709 13:05:36.828910  9490 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:36.829442 16441 consensus_queue.cc:1048] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:05:36.831058 16441 raft_consensus.cc:2749] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:05:36.837493  9418 consensus_peers.cc:597] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:36.838182  9418 consensus_peers.cc:597] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:36.843729 16475 consensus_queue.cc:1048] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:05:36.845768  9492 consensus_peers.cc:597] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:36.847790  9418 consensus_peers.cc:597] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:36.843858 10027 consensus_peers.cc:597] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:36.856761 16475 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.857435 16475 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:36.862793 16475 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:36.862963 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:05:36.863783 10064 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 18.
W20260709 13:05:36.874375  9418 leader_election.cc:336] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:36.878741 16468 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.879452 16468 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:36.883474 16468 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:36.888250  9417 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:36.889741 16463 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:36.890172 16463 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.890537 16463 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:36.899744  9492 consensus_peers.cc:597] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:36.903527  9418 consensus_peers.cc:597] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:36.916431  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:05:36.919359  9450 raft_consensus.cc:1275] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:05:36.922500  9418 consensus_peers.cc:597] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:36.904036 16463 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:36.924908 16456 consensus_queue.cc:1048] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:36.928805 16477 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.929469 16477 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:36.931641 16477 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:36.934572  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:05:36.937143 16463 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:36.938639 10064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a326e6d2c4664dbe9374e92fa4c42c93" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
W20260709 13:05:36.944247  9418 leader_election.cc:336] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:36.947947  9418 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d62c9d5a052b42ce8675f8438f846526; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:36.949620 16463 raft_consensus.cc:2749] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:36.939225 10064 raft_consensus.cc:3060] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:36.956873  9418 leader_election.cc:336] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:36.960395  9449 raft_consensus.cc:1275] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:05:36.966336 16456 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.966943 16456 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:36.969395 16456 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:36.970472 10069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:05:36.971149 16456 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.971340 10069 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 16.
I20260709 13:05:36.971763 16456 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:36.973604  9491 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:05:36.974550 16481 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:36.974721 16456 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:36.975107 16481 raft_consensus.cc:493] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:05:36.975970  9492 leader_election.cc:336] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:36.975626 16481 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:36.978132  9443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526" is_pre_election: true
I20260709 13:05:36.978806  9443 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 13.
W20260709 13:05:36.979373  9492 leader_election.cc:336] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:36.982089  9490 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:36.983417 16470 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:36.983906 16470 raft_consensus.cc:493] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:36.984385 16470 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:36.999531  9418 consensus_peers.cc:597] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:37.003070  9521 raft_consensus.cc:1275] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:37.009716 10060 raft_consensus.cc:1275] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [term 14 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:05:37.011296 16456 consensus_queue.cc:1048] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:05:37.011615 10027 leader_election.cc:336] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:37.012149 10027 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:37.014809 16470 raft_consensus.cc:515] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:37.019294 16481 raft_consensus.cc:515] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:37.021880 16481 leader_election.cc:290] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:37.025135 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f9d5965eae4c788eb6a40e856cadc7" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:05:37.025965 10061 raft_consensus.cc:3060] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:37.026167 10060 raft_consensus.cc:1275] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:37.027905 16475 consensus_queue.cc:1048] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:05:37.034214  9492 consensus_peers.cc:597] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:37.037114 10061 raft_consensus.cc:2468] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 17.
I20260709 13:05:37.037573 16475 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
I20260709 13:05:37.038265 16475 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:37.040804 16475 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:37.044485  9491 leader_election.cc:304] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:05:37.045542 16456 raft_consensus.cc:2804] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:37.046092 16456 raft_consensus.cc:697] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 17 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:05:37.047034 16456 consensus_queue.cc:237] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:37.054664 16475 consensus_queue.cc:1048] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:37.058352 16470 leader_election.cc:290] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:37.059254 16497 raft_consensus.cc:2749] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:37.065022 16481 consensus_queue.cc:1048] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:37.075982  9521 raft_consensus.cc:1275] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:05:37.077411 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37547, user_credentials={real_user=slave}} blocked reactor thread for 65818.2us
I20260709 13:05:37.081677  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:05:37.082573  9521 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 19.
I20260709 13:05:37.092125 10064 raft_consensus.cc:2468] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 19.
I20260709 13:05:37.094148  9417 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0812463215649c3b011d36e2f0400c9, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
W20260709 13:05:37.097723  9492 leader_election.cc:336] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
W20260709 13:05:37.111853  9492 leader_election.cc:336] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:37.110167  9449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad3a86fe3f14e62819801e837794bfb" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d62c9d5a052b42ce8675f8438f846526"
I20260709 13:05:37.101094 16475 raft_consensus.cc:2804] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:37.135279  9449 raft_consensus.cc:3060] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:37.135447 16475 raft_consensus.cc:697] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 19 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:05:37.136551 16475 consensus_queue.cc:237] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:05:37.138904  9418 consensus_peers.cc:597] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:37.150501 16477 consensus_queue.cc:1048] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:37.154951  9449 raft_consensus.cc:2468] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 14.
I20260709 13:05:37.169474  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 
I20260709 13:05:37.203792  9490 leader_election.cc:304] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:37.159842  9271 catalog_manager.cc:5697] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 16 to 17, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 17 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.213742 16476 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:37.217515 16481 raft_consensus.cc:2804] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:05:37.224599  9418 leader_election.cc:336] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
W20260709 13:05:37.240619  9418 consensus_peers.cc:597] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:37.223822 16476 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 925acbe78db14db3b9e4cfc857717947)
W20260709 13:05:37.256179  9491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:43623, user_credentials={real_user=slave}} blocked reactor thread for 48241.3us
W20260709 13:05:37.262457  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:45279, user_credentials={real_user=slave}} blocked reactor thread for 46832.2us
I20260709 13:05:37.244722 16481 raft_consensus.cc:697] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:05:37.264689 16476 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:37.299474 16481 consensus_queue.cc:237] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:37.318696  9272 catalog_manager.cc:5697] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 18 to 19, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 19 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:37.343442  9418 consensus_peers.cc:597] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:37.344022  9418 consensus_peers.cc:597] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:37.360790  9418 consensus_peers.cc:597] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:37.425625  9418 consensus_peers.cc:597] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:37.429100 16476 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:37.431739 16476 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 20 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:05:37.444099 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35929, user_credentials={real_user=slave}} blocked reactor thread for 62246.2us
I20260709 13:05:37.458544 10069 raft_consensus.cc:1275] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:05:37.461705  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e88678fcd042e78609b17fe3521242" candidate_uuid: "d62c9d5a052b42ce8675f8438f846526" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:05:37.468217 16456 consensus_queue.cc:1048] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:37.474408  9524 raft_consensus.cc:3060] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:37.496315  9524 raft_consensus.cc:2468] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62c9d5a052b42ce8675f8438f846526 in term 20.
W20260709 13:05:37.516901  9418 leader_election.cc:336] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:37.522217  9271 catalog_manager.cc:5697] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 13 to 14, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 14 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:37.535610  9418 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:37.540513 16463 raft_consensus.cc:2804] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:37.541119 16463 raft_consensus.cc:697] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 20 LEADER]: Becoming Leader. State: Replica: d62c9d5a052b42ce8675f8438f846526, State: Running, Role: LEADER
I20260709 13:05:37.542003 16463 consensus_queue.cc:237] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:05:37.560191  9492 consensus_peers.cc:597] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:37.593148  9271 catalog_manager.cc:5697] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 reported cstate change: term changed from 19 to 20, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to d62c9d5a052b42ce8675f8438f846526 (127.8.4.66). New cstate: current_term: 20 leader_uuid: "d62c9d5a052b42ce8675f8438f846526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.603749 10069 raft_consensus.cc:1275] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:05:37.617980 16463 consensus_queue.cc:1048] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:05:37.635106  9418 consensus_peers.cc:597] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:37.762048 16527 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.762629 16527 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:37.768811  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 16 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
I20260709 13:05:37.772871  9524 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 16.
I20260709 13:05:37.778285 10027 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:05:37.785298 16524 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:37.785823 16524 raft_consensus.cc:493] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.786234 16524 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:37.764860 16527 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:05:37.800282 10027 leader_election.cc:336] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:37.842914 16524 raft_consensus.cc:515] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:05:37.855187  9492 consensus_peers.cc:597] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:37.863977 16524 leader_election.cc:290] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 election: Requested vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:05:37.865080 10027 leader_election.cc:336] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:37.866866  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807906edc34d41589d9b860b72f70e16" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 16 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b"
I20260709 13:05:37.867524  9524 raft_consensus.cc:3060] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:37.882105  9449 raft_consensus.cc:1275] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:37.883950 16456 consensus_queue.cc:1048] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:37.893976  9524 raft_consensus.cc:2468] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0812463215649c3b011d36e2f0400c9 in term 17.
I20260709 13:05:37.895571 10027 leader_election.cc:304] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:37.903852 16524 raft_consensus.cc:2804] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:37.904738 16524 raft_consensus.cc:697] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 17 LEADER]: Becoming Leader. State: Replica: b0812463215649c3b011d36e2f0400c9, State: Running, Role: LEADER
I20260709 13:05:37.908912 16524 consensus_queue.cc:237] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 15.16, Last appended by leader: 16, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:37.962321  9271 catalog_manager.cc:5697] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 reported cstate change: term changed from 15 to 17, leader changed from 925acbe78db14db3b9e4cfc857717947 (127.8.4.65) to b0812463215649c3b011d36e2f0400c9 (127.8.4.68). New cstate: current_term: 17 leader_uuid: "b0812463215649c3b011d36e2f0400c9" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:38.031139  9418 consensus_peers.cc:597] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.171393  9520 raft_consensus.cc:1275] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Refusing update from remote peer d62c9d5a052b42ce8675f8438f846526: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:05:38.177421 16463 consensus_queue.cc:1048] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:05:38.380082 10027 consensus_peers.cc:597] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.429773  9524 raft_consensus.cc:1275] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Refusing update from remote peer b0812463215649c3b011d36e2f0400c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 16. Preceding OpId from leader: term: 17 index: 17. (index mismatch)
I20260709 13:05:38.432286 16534 consensus_queue.cc:1048] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:05:38.565254  9492 consensus_peers.cc:597] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:38.617960  9492 consensus_peers.cc:597] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:38.620297  9418 consensus_peers.cc:597] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:38.752453  9418 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111) [suppressed 387 similar messages]
W20260709 13:05:38.795614  9492 consensus_peers.cc:597] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:39.027231  9492 consensus_peers.cc:597] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:39.027920  9492 consensus_peers.cc:597] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:39.028877 10027 consensus_peers.cc:597] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:39.057041  9492 consensus_peers.cc:597] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:39.081748 10027 consensus_peers.cc:597] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:39.082324 10027 consensus_peers.cc:597] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:39.087916  9492 consensus_peers.cc:597] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:39.131495  9492 consensus_peers.cc:597] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:39.147799 10027 consensus_peers.cc:597] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:39.148535 10027 consensus_peers.cc:597] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:39.161640  9418 consensus_peers.cc:597] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:39.165853  9492 consensus_peers.cc:597] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:39.183804  9418 consensus_peers.cc:597] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:39.191514  8209 tablet_server.cc:196] TabletServer@127.8.4.65:0 shutdown complete.
W20260709 13:05:39.197345  9418 consensus_peers.cc:597] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:39.215946  9418 consensus_peers.cc:597] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:39.238744  9418 consensus_peers.cc:597] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:39.256331  9492 consensus_peers.cc:597] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:39.299801  9492 consensus_peers.cc:597] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:39.306511  9418 consensus_peers.cc:597] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:39.333110  9492 consensus_peers.cc:597] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:39.377039  9418 consensus_peers.cc:597] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:39.388511  8209 tablet_server.cc:179] TabletServer@127.8.4.66:0 shutting down...
W20260709 13:05:39.413199 10025 consensus_peers.cc:597] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:39.414862  9418 consensus_peers.cc:597] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:39.420648  9492 consensus_peers.cc:597] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:39.424753 10027 consensus_peers.cc:597] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:39.457906 10025 consensus_peers.cc:597] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:39.478489  9492 consensus_peers.cc:597] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:39.522008 10025 consensus_peers.cc:597] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:39.529487  9492 consensus_peers.cc:597] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:39.530264  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:39.535343  8209 tablet_replica.cc:333] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.554234  8209 raft_consensus.cc:2243] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:39.555938  9418 consensus_peers.cc:597] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:39.557603  9490 consensus_peers.cc:597] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:39.558323  9490 consensus_peers.cc:597] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:39.558980  9490 consensus_peers.cc:597] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:39.569794  8209 raft_consensus.cc:2272] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:39.573076  8209 tablet_replica.cc:333] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.574196  8209 raft_consensus.cc:2243] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:05:39.575490  8209 raft_consensus.cc:2272] T 605e9c36ec724a60ac9a7846d6491c9f P d62c9d5a052b42ce8675f8438f846526 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:39.578626  8209 tablet_replica.cc:333] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.579574  8209 raft_consensus.cc:2243] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:39.580283  8209 raft_consensus.cc:2272] T 10c8ef1923f34ce1befc8604db656137 P d62c9d5a052b42ce8675f8438f846526 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:39.597570  8209 tablet_replica.cc:333] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.599689  8209 raft_consensus.cc:2243] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:05:39.601244  8209 raft_consensus.cc:2272] T 7a4d4b66d6394ace8bb74d9778cbd542 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:39.604522  8209 tablet_replica.cc:333] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.605435  8209 raft_consensus.cc:2243] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:39.607693  9490 consensus_peers.cc:597] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:39.608683  9490 consensus_peers.cc:597] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:39.609625  9490 consensus_peers.cc:597] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:39.610303  8209 raft_consensus.cc:2272] T 620e7847d47845ad93329cf9a3a07dba P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:39.616071  9418 consensus_peers.cc:597] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:39.616786  9418 consensus_peers.cc:597] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:39.617653  9490 consensus_peers.cc:597] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:39.627434  9418 consensus_peers.cc:597] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:39.642102  8209 tablet_replica.cc:333] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.643076  8209 raft_consensus.cc:2243] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:05:39.644577  8209 raft_consensus.cc:2272] T 7f6a0746767b404997bb10c4d3ecd42c P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:39.647670  9490 consensus_peers.cc:597] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:39.648313 10025 consensus_peers.cc:597] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:39.660943  8209 tablet_replica.cc:333] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.661777  8209 raft_consensus.cc:2243] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:05:39.662874  8209 raft_consensus.cc:2272] T 09bfbc64d6af4fe0893109a7008e9b5d P d62c9d5a052b42ce8675f8438f846526 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:39.665584  9490 consensus_peers.cc:597] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:39.666931  8209 tablet_replica.cc:333] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.667764  8209 raft_consensus.cc:2243] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:39.668332  8209 raft_consensus.cc:2272] T 1e9721df2c264fa2bc26de02ce5bbe1a P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:39.674418 10025 consensus_peers.cc:597] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:39.674896  8209 tablet_replica.cc:333] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.675779  8209 raft_consensus.cc:2243] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:39.676752  8209 raft_consensus.cc:2272] T 99c4416401f2427a9f7e68b64ec6915e P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:39.679659  8209 tablet_replica.cc:333] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.680477  8209 raft_consensus.cc:2243] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:05:39.689654  8209 raft_consensus.cc:2272] T 2d995bd1db654f5db92b8452f148c18a P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:39.694420 10025 consensus_peers.cc:597] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:39.699721 10025 consensus_peers.cc:597] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:39.702215  8209 tablet_replica.cc:333] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.703353  8209 raft_consensus.cc:2243] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:39.704021  8209 raft_consensus.cc:2272] T 895d29bbb65c4b67a479a2dc2f3cbb83 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:39.706780  8209 tablet_replica.cc:333] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.707584  8209 raft_consensus.cc:2243] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:05:39.708513  8209 raft_consensus.cc:2272] T d7a866663507456b9442af6c42748c5f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:39.711155  8209 tablet_replica.cc:333] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.711992  8209 raft_consensus.cc:2243] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:39.725186  8209 raft_consensus.cc:2272] T c70c7dbdc8034cefbfa29154c4082cc7 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:39.728077  8209 tablet_replica.cc:333] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.728920  8209 raft_consensus.cc:2243] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:05:39.729961  8209 raft_consensus.cc:2272] T aada562be2484a8fb8aac8e7f9348043 P d62c9d5a052b42ce8675f8438f846526 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:39.732561  8209 tablet_replica.cc:333] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.733393  8209 raft_consensus.cc:2243] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:05:39.734452  8209 raft_consensus.cc:2272] T a3b5c7847cbc42538f7f07cceeb9c125 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:39.734606  9492 consensus_peers.cc:597] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:39.758611 10027 consensus_peers.cc:597] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:39.764724  8209 tablet_replica.cc:333] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.765728  8209 raft_consensus.cc:2243] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:05:39.766957  8209 raft_consensus.cc:2272] T 1b9a868ddd7e47e2bf15bb4c000634d0 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:39.770013  8209 tablet_replica.cc:333] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.770968  8209 raft_consensus.cc:2243] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:39.772071  8209 raft_consensus.cc:2272] T 6d1dd60ff2744b109e2d3f9d61d2702f P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:39.776121 10025 consensus_peers.cc:597] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:39.782245  8209 tablet_replica.cc:333] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.783146  8209 raft_consensus.cc:2243] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:39.783788  8209 raft_consensus.cc:2272] T 522dd78118a14f5783e99d5dc43c9308 P d62c9d5a052b42ce8675f8438f846526 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:39.785524 10025 consensus_peers.cc:597] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:39.786412  8209 tablet_replica.cc:333] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
W20260709 13:05:39.786621  9418 consensus_peers.cc:597] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:39.787334  8209 raft_consensus.cc:2243] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:39.788167  8209 raft_consensus.cc:2272] T 83531d29bc754f95b7c86cb864a9e096 P d62c9d5a052b42ce8675f8438f846526 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:39.795027  9490 consensus_peers.cc:597] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:39.796087  9490 consensus_peers.cc:597] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:39.796893  9490 consensus_peers.cc:597] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:39.797717  9490 consensus_peers.cc:597] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:39.801934  8209 tablet_replica.cc:333] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.802848  8209 raft_consensus.cc:2243] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:39.809775  8209 raft_consensus.cc:2272] T 9e3280937dd84fa789b7a8c362985847 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:39.812954  8209 tablet_replica.cc:333] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.813913  8209 raft_consensus.cc:2243] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:05:39.827342  8209 raft_consensus.cc:2272] T f7b2e1b1ef6540b1915f1dda8f95e81b P d62c9d5a052b42ce8675f8438f846526 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:39.830631  8209 tablet_replica.cc:333] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.831591  8209 raft_consensus.cc:2243] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:05:39.832916  8209 raft_consensus.cc:2272] T 7201bcdf8f724879b727639e6e67e31e P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:39.836339  8209 tablet_replica.cc:333] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.837242  8209 raft_consensus.cc:2243] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:39.838048  8209 raft_consensus.cc:2272] T 23a88c5000a045dbb65387d4da0a378c P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:39.839202  9306 debug-util.cc:398] Leaking SignalData structure 0x7b080039d260 after lost signal to thread 8212
W20260709 13:05:39.840452  9306 debug-util.cc:398] Leaking SignalData structure 0x7b0800045b40 after lost signal to thread 9309
I20260709 13:05:39.841037  8209 tablet_replica.cc:333] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.841861  8209 raft_consensus.cc:2243] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:05:39.841902  9306 debug-util.cc:398] Leaking SignalData structure 0x7b080004f8a0 after lost signal to thread 9476
I20260709 13:05:39.843098  8209 raft_consensus.cc:2272] T 060ae09cf899421ea6057ee5eca95814 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:39.843289  9306 debug-util.cc:398] Leaking SignalData structure 0x7b08001d7700 after lost signal to thread 9550
W20260709 13:05:39.844637  9306 debug-util.cc:398] Leaking SignalData structure 0x7b0800145c00 after lost signal to thread 10094
I20260709 13:05:39.846019  8209 tablet_replica.cc:333] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.846900  8209 raft_consensus.cc:2243] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:05:39.848392  8209 raft_consensus.cc:2272] T 58a6a34a419649a4829c651a0402a5fa P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:39.852720 10025 consensus_peers.cc:597] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:39.857692  8209 tablet_replica.cc:333] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.858754  8209 raft_consensus.cc:2243] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:39.859781  8209 raft_consensus.cc:2272] T 6836716b8e044849b07461ac40f5f1a6 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:39.863113  8209 tablet_replica.cc:333] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.864028  8209 raft_consensus.cc:2243] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:05:39.865381  8209 raft_consensus.cc:2272] T dc4ed6b5107b44b2bf1844daec23e8dd P d62c9d5a052b42ce8675f8438f846526 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:39.886966  8209 tablet_replica.cc:333] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.889168  8209 raft_consensus.cc:2243] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:39.889972  8209 raft_consensus.cc:2272] T 7f8897d3859c4aa692a409afb3f57944 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:39.893486  8209 tablet_replica.cc:333] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.894486  8209 raft_consensus.cc:2243] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:39.895327  8209 raft_consensus.cc:2272] T a81c17774a484973a3b82a63d2a33ff0 P d62c9d5a052b42ce8675f8438f846526 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:39.898768  8209 tablet_replica.cc:333] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.899821  8209 raft_consensus.cc:2243] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:05:39.901432  8209 raft_consensus.cc:2272] T 084579f9b3b648f0bff0a7e9cdc1669b P d62c9d5a052b42ce8675f8438f846526 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:39.904683  8209 tablet_replica.cc:333] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
W20260709 13:05:39.946205  9490 consensus_peers.cc:597] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:39.963420  8209 raft_consensus.cc:2243] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:05:39.964826  8209 raft_consensus.cc:2272] T 82949cde879a425f9973e01e26ea0b69 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:39.975808  8209 tablet_replica.cc:333] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.976678  8209 raft_consensus.cc:2243] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:39.977439  8209 raft_consensus.cc:2272] T 5b1affc9131446038db1c8ad10108ab0 P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:39.980242  8209 tablet_replica.cc:333] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:39.980991  8209 raft_consensus.cc:2243] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.000049  8209 raft_consensus.cc:2272] T 7f7d9e2ac04d41d69afab7dd1be321e2 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.002709  8209 tablet_replica.cc:333] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:40.008890  8209 raft_consensus.cc:2243] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:05:40.010273  8209 raft_consensus.cc:2272] T 5e2df6fa742945289dda523a3fb658b0 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.013262  8209 tablet_replica.cc:333] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:40.014284  8209 raft_consensus.cc:2243] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:05:40.015544  8209 raft_consensus.cc:2272] T a326e6d2c4664dbe9374e92fa4c42c93 P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.018944  8209 tablet_replica.cc:333] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:40.019788  8209 raft_consensus.cc:2243] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.020520  8209 raft_consensus.cc:2272] T 6e8f1f59b3d149e09a5d394c216144b9 P d62c9d5a052b42ce8675f8438f846526 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.023473  8209 tablet_replica.cc:333] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:40.024415  8209 raft_consensus.cc:2243] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.025544  8209 raft_consensus.cc:2272] T 8cb1b08cec264585b21aa628ca12e206 P d62c9d5a052b42ce8675f8438f846526 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.028529  8209 tablet_replica.cc:333] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:40.029369  8209 raft_consensus.cc:2243] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.030035  8209 raft_consensus.cc:2272] T b5a227bc15c0427bbed0fbbe37f826f1 P d62c9d5a052b42ce8675f8438f846526 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.058670  8209 tablet_replica.cc:333] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:40.059439  8209 raft_consensus.cc:2243] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:05:40.060436  8209 raft_consensus.cc:2272] T 36e88678fcd042e78609b17fe3521242 P d62c9d5a052b42ce8675f8438f846526 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.068169  8209 tablet_replica.cc:333] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:40.080624  8209 raft_consensus.cc:2243] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.081347  8209 raft_consensus.cc:2272] T aad3a86fe3f14e62819801e837794bfb P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:40.106123  9492 consensus_peers.cc:597] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:40.084211  8209 tablet_replica.cc:333] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:40.111860  8209 raft_consensus.cc:2243] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.154457  8209 raft_consensus.cc:2272] T 31a8af9a9a6948d584c9c4c96ee8c808 P d62c9d5a052b42ce8675f8438f846526 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.169386  8209 tablet_replica.cc:333] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:40.170367  8209 raft_consensus.cc:2243] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:05:40.171643  8209 raft_consensus.cc:2272] T 001ad880018f49e5bec36246253efa0f P d62c9d5a052b42ce8675f8438f846526 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.178092  8209 tablet_replica.cc:333] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:40.179273  8209 raft_consensus.cc:2243] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.181162  8209 raft_consensus.cc:2272] T 897f815762f54948b7f3aea4ee0c84f0 P d62c9d5a052b42ce8675f8438f846526 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.187879  8209 tablet_replica.cc:333] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:40.189471  8209 raft_consensus.cc:2243] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:05:40.190914  8209 raft_consensus.cc:2272] T 3ad4133883414768941dffb952ca7caf P d62c9d5a052b42ce8675f8438f846526 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.202255  8209 tablet_replica.cc:333] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526: stopping tablet replica
I20260709 13:05:40.234462  8209 raft_consensus.cc:2243] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.235247  8209 raft_consensus.cc:2272] T d55d9be5c0db4ab3a575698dea3014ba P d62c9d5a052b42ce8675f8438f846526 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:40.680337  9492 consensus_peers.cc:597] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:40.695930 10027 consensus_peers.cc:597] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:40.714354 16527 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:40.714996 16527 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:40.717690 16527 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:40.740219 10027 leader_election.cc:336] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
W20260709 13:05:40.747692 10025 leader_election.cc:336] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:40.748574 10025 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:40.749775 16527 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:40.875175 16527 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:40.875272 16548 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:40.875929 16527 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:40.875941 16548 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:40.878263 16548 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:40.885258 10025 leader_election.cc:336] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
W20260709 13:05:40.886847 10025 leader_election.cc:336] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:40.891687 16548 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:40.892231 16548 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:40.894501 16548 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:40.886252 16527 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:40.889730 10027 leader_election.cc:336] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:40.895358 10027 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:05:40.896350 10027 leader_election.cc:336] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:40.896550 16527 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:40.896811 10027 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:40.898661 16548 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:05:40.903139 10027 leader_election.cc:336] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
W20260709 13:05:40.904611 10025 leader_election.cc:336] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:40.905110 10025 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:40.906442 16527 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:40.921559 16527 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:40.922219 16527 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:40.926890 16527 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:40.929447  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:05:40.932628 10027 leader_election.cc:336] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:40.933145 10027 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:05:40.933780 10025 leader_election.cc:336] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:40.934230 16527 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:40.975116 16545 raft_consensus.cc:493] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:40.975816 16545 raft_consensus.cc:515] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
W20260709 13:05:40.983314  9492 leader_election.cc:336] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
W20260709 13:05:40.989838  9490 leader_election.cc:336] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:40.990374  9490 leader_election.cc:304] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:40.991343 16536 raft_consensus.cc:2749] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:40.992671 16545 leader_election.cc:290] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:41.038865 16545 raft_consensus.cc:493] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:41.039491 16545 raft_consensus.cc:515] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:41.041836 16545 leader_election.cc:290] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:41.046648 16527 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:41.047302 16527 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:41.049528 16527 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:41.056289 10025 leader_election.cc:336] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
W20260709 13:05:41.058547  9492 leader_election.cc:336] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
W20260709 13:05:41.058655 10027 leader_election.cc:336] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:41.059266 10027 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:05:41.059774  9490 leader_election.cc:336] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:41.060400  9490 leader_election.cc:304] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:41.060644 16527 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:41.061758 16545 raft_consensus.cc:2749] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:41.064028 16545 raft_consensus.cc:493] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:41.064644 16545 raft_consensus.cc:515] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } attrs { replace: true } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:05:41.076642  9492 leader_election.cc:336] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:41.077688 16527 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:41.078351 16527 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:41.084076 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6a0746767b404997bb10c4d3ecd42c" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:05:41.084858 10066 raft_consensus.cc:2468] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 15.
I20260709 13:05:41.084208 16548 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:41.085460 16548 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:41.087651 16548 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:05:41.090655  9492 consensus_peers.cc:597] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:05:41.092073  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:05:41.095069 10027 leader_election.cc:336] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:41.080757 16527 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:41.091153 16545 leader_election.cc:290] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:41.100255 16545 raft_consensus.cc:493] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
W20260709 13:05:41.103149 10025 leader_election.cc:336] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:41.104672 10025 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:05:41.105732 10025 leader_election.cc:336] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:41.106137 10025 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:41.106240 16527 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:41.106876 16548 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:41.104645 16545 raft_consensus.cc:515] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:41.115751 16545 leader_election.cc:290] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:41.120579  9490 leader_election.cc:336] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:41.132156  9490 leader_election.cc:304] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:41.134162 16545 raft_consensus.cc:2749] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:41.135818  9492 leader_election.cc:336] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
W20260709 13:05:41.142740  9490 leader_election.cc:336] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:41.143302  9490 leader_election.cc:304] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:41.144062 16545 raft_consensus.cc:2749] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:41.165107 16548 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:41.165740 16548 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:41.168076 16548 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:41.178491 16545 raft_consensus.cc:493] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:41.179644 16545 raft_consensus.cc:515] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:41.182351 16545 leader_election.cc:290] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:41.184090 10025 leader_election.cc:336] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
W20260709 13:05:41.195489 10027 leader_election.cc:336] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:41.201079 10027 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:41.201942 16548 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:41.203285  9492 leader_election.cc:336] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:41.205118 16536 raft_consensus.cc:493] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:41.205780 16536 raft_consensus.cc:515] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:41.208120 16536 leader_election.cc:290] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:41.224680  9490 leader_election.cc:336] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:41.225329  9490 leader_election.cc:304] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:41.234200 16545 raft_consensus.cc:2749] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:41.233332  9492 leader_election.cc:336] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:41.242543 16545 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:41.243249 16545 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:41.246631 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:05:41.247272 10066 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 17.
I20260709 13:05:41.248625  9491 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:05:41.249519 16536 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:41.249883 16536 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:41.250216 16536 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:41.265130 16545 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:41.266175 16548 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:41.266806 16548 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:05:41.273268  9490 leader_election.cc:336] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:41.273775  9490 leader_election.cc:304] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:05:41.274583 10025 leader_election.cc:336] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:41.275484 16545 raft_consensus.cc:2749] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:05:41.279356  9492 consensus_peers.cc:597] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:41.280349 16536 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:41.283500 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b5c7847cbc42538f7f07cceeb9c125" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:05:41.283846 16548 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:41.284080 10066 raft_consensus.cc:3060] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:41.286369 10027 leader_election.cc:336] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:41.286981 10027 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:41.287765 16527 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:41.289260 16527 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:41.290148 16527 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:41.295804 16527 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
I20260709 13:05:41.299094 16536 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
W20260709 13:05:41.302985  9490 leader_election.cc:336] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
W20260709 13:05:41.303890  9490 leader_election.cc:336] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
W20260709 13:05:41.304903 10025 leader_election.cc:336] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:41.291692 10066 raft_consensus.cc:2468] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 18.
I20260709 13:05:41.308106  9491 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:41.309387 16536 raft_consensus.cc:2804] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:05:41.309935 10027 leader_election.cc:336] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:41.310436 10027 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:41.311159 16527 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:41.313115 16536 raft_consensus.cc:697] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 18 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:05:41.314349 16536 consensus_queue.cc:237] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:41.328059 16527 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:41.328662 16527 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:41.330708 16527 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:41.335248  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "b0812463215649c3b011d36e2f0400c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "6d50f1c263264b21919230bee398022b" is_pre_election: true
W20260709 13:05:41.337810 10025 leader_election.cc:336] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:41.338326 10025 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:41.339531 16527 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:41.350564 16545 raft_consensus.cc:493] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:41.351225 16545 raft_consensus.cc:515] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:41.358917 16545 leader_election.cc:290] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:41.373163  9490 leader_election.cc:336] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:41.373816  9272 catalog_manager.cc:5697] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 17 to 18, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 18 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.380645 16527 raft_consensus.cc:493] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:41.381301 16527 raft_consensus.cc:515] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:41.383453 16527 leader_election.cc:290] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:41.389245 10025 leader_election.cc:336] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:41.392661 16548 raft_consensus.cc:493] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:41.393234 16548 raft_consensus.cc:515] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:41.395320 16548 leader_election.cc:290] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:41.405139 10025 leader_election.cc:336] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:41.448691 16536 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:41.449252 16536 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:41.451354 16536 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:41.453109 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9" is_pre_election: true
I20260709 13:05:41.453845 10066 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 17.
I20260709 13:05:41.455713  9491 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: 
I20260709 13:05:41.458578 16545 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:41.459043 16545 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Starting leader election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:41.459447 16545 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:41.467466  9490 leader_election.cc:336] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:41.469624 16545 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
W20260709 13:05:41.486433  9490 leader_election.cc:336] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:41.488996 10066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2df6fa742945289dda523a3fb658b0" candidate_uuid: "6d50f1c263264b21919230bee398022b" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b0812463215649c3b011d36e2f0400c9"
I20260709 13:05:41.489742 10066 raft_consensus.cc:3060] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:41.497805 10066 raft_consensus.cc:2468] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d50f1c263264b21919230bee398022b in term 18.
I20260709 13:05:41.499536  9491 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d50f1c263264b21919230bee398022b, b0812463215649c3b011d36e2f0400c9; no voters: d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:41.498339 16545 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 18 election: Requested vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), b0812463215649c3b011d36e2f0400c9 (127.8.4.68:43623)
I20260709 13:05:41.501535 16545 raft_consensus.cc:2804] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:41.502847 16545 raft_consensus.cc:697] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 18 LEADER]: Becoming Leader. State: Replica: 6d50f1c263264b21919230bee398022b, State: Running, Role: LEADER
I20260709 13:05:41.505375 16545 consensus_queue.cc:237] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:41.518718 16554 raft_consensus.cc:493] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:41.519394 16554 raft_consensus.cc:515] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } }
I20260709 13:05:41.524169 16554 leader_election.cc:290] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:41.530836  9490 leader_election.cc:336] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:41.554651  9272 catalog_manager.cc:5697] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b reported cstate change: term changed from 17 to 18, leader changed from d62c9d5a052b42ce8675f8438f846526 (127.8.4.66) to 6d50f1c263264b21919230bee398022b (127.8.4.67). New cstate: current_term: 18 leader_uuid: "6d50f1c263264b21919230bee398022b" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.736516 10066 raft_consensus.cc:1275] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:41.739502 16554 consensus_queue.cc:1048] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:05:41.763270  9490 consensus_peers.cc:597] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:41.800992  9490 consensus_peers.cc:597] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:41.847532 10025 consensus_peers.cc:597] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:41.870827  8209 tablet_server.cc:196] TabletServer@127.8.4.66:0 shutdown complete.
W20260709 13:05:41.906502  9490 consensus_peers.cc:597] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:41.910702 10025 consensus_peers.cc:597] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:41.930856 10066 raft_consensus.cc:1275] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Refusing update from remote peer 6d50f1c263264b21919230bee398022b: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 13:05:41.934963 16545 consensus_queue.cc:1048] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:05:41.990479 10025 consensus_peers.cc:597] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:42.022373  8209 tablet_server.cc:179] TabletServer@127.8.4.67:0 shutting down...
W20260709 13:05:42.025432 10025 consensus_peers.cc:597] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:41.993822  9490 consensus_peers.cc:597] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:42.047434  9490 consensus_peers.cc:597] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:42.067497 10025 consensus_peers.cc:597] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:42.090976  9490 consensus_peers.cc:597] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:42.106393  9490 consensus_peers.cc:597] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:42.110100  9490 consensus_peers.cc:597] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:42.110849  9490 consensus_peers.cc:597] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:42.114384  9490 consensus_peers.cc:597] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:42.114984  9490 consensus_peers.cc:597] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:42.126039  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:42.133991  8209 tablet_replica.cc:333] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.134833  8209 raft_consensus.cc:2243] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:42.135538  8209 raft_consensus.cc:2272] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:42.138109 10027 consensus_peers.cc:597] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 -> Peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Couldn't send request to peer 6d50f1c263264b21919230bee398022b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:42.141983  9490 consensus_peers.cc:597] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:42.141381  8209 tablet_replica.cc:333] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
W20260709 13:05:42.142786 10025 consensus_peers.cc:597] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:42.143532  8209 raft_consensus.cc:2243] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:05:42.144665  8209 raft_consensus.cc:2272] T 10c8ef1923f34ce1befc8604db656137 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.147590  8209 tablet_replica.cc:333] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.148605  8209 raft_consensus.cc:2243] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:05:42.149421 10027 consensus_peers.cc:597] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 -> Peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Couldn't send request to peer 6d50f1c263264b21919230bee398022b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:42.149641  8209 raft_consensus.cc:2272] T b5154ade768f425fa43369d9709e66a4 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.152760  8209 tablet_replica.cc:333] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.153746  8209 raft_consensus.cc:2243] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:05:42.154748  8209 raft_consensus.cc:2272] T f322b7281d554c459bb8109ed249047b P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.157859  8209 tablet_replica.cc:333] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.158775  8209 raft_consensus.cc:2243] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:05:42.159713  8209 raft_consensus.cc:2272] T 1e9721df2c264fa2bc26de02ce5bbe1a P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.162792  8209 tablet_replica.cc:333] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.163693  8209 raft_consensus.cc:2243] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:42.164337  8209 raft_consensus.cc:2272] T 9c4c96d6eb2446529db451af4486b758 P 6d50f1c263264b21919230bee398022b [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.167454  8209 tablet_replica.cc:333] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.168381  8209 raft_consensus.cc:2243] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:05:42.169461  8209 raft_consensus.cc:2272] T d4df305315b74f329792b6a1f9a5e4db P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.172479  8209 tablet_replica.cc:333] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.173477  8209 raft_consensus.cc:2243] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:42.174080  8209 raft_consensus.cc:2272] T d7a866663507456b9442af6c42748c5f P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.177127  8209 tablet_replica.cc:333] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.177953  8209 raft_consensus.cc:2243] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:05:42.178833  8209 raft_consensus.cc:2272] T c70c7dbdc8034cefbfa29154c4082cc7 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.181469  8209 tablet_replica.cc:333] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.182509  8209 raft_consensus.cc:2243] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:05:42.183928  8209 raft_consensus.cc:2272] T 6d1dd60ff2744b109e2d3f9d61d2702f P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.187179  8209 tablet_replica.cc:333] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.188182  8209 raft_consensus.cc:2243] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:42.188982  8209 raft_consensus.cc:2272] T 2d995bd1db654f5db92b8452f148c18a P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:42.190585 10025 consensus_peers.cc:597] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:42.191459  8209 tablet_replica.cc:333] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.192332  8209 raft_consensus.cc:2243] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:42.193216  8209 raft_consensus.cc:2272] T 895d29bbb65c4b67a479a2dc2f3cbb83 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.196295  8209 tablet_replica.cc:333] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.197281  8209 raft_consensus.cc:2243] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:42.198119  8209 raft_consensus.cc:2272] T 45a4f94c156249adab9c2b1ffb00ac46 P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.200947  8209 tablet_replica.cc:333] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.201848  8209 raft_consensus.cc:2243] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:05:42.202832  8209 raft_consensus.cc:2272] T f70a11c5ae574b43ab50a91cfb6e293c P 6d50f1c263264b21919230bee398022b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.205541  8209 tablet_replica.cc:333] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.206300  8209 raft_consensus.cc:2243] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:42.206868  8209 raft_consensus.cc:2272] T dc4ed6b5107b44b2bf1844daec23e8dd P 6d50f1c263264b21919230bee398022b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.210073  8209 tablet_replica.cc:333] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.210928  8209 raft_consensus.cc:2243] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:42.211496  8209 raft_consensus.cc:2272] T 522dd78118a14f5783e99d5dc43c9308 P 6d50f1c263264b21919230bee398022b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.214130  8209 tablet_replica.cc:333] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.214905  8209 raft_consensus.cc:2243] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:42.215478  8209 raft_consensus.cc:2272] T 83531d29bc754f95b7c86cb864a9e096 P 6d50f1c263264b21919230bee398022b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:42.216614 10027 consensus_peers.cc:597] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 -> Peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Couldn't send request to peer 6d50f1c263264b21919230bee398022b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:42.218116  8209 tablet_replica.cc:333] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.219039  8209 raft_consensus.cc:2243] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:05:42.220818  8209 raft_consensus.cc:2272] T a8c41deeda674b9b8d27e72d70e96e79 P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.223408  8209 tablet_replica.cc:333] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.224189  8209 raft_consensus.cc:2243] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:05:42.225899  8209 raft_consensus.cc:2272] T 0e30c155cba64357ae275b3366772777 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.228725  8209 tablet_replica.cc:333] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.229559  8209 raft_consensus.cc:2243] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:05:42.230131  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.230726  8209 raft_consensus.cc:2272] T a3b5c7847cbc42538f7f07cceeb9c125 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.233811  8209 tablet_replica.cc:333] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.234586  8209 raft_consensus.cc:2243] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:42.235363  8209 raft_consensus.cc:2272] T 1b9a868ddd7e47e2bf15bb4c000634d0 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.240433  8209 tablet_replica.cc:333] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.241410  8209 raft_consensus.cc:2243] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:42.241839 10027 consensus_peers.cc:597] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 -> Peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Couldn't send request to peer 6d50f1c263264b21919230bee398022b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:42.242300  8209 raft_consensus.cc:2272] T 620e7847d47845ad93329cf9a3a07dba P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.245401  8209 tablet_replica.cc:333] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.246316  8209 raft_consensus.cc:2243] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:05:42.247372  8209 raft_consensus.cc:2272] T 23a88c5000a045dbb65387d4da0a378c P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.250128  8209 tablet_replica.cc:333] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.251011  8209 raft_consensus.cc:2243] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:05:42.252179  8209 raft_consensus.cc:2272] T 6836716b8e044849b07461ac40f5f1a6 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.254873  8209 tablet_replica.cc:333] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.255708  8209 raft_consensus.cc:2243] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:05:42.256671  8209 raft_consensus.cc:2272] T 9e3280937dd84fa789b7a8c362985847 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.259770  8209 tablet_replica.cc:333] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.260522  8209 raft_consensus.cc:2243] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:05:42.261684  8209 raft_consensus.cc:2272] T 5b1affc9131446038db1c8ad10108ab0 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:42.263293  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.264478  8209 tablet_replica.cc:333] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.265522  8209 raft_consensus.cc:2243] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:42.266125  8209 raft_consensus.cc:2272] T 82949cde879a425f9973e01e26ea0b69 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:42.266193  9492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:42.266914 10025 consensus_peers.cc:597] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:42.268787  8209 tablet_replica.cc:333] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.269704  8209 raft_consensus.cc:2243] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:05:42.270668  8209 raft_consensus.cc:2272] T 7f7d9e2ac04d41d69afab7dd1be321e2 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.273625  8209 tablet_replica.cc:333] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.274466  8209 raft_consensus.cc:2243] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:05:42.274837  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.275964  8209 raft_consensus.cc:2272] T 5e2df6fa742945289dda523a3fb658b0 P 6d50f1c263264b21919230bee398022b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.279057  8209 tablet_replica.cc:333] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.279870  8209 raft_consensus.cc:2243] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:42.280550  8209 raft_consensus.cc:2272] T 7f6a0746767b404997bb10c4d3ecd42c P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.283372  8209 tablet_replica.cc:333] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.284123  8209 raft_consensus.cc:2243] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:42.284698  8209 raft_consensus.cc:2272] T 807906edc34d41589d9b860b72f70e16 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.287155  8209 tablet_replica.cc:333] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.287884  8209 raft_consensus.cc:2243] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:42.288928  8209 raft_consensus.cc:2272] T 7260766fbe5c43b1aab09346a89d9ac6 P 6d50f1c263264b21919230bee398022b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.291976  8209 tablet_replica.cc:333] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.292763  8209 raft_consensus.cc:2243] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:05:42.293781  8209 raft_consensus.cc:2272] T 7f8897d3859c4aa692a409afb3f57944 P 6d50f1c263264b21919230bee398022b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.296665  8209 tablet_replica.cc:333] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.297518  8209 raft_consensus.cc:2243] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:42.298151  8209 raft_consensus.cc:2272] T a81c17774a484973a3b82a63d2a33ff0 P 6d50f1c263264b21919230bee398022b [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:42.299678 10027 consensus_peers.cc:597] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 -> Peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Couldn't send request to peer 6d50f1c263264b21919230bee398022b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:42.300884  8209 tablet_replica.cc:333] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.301813  8209 raft_consensus.cc:2243] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:05:42.302829  8209 raft_consensus.cc:2272] T b77c45e065544a6cb4ff451f91a27cd1 P 6d50f1c263264b21919230bee398022b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.305760  8209 tablet_replica.cc:333] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.306726  8209 raft_consensus.cc:2243] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:05:42.307895  8209 raft_consensus.cc:2272] T 897f815762f54948b7f3aea4ee0c84f0 P 6d50f1c263264b21919230bee398022b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.310899  8209 tablet_replica.cc:333] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.311690  8209 raft_consensus.cc:2243] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:42.312498  8209 raft_consensus.cc:2272] T f6a0d9dc457d47bc801e795a2a573601 P 6d50f1c263264b21919230bee398022b [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.315296  8209 tablet_replica.cc:333] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.316092  8209 raft_consensus.cc:2243] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:05:42.317147  8209 raft_consensus.cc:2272] T ffaf31f504f540dc957e0b558c940f79 P 6d50f1c263264b21919230bee398022b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.320238  8209 tablet_replica.cc:333] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.321082  8209 raft_consensus.cc:2243] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:05:42.322034  8209 raft_consensus.cc:2272] T d55d9be5c0db4ab3a575698dea3014ba P 6d50f1c263264b21919230bee398022b [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:42.324191 10025 consensus_peers.cc:597] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:42.324842  8209 tablet_replica.cc:333] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.325984  8209 raft_consensus.cc:2243] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:05:42.326944  8209 raft_consensus.cc:2272] T 31f9d5965eae4c788eb6a40e856cadc7 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.329401  8209 tablet_replica.cc:333] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.330106  8209 raft_consensus.cc:2243] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:05:42.330814  9491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.331326  8209 raft_consensus.cc:2272] T aad3a86fe3f14e62819801e837794bfb P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.334198  8209 tablet_replica.cc:333] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.334991  8209 raft_consensus.cc:2243] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:42.335801  8209 raft_consensus.cc:2272] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:42.336076 10027 consensus_peers.cc:597] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 -> Peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Couldn't send request to peer 6d50f1c263264b21919230bee398022b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:42.338464  8209 tablet_replica.cc:333] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.339289  8209 raft_consensus.cc:2243] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:05:42.340389  8209 raft_consensus.cc:2272] T 8cb1b08cec264585b21aa628ca12e206 P 6d50f1c263264b21919230bee398022b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.343165  8209 tablet_replica.cc:333] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.343856  8209 raft_consensus.cc:2243] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:42.344888  8209 raft_consensus.cc:2272] T 31a8af9a9a6948d584c9c4c96ee8c808 P 6d50f1c263264b21919230bee398022b [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.347509  8209 tablet_replica.cc:333] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b: stopping tablet replica
I20260709 13:05:42.348176  8209 raft_consensus.cc:2243] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:42.348838  8209 raft_consensus.cc:2272] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:42.367421 10027 consensus_peers.cc:597] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 -> Peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Couldn't send request to peer 6d50f1c263264b21919230bee398022b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:42.373730  9492 leader_election.cc:336] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:42.375396  9492 leader_election.cc:304] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:05:42.376098  9492 raft_consensus.cc:2686] T 36e88678fcd042e78609b17fe3521242 P 6d50f1c263264b21919230bee398022b: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:05:42.379078  9492 leader_election.cc:336] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:42.379539  9492 leader_election.cc:304] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d50f1c263264b21919230bee398022b; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:05:42.380156  9492 raft_consensus.cc:2686] T 001ad880018f49e5bec36246253efa0f P 6d50f1c263264b21919230bee398022b: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:05:42.396840 10027 consensus_peers.cc:597] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:42.397529 10027 leader_election.cc:336] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:42.397980 10027 leader_election.cc:304] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:42.398715 16527 raft_consensus.cc:2749] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:42.399924 10027 leader_election.cc:336] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:42.400480 10027 leader_election.cc:304] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:42.401356 16527 raft_consensus.cc:2749] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:05:42.402827 10027 consensus_peers.cc:597] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:42.403568 10027 consensus_peers.cc:597] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:42.404165 10027 consensus_peers.cc:597] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:05:42.423496 16527 raft_consensus.cc:493] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:42.424201 16527 raft_consensus.cc:515] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:42.426558 16527 leader_election.cc:290] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:42.432564 10025 leader_election.cc:336] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:42.439790 16548 raft_consensus.cc:493] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:42.440508 16548 raft_consensus.cc:515] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:42.442968 16548 leader_election.cc:290] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:42.446378 10025 consensus_peers.cc:597] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 -> Peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Couldn't send request to peer d62c9d5a052b42ce8675f8438f846526. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:42.453178 10025 leader_election.cc:336] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
W20260709 13:05:42.464612 10027 leader_election.cc:336] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:42.465216 10027 leader_election.cc:304] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:42.465966 16527 raft_consensus.cc:2749] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:05:42.466377 10027 leader_election.cc:336] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:42.466882 10027 leader_election.cc:304] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:42.467602 16527 raft_consensus.cc:2749] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:42.468134 10027 consensus_peers.cc:597] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 -> Peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Couldn't send request to peer 6d50f1c263264b21919230bee398022b. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.67:35929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:42.472019 10027 consensus_peers.cc:597] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 -> Peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Couldn't send request to peer 6d50f1c263264b21919230bee398022b. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.67:35929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:42.481362 10027 consensus_peers.cc:597] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 -> Peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Couldn't send request to peer 6d50f1c263264b21919230bee398022b. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.67:35929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:42.501742 10027 consensus_peers.cc:597] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 -> Peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Couldn't send request to peer 6d50f1c263264b21919230bee398022b. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.67:35929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:42.508570 10027 consensus_peers.cc:597] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 -> Peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Couldn't send request to peer 6d50f1c263264b21919230bee398022b. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.67:35929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:42.597770 16548 raft_consensus.cc:493] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:42.598381 16548 raft_consensus.cc:515] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:42.601130 16548 leader_election.cc:290] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:42.607081 10025 leader_election.cc:336] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:42.788347 16548 raft_consensus.cc:493] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:42.788950 16548 raft_consensus.cc:515] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:42.791184 16548 leader_election.cc:290] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:42.795581 10025 leader_election.cc:336] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:42.875988 16548 raft_consensus.cc:493] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:42.876565 16548 raft_consensus.cc:515] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:42.878774 16548 leader_election.cc:290] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:42.883358 10025 leader_election.cc:336] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:43.040804 16548 raft_consensus.cc:493] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:43.041399 16548 raft_consensus.cc:515] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:43.043576 16548 leader_election.cc:290] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:43.048306 10025 leader_election.cc:336] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:43.055382 16560 raft_consensus.cc:493] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:43.055960 16560 raft_consensus.cc:515] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:43.058000 16560 leader_election.cc:290] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:43.064560 10025 leader_election.cc:336] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:43.067667 16548 raft_consensus.cc:493] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:43.068269 16548 raft_consensus.cc:515] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:43.070346 16548 leader_election.cc:290] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:43.076793 10025 leader_election.cc:336] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:43.243305 16548 raft_consensus.cc:493] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d62c9d5a052b42ce8675f8438f846526)
I20260709 13:05:43.243880 16548 raft_consensus.cc:515] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:43.246126 16548 leader_election.cc:290] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279)
W20260709 13:05:43.250523 10025 leader_election.cc:336] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:43.254629 16548 raft_consensus.cc:493] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:05:43.255292 16548 raft_consensus.cc:515] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:43.257684 16548 leader_election.cc:290] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:43.258881 16548 raft_consensus.cc:493] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:05:43.259380 16548 raft_consensus.cc:515] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:43.263537 16548 leader_election.cc:290] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:05:43.263129 10027 leader_election.cc:336] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Network error: Client connection negotiation failed: client connection to 127.8.4.67:35929: connect: Connection refused (error 111)
W20260709 13:05:43.267928 10027 leader_election.cc:336] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Network error: Client connection negotiation failed: client connection to 127.8.4.67:35929: connect: Connection refused (error 111)
W20260709 13:05:43.270202 10025 leader_election.cc:336] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:43.270639 10025 leader_election.cc:304] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:43.272349 16548 raft_consensus.cc:2749] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:43.281977 16548 raft_consensus.cc:493] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:05:43.282550 16548 raft_consensus.cc:515] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:43.284803 16548 leader_election.cc:290] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:05:43.291530 10025 leader_election.cc:336] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
W20260709 13:05:43.293040 10027 leader_election.cc:336] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Network error: Client connection negotiation failed: client connection to 127.8.4.67:35929: connect: Connection refused (error 111)
I20260709 13:05:43.293495 10027 leader_election.cc:304] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:43.294206 16548 raft_consensus.cc:2749] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:43.322172 16548 raft_consensus.cc:493] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:05:43.322754 16548 raft_consensus.cc:515] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:43.325227 16548 leader_election.cc:290] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:05:43.329962 10027 leader_election.cc:336] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Network error: Client connection negotiation failed: client connection to 127.8.4.67:35929: connect: Connection refused (error 111)
I20260709 13:05:43.337232 16548 raft_consensus.cc:493] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:05:43.337963 16548 raft_consensus.cc:515] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:43.338722 16560 raft_consensus.cc:493] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:05:43.339424 16560 raft_consensus.cc:515] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:43.340204 16548 leader_election.cc:290] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:43.341667 16560 leader_election.cc:290] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:05:43.346503 10027 leader_election.cc:336] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Network error: Client connection negotiation failed: client connection to 127.8.4.67:35929: connect: Connection refused (error 111)
W20260709 13:05:43.347070 10027 leader_election.cc:336] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Network error: Client connection negotiation failed: client connection to 127.8.4.67:35929: connect: Connection refused (error 111)
I20260709 13:05:43.413096  8209 tablet_server.cc:196] TabletServer@127.8.4.67:0 shutdown complete.
I20260709 13:05:43.416072 16560 raft_consensus.cc:493] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:05:43.416711 16560 raft_consensus.cc:515] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:43.418855 16560 leader_election.cc:290] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:05:43.426401 10027 leader_election.cc:336] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Network error: Client connection negotiation failed: client connection to 127.8.4.67:35929: connect: Connection refused (error 111)
I20260709 13:05:43.431069 16548 raft_consensus.cc:493] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:05:43.431607 16548 raft_consensus.cc:515] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:43.434095 16548 leader_election.cc:290] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:05:43.441251 10025 leader_election.cc:336] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
W20260709 13:05:43.442137 10027 leader_election.cc:336] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Network error: Client connection negotiation failed: client connection to 127.8.4.67:35929: connect: Connection refused (error 111)
I20260709 13:05:43.442641 10027 leader_election.cc:304] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:43.443971 16560 raft_consensus.cc:2749] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:43.517918 10027 leader_election.cc:336] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:43.518473 10027 leader_election.cc:304] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:43.519280 16548 raft_consensus.cc:2749] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:05:43.519462 10027 leader_election.cc:336] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:43.519999 10027 leader_election.cc:304] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:43.520313 16548 raft_consensus.cc:493] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
W20260709 13:05:43.521157 10027 leader_election.cc:336] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:43.520869 16548 raft_consensus.cc:515] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:43.521667 10027 leader_election.cc:304] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:43.522446 16527 raft_consensus.cc:2749] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:43.523077 16560 raft_consensus.cc:2749] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:05:43.523532 10027 leader_election.cc:336] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:43.524098 10027 leader_election.cc:304] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:05:43.525097 10027 leader_election.cc:336] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:43.525533 10027 leader_election.cc:304] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:43.526221 16527 raft_consensus.cc:2749] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:43.525126 16560 raft_consensus.cc:2749] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:43.527233 10027 leader_election.cc:336] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:43.527664 10027 leader_election.cc:304] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
W20260709 13:05:43.528620 10027 leader_election.cc:336] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:43.529201 10027 leader_election.cc:304] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:43.529210 16560 raft_consensus.cc:2749] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:43.528663 16548 leader_election.cc:290] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:43.530082 16527 raft_consensus.cc:2749] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:05:43.530676 10027 leader_election.cc:336] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:43.531147 10027 leader_election.cc:304] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:43.531831 16548 raft_consensus.cc:2749] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:05:43.532835 10027 leader_election.cc:336] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:43.533303 10027 leader_election.cc:304] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:05:43.533969 10025 leader_election.cc:336] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
W20260709 13:05:43.534332 10027 leader_election.cc:336] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:43.534799 10027 leader_election.cc:304] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:43.533972 16548 raft_consensus.cc:2749] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:43.535558 16527 raft_consensus.cc:2749] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:43.536505 10027 leader_election.cc:336] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:43.536938 10027 leader_election.cc:304] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:43.537693 16527 raft_consensus.cc:2749] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:43.538717 16527 raft_consensus.cc:493] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:05:43.539501  8209 tablet_server.cc:179] TabletServer@127.8.4.68:0 shutting down...
I20260709 13:05:43.539158 16527 raft_consensus.cc:515] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:43.541313 16527 leader_election.cc:290] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:05:43.543361 10027 consensus_peers.cc:597] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:43.543864 10027 consensus_peers.cc:597] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:43.544242 10027 leader_election.cc:336] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:43.544585 10027 leader_election.cc:304] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 925acbe78db14db3b9e4cfc857717947, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:43.545856 16527 raft_consensus.cc:2749] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:05:43.546054 10027 consensus_peers.cc:597] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 -> Peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Couldn't send request to peer 925acbe78db14db3b9e4cfc857717947. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:05:43.550263 10027 leader_election.cc:336] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
W20260709 13:05:43.550993 10027 leader_election.cc:336] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Network error: Client connection negotiation failed: client connection to 127.8.4.67:35929: connect: Connection refused (error 111)
I20260709 13:05:43.551469 10027 leader_election.cc:304] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:43.552321 16527 raft_consensus.cc:2749] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:43.552510 10027 leader_election.cc:336] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Network error: Client connection negotiation failed: client connection to 127.8.4.67:35929: connect: Connection refused (error 111)
I20260709 13:05:43.553046 10027 leader_election.cc:304] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:43.553784 16548 raft_consensus.cc:2749] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:43.561416 16548 raft_consensus.cc:493] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:05:43.561873 16548 raft_consensus.cc:515] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:43.563944 16548 leader_election.cc:290] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:05:43.568331 10025 leader_election.cc:336] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
W20260709 13:05:43.572223 10027 leader_election.cc:336] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Network error: Client connection negotiation failed: client connection to 127.8.4.67:35929: connect: Connection refused (error 111)
I20260709 13:05:43.572693 10027 leader_election.cc:304] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:43.573665 16548 raft_consensus.cc:2749] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:43.592893  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:43.593947  8209 tablet_replica.cc:333] T 5b1affc9131446038db1c8ad10108ab0 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.594652 16548 raft_consensus.cc:493] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:05:43.594995  8209 raft_consensus.cc:2243] T 5b1affc9131446038db1c8ad10108ab0 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.595184 16548 raft_consensus.cc:515] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:43.595906  8209 raft_consensus.cc:2272] T 5b1affc9131446038db1c8ad10108ab0 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.597674 16548 leader_election.cc:290] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:43.598871 16548 raft_consensus.cc:493] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:05:43.599120  8209 tablet_replica.cc:333] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.599387 16548 raft_consensus.cc:515] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "925acbe78db14db3b9e4cfc857717947" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37547 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:43.600090  8209 raft_consensus.cc:2243] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.600839  8209 raft_consensus.cc:2272] T aada562be2484a8fb8aac8e7f9348043 P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.602900 16527 raft_consensus.cc:493] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d50f1c263264b21919230bee398022b)
I20260709 13:05:43.603356 16527 raft_consensus.cc:515] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d62c9d5a052b42ce8675f8438f846526" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 45279 } } peers { permanent_uuid: "6d50f1c263264b21919230bee398022b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35929 } } peers { permanent_uuid: "b0812463215649c3b011d36e2f0400c9" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 43623 } attrs { promote: false } }
I20260709 13:05:43.603871  8209 tablet_replica.cc:333] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.604815  8209 raft_consensus.cc:2243] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.605363 16527 leader_election.cc:290] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
I20260709 13:05:43.605572  8209 raft_consensus.cc:2272] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:43.605948 10027 leader_election.cc:336] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:43.602559 16548 leader_election.cc:290] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547), 6d50f1c263264b21919230bee398022b (127.8.4.67:35929)
W20260709 13:05:43.608372 10027 leader_election.cc:336] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Network error: Client connection negotiation failed: client connection to 127.8.4.67:35929: connect: Connection refused (error 111)
I20260709 13:05:43.608803  8209 tablet_replica.cc:333] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.608827 10027 leader_election.cc:304] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
W20260709 13:05:43.609740 10027 raft_consensus.cc:2686] T ffaf31f504f540dc957e0b558c940f79 P b0812463215649c3b011d36e2f0400c9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:05:43.609884  8209 raft_consensus.cc:2243] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:43.610771 10025 leader_election.cc:336] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d62c9d5a052b42ce8675f8438f846526 (127.8.4.66:45279): Network error: Client connection negotiation failed: client connection to 127.8.4.66:45279: connect: Connection refused (error 111)
I20260709 13:05:43.611301  8209 raft_consensus.cc:2272] T 6d1dd60ff2744b109e2d3f9d61d2702f P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:43.613620 10027 leader_election.cc:336] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Network error: Client connection negotiation failed: client connection to 127.8.4.67:35929: connect: Connection refused (error 111)
I20260709 13:05:43.614357  8209 tablet_replica.cc:333] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
W20260709 13:05:43.614740 10027 leader_election.cc:336] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 925acbe78db14db3b9e4cfc857717947 (127.8.4.65:37547): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37547: connect: Connection refused (error 111)
I20260709 13:05:43.615267  8209 raft_consensus.cc:2243] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.615157 10027 leader_election.cc:304] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, 925acbe78db14db3b9e4cfc857717947
I20260709 13:05:43.615931  8209 raft_consensus.cc:2272] T 09bfbc64d6af4fe0893109a7008e9b5d P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.615967 16548 raft_consensus.cc:2749] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:43.618297 10027 leader_election.cc:336] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6d50f1c263264b21919230bee398022b (127.8.4.67:35929): Network error: Client connection negotiation failed: client connection to 127.8.4.67:35929: connect: Connection refused (error 111)
I20260709 13:05:43.618696 10027 leader_election.cc:304] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0812463215649c3b011d36e2f0400c9; no voters: 6d50f1c263264b21919230bee398022b, d62c9d5a052b42ce8675f8438f846526
I20260709 13:05:43.619112  8209 tablet_replica.cc:333] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.619467 16548 raft_consensus.cc:2749] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:43.620079  8209 raft_consensus.cc:2243] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.620811  8209 raft_consensus.cc:2272] T 8cb1b08cec264585b21aa628ca12e206 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.623158  8209 tablet_replica.cc:333] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.623760  8209 raft_consensus.cc:2243] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.624254  8209 raft_consensus.cc:2272] T 7201bcdf8f724879b727639e6e67e31e P b0812463215649c3b011d36e2f0400c9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.626734  8209 tablet_replica.cc:333] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.627317  8209 raft_consensus.cc:2243] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.627857  8209 raft_consensus.cc:2272] T 31f9d5965eae4c788eb6a40e856cadc7 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.630468  8209 tablet_replica.cc:333] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.631067  8209 raft_consensus.cc:2243] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.631690  8209 raft_consensus.cc:2272] T 897f815762f54948b7f3aea4ee0c84f0 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.634231  8209 tablet_replica.cc:333] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.634841  8209 raft_consensus.cc:2243] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.635394  8209 raft_consensus.cc:2272] T 084579f9b3b648f0bff0a7e9cdc1669b P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.637820  8209 tablet_replica.cc:333] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.638399  8209 raft_consensus.cc:2243] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:05:43.639235  8209 raft_consensus.cc:2272] T 71ffe24ed6cf41c5b150d5ed4fa28c44 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.641680  8209 tablet_replica.cc:333] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.642323  8209 raft_consensus.cc:2243] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.642947  8209 raft_consensus.cc:2272] T 3ad4133883414768941dffb952ca7caf P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.645327  8209 tablet_replica.cc:333] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.645970  8209 raft_consensus.cc:2243] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.646588  8209 raft_consensus.cc:2272] T f322b7281d554c459bb8109ed249047b P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.649037  8209 tablet_replica.cc:333] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.649737  8209 raft_consensus.cc:2243] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.650467  8209 raft_consensus.cc:2272] T d4df305315b74f329792b6a1f9a5e4db P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.653780  8209 tablet_replica.cc:333] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.654404  8209 raft_consensus.cc:2243] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:05:43.655403  8209 raft_consensus.cc:2272] T 6e8f1f59b3d149e09a5d394c216144b9 P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.657553  8209 tablet_replica.cc:333] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.658212  8209 raft_consensus.cc:2243] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.658718  8209 raft_consensus.cc:2272] T a3b5c7847cbc42538f7f07cceeb9c125 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.660969  8209 tablet_replica.cc:333] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.661674  8209 raft_consensus.cc:2243] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.662539  8209 raft_consensus.cc:2272] T 6836716b8e044849b07461ac40f5f1a6 P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.664942  8209 tablet_replica.cc:333] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.665663  8209 raft_consensus.cc:2243] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.666159  8209 raft_consensus.cc:2272] T f7b2e1b1ef6540b1915f1dda8f95e81b P b0812463215649c3b011d36e2f0400c9 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.668282  8209 tablet_replica.cc:333] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.668946  8209 raft_consensus.cc:2243] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.669631  8209 raft_consensus.cc:2272] T b5154ade768f425fa43369d9709e66a4 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.672127  8209 tablet_replica.cc:333] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.672758  8209 raft_consensus.cc:2243] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:05:43.673702  8209 raft_consensus.cc:2272] T 620e7847d47845ad93329cf9a3a07dba P b0812463215649c3b011d36e2f0400c9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.676165  8209 tablet_replica.cc:333] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.676883  8209 raft_consensus.cc:2243] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.677593  8209 raft_consensus.cc:2272] T 060ae09cf899421ea6057ee5eca95814 P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.679636  8209 tablet_replica.cc:333] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.680190  8209 raft_consensus.cc:2243] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:05:43.680997  8209 raft_consensus.cc:2272] T 99c4416401f2427a9f7e68b64ec6915e P b0812463215649c3b011d36e2f0400c9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.683470  8209 tablet_replica.cc:333] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.684051  8209 raft_consensus.cc:2243] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.684484  8209 raft_consensus.cc:2272] T 58a6a34a419649a4829c651a0402a5fa P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.686827  8209 tablet_replica.cc:333] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.687407  8209 raft_consensus.cc:2243] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:05:43.688659  8209 raft_consensus.cc:2272] T 522dd78118a14f5783e99d5dc43c9308 P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.691992  8209 tablet_replica.cc:333] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.692678  8209 raft_consensus.cc:2243] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:05:43.693893  8209 raft_consensus.cc:2272] T 807906edc34d41589d9b860b72f70e16 P b0812463215649c3b011d36e2f0400c9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.696116  8209 tablet_replica.cc:333] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.696812  8209 raft_consensus.cc:2243] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:05:43.697952  8209 raft_consensus.cc:2272] T 45a4f94c156249adab9c2b1ffb00ac46 P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.700278  8209 tablet_replica.cc:333] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.700882  8209 raft_consensus.cc:2243] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:05:43.701720  8209 raft_consensus.cc:2272] T b5a227bc15c0427bbed0fbbe37f826f1 P b0812463215649c3b011d36e2f0400c9 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.704030  8209 tablet_replica.cc:333] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.704604  8209 raft_consensus.cc:2243] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:05:43.705505  8209 raft_consensus.cc:2272] T f6a0d9dc457d47bc801e795a2a573601 P b0812463215649c3b011d36e2f0400c9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.707579  8209 tablet_replica.cc:333] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.708189  8209 raft_consensus.cc:2243] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.708727  8209 raft_consensus.cc:2272] T a326e6d2c4664dbe9374e92fa4c42c93 P b0812463215649c3b011d36e2f0400c9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.710888  8209 tablet_replica.cc:333] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.711488  8209 raft_consensus.cc:2243] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:05:43.712446  8209 raft_consensus.cc:2272] T 7260766fbe5c43b1aab09346a89d9ac6 P b0812463215649c3b011d36e2f0400c9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.715221  8209 tablet_replica.cc:333] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.715808  8209 raft_consensus.cc:2243] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.716473  8209 raft_consensus.cc:2272] T 5e2df6fa742945289dda523a3fb658b0 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.719251  8209 tablet_replica.cc:333] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.720052  8209 raft_consensus.cc:2243] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.720736  8209 raft_consensus.cc:2272] T 0e30c155cba64357ae275b3366772777 P b0812463215649c3b011d36e2f0400c9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.723316  8209 tablet_replica.cc:333] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.723860  8209 raft_consensus.cc:2243] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.724463  8209 raft_consensus.cc:2272] T 7f6a0746767b404997bb10c4d3ecd42c P b0812463215649c3b011d36e2f0400c9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.727072  8209 tablet_replica.cc:333] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.727672  8209 raft_consensus.cc:2243] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.728147  8209 raft_consensus.cc:2272] T a8c41deeda674b9b8d27e72d70e96e79 P b0812463215649c3b011d36e2f0400c9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.730585  8209 tablet_replica.cc:333] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.731173  8209 raft_consensus.cc:2243] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:43.732025  8209 raft_consensus.cc:2272] T 83531d29bc754f95b7c86cb864a9e096 P b0812463215649c3b011d36e2f0400c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.734108  8209 tablet_replica.cc:333] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.734997  8209 raft_consensus.cc:2243] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.735844  8209 raft_consensus.cc:2272] T b77c45e065544a6cb4ff451f91a27cd1 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.738229  8209 tablet_replica.cc:333] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.738788  8209 raft_consensus.cc:2243] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.739261  8209 raft_consensus.cc:2272] T 7a4d4b66d6394ace8bb74d9778cbd542 P b0812463215649c3b011d36e2f0400c9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.741513  8209 tablet_replica.cc:333] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.742110  8209 raft_consensus.cc:2243] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:43.742988  8209 raft_consensus.cc:2272] T a81c17774a484973a3b82a63d2a33ff0 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.745388  8209 tablet_replica.cc:333] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.746016  8209 raft_consensus.cc:2243] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:05:43.746901  8209 raft_consensus.cc:2272] T 9c4c96d6eb2446529db451af4486b758 P b0812463215649c3b011d36e2f0400c9 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.749424  8209 tablet_replica.cc:333] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.749961  8209 raft_consensus.cc:2243] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.750622  8209 raft_consensus.cc:2272] T f70a11c5ae574b43ab50a91cfb6e293c P b0812463215649c3b011d36e2f0400c9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.752830  8209 tablet_replica.cc:333] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.753401  8209 raft_consensus.cc:2243] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.753965  8209 raft_consensus.cc:2272] T 605e9c36ec724a60ac9a7846d6491c9f P b0812463215649c3b011d36e2f0400c9 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.756070  8209 tablet_replica.cc:333] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.756594  8209 raft_consensus.cc:2243] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:05:43.757503  8209 raft_consensus.cc:2272] T 31a8af9a9a6948d584c9c4c96ee8c808 P b0812463215649c3b011d36e2f0400c9 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.759505  8209 tablet_replica.cc:333] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9: stopping tablet replica
I20260709 13:05:43.760015  8209 raft_consensus.cc:2243] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:43.760857  8209 raft_consensus.cc:2272] T 895d29bbb65c4b67a479a2dc2f3cbb83 P b0812463215649c3b011d36e2f0400c9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:44.033875  8209 tablet_server.cc:196] TabletServer@127.8.4.68:0 shutdown complete.
I20260709 13:05:44.117803  8209 master.cc:562] Master@127.8.4.126:34725 shutting down...
W20260709 13:05:44.168212  9323 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:05:44.168566  9323 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:05:44.168871  9323 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:05:44.172537  8209 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:44.173342  8209 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:44.173758  8209 tablet_replica.cc:333] T 00000000000000000000000000000000 P f3fb61137daa445d9297d2162e98e24e: stopping tablet replica
I20260709 13:05:44.381384  8209 master.cc:584] Master@127.8.4.126:34725 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (223514 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:05:44.492338  8209 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.4.126:37545
I20260709 13:05:44.493492  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:44.500311 16563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:44.500624 16564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:44.501456 16566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:44.502669  8209 server_base.cc:1061] running on GCE node
I20260709 13:05:44.505493  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:44.505815  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:44.506187  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602344506143 us; error 0 us; skew 500 ppm
I20260709 13:05:44.506780  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:44.509761  8209 webserver.cc:533] Webserver started at http://127.8.4.126:38431/ using document root <none> and password file <none>
I20260709 13:05:44.510341  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:44.510537  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:44.510905  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:44.512365  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/master-0-root/instance:
uuid: "717ac9db426249d99b79ed1678194d86"
format_stamp: "Formatted at 2026-07-09 13:05:44 on dist-test-slave-008w"
I20260709 13:05:44.517608  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:05:44.521754 16571 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:44.522748  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:05:44.523145  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/master-0-root
uuid: "717ac9db426249d99b79ed1678194d86"
format_stamp: "Formatted at 2026-07-09 13:05:44 on dist-test-slave-008w"
I20260709 13:05:44.523548  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:44.557523  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:44.558701  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:44.602751  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.126:37545
I20260709 13:05:44.602928 16622 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.126:37545 every 8 connection(s)
I20260709 13:05:44.607051 16623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.617807 16623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86: Bootstrap starting.
I20260709 13:05:44.622697 16623 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.628240 16623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86: No bootstrap required, opened a new log
I20260709 13:05:44.631150 16623 raft_consensus.cc:359] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "717ac9db426249d99b79ed1678194d86" member_type: VOTER }
I20260709 13:05:44.631603 16623 raft_consensus.cc:385] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.631879 16623 raft_consensus.cc:740] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 717ac9db426249d99b79ed1678194d86, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.632802 16623 consensus_queue.cc:260] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "717ac9db426249d99b79ed1678194d86" member_type: VOTER }
I20260709 13:05:44.633419 16623 raft_consensus.cc:399] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:44.633662 16623 raft_consensus.cc:493] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:44.634025 16623 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.639173 16623 raft_consensus.cc:515] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "717ac9db426249d99b79ed1678194d86" member_type: VOTER }
I20260709 13:05:44.639811 16623 leader_election.cc:304] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 717ac9db426249d99b79ed1678194d86; no voters: 
I20260709 13:05:44.641222 16623 leader_election.cc:290] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:44.641822 16626 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:44.643271 16626 raft_consensus.cc:697] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86 [term 1 LEADER]: Becoming Leader. State: Replica: 717ac9db426249d99b79ed1678194d86, State: Running, Role: LEADER
I20260709 13:05:44.644048 16626 consensus_queue.cc:237] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "717ac9db426249d99b79ed1678194d86" member_type: VOTER }
I20260709 13:05:44.644701 16623 sys_catalog.cc:565] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:44.648597 16627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "717ac9db426249d99b79ed1678194d86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "717ac9db426249d99b79ed1678194d86" member_type: VOTER } }
I20260709 13:05:44.649336 16627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:44.649839 16628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 717ac9db426249d99b79ed1678194d86. Latest consensus state: current_term: 1 leader_uuid: "717ac9db426249d99b79ed1678194d86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "717ac9db426249d99b79ed1678194d86" member_type: VOTER } }
I20260709 13:05:44.650751 16628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:44.654752 16633 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:44.664631 16633 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:44.667344  8209 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:44.675683 16633 catalog_manager.cc:1383] Generated new cluster ID: 2cb2d64f3e1040dfb70c17347456707d
I20260709 13:05:44.676035 16633 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:44.690536 16633 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:44.692049 16633 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:44.707944 16633 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86: Generated new TSK 0
I20260709 13:05:44.708600 16633 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:44.734594  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:44.742472 16645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:44.742619 16644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:44.743893 16647 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:44.745146  8209 server_base.cc:1061] running on GCE node
I20260709 13:05:44.747752  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:44.747953  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:44.748087  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602344748075 us; error 0 us; skew 500 ppm
I20260709 13:05:44.748548  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:44.751561  8209 webserver.cc:533] Webserver started at http://127.8.4.65:45733/ using document root <none> and password file <none>
I20260709 13:05:44.752099  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:44.752286  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:44.752533  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:44.754058  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-0-root/instance:
uuid: "1cbe303821774e4d936ea3d54875dcb8"
format_stamp: "Formatted at 2026-07-09 13:05:44 on dist-test-slave-008w"
I20260709 13:05:44.759509  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:05:44.763937 16652 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:44.764974  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:05:44.765600  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-0-root
uuid: "1cbe303821774e4d936ea3d54875dcb8"
format_stamp: "Formatted at 2026-07-09 13:05:44 on dist-test-slave-008w"
I20260709 13:05:44.765926  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:44.790859  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:44.792213  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:44.794030  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:44.797230  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:44.797456  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:44.797678  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:44.797843  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:44.848651  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.65:37355
I20260709 13:05:44.848773 16714 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.65:37355 every 8 connection(s)
I20260709 13:05:44.853997  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:44.863312 16719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:44.863904 16720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:44.870278  8209 server_base.cc:1061] running on GCE node
W20260709 13:05:44.871886 16723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:44.872830 16715 heartbeater.cc:344] Connected to a master server at 127.8.4.126:37545
I20260709 13:05:44.873405 16715 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:44.873502  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:44.873865  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:44.874086  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602344874066 us; error 0 us; skew 500 ppm
I20260709 13:05:44.874507 16715 heartbeater.cc:507] Master 127.8.4.126:37545 requested a full tablet report, sending...
I20260709 13:05:44.874990  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:44.877825 16588 ts_manager.cc:194] Registered new tserver with Master: 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:44.878886  8209 webserver.cc:533] Webserver started at http://127.8.4.66:33423/ using document root <none> and password file <none>
I20260709 13:05:44.879513  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:44.879750  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:44.880052  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:44.880247 16588 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56048
I20260709 13:05:44.881939  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-1-root/instance:
uuid: "d0ea3afb898b4eb5b21faeb676627011"
format_stamp: "Formatted at 2026-07-09 13:05:44 on dist-test-slave-008w"
I20260709 13:05:44.888316  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:44.892830 16727 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:44.894274  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:05:44.894781  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-1-root
uuid: "d0ea3afb898b4eb5b21faeb676627011"
format_stamp: "Formatted at 2026-07-09 13:05:44 on dist-test-slave-008w"
I20260709 13:05:44.895115  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:44.912451  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:44.913810  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:44.915719  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:44.918483  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:44.918783  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:44.919063  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:44.919422  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:44.967772  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.66:33887
I20260709 13:05:44.967872 16789 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.66:33887 every 8 connection(s)
I20260709 13:05:44.973460  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:44.981794 16793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:44.982366 16794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:44.984827 16796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:44.985623  8209 server_base.cc:1061] running on GCE node
I20260709 13:05:44.986847  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:44.987094  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:44.987334  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602344987299 us; error 0 us; skew 500 ppm
I20260709 13:05:44.987874 16790 heartbeater.cc:344] Connected to a master server at 127.8.4.126:37545
I20260709 13:05:44.987990  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:44.988384 16790 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:44.989343 16790 heartbeater.cc:507] Master 127.8.4.126:37545 requested a full tablet report, sending...
I20260709 13:05:44.990902  8209 webserver.cc:533] Webserver started at http://127.8.4.67:43741/ using document root <none> and password file <none>
I20260709 13:05:44.991562  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:44.991736  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:44.991916 16588 ts_manager.cc:194] Registered new tserver with Master: d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:44.992048  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:44.993780 16588 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56054
I20260709 13:05:44.993599  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-2-root/instance:
uuid: "622433288cac4964aea9ea5a24ba77fd"
format_stamp: "Formatted at 2026-07-09 13:05:44 on dist-test-slave-008w"
I20260709 13:05:44.999966  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:05:45.003798 16801 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:45.004777  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:05:45.005194  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-2-root
uuid: "622433288cac4964aea9ea5a24ba77fd"
format_stamp: "Formatted at 2026-07-09 13:05:44 on dist-test-slave-008w"
I20260709 13:05:45.005542  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:45.021348  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:45.022688  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:45.024163  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:45.026829  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:45.027083  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:45.027348  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:45.027539  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:45.132874  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.67:39929
I20260709 13:05:45.132982 16864 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.67:39929 every 8 connection(s)
I20260709 13:05:45.140708  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:45.151649 16868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:45.152105 16869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:45.159036  8209 server_base.cc:1061] running on GCE node
W20260709 13:05:45.159255 16872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:45.159729 16865 heartbeater.cc:344] Connected to a master server at 127.8.4.126:37545
I20260709 13:05:45.160475 16865 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:45.160949  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:45.161301  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:45.161527  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602345161508 us; error 0 us; skew 500 ppm
I20260709 13:05:45.161753 16865 heartbeater.cc:507] Master 127.8.4.126:37545 requested a full tablet report, sending...
I20260709 13:05:45.162274  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:45.164863 16588 ts_manager.cc:194] Registered new tserver with Master: 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:45.165928  8209 webserver.cc:533] Webserver started at http://127.8.4.68:39279/ using document root <none> and password file <none>
I20260709 13:05:45.166669  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:45.166910  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:45.167402  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:45.167543 16588 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56058
I20260709 13:05:45.170222  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-3-root/instance:
uuid: "7197bc10b2304fccb972da2da7749e3b"
format_stamp: "Formatted at 2026-07-09 13:05:45 on dist-test-slave-008w"
I20260709 13:05:45.176294  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
I20260709 13:05:45.180374 16876 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:45.181351  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:05:45.181668  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-3-root
uuid: "7197bc10b2304fccb972da2da7749e3b"
format_stamp: "Formatted at 2026-07-09 13:05:45 on dist-test-slave-008w"
I20260709 13:05:45.182009  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:45.196303  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:45.198019  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:45.200053  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:45.203019  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:45.203269  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:45.203493  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:45.203670  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:45.255565  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.68:45033
I20260709 13:05:45.255913 16938 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.68:45033 every 8 connection(s)
I20260709 13:05:45.276998 16939 heartbeater.cc:344] Connected to a master server at 127.8.4.126:37545
I20260709 13:05:45.277616 16939 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:45.278385 16939 heartbeater.cc:507] Master 127.8.4.126:37545 requested a full tablet report, sending...
I20260709 13:05:45.280627 16588 ts_manager.cc:194] Registered new tserver with Master: 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:45.281659  8209 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.021715272s
I20260709 13:05:45.282928 16588 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56074
I20260709 13:05:45.315290 16588 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56088:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:05:45.607690 16904 tablet_service.cc:1511] Processing CreateTablet for tablet b7e982a881834665b4845c226db01020 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:45.609932 16904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e982a881834665b4845c226db01020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.620549 16755 tablet_service.cc:1511] Processing CreateTablet for tablet b7e982a881834665b4845c226db01020 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:45.620719 16754 tablet_service.cc:1511] Processing CreateTablet for tablet fff8e33f0af546a8a976e5547b1b437e (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:45.622520 16755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e982a881834665b4845c226db01020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.622886 16829 tablet_service.cc:1511] Processing CreateTablet for tablet fff8e33f0af546a8a976e5547b1b437e (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:45.624639 16829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fff8e33f0af546a8a976e5547b1b437e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.625624 16754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fff8e33f0af546a8a976e5547b1b437e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.628265 16903 tablet_service.cc:1511] Processing CreateTablet for tablet 73a0ed4bc207489699e41033ec224d3a (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:45.628680 16753 tablet_service.cc:1511] Processing CreateTablet for tablet 37a024bf1cd844419249b9636dd94c69 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:45.630077 16903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a0ed4bc207489699e41033ec224d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.630214 16753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a024bf1cd844419249b9636dd94c69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.635645 16828 tablet_service.cc:1511] Processing CreateTablet for tablet 73a0ed4bc207489699e41033ec224d3a (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:45.637892 16752 tablet_service.cc:1511] Processing CreateTablet for tablet 9bc00a2c7a04450a9c9ce82457ab573c (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:45.638360 16902 tablet_service.cc:1511] Processing CreateTablet for tablet 37a024bf1cd844419249b9636dd94c69 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:45.639526 16752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc00a2c7a04450a9c9ce82457ab573c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.640112 16902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a024bf1cd844419249b9636dd94c69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.643725 16901 tablet_service.cc:1511] Processing CreateTablet for tablet 3526ae05dd1141aaaaa2aaea2391b108 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:45.645768 16828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a0ed4bc207489699e41033ec224d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.646580 16901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3526ae05dd1141aaaaa2aaea2391b108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.649657 16751 tablet_service.cc:1511] Processing CreateTablet for tablet 3526ae05dd1141aaaaa2aaea2391b108 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:45.651176 16751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3526ae05dd1141aaaaa2aaea2391b108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.654644 16750 tablet_service.cc:1511] Processing CreateTablet for tablet a8d411124ca242a3b8b4fbb5b0a90b66 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:45.656263 16750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d411124ca242a3b8b4fbb5b0a90b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.660468 16899 tablet_service.cc:1511] Processing CreateTablet for tablet a8d411124ca242a3b8b4fbb5b0a90b66 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:45.662050 16899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d411124ca242a3b8b4fbb5b0a90b66. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:45.663441 16636 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:45.665463 16900 tablet_service.cc:1511] Processing CreateTablet for tablet d281c9020d454b23a8bd21ccfadfa93c (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:45.667209 16900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d281c9020d454b23a8bd21ccfadfa93c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.670436 16749 tablet_service.cc:1511] Processing CreateTablet for tablet 2500d1c1df2649d99c7a5e1146e771d9 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:45.672148 16749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2500d1c1df2649d99c7a5e1146e771d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.672008 16680 tablet_service.cc:1511] Processing CreateTablet for tablet b7e982a881834665b4845c226db01020 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:45.673584 16898 tablet_service.cc:1511] Processing CreateTablet for tablet d965337ae0df4ca7aba0e4f9549a8ca9 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:45.674381 16679 tablet_service.cc:1511] Processing CreateTablet for tablet fff8e33f0af546a8a976e5547b1b437e (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:45.675125 16898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d965337ae0df4ca7aba0e4f9549a8ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.676679 16678 tablet_service.cc:1511] Processing CreateTablet for tablet 73a0ed4bc207489699e41033ec224d3a (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:45.678574 16897 tablet_service.cc:1511] Processing CreateTablet for tablet 661f1f2dcacb42bca7e3b25195dbdfe1 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:45.679085 16677 tablet_service.cc:1511] Processing CreateTablet for tablet 9bc00a2c7a04450a9c9ce82457ab573c (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:45.680189 16897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 661f1f2dcacb42bca7e3b25195dbdfe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.683176 16680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e982a881834665b4845c226db01020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.683730 16675 tablet_service.cc:1511] Processing CreateTablet for tablet d281c9020d454b23a8bd21ccfadfa93c (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:45.688618 16679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fff8e33f0af546a8a976e5547b1b437e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.693382 16678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a0ed4bc207489699e41033ec224d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.681843 16676 tablet_service.cc:1511] Processing CreateTablet for tablet 3526ae05dd1141aaaaa2aaea2391b108 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:45.694993 16676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3526ae05dd1141aaaaa2aaea2391b108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.674412 16748 tablet_service.cc:1511] Processing CreateTablet for tablet d965337ae0df4ca7aba0e4f9549a8ca9 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:45.697678 16677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc00a2c7a04450a9c9ce82457ab573c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.698016 16748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d965337ae0df4ca7aba0e4f9549a8ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.701640 16675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d281c9020d454b23a8bd21ccfadfa93c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.735954 16747 tablet_service.cc:1511] Processing CreateTablet for tablet ce42d5cbca2144e8a54bab8a8cf31763 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:45.703351 16674 tablet_service.cc:1511] Processing CreateTablet for tablet 2500d1c1df2649d99c7a5e1146e771d9 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:45.706431 16672 tablet_service.cc:1511] Processing CreateTablet for tablet 661f1f2dcacb42bca7e3b25195dbdfe1 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:45.737654 16747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce42d5cbca2144e8a54bab8a8cf31763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.707685 16673 tablet_service.cc:1511] Processing CreateTablet for tablet d965337ae0df4ca7aba0e4f9549a8ca9 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:45.714392 16827 tablet_service.cc:1511] Processing CreateTablet for tablet 37a024bf1cd844419249b9636dd94c69 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:45.740042 16827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a024bf1cd844419249b9636dd94c69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.716519 16826 tablet_service.cc:1511] Processing CreateTablet for tablet 9bc00a2c7a04450a9c9ce82457ab573c (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:45.741941 16826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc00a2c7a04450a9c9ce82457ab573c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.742362 16896 tablet_service.cc:1511] Processing CreateTablet for tablet ce42d5cbca2144e8a54bab8a8cf31763 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:45.743847 16896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce42d5cbca2144e8a54bab8a8cf31763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.718654 16825 tablet_service.cc:1511] Processing CreateTablet for tablet d281c9020d454b23a8bd21ccfadfa93c (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:45.746021 16825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d281c9020d454b23a8bd21ccfadfa93c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.747565 16746 tablet_service.cc:1511] Processing CreateTablet for tablet 4f0d93c13e344f40b065cabcbc63d751 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:45.725982 16671 tablet_service.cc:1511] Processing CreateTablet for tablet 4f0d93c13e344f40b065cabcbc63d751 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:45.726924 16822 tablet_service.cc:1511] Processing CreateTablet for tablet 661f1f2dcacb42bca7e3b25195dbdfe1 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:45.749120 16746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f0d93c13e344f40b065cabcbc63d751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.749925 16822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 661f1f2dcacb42bca7e3b25195dbdfe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.720625 16824 tablet_service.cc:1511] Processing CreateTablet for tablet a8d411124ca242a3b8b4fbb5b0a90b66 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:45.737787 16674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2500d1c1df2649d99c7a5e1146e771d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.754022 16824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d411124ca242a3b8b4fbb5b0a90b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.722705 16823 tablet_service.cc:1511] Processing CreateTablet for tablet 2500d1c1df2649d99c7a5e1146e771d9 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:45.758016 16823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2500d1c1df2649d99c7a5e1146e771d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.757607 16900 tablet_service.cc:1511] Processing CreateTablet for tablet 16b4be927a834597b7190497210b9169 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:45.729745 16821 tablet_service.cc:1511] Processing CreateTablet for tablet ce42d5cbca2144e8a54bab8a8cf31763 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:45.759436 16900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16b4be927a834597b7190497210b9169. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.732323 16820 tablet_service.cc:1511] Processing CreateTablet for tablet 4f0d93c13e344f40b065cabcbc63d751 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:45.761329 16895 tablet_service.cc:1511] Processing CreateTablet for tablet 1e348c32749d48f68c70dc32267e38c0 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:45.762463 16671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f0d93c13e344f40b065cabcbc63d751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.763449 16895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e348c32749d48f68c70dc32267e38c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.764072 16673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d965337ae0df4ca7aba0e4f9549a8ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.765885 16672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 661f1f2dcacb42bca7e3b25195dbdfe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.760679 16821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce42d5cbca2144e8a54bab8a8cf31763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.768748 16820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f0d93c13e344f40b065cabcbc63d751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.817792 16902 tablet_service.cc:1511] Processing CreateTablet for tablet f1e9d9f32bec4123a2f10e3a20f1067b (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:45.819391 16902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e9d9f32bec4123a2f10e3a20f1067b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.845594 16959 tablet_bootstrap.cc:492] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:45.845372 16899 tablet_service.cc:1511] Processing CreateTablet for tablet 9b51d554de084a5594e8c14973873edc (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:45.846197 16900 tablet_service.cc:1511] Processing CreateTablet for tablet 061a5313535a475ea9385383b611b52d (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:45.846906 16899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b51d554de084a5594e8c14973873edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.847618 16900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 061a5313535a475ea9385383b611b52d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.862336 16753 tablet_service.cc:1511] Processing CreateTablet for tablet 16b4be927a834597b7190497210b9169 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:45.866827 16904 tablet_service.cc:1511] Processing CreateTablet for tablet 13d7f28a321a46919d282b9709ab84cb (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:45.872354 16904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d7f28a321a46919d282b9709ab84cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.881368 16755 tablet_service.cc:1511] Processing CreateTablet for tablet 8b89e067aed8497a9c9c70577ac56c77 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:45.882697 16753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16b4be927a834597b7190497210b9169. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.884235 16715 heartbeater.cc:499] Master 127.8.4.126:37545 was elected leader, sending a full tablet report...
I20260709 13:05:45.869518 16751 tablet_service.cc:1511] Processing CreateTablet for tablet f1e9d9f32bec4123a2f10e3a20f1067b (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:45.905535 16959 tablet_bootstrap.cc:654] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:45.910706 16754 tablet_service.cc:1511] Processing CreateTablet for tablet 9b51d554de084a5594e8c14973873edc (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:45.913434 16679 tablet_service.cc:1511] Processing CreateTablet for tablet 16b4be927a834597b7190497210b9169 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
W20260709 13:05:45.933254 16572 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.8.4.66:33887, user_credentials={real_user=slave}} blocked reactor thread for 48790.6us
I20260709 13:05:45.938723 16900 tablet_service.cc:1511] Processing CreateTablet for tablet a6c91dff9e8c4ab78bacda0d282beacf (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:45.940164 16900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6c91dff9e8c4ab78bacda0d282beacf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.940825 16749 tablet_service.cc:1511] Processing CreateTablet for tablet 13d7f28a321a46919d282b9709ab84cb (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:45.941911 16751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e9d9f32bec4123a2f10e3a20f1067b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.939113 16960 tablet_bootstrap.cc:492] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:45.944429 16755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b89e067aed8497a9c9c70577ac56c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.945824 16901 tablet_service.cc:1511] Processing CreateTablet for tablet aab71409c1cf4356817b8f83a1686482 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:45.949366 16754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b51d554de084a5594e8c14973873edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.950606 16901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab71409c1cf4356817b8f83a1686482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.959729 16961 tablet_bootstrap.cc:492] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:45.963505 16749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d7f28a321a46919d282b9709ab84cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.985402 16828 tablet_service.cc:1511] Processing CreateTablet for tablet 1e348c32749d48f68c70dc32267e38c0 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:45.989549 16827 tablet_service.cc:1511] Processing CreateTablet for tablet f1e9d9f32bec4123a2f10e3a20f1067b (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:45.997578 16790 heartbeater.cc:499] Master 127.8.4.126:37545 was elected leader, sending a full tablet report...
I20260709 13:05:46.009436 16677 tablet_service.cc:1511] Processing CreateTablet for tablet 8b89e067aed8497a9c9c70577ac56c77 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:46.001703 16679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16b4be927a834597b7190497210b9169. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.012053 16962 tablet_bootstrap.cc:492] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:46.014230 16829 tablet_service.cc:1511] Processing CreateTablet for tablet 061a5313535a475ea9385383b611b52d (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:46.009931 16828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e348c32749d48f68c70dc32267e38c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.008684 16680 tablet_service.cc:1511] Processing CreateTablet for tablet 1e348c32749d48f68c70dc32267e38c0 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:46.019385 16680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e348c32749d48f68c70dc32267e38c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.046154 16822 tablet_service.cc:1511] Processing CreateTablet for tablet 8b89e067aed8497a9c9c70577ac56c77 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:46.046627 16673 tablet_service.cc:1511] Processing CreateTablet for tablet 47e91185676f4335a4100a6d3fa40c8d (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:46.048507 16822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b89e067aed8497a9c9c70577ac56c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.034569 16672 tablet_service.cc:1511] Processing CreateTablet for tablet 061a5313535a475ea9385383b611b52d (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:46.037807 16903 tablet_service.cc:1511] Processing CreateTablet for tablet e5445951d8c04b35838db7ef8df62694 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:46.040561 16750 tablet_service.cc:1511] Processing CreateTablet for tablet e5445951d8c04b35838db7ef8df62694 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:46.022020 16959 tablet_bootstrap.cc:492] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:46.063652 16903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5445951d8c04b35838db7ef8df62694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.064234 16959 ts_tablet_manager.cc:1403] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.219s	user 0.011s	sys 0.010s
I20260709 13:05:46.044387 16826 tablet_service.cc:1511] Processing CreateTablet for tablet aab71409c1cf4356817b8f83a1686482 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:46.070890 16824 tablet_service.cc:1511] Processing CreateTablet for tablet 47e91185676f4335a4100a6d3fa40c8d (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:46.063736 16750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5445951d8c04b35838db7ef8df62694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.032692 16675 tablet_service.cc:1511] Processing CreateTablet for tablet 9b51d554de084a5594e8c14973873edc (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:46.055999 16752 tablet_service.cc:1511] Processing CreateTablet for tablet 2369d92de77f42e7be750810912daeef (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:46.048893 16673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47e91185676f4335a4100a6d3fa40c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.072984 16960 tablet_bootstrap.cc:654] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.097642 16677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b89e067aed8497a9c9c70577ac56c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.100835 16820 tablet_service.cc:1511] Processing CreateTablet for tablet 13d7f28a321a46919d282b9709ab84cb (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:46.101468 16672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 061a5313535a475ea9385383b611b52d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.103525 16959 raft_consensus.cc:359] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:46.104743 16959 raft_consensus.cc:385] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.105477 16675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b51d554de084a5594e8c14973873edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.107337 16678 tablet_service.cc:1511] Processing CreateTablet for tablet aab71409c1cf4356817b8f83a1686482 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:46.109063 16678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab71409c1cf4356817b8f83a1686482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.111879 16902 tablet_service.cc:1511] Processing CreateTablet for tablet 82e52334c3ab4394b0a09b0a460e34d4 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:46.105136 16959 raft_consensus.cc:740] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.090090 16752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2369d92de77f42e7be750810912daeef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.119974 16821 tablet_service.cc:1511] Processing CreateTablet for tablet e5445951d8c04b35838db7ef8df62694 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:46.121757 16902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e52334c3ab4394b0a09b0a460e34d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.032570 16747 tablet_service.cc:1511] Processing CreateTablet for tablet 47e91185676f4335a4100a6d3fa40c8d (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:46.135955 16820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d7f28a321a46919d282b9709ab84cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.086118 16676 tablet_service.cc:1511] Processing CreateTablet for tablet a6c91dff9e8c4ab78bacda0d282beacf (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:46.095889 16748 tablet_service.cc:1511] Processing CreateTablet for tablet a6c91dff9e8c4ab78bacda0d282beacf (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:46.112692 16823 tablet_service.cc:1511] Processing CreateTablet for tablet 2369d92de77f42e7be750810912daeef (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:46.121812 16959 consensus_queue.cc:260] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:46.158939 16747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47e91185676f4335a4100a6d3fa40c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.159798 16753 tablet_service.cc:1511] Processing CreateTablet for tablet 82e52334c3ab4394b0a09b0a460e34d4 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:46.161281 16753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e52334c3ab4394b0a09b0a460e34d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.161549 16676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6c91dff9e8c4ab78bacda0d282beacf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.166184 16961 tablet_bootstrap.cc:654] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.172452 16865 heartbeater.cc:499] Master 127.8.4.126:37545 was elected leader, sending a full tablet report...
I20260709 13:05:46.184314 16671 tablet_service.cc:1511] Processing CreateTablet for tablet 82e52334c3ab4394b0a09b0a460e34d4 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:46.186276 16671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e52334c3ab4394b0a09b0a460e34d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.193926 16748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6c91dff9e8c4ab78bacda0d282beacf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.198202 16897 tablet_service.cc:1511] Processing CreateTablet for tablet 0d72e7ee195341ab8a8d3865c5013ac8 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:46.199764 16897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d72e7ee195341ab8a8d3865c5013ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.188824 16827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e9d9f32bec4123a2f10e3a20f1067b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.213449 16826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab71409c1cf4356817b8f83a1686482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.218506 16829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 061a5313535a475ea9385383b611b52d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.225536 16821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5445951d8c04b35838db7ef8df62694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.229425 16824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47e91185676f4335a4100a6d3fa40c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.231309 16960 tablet_bootstrap.cc:492] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:46.231925 16960 ts_tablet_manager.cc:1403] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.293s	user 0.028s	sys 0.022s
I20260709 13:05:46.235047 16960 raft_consensus.cc:359] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:46.235841 16960 raft_consensus.cc:385] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.236145 16960 raft_consensus.cc:740] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.237067 16960 consensus_queue.cc:260] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:46.202879 16962 tablet_bootstrap.cc:654] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.265671 16674 tablet_service.cc:1511] Processing CreateTablet for tablet 2369d92de77f42e7be750810912daeef (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:46.267349 16674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2369d92de77f42e7be750810912daeef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.287192 16939 heartbeater.cc:499] Master 127.8.4.126:37545 was elected leader, sending a full tablet report...
I20260709 13:05:46.299161 16678 tablet_service.cc:1511] Processing CreateTablet for tablet 0d72e7ee195341ab8a8d3865c5013ac8 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:46.306449 16959 ts_tablet_manager.cc:1434] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.242s	user 0.021s	sys 0.007s
I20260709 13:05:46.309770 16959 tablet_bootstrap.cc:492] T 3526ae05dd1141aaaaa2aaea2391b108 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:46.326334 16959 tablet_bootstrap.cc:654] T 3526ae05dd1141aaaaa2aaea2391b108 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.318922 16823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2369d92de77f42e7be750810912daeef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.336771 16961 tablet_bootstrap.cc:492] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:46.337391 16961 ts_tablet_manager.cc:1403] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.378s	user 0.030s	sys 0.043s
I20260709 13:05:46.348721 16961 raft_consensus.cc:359] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:46.349710 16961 raft_consensus.cc:385] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.350116 16961 raft_consensus.cc:740] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.350171 16825 tablet_service.cc:1511] Processing CreateTablet for tablet 0d72e7ee195341ab8a8d3865c5013ac8 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:46.351100 16961 consensus_queue.cc:260] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:46.351817 16825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d72e7ee195341ab8a8d3865c5013ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.349244 16678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d72e7ee195341ab8a8d3865c5013ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.353165 16753 tablet_service.cc:1511] Processing CreateTablet for tablet d51df8e7709946bbb3f3d5ec1c541307 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:46.354498 16753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51df8e7709946bbb3f3d5ec1c541307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.369118 16828 tablet_service.cc:1511] Processing CreateTablet for tablet d51df8e7709946bbb3f3d5ec1c541307 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:46.370908 16828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51df8e7709946bbb3f3d5ec1c541307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.386863 16897 tablet_service.cc:1511] Processing CreateTablet for tablet d51df8e7709946bbb3f3d5ec1c541307 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:46.388379 16897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51df8e7709946bbb3f3d5ec1c541307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.392295 16961 ts_tablet_manager.cc:1434] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.054s	user 0.013s	sys 0.002s
I20260709 13:05:46.375205 16965 raft_consensus.cc:493] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.395274 16679 tablet_service.cc:1511] Processing CreateTablet for tablet 82e662a1c0204e5bab9a5b5e50b81561 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
W20260709 13:05:46.397145 16866 tablet.cc:2406] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:46.399541 16965 raft_consensus.cc:515] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:46.400995 16679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e662a1c0204e5bab9a5b5e50b81561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.398322 16820 tablet_service.cc:1511] Processing CreateTablet for tablet 82e662a1c0204e5bab9a5b5e50b81561 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:46.424448 16750 tablet_service.cc:1511] Processing CreateTablet for tablet 82e662a1c0204e5bab9a5b5e50b81561 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:46.425935 16750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e662a1c0204e5bab9a5b5e50b81561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.429610 16820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e662a1c0204e5bab9a5b5e50b81561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.437412 16672 tablet_service.cc:1511] Processing CreateTablet for tablet fa6e4009e1d445a1b055538cf3006287 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:46.428771 16961 tablet_bootstrap.cc:492] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:46.448390 16752 tablet_service.cc:1511] Processing CreateTablet for tablet fa6e4009e1d445a1b055538cf3006287 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:46.450068 16752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa6e4009e1d445a1b055538cf3006287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.453760 16960 ts_tablet_manager.cc:1434] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.221s	user 0.031s	sys 0.026s
I20260709 13:05:46.455035 16960 tablet_bootstrap.cc:492] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:46.457700 16965 leader_election.cc:290] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:46.469172 16672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa6e4009e1d445a1b055538cf3006287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.478094 16962 tablet_bootstrap.cc:492] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:46.478718 16962 ts_tablet_manager.cc:1403] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.467s	user 0.018s	sys 0.008s
I20260709 13:05:46.482407 16902 tablet_service.cc:1511] Processing CreateTablet for tablet fa6e4009e1d445a1b055538cf3006287 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:46.485059 16902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa6e4009e1d445a1b055538cf3006287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.488101 16962 raft_consensus.cc:359] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:46.494906 16962 raft_consensus.cc:385] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.495959 16962 raft_consensus.cc:740] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.489807 16829 tablet_service.cc:1511] Processing CreateTablet for tablet 2088afc1f50443139a328a7e3bb10212 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:46.498396 16829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2088afc1f50443139a328a7e3bb10212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.501686 16962 consensus_queue.cc:260] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:46.507326 16959 tablet_bootstrap.cc:492] T 3526ae05dd1141aaaaa2aaea2391b108 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:46.518185 16959 ts_tablet_manager.cc:1403] T 3526ae05dd1141aaaaa2aaea2391b108 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.209s	user 0.016s	sys 0.010s
I20260709 13:05:46.519265 16900 tablet_service.cc:1511] Processing CreateTablet for tablet 2088afc1f50443139a328a7e3bb10212 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:46.520787 16900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2088afc1f50443139a328a7e3bb10212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.525334 16960 tablet_bootstrap.cc:654] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.525625 16675 tablet_service.cc:1511] Processing CreateTablet for tablet 2088afc1f50443139a328a7e3bb10212 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:46.532233 16675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2088afc1f50443139a328a7e3bb10212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.533665 16750 tablet_service.cc:1511] Processing CreateTablet for tablet e848db4f370a472f9baa6f3d547cb966 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:46.535264 16750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e848db4f370a472f9baa6f3d547cb966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.539752 16967 raft_consensus.cc:493] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.539625 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff8e33f0af546a8a976e5547b1b437e" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:46.541472 16967 raft_consensus.cc:515] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
W20260709 13:05:46.543449 16729 leader_election.cc:343] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:46.544716 16967 leader_election.cc:290] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:46.568020 16679 tablet_service.cc:1511] Processing CreateTablet for tablet 4723ff8bcfab41bfad7b411c81cd0386 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:46.569744 16679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4723ff8bcfab41bfad7b411c81cd0386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.582855 16671 tablet_service.cc:1511] Processing CreateTablet for tablet 30d0c8416cdc43289eceaddcbd00a20e (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:46.584434 16671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30d0c8416cdc43289eceaddcbd00a20e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.587110 16753 tablet_service.cc:1511] Processing CreateTablet for tablet 4723ff8bcfab41bfad7b411c81cd0386 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:46.588853 16753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4723ff8bcfab41bfad7b411c81cd0386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.590735 16749 tablet_service.cc:1511] Processing CreateTablet for tablet 30d0c8416cdc43289eceaddcbd00a20e (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:46.591260 16822 tablet_service.cc:1511] Processing CreateTablet for tablet e848db4f370a472f9baa6f3d547cb966 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:46.592332 16749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30d0c8416cdc43289eceaddcbd00a20e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.592646 16822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e848db4f370a472f9baa6f3d547cb966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.594075 16962 ts_tablet_manager.cc:1434] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.115s	user 0.018s	sys 0.000s
I20260709 13:05:46.595352 16962 tablet_bootstrap.cc:492] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:46.595498 16961 tablet_bootstrap.cc:654] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.597791 16959 raft_consensus.cc:359] T 3526ae05dd1141aaaaa2aaea2391b108 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:46.604436 16959 raft_consensus.cc:385] T 3526ae05dd1141aaaaa2aaea2391b108 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.606271 16960 tablet_bootstrap.cc:492] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:46.604776 16959 raft_consensus.cc:740] T 3526ae05dd1141aaaaa2aaea2391b108 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.609231 16959 consensus_queue.cc:260] T 3526ae05dd1141aaaaa2aaea2391b108 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:46.612526 16959 ts_tablet_manager.cc:1434] T 3526ae05dd1141aaaaa2aaea2391b108 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.094s	user 0.008s	sys 0.000s
I20260709 13:05:46.613582 16959 tablet_bootstrap.cc:492] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:46.617628 16826 tablet_service.cc:1511] Processing CreateTablet for tablet 4723ff8bcfab41bfad7b411c81cd0386 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:46.606900 16960 ts_tablet_manager.cc:1403] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.152s	user 0.017s	sys 0.005s
I20260709 13:05:46.620440 16825 tablet_service.cc:1511] Processing CreateTablet for tablet af9f8110756a49c082a81e072eed60b3 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:46.619159 16826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4723ff8bcfab41bfad7b411c81cd0386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.624245 16960 raft_consensus.cc:359] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:46.644647 16672 tablet_service.cc:1511] Processing CreateTablet for tablet af9f8110756a49c082a81e072eed60b3 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:46.647444 16821 tablet_service.cc:1511] Processing CreateTablet for tablet 3c96e991f59b4bc298a3819b579eaa15 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:46.649317 16672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af9f8110756a49c082a81e072eed60b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.650095 16902 tablet_service.cc:1511] Processing CreateTablet for tablet e848db4f370a472f9baa6f3d547cb966 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:46.650624 16747 tablet_service.cc:1511] Processing CreateTablet for tablet 3c96e991f59b4bc298a3819b579eaa15 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:46.651607 16902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e848db4f370a472f9baa6f3d547cb966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.651997 16747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c96e991f59b4bc298a3819b579eaa15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.639536 16960 raft_consensus.cc:385] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.664744 16960 raft_consensus.cc:740] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.665619 16897 tablet_service.cc:1511] Processing CreateTablet for tablet 30d0c8416cdc43289eceaddcbd00a20e (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:46.665844 16960 consensus_queue.cc:260] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:46.666656 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e982a881834665b4845c226db01020" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:46.667310 16897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30d0c8416cdc43289eceaddcbd00a20e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.668224 16959 tablet_bootstrap.cc:654] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.662976 16825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af9f8110756a49c082a81e072eed60b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.674568 16962 tablet_bootstrap.cc:654] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:46.681324 16636 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:46.688536 16678 tablet_service.cc:1511] Processing CreateTablet for tablet f2eb3c14d44647a7a2a6e4a88d64df71 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:46.689402 16821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c96e991f59b4bc298a3819b579eaa15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.690197 16678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2eb3c14d44647a7a2a6e4a88d64df71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.690454 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff8e33f0af546a8a976e5547b1b437e" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
W20260709 13:05:46.692345 16730 leader_election.cc:343] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:46.692657 16879 leader_election.cc:343] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:46.692912 16730 leader_election.cc:304] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:46.694341 16965 raft_consensus.cc:2749] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:46.701323 16901 tablet_service.cc:1511] Processing CreateTablet for tablet af9f8110756a49c082a81e072eed60b3 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:46.702757 16901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af9f8110756a49c082a81e072eed60b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.703238 16752 tablet_service.cc:1511] Processing CreateTablet for tablet f2eb3c14d44647a7a2a6e4a88d64df71 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:46.704573 16752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2eb3c14d44647a7a2a6e4a88d64df71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.705087 16960 ts_tablet_manager.cc:1434] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.000s
I20260709 13:05:46.706255 16960 tablet_bootstrap.cc:492] T 37a024bf1cd844419249b9636dd94c69 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:46.717650 16820 tablet_service.cc:1511] Processing CreateTablet for tablet f2eb3c14d44647a7a2a6e4a88d64df71 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:46.718992 16820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2eb3c14d44647a7a2a6e4a88d64df71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.742985 16900 tablet_service.cc:1511] Processing CreateTablet for tablet 3c96e991f59b4bc298a3819b579eaa15 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:46.743232 16904 tablet_service.cc:1511] Processing CreateTablet for tablet 2f610e2abe7b467facd521257722760d (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:46.743999 16675 tablet_service.cc:1511] Processing CreateTablet for tablet 2f610e2abe7b467facd521257722760d (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:46.744724 16900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c96e991f59b4bc298a3819b579eaa15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.745409 16675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f610e2abe7b467facd521257722760d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.745447 16904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f610e2abe7b467facd521257722760d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.753497 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e982a881834665b4845c226db01020" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:46.754101 16961 tablet_bootstrap.cc:492] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:46.754717 16961 ts_tablet_manager.cc:1403] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.326s	user 0.026s	sys 0.000s
W20260709 13:05:46.755915 16877 leader_election.cc:343] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:46.757206 16877 leader_election.cc:304] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:46.763567 16967 raft_consensus.cc:2749] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:46.780906 16750 tablet_service.cc:1511] Processing CreateTablet for tablet 2f610e2abe7b467facd521257722760d (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:46.782507 16750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f610e2abe7b467facd521257722760d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.785758 16961 raft_consensus.cc:359] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:46.786697 16961 raft_consensus.cc:385] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.787009 16961 raft_consensus.cc:740] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.787544 16962 tablet_bootstrap.cc:492] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:46.788166 16962 ts_tablet_manager.cc:1403] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.193s	user 0.011s	sys 0.003s
I20260709 13:05:46.787967 16961 consensus_queue.cc:260] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:46.790232 16961 ts_tablet_manager.cc:1434] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.002s
I20260709 13:05:46.799041 16679 tablet_service.cc:1511] Processing CreateTablet for tablet 95d82e412df245e1a4f614cc8c60539c (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:46.799142 16962 raft_consensus.cc:359] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:46.800551 16679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d82e412df245e1a4f614cc8c60539c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.802271 16749 tablet_service.cc:1511] Processing CreateTablet for tablet 7013ecc82f234c109dc955f8dca102b2 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:46.803874 16969 raft_consensus.cc:493] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.804261 16749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7013ecc82f234c109dc955f8dca102b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.804364 16969 raft_consensus.cc:515] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:46.807503 16969 leader_election.cc:290] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:46.800120 16962 raft_consensus.cc:385] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.813591 16962 raft_consensus.cc:740] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.813836 16959 tablet_bootstrap.cc:492] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:46.814487 16959 ts_tablet_manager.cc:1403] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.201s	user 0.019s	sys 0.025s
I20260709 13:05:46.814687 16962 consensus_queue.cc:260] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:46.816241 16901 tablet_service.cc:1511] Processing CreateTablet for tablet 7013ecc82f234c109dc955f8dca102b2 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:46.826877 16901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7013ecc82f234c109dc955f8dca102b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.819950 16960 tablet_bootstrap.cc:654] T 37a024bf1cd844419249b9636dd94c69 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.820051 16959 raft_consensus.cc:359] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:46.822220 16961 tablet_bootstrap.cc:492] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:46.814080 16902 tablet_service.cc:1511] Processing CreateTablet for tablet 95d82e412df245e1a4f614cc8c60539c (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:46.828601 16962 ts_tablet_manager.cc:1434] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.005s
I20260709 13:05:46.838284 16902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d82e412df245e1a4f614cc8c60539c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.832530 16959 raft_consensus.cc:385] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.844835 16959 raft_consensus.cc:740] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.869158 16825 tablet_service.cc:1511] Processing CreateTablet for tablet 95d82e412df245e1a4f614cc8c60539c (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:46.870793 16825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d82e412df245e1a4f614cc8c60539c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.872831 16675 tablet_service.cc:1511] Processing CreateTablet for tablet 83f0df42f20d4d9398c8d4b5b3cba4ea (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:46.874446 16675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83f0df42f20d4d9398c8d4b5b3cba4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.876801 16959 consensus_queue.cc:260] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:46.879317 16959 ts_tablet_manager.cc:1434] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.002s
I20260709 13:05:46.879737 16903 tablet_service.cc:1511] Processing CreateTablet for tablet e2f17f39ebb642ac9ff48f3820305d1a (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:46.881266 16826 tablet_service.cc:1511] Processing CreateTablet for tablet 7013ecc82f234c109dc955f8dca102b2 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:46.882284 16903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2f17f39ebb642ac9ff48f3820305d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.882769 16826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7013ecc82f234c109dc955f8dca102b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.870328 16752 tablet_service.cc:1511] Processing CreateTablet for tablet 83f0df42f20d4d9398c8d4b5b3cba4ea (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:46.888451 16752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83f0df42f20d4d9398c8d4b5b3cba4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.891485 16961 tablet_bootstrap.cc:654] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.862180 16962 tablet_bootstrap.cc:492] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:46.888630 16959 tablet_bootstrap.cc:492] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:46.909312 16672 tablet_service.cc:1511] Processing CreateTablet for tablet e2f17f39ebb642ac9ff48f3820305d1a (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:46.910799 16672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2f17f39ebb642ac9ff48f3820305d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.914502 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a0ed4bc207489699e41033ec224d3a" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:46.916158 16969 raft_consensus.cc:493] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:46.917846 16804 leader_election.cc:343] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:46.916715 16969 raft_consensus.cc:515] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:46.925633 16975 raft_consensus.cc:493] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.926474 16975 raft_consensus.cc:515] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:46.936707 16975 leader_election.cc:290] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:46.949040 16820 tablet_service.cc:1511] Processing CreateTablet for tablet 83f0df42f20d4d9398c8d4b5b3cba4ea (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:46.950557 16820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83f0df42f20d4d9398c8d4b5b3cba4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.950322 16747 tablet_service.cc:1511] Processing CreateTablet for tablet e2f17f39ebb642ac9ff48f3820305d1a (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:46.952766 16747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2f17f39ebb642ac9ff48f3820305d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.955408 16829 tablet_service.cc:1511] Processing CreateTablet for tablet 7e97f3430b8a49e2a9476402b7d46203 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:46.957382 16829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e97f3430b8a49e2a9476402b7d46203. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.967327 16962 tablet_bootstrap.cc:654] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.988533 16969 leader_election.cc:290] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:46.988577 16960 tablet_bootstrap.cc:492] T 37a024bf1cd844419249b9636dd94c69 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:46.989817 16960 ts_tablet_manager.cc:1403] T 37a024bf1cd844419249b9636dd94c69 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.284s	user 0.028s	sys 0.000s
I20260709 13:05:46.995612 16961 tablet_bootstrap.cc:492] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:46.995397 16904 tablet_service.cc:1511] Processing CreateTablet for tablet 7e97f3430b8a49e2a9476402b7d46203 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:46.996351 16961 ts_tablet_manager.cc:1403] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.174s	user 0.014s	sys 0.006s
I20260709 13:05:46.997256 16904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e97f3430b8a49e2a9476402b7d46203. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.998220 16753 tablet_service.cc:1511] Processing CreateTablet for tablet 9de37f630dc142a28db71d81fa427ab4 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:47.000065 16753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9de37f630dc142a28db71d81fa427ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.002290 16960 raft_consensus.cc:359] T 37a024bf1cd844419249b9636dd94c69 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:47.009981 16960 raft_consensus.cc:385] T 37a024bf1cd844419249b9636dd94c69 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.012674 16960 raft_consensus.cc:740] T 37a024bf1cd844419249b9636dd94c69 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.024655 16965 raft_consensus.cc:493] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.025767 16965 raft_consensus.cc:515] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:47.030098 16965 leader_election.cc:290] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:47.031388 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a024bf1cd844419249b9636dd94c69" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:47.031638 16678 tablet_service.cc:1511] Processing CreateTablet for tablet 7e97f3430b8a49e2a9476402b7d46203 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:47.032186 16839 raft_consensus.cc:2468] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 0.
I20260709 13:05:47.033211 16678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e97f3430b8a49e2a9476402b7d46203. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.034597 16729 leader_election.cc:304] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:47.037894 16965 raft_consensus.cc:2804] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:47.039032 16965 raft_consensus.cc:493] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.040030 16965 raft_consensus.cc:3060] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.029182 16960 consensus_queue.cc:260] T 37a024bf1cd844419249b9636dd94c69 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:47.040928 16959 tablet_bootstrap.cc:654] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.054044 16821 tablet_service.cc:1511] Processing CreateTablet for tablet 9de37f630dc142a28db71d81fa427ab4 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:47.055930 16821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9de37f630dc142a28db71d81fa427ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.058468 16961 raft_consensus.cc:359] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:47.059278 16961 raft_consensus.cc:385] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.059563 16961 raft_consensus.cc:740] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.060950 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a0ed4bc207489699e41033ec224d3a" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:47.063206 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a024bf1cd844419249b9636dd94c69" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:47.064221 16913 raft_consensus.cc:2468] T 37a024bf1cd844419249b9636dd94c69 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
W20260709 13:05:47.067337 16802 leader_election.cc:343] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:47.067921 16802 leader_election.cc:304] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd; no voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:47.069410 16802 leader_election.cc:304] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:47.070631 16969 raft_consensus.cc:2749] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:47.071430 16969 raft_consensus.cc:2804] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:47.071815 16969 raft_consensus.cc:493] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.072285 16969 raft_consensus.cc:3060] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.088030 16902 tablet_service.cc:1511] Processing CreateTablet for tablet 9de37f630dc142a28db71d81fa427ab4 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:47.100848 16967 raft_consensus.cc:493] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.101104 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661f1f2dcacb42bca7e3b25195dbdfe1" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:47.101511 16967 raft_consensus.cc:515] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:47.101809 16675 tablet_service.cc:1511] Processing CreateTablet for tablet 0f6a383a050745a791b07441a3b93828 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:47.103286 16675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f6a383a050745a791b07441a3b93828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.104157 16967 leader_election.cc:290] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:47.105762 16960 ts_tablet_manager.cc:1434] T 37a024bf1cd844419249b9636dd94c69 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.115s	user 0.012s	sys 0.000s
I20260709 13:05:47.110281 16750 tablet_service.cc:1511] Processing CreateTablet for tablet 0f6a383a050745a791b07441a3b93828 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:47.111871 16750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f6a383a050745a791b07441a3b93828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.116361 16962 tablet_bootstrap.cc:492] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:47.117069 16962 ts_tablet_manager.cc:1403] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.266s	user 0.010s	sys 0.015s
I20260709 13:05:47.121845 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d281c9020d454b23a8bd21ccfadfa93c" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:47.060473 16961 consensus_queue.cc:260] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:47.129252 16839 raft_consensus.cc:2468] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 0.
I20260709 13:05:47.131245 16961 ts_tablet_manager.cc:1434] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.134s	user 0.013s	sys 0.000s
I20260709 13:05:47.117107 16902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9de37f630dc142a28db71d81fa427ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.139990 16903 tablet_service.cc:1511] Processing CreateTablet for tablet c80dc47d27a749eab1ffa183f231f036 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:47.142532 16969 raft_consensus.cc:515] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:47.144759 16654 leader_election.cc:304] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd; no voters: 
I20260709 13:05:47.146741 16975 raft_consensus.cc:2804] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:47.147240 16975 raft_consensus.cc:493] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.147643 16975 raft_consensus.cc:3060] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.154102 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a024bf1cd844419249b9636dd94c69" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:47.154991 16903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c80dc47d27a749eab1ffa183f231f036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.154029 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d281c9020d454b23a8bd21ccfadfa93c" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:47.144814 16969 leader_election.cc:290] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:47.157205 16961 tablet_bootstrap.cc:492] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
W20260709 13:05:47.157140 16878 leader_election.cc:343] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:47.161082 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661f1f2dcacb42bca7e3b25195dbdfe1" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
W20260709 13:05:47.161365 16879 leader_election.cc:343] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:47.162843 16653 leader_election.cc:343] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:47.161998 16879 leader_election.cc:304] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:47.165052 16967 raft_consensus.cc:2749] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:47.145479 16960 tablet_bootstrap.cc:492] T d965337ae0df4ca7aba0e4f9549a8ca9 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:47.172227 16995 raft_consensus.cc:493] T 3526ae05dd1141aaaaa2aaea2391b108 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:47.170382 16573 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.8.4.67:39929, user_credentials={real_user=slave}} blocked reactor thread for 47349us
I20260709 13:05:47.156828 16962 raft_consensus.cc:359] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:47.184834 16825 tablet_service.cc:1511] Processing CreateTablet for tablet 0f6a383a050745a791b07441a3b93828 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:47.185225 16672 tablet_service.cc:1511] Processing CreateTablet for tablet c80dc47d27a749eab1ffa183f231f036 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:47.186508 16672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c80dc47d27a749eab1ffa183f231f036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.193732 16825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f6a383a050745a791b07441a3b93828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.194201 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a024bf1cd844419249b9636dd94c69" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:47.200218 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a024bf1cd844419249b9636dd94c69" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:47.200850 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a024bf1cd844419249b9636dd94c69" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:47.201565 16975 raft_consensus.cc:515] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:47.200945 16913 raft_consensus.cc:2468] T 37a024bf1cd844419249b9636dd94c69 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 0.
I20260709 13:05:47.183416 16962 raft_consensus.cc:385] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.206243 16962 raft_consensus.cc:740] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.208765 16961 tablet_bootstrap.cc:654] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.177386 16995 raft_consensus.cc:515] T 3526ae05dd1141aaaaa2aaea2391b108 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:47.192677 16965 raft_consensus.cc:515] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:47.212316 16802 leader_election.cc:304] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd; no voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:47.215297 16995 leader_election.cc:290] T 3526ae05dd1141aaaaa2aaea2391b108 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:47.217031 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3526ae05dd1141aaaaa2aaea2391b108" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:47.220016 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3526ae05dd1141aaaaa2aaea2391b108" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
W20260709 13:05:47.221354 16728 leader_election.cc:343] T 3526ae05dd1141aaaaa2aaea2391b108 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:47.201478 16752 tablet_service.cc:1511] Processing CreateTablet for tablet c80dc47d27a749eab1ffa183f231f036 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260709 13:05:47.222259 16730 leader_election.cc:343] T 3526ae05dd1141aaaaa2aaea2391b108 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:47.222780 16730 leader_election.cc:304] T 3526ae05dd1141aaaaa2aaea2391b108 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:47.224884 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661f1f2dcacb42bca7e3b25195dbdfe1" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:47.225664 16839 raft_consensus.cc:3060] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.223040 16752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c80dc47d27a749eab1ffa183f231f036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.227227 16995 raft_consensus.cc:2749] T 3526ae05dd1141aaaaa2aaea2391b108 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:47.231166 16765 raft_consensus.cc:2393] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 622433288cac4964aea9ea5a24ba77fd in current term 1: Already voted for candidate d0ea3afb898b4eb5b21faeb676627011 in this term.
I20260709 13:05:47.233912 16678 tablet_service.cc:1511] Processing CreateTablet for tablet e79d615b8ac14c149720027be9d4dee2 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:47.237820 16678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e79d615b8ac14c149720027be9d4dee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.228504 16962 consensus_queue.cc:260] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:47.230315 16901 tablet_service.cc:1511] Processing CreateTablet for tablet e79d615b8ac14c149720027be9d4dee2 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:47.231633 16749 tablet_service.cc:1511] Processing CreateTablet for tablet 1ceff4a1d9cf4d75994e64ebab75c551 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:47.240733 16749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ceff4a1d9cf4d75994e64ebab75c551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.242121 16965 leader_election.cc:290] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:47.233157 16994 raft_consensus.cc:2749] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:47.244714 16901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e79d615b8ac14c149720027be9d4dee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.245138 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a024bf1cd844419249b9636dd94c69" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:47.245771 16913 raft_consensus.cc:3060] T 37a024bf1cd844419249b9636dd94c69 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.244741 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a024bf1cd844419249b9636dd94c69" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:47.250114 16838 raft_consensus.cc:2393] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d0ea3afb898b4eb5b21faeb676627011 in current term 1: Already voted for candidate 622433288cac4964aea9ea5a24ba77fd in this term.
I20260709 13:05:47.250850 16960 tablet_bootstrap.cc:654] T d965337ae0df4ca7aba0e4f9549a8ca9 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.251845 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661f1f2dcacb42bca7e3b25195dbdfe1" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:47.252770 16975 leader_election.cc:290] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:47.260704 16829 tablet_service.cc:1511] Processing CreateTablet for tablet 1ceff4a1d9cf4d75994e64ebab75c551 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:47.262522 16829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ceff4a1d9cf4d75994e64ebab75c551. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:47.265071 16653 leader_election.cc:343] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:47.265676 16959 tablet_bootstrap.cc:492] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:47.266355 16959 ts_tablet_manager.cc:1403] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.378s	user 0.010s	sys 0.014s
I20260709 13:05:47.269099 16839 raft_consensus.cc:2468] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 1.
I20260709 13:05:47.270642 16654 leader_election.cc:304] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd; no voters: 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:47.273877 16975 raft_consensus.cc:2804] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:47.278241 16820 tablet_service.cc:1511] Processing CreateTablet for tablet e79d615b8ac14c149720027be9d4dee2 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:47.282719 16897 tablet_service.cc:1511] Processing CreateTablet for tablet 1ceff4a1d9cf4d75994e64ebab75c551 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:47.286016 16959 raft_consensus.cc:359] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:47.293704 16997 raft_consensus.cc:493] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.297951 16897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ceff4a1d9cf4d75994e64ebab75c551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.298743 16679 tablet_service.cc:1511] Processing CreateTablet for tablet 772bb23805934270899495ae7c8cbb07 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:47.309664 16820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e79d615b8ac14c149720027be9d4dee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.311312 16913 raft_consensus.cc:2468] T 37a024bf1cd844419249b9636dd94c69 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
I20260709 13:05:47.313231 16728 leader_election.cc:304] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:47.314518 16965 raft_consensus.cc:2804] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:47.300861 16679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772bb23805934270899495ae7c8cbb07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.315130 16965 raft_consensus.cc:697] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Becoming Leader. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:05:47.316572 16965 consensus_queue.cc:237] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:47.295807 16959 raft_consensus.cc:385] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.342289 16825 tablet_service.cc:1511] Processing CreateTablet for tablet 772bb23805934270899495ae7c8cbb07 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:47.342535 16902 tablet_service.cc:1511] Processing CreateTablet for tablet 4e93c7f885494add9735d842339e740a (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:47.343956 16902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e93c7f885494add9735d842339e740a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.333448 16959 raft_consensus.cc:740] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.343956 16825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772bb23805934270899495ae7c8cbb07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.330513 16997 raft_consensus.cc:515] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:47.355338 16749 tablet_service.cc:1511] Processing CreateTablet for tablet 772bb23805934270899495ae7c8cbb07 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:47.370383 16821 tablet_service.cc:1511] Processing CreateTablet for tablet 0f906a9d133f4a90b55f8dd4ba7d917a (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:47.358264 16962 ts_tablet_manager.cc:1434] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.241s	user 0.013s	sys 0.018s
I20260709 13:05:47.358006 16675 tablet_service.cc:1511] Processing CreateTablet for tablet 4e93c7f885494add9735d842339e740a (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:47.372581 16904 tablet_service.cc:1511] Processing CreateTablet for tablet 0f906a9d133f4a90b55f8dd4ba7d917a (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:47.373427 16675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e93c7f885494add9735d842339e740a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.374092 16904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f906a9d133f4a90b55f8dd4ba7d917a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.376585 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff8e33f0af546a8a976e5547b1b437e" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
W20260709 13:05:47.379005 16654 leader_election.cc:343] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:47.380376 16997 leader_election.cc:290] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:47.363560 16750 tablet_service.cc:1511] Processing CreateTablet for tablet 4e93c7f885494add9735d842339e740a (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:47.364909 17000 raft_consensus.cc:493] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.366101 16961 tablet_bootstrap.cc:492] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:47.402876 16961 ts_tablet_manager.cc:1403] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.270s	user 0.026s	sys 0.008s
I20260709 13:05:47.402854 16672 tablet_service.cc:1511] Processing CreateTablet for tablet b49036bff00949ec88900c3537cf5edc (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:47.404647 16672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b49036bff00949ec88900c3537cf5edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.405453 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff8e33f0af546a8a976e5547b1b437e" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:47.406217 16765 raft_consensus.cc:2468] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 0.
I20260709 13:05:47.370904 16749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772bb23805934270899495ae7c8cbb07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.350502 16975 raft_consensus.cc:697] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:05:47.372041 16960 tablet_bootstrap.cc:492] T d965337ae0df4ca7aba0e4f9549a8ca9 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:47.419029 16960 ts_tablet_manager.cc:1403] T d965337ae0df4ca7aba0e4f9549a8ca9 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.274s	user 0.029s	sys 0.029s
I20260709 13:05:47.419196 16826 tablet_service.cc:1511] Processing CreateTablet for tablet e3aa4f2f9c5f43b383113ff0d0ad296d (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:47.372206 16821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f906a9d133f4a90b55f8dd4ba7d917a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.421540 16671 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce874d8c223464585bd12c973d333b6 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:47.422603 16901 tablet_service.cc:1511] Processing CreateTablet for tablet e3aa4f2f9c5f43b383113ff0d0ad296d (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:47.423311 16671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce874d8c223464585bd12c973d333b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.424209 16901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3aa4f2f9c5f43b383113ff0d0ad296d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.412565 16747 tablet_service.cc:1511] Processing CreateTablet for tablet b49036bff00949ec88900c3537cf5edc (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:47.384990 16962 tablet_bootstrap.cc:492] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:47.359050 16959 consensus_queue.cc:260] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:47.427245 16959 ts_tablet_manager.cc:1434] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.161s	user 0.008s	sys 0.001s
I20260709 13:05:47.428403 16959 tablet_bootstrap.cc:492] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:47.393356 16678 tablet_service.cc:1511] Processing CreateTablet for tablet 0f906a9d133f4a90b55f8dd4ba7d917a (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:47.429666 16678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f906a9d133f4a90b55f8dd4ba7d917a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.430094 16897 tablet_service.cc:1511] Processing CreateTablet for tablet e863dd66af3949e78a0e9882520673fb (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:47.431550 16897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e863dd66af3949e78a0e9882520673fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.399995 16829 tablet_service.cc:1511] Processing CreateTablet for tablet e863dd66af3949e78a0e9882520673fb (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:47.415082 16653 leader_election.cc:304] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:47.414281 17000 raft_consensus.cc:515] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:47.415733 16753 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce874d8c223464585bd12c973d333b6 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:47.415094 16750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e93c7f885494add9735d842339e740a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.417846 16975 consensus_queue.cc:237] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:47.440860 17000 leader_election.cc:290] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:47.442911 16677 tablet_service.cc:1511] Processing CreateTablet for tablet e3aa4f2f9c5f43b383113ff0d0ad296d (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:47.444114 16747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b49036bff00949ec88900c3537cf5edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.444484 16677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3aa4f2f9c5f43b383113ff0d0ad296d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.445468 16753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce874d8c223464585bd12c973d333b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.449201 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e982a881834665b4845c226db01020" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:47.449996 16913 raft_consensus.cc:2468] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 0.
I20260709 13:05:47.437592 16752 tablet_service.cc:1511] Processing CreateTablet for tablet e863dd66af3949e78a0e9882520673fb (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:47.451448 16752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e863dd66af3949e78a0e9882520673fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.447780 16826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3aa4f2f9c5f43b383113ff0d0ad296d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.454041 16587 catalog_manager.cc:5697] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011 reported cstate change: term changed from 0 to 1, leader changed from <none> to d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d0ea3afb898b4eb5b21faeb676627011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.458017 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e982a881834665b4845c226db01020" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:47.458920 16765 raft_consensus.cc:2468] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 0.
I20260709 13:05:47.461108 17000 raft_consensus.cc:2804] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:47.461608 17000 raft_consensus.cc:493] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.462018 17000 raft_consensus.cc:3060] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.462077 16961 raft_consensus.cc:359] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:47.462961 16961 raft_consensus.cc:385] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.463282 16961 raft_consensus.cc:740] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.464061 16961 consensus_queue.cc:260] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:47.465389 16653 leader_election.cc:304] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:47.460446 16903 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce874d8c223464585bd12c973d333b6 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:47.466301 16997 raft_consensus.cc:2804] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:47.466286 16960 raft_consensus.cc:359] T d965337ae0df4ca7aba0e4f9549a8ca9 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:47.467073 16997 raft_consensus.cc:493] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.467391 16960 raft_consensus.cc:385] T d965337ae0df4ca7aba0e4f9549a8ca9 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.467532 16997 raft_consensus.cc:3060] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.467619 16903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce874d8c223464585bd12c973d333b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.472100 16961 ts_tablet_manager.cc:1434] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.000s
I20260709 13:05:47.481127 16960 raft_consensus.cc:740] T d965337ae0df4ca7aba0e4f9549a8ca9 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.481961 16820 tablet_service.cc:1511] Processing CreateTablet for tablet b49036bff00949ec88900c3537cf5edc (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:47.482241 16960 consensus_queue.cc:260] T d965337ae0df4ca7aba0e4f9549a8ca9 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:47.498438 16829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e863dd66af3949e78a0e9882520673fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.502501 16748 tablet_service.cc:1511] Processing CreateTablet for tablet c522eefb992a4533ad3a9f3ba6634bc8 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:47.503896 16748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c522eefb992a4533ad3a9f3ba6634bc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.505103 16997 raft_consensus.cc:515] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:47.507500 16997 leader_election.cc:290] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:47.508922 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e982a881834665b4845c226db01020" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:47.509753 16913 raft_consensus.cc:3060] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.513940 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e982a881834665b4845c226db01020" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:47.514899 16765 raft_consensus.cc:3060] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.518534 17000 raft_consensus.cc:515] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:47.519544 16962 tablet_bootstrap.cc:654] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.512516 16902 tablet_service.cc:1511] Processing CreateTablet for tablet c522eefb992a4533ad3a9f3ba6634bc8 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:47.547685 16902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c522eefb992a4533ad3a9f3ba6634bc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.523708 16959 tablet_bootstrap.cc:654] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.531144 16913 raft_consensus.cc:2468] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 1.
I20260709 13:05:47.532722 16765 raft_consensus.cc:2468] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 1.
I20260709 13:05:47.536870 16961 tablet_bootstrap.cc:492] T 4f0d93c13e344f40b065cabcbc63d751 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:47.537081 16751 tablet_service.cc:1511] Processing CreateTablet for tablet bf3d4f25ea4e4b14b6dd55a052daf82c (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:47.554050 16751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf3d4f25ea4e4b14b6dd55a052daf82c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.548089 16585 catalog_manager.cc:5697] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:47.558240 16822 tablet_service.cc:1511] Processing CreateTablet for tablet bf3d4f25ea4e4b14b6dd55a052daf82c (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:47.529623 16960 ts_tablet_manager.cc:1434] T d965337ae0df4ca7aba0e4f9549a8ca9 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.110s	user 0.004s	sys 0.005s
I20260709 13:05:47.560460 16960 tablet_bootstrap.cc:492] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:47.565438 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff8e33f0af546a8a976e5547b1b437e" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:47.565802 16820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b49036bff00949ec88900c3537cf5edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.566124 16839 raft_consensus.cc:3060] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.567896 16822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf3d4f25ea4e4b14b6dd55a052daf82c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.570007 16961 tablet_bootstrap.cc:654] T 4f0d93c13e344f40b065cabcbc63d751 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.570071 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff8e33f0af546a8a976e5547b1b437e" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:47.570937 16764 raft_consensus.cc:3060] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.545107 16679 tablet_service.cc:1511] Processing CreateTablet for tablet bf3d4f25ea4e4b14b6dd55a052daf82c (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:47.574712 17000 leader_election.cc:290] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:47.589502 16653 leader_election.cc:304] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:47.609290 17000 raft_consensus.cc:2804] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:47.610234 17000 raft_consensus.cc:697] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:05:47.610162 16671 tablet_service.cc:1511] Processing CreateTablet for tablet 5f7a4cb12b194107a5bba9336ed37819 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:47.611385 17000 consensus_queue.cc:237] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:47.619341 16764 raft_consensus.cc:2468] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 1.
I20260709 13:05:47.622430 16653 leader_election.cc:304] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:47.623833 16975 raft_consensus.cc:2804] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:47.624673 16975 raft_consensus.cc:697] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:05:47.625715 16975 consensus_queue.cc:237] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:47.602509 16839 raft_consensus.cc:2468] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 1.
I20260709 13:05:47.626227 16903 tablet_service.cc:1511] Processing CreateTablet for tablet 5f7a4cb12b194107a5bba9336ed37819 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:47.631430 16903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7a4cb12b194107a5bba9336ed37819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.654232 16960 tablet_bootstrap.cc:654] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.560554 16825 tablet_service.cc:1511] Processing CreateTablet for tablet c522eefb992a4533ad3a9f3ba6634bc8 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:47.656608 16825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c522eefb992a4533ad3a9f3ba6634bc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.665337 16679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf3d4f25ea4e4b14b6dd55a052daf82c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.686493 16671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7a4cb12b194107a5bba9336ed37819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.710088 16677 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac2a62af17746bcba9f94b6a1053f28 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:47.710994 16961 tablet_bootstrap.cc:492] T 4f0d93c13e344f40b065cabcbc63d751 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:47.711517 16677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac2a62af17746bcba9f94b6a1053f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.711570 16961 ts_tablet_manager.cc:1403] T 4f0d93c13e344f40b065cabcbc63d751 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.175s	user 0.060s	sys 0.034s
I20260709 13:05:47.705915 16749 tablet_service.cc:1511] Processing CreateTablet for tablet 5f7a4cb12b194107a5bba9336ed37819 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:47.713761 16959 tablet_bootstrap.cc:492] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:47.714308 16959 ts_tablet_manager.cc:1403] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.286s	user 0.044s	sys 0.019s
I20260709 13:05:47.714380 16749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7a4cb12b194107a5bba9336ed37819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.715072 16961 raft_consensus.cc:359] T 4f0d93c13e344f40b065cabcbc63d751 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:47.715871 16961 raft_consensus.cc:385] T 4f0d93c13e344f40b065cabcbc63d751 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.716168 16961 raft_consensus.cc:740] T 4f0d93c13e344f40b065cabcbc63d751 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.716953 16961 consensus_queue.cc:260] T 4f0d93c13e344f40b065cabcbc63d751 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:47.718012 16821 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac2a62af17746bcba9f94b6a1053f28 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:47.719517 16821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac2a62af17746bcba9f94b6a1053f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.721764 16897 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac2a62af17746bcba9f94b6a1053f28 (DEFAULT_TABLE table=test-workload [id=e9d77755801e43f28c8984c4fe23c07e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:47.723606 16897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac2a62af17746bcba9f94b6a1053f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:47.725762 16967 raft_consensus.cc:493] T d965337ae0df4ca7aba0e4f9549a8ca9 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.726351 16967 raft_consensus.cc:515] T d965337ae0df4ca7aba0e4f9549a8ca9 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:47.731477 16961 ts_tablet_manager.cc:1434] T 4f0d93c13e344f40b065cabcbc63d751 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 13:05:47.731719 16967 leader_election.cc:290] T d965337ae0df4ca7aba0e4f9549a8ca9 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:47.732659 16961 tablet_bootstrap.cc:492] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:47.733054 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d965337ae0df4ca7aba0e4f9549a8ca9" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
W20260709 13:05:47.734561 16877 leader_election.cc:343] T d965337ae0df4ca7aba0e4f9549a8ca9 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:47.738977 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d965337ae0df4ca7aba0e4f9549a8ca9" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:47.740728 16962 tablet_bootstrap.cc:492] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
W20260709 13:05:47.740657 16879 leader_election.cc:343] T d965337ae0df4ca7aba0e4f9549a8ca9 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:47.741328 16962 ts_tablet_manager.cc:1403] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.357s	user 0.017s	sys 0.005s
I20260709 13:05:47.741285 16879 leader_election.cc:304] T d965337ae0df4ca7aba0e4f9549a8ca9 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:47.742594 16967 raft_consensus.cc:2749] T d965337ae0df4ca7aba0e4f9549a8ca9 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:47.750005 16995 consensus_queue.cc:1048] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:47.758981 16962 raft_consensus.cc:359] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:47.760025 16962 raft_consensus.cc:385] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.760392 16962 raft_consensus.cc:740] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.773455 16962 consensus_queue.cc:260] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:47.785439 16962 ts_tablet_manager.cc:1434] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.001s
I20260709 13:05:47.786638 16962 tablet_bootstrap.cc:492] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:47.728350 16959 raft_consensus.cc:359] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:47.787204 16959 raft_consensus.cc:385] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.787567 16959 raft_consensus.cc:740] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
W20260709 13:05:47.788787 16636 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:47.818539 16995 consensus_queue.cc:1048] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:47.812752 16959 consensus_queue.cc:260] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:47.830782 16961 tablet_bootstrap.cc:654] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.840616 16962 tablet_bootstrap.cc:654] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.845093 16959 ts_tablet_manager.cc:1434] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.130s	user 0.006s	sys 0.004s
I20260709 13:05:47.846510 16959 tablet_bootstrap.cc:492] T a8d411124ca242a3b8b4fbb5b0a90b66 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:47.853367 16960 tablet_bootstrap.cc:492] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:47.854080 16960 ts_tablet_manager.cc:1403] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.294s	user 0.034s	sys 0.002s
I20260709 13:05:47.856467 16961 tablet_bootstrap.cc:492] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:47.857187 16961 ts_tablet_manager.cc:1403] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.125s	user 0.012s	sys 0.004s
I20260709 13:05:47.857801 16960 raft_consensus.cc:359] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:47.858620 16960 raft_consensus.cc:385] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.858929 16960 raft_consensus.cc:740] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.862270 16961 raft_consensus.cc:359] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:47.863257 16961 raft_consensus.cc:385] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.863695 16961 raft_consensus.cc:740] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.866732 16960 consensus_queue.cc:260] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:47.871454 16960 ts_tablet_manager.cc:1434] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.005s
I20260709 13:05:47.872687 16960 tablet_bootstrap.cc:492] T 16b4be927a834597b7190497210b9169 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:47.874675 16962 tablet_bootstrap.cc:492] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:47.875351 16962 ts_tablet_manager.cc:1403] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.089s	user 0.007s	sys 0.015s
I20260709 13:05:47.878684 16962 raft_consensus.cc:359] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:47.880474 16962 raft_consensus.cc:385] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.880805 16962 raft_consensus.cc:740] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.881587 16962 consensus_queue.cc:260] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:47.882411 16587 catalog_manager.cc:5697] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.883541 17000 consensus_queue.cc:1048] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:47.884034 16962 ts_tablet_manager.cc:1434] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 13:05:47.885331 16962 tablet_bootstrap.cc:492] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:47.884819 16587 catalog_manager.cc:5697] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.880057 16960 tablet_bootstrap.cc:654] T 16b4be927a834597b7190497210b9169 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.895731 16962 tablet_bootstrap.cc:654] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.895731 16959 tablet_bootstrap.cc:654] T a8d411124ca242a3b8b4fbb5b0a90b66 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.897058 16960 tablet_bootstrap.cc:492] T 16b4be927a834597b7190497210b9169 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:47.900390 16960 ts_tablet_manager.cc:1403] T 16b4be927a834597b7190497210b9169 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.028s	user 0.005s	sys 0.008s
I20260709 13:05:47.903772 16961 consensus_queue.cc:260] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:47.908850 16961 ts_tablet_manager.cc:1434] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 13:05:47.910367 16961 tablet_bootstrap.cc:492] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:47.904174 16960 raft_consensus.cc:359] T 16b4be927a834597b7190497210b9169 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:47.911460 16960 raft_consensus.cc:385] T 16b4be927a834597b7190497210b9169 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.911886 16960 raft_consensus.cc:740] T 16b4be927a834597b7190497210b9169 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.912772 16960 consensus_queue.cc:260] T 16b4be927a834597b7190497210b9169 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:47.916098 16960 ts_tablet_manager.cc:1434] T 16b4be927a834597b7190497210b9169 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:05:47.917371 16960 tablet_bootstrap.cc:492] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:47.918716 16961 tablet_bootstrap.cc:654] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.928030 16960 tablet_bootstrap.cc:654] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.937322 16959 tablet_bootstrap.cc:492] T a8d411124ca242a3b8b4fbb5b0a90b66 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:47.937961 16959 ts_tablet_manager.cc:1403] T a8d411124ca242a3b8b4fbb5b0a90b66 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.092s	user 0.014s	sys 0.004s
W20260709 13:05:47.939379 16653 consensus_peers.cc:597] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 -> Peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Couldn't send request to peer 7197bc10b2304fccb972da2da7749e3b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:47.942865 16959 raft_consensus.cc:359] T a8d411124ca242a3b8b4fbb5b0a90b66 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:47.944164 16959 raft_consensus.cc:385] T a8d411124ca242a3b8b4fbb5b0a90b66 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.944768 16959 raft_consensus.cc:740] T a8d411124ca242a3b8b4fbb5b0a90b66 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.945886 16959 consensus_queue.cc:260] T a8d411124ca242a3b8b4fbb5b0a90b66 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:47.949198 16962 tablet_bootstrap.cc:492] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:47.949527 16959 ts_tablet_manager.cc:1434] T a8d411124ca242a3b8b4fbb5b0a90b66 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:05:47.949848 16962 ts_tablet_manager.cc:1403] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.016s
I20260709 13:05:47.951010 16959 tablet_bootstrap.cc:492] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:47.953410 16962 raft_consensus.cc:359] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:47.954299 16962 raft_consensus.cc:385] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.954648 16962 raft_consensus.cc:740] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.958209 16960 tablet_bootstrap.cc:492] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:47.958827 16960 ts_tablet_manager.cc:1403] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.004s
I20260709 13:05:47.959579 16959 tablet_bootstrap.cc:654] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.962512 16960 raft_consensus.cc:359] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:47.963460 16960 raft_consensus.cc:385] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.963795 16960 raft_consensus.cc:740] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.965327 16959 tablet_bootstrap.cc:492] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:47.964699 16960 consensus_queue.cc:260] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:47.965893 16959 ts_tablet_manager.cc:1403] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:05:47.967473 16961 tablet_bootstrap.cc:492] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:47.967597 16960 ts_tablet_manager.cc:1434] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:05:47.968374 16961 ts_tablet_manager.cc:1403] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.005s
I20260709 13:05:47.969587 16960 tablet_bootstrap.cc:492] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:47.970773 16959 raft_consensus.cc:359] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:47.971666 16959 raft_consensus.cc:385] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.972018 16959 raft_consensus.cc:740] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.971825 16961 raft_consensus.cc:359] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:47.973426 16959 consensus_queue.cc:260] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:47.976775 16959 ts_tablet_manager.cc:1434] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:05:47.977504 16960 tablet_bootstrap.cc:654] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.973124 16961 raft_consensus.cc:385] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.978261 16961 raft_consensus.cc:740] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.978438 16959 tablet_bootstrap.cc:492] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:47.979274 16961 consensus_queue.cc:260] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:47.986157 16959 tablet_bootstrap.cc:654] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.990978 16961 ts_tablet_manager.cc:1434] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.004s
I20260709 13:05:47.992439 16960 tablet_bootstrap.cc:492] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:47.993050 16960 ts_tablet_manager.cc:1403] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.013s
I20260709 13:05:47.992959 16962 consensus_queue.cc:260] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:47.995862 16962 ts_tablet_manager.cc:1434] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.046s	user 0.002s	sys 0.005s
I20260709 13:05:47.996492 16959 tablet_bootstrap.cc:492] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:47.996479 16960 raft_consensus.cc:359] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:47.997313 16959 ts_tablet_manager.cc:1403] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:05:47.997416 16960 raft_consensus.cc:385] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.997416 16962 tablet_bootstrap.cc:492] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:48.000466 16959 raft_consensus.cc:359] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.001350 16959 raft_consensus.cc:385] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.001645 16959 raft_consensus.cc:740] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.002437 16959 consensus_queue.cc:260] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:47.997923 16960 raft_consensus.cc:740] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.006971 16961 tablet_bootstrap.cc:492] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:48.007206 16960 consensus_queue.cc:260] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:48.008776 16997 consensus_queue.cc:1048] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:48.009613 16960 ts_tablet_manager.cc:1434] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:05:48.014108 16960 tablet_bootstrap.cc:492] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:48.016089 16961 tablet_bootstrap.cc:654] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.017088 16959 ts_tablet_manager.cc:1434] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:05:48.017433 16967 raft_consensus.cc:493] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.019387 16967 raft_consensus.cc:515] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:48.020372 16960 tablet_bootstrap.cc:654] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.021700 16967 leader_election.cc:290] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:48.023324 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3526ae05dd1141aaaaa2aaea2391b108" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:48.024317 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3526ae05dd1141aaaaa2aaea2391b108" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:48.024674 16962 tablet_bootstrap.cc:654] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:48.024888 16879 leader_election.cc:343] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.024992 16765 raft_consensus.cc:2468] T 3526ae05dd1141aaaaa2aaea2391b108 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:48.026546 16877 leader_election.cc:304] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:48.027351 16967 raft_consensus.cc:2804] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:48.027729 16967 raft_consensus.cc:493] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.028071 16967 raft_consensus.cc:3060] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.028395 16997 consensus_queue.cc:1048] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:48.032894 16994 raft_consensus.cc:493] T 4f0d93c13e344f40b065cabcbc63d751 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.033454 16994 raft_consensus.cc:515] T 4f0d93c13e344f40b065cabcbc63d751 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:48.037137 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f0d93c13e344f40b065cabcbc63d751" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
W20260709 13:05:48.038941 16802 leader_election.cc:343] T 4f0d93c13e344f40b065cabcbc63d751 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.037174 16959 tablet_bootstrap.cc:492] T 9bc00a2c7a04450a9c9ce82457ab573c P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:48.040290 16994 leader_election.cc:290] T 4f0d93c13e344f40b065cabcbc63d751 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:48.035967 16967 raft_consensus.cc:515] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:48.045315 16967 leader_election.cc:290] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Requested vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:48.046114 16967 raft_consensus.cc:493] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.046766 16967 raft_consensus.cc:515] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.055274 17038 raft_consensus.cc:493] T 16b4be927a834597b7190497210b9169 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.056159 17038 raft_consensus.cc:515] T 16b4be927a834597b7190497210b9169 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:48.057512 16995 raft_consensus.cc:493] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.070144 16995 raft_consensus.cc:515] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:48.059165 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f0d93c13e344f40b065cabcbc63d751" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:48.062280 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3526ae05dd1141aaaaa2aaea2391b108" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:48.073822 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d965337ae0df4ca7aba0e4f9549a8ca9" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:48.074599 16913 raft_consensus.cc:2468] T d965337ae0df4ca7aba0e4f9549a8ca9 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 0.
I20260709 13:05:48.074887 16995 leader_election.cc:290] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:48.063367 17036 raft_consensus.cc:493] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.075598 16967 leader_election.cc:290] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
W20260709 13:05:48.075976 16804 leader_election.cc:343] T 4f0d93c13e344f40b065cabcbc63d751 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.076124 16959 tablet_bootstrap.cc:654] T 9bc00a2c7a04450a9c9ce82457ab573c P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.076524 16804 leader_election.cc:304] T 4f0d93c13e344f40b065cabcbc63d751 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd; no voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:48.077198 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d411124ca242a3b8b4fbb5b0a90b66" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:48.078104 16994 raft_consensus.cc:2749] T 4f0d93c13e344f40b065cabcbc63d751 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:48.074927 17038 leader_election.cc:290] T 16b4be927a834597b7190497210b9169 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:48.068746 16997 raft_consensus.cc:493] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.077754 17036 raft_consensus.cc:515] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.069475 16960 tablet_bootstrap.cc:492] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:48.079766 16960 ts_tablet_manager.cc:1403] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.066s	user 0.020s	sys 0.006s
I20260709 13:05:48.080420 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d965337ae0df4ca7aba0e4f9549a8ca9" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
W20260709 13:05:48.081784 16879 leader_election.cc:343] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.082149 16839 raft_consensus.cc:2468] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:48.082517 16689 raft_consensus.cc:2468] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 0.
I20260709 13:05:48.082674 16997 raft_consensus.cc:515] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.080842 16728 leader_election.cc:304] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:48.081286 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16b4be927a834597b7190497210b9169" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:48.084280 16878 leader_election.cc:304] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:48.086971 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d411124ca242a3b8b4fbb5b0a90b66" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:48.087350 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d281c9020d454b23a8bd21ccfadfa93c" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:48.087729 16765 raft_consensus.cc:2468] T a8d411124ca242a3b8b4fbb5b0a90b66 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
I20260709 13:05:48.088093 16995 raft_consensus.cc:493] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.088820 16995 raft_consensus.cc:515] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
W20260709 13:05:48.089154 16654 leader_election.cc:343] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.089257 16802 leader_election.cc:304] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:48.090422 16994 raft_consensus.cc:2804] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:48.090864 16994 raft_consensus.cc:493] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.091244 16994 raft_consensus.cc:3060] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.091598 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d281c9020d454b23a8bd21ccfadfa93c" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:48.092363 16913 raft_consensus.cc:2468] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 0.
I20260709 13:05:48.094117 16653 leader_election.cc:304] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b; no voters: 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:48.095237 17000 raft_consensus.cc:2804] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:48.095682 17000 raft_consensus.cc:493] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.096050 17000 raft_consensus.cc:3060] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.099171 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d411124ca242a3b8b4fbb5b0a90b66" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:48.100109 16913 raft_consensus.cc:2468] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
I20260709 13:05:48.102718 16965 raft_consensus.cc:2804] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:48.103380 16965 raft_consensus.cc:493] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.103875 16965 raft_consensus.cc:3060] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.105581 17000 raft_consensus.cc:515] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.106791 16997 leader_election.cc:290] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
W20260709 13:05:48.108096 16879 leader_election.cc:343] T 16b4be927a834597b7190497210b9169 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.109285 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2500d1c1df2649d99c7a5e1146e771d9" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
W20260709 13:05:48.111512 16730 leader_election.cc:343] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.103390 17036 leader_election.cc:290] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:48.114025 16995 leader_election.cc:290] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:48.114746 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2500d1c1df2649d99c7a5e1146e771d9" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:48.115923 17039 raft_consensus.cc:2804] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:48.116605 17039 raft_consensus.cc:493] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:48.116936 16729 leader_election.cc:343] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.117103 17039 raft_consensus.cc:3060] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.117587 16729 leader_election.cc:304] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:48.118930 16995 raft_consensus.cc:2749] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:48.119984 16959 tablet_bootstrap.cc:492] T 9bc00a2c7a04450a9c9ce82457ab573c P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:48.120668 16959 ts_tablet_manager.cc:1403] T 9bc00a2c7a04450a9c9ce82457ab573c P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.094s	user 0.013s	sys 0.007s
I20260709 13:05:48.120754 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3526ae05dd1141aaaaa2aaea2391b108" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:48.121687 16764 raft_consensus.cc:3060] T 3526ae05dd1141aaaaa2aaea2391b108 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.122077 16965 raft_consensus.cc:515] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:48.126029 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d965337ae0df4ca7aba0e4f9549a8ca9" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:48.126734 16690 raft_consensus.cc:3060] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.131400 16764 raft_consensus.cc:2468] T 3526ae05dd1141aaaaa2aaea2391b108 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:48.133798 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d965337ae0df4ca7aba0e4f9549a8ca9" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:48.134645 16913 raft_consensus.cc:3060] T d965337ae0df4ca7aba0e4f9549a8ca9 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.135226 16690 raft_consensus.cc:2468] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
I20260709 13:05:48.135886 16959 raft_consensus.cc:359] T 9bc00a2c7a04450a9c9ce82457ab573c P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:48.136715 16730 leader_election.cc:304] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:48.137140 16959 raft_consensus.cc:385] T 9bc00a2c7a04450a9c9ce82457ab573c P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.137607 16959 raft_consensus.cc:740] T 9bc00a2c7a04450a9c9ce82457ab573c P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.137784 16995 raft_consensus.cc:2804] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:48.141621 16959 consensus_queue.cc:260] T 9bc00a2c7a04450a9c9ce82457ab573c P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:48.142731 16960 raft_consensus.cc:359] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.143560 16960 raft_consensus.cc:385] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.143888 16960 raft_consensus.cc:740] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.147732 16994 raft_consensus.cc:515] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.155671 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d411124ca242a3b8b4fbb5b0a90b66" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:48.156385 16765 raft_consensus.cc:3060] T a8d411124ca242a3b8b4fbb5b0a90b66 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.161571 16763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16b4be927a834597b7190497210b9169" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:48.164433 16763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d411124ca242a3b8b4fbb5b0a90b66" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:48.165827 16765 raft_consensus.cc:2468] T a8d411124ca242a3b8b4fbb5b0a90b66 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:48.166366 16877 leader_election.cc:304] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:48.167279 16802 leader_election.cc:304] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
W20260709 13:05:48.167918 16877 leader_election.cc:343] T 16b4be927a834597b7190497210b9169 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.168535 17036 raft_consensus.cc:2804] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:48.169275 17038 raft_consensus.cc:2804] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:48.171057 17038 raft_consensus.cc:697] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Becoming Leader. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:05:48.183815 17036 raft_consensus.cc:697] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Becoming Leader. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:05:48.196293 17036 consensus_queue.cc:237] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.201022 16997 consensus_queue.cc:1048] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:48.144726 16960 consensus_queue.cc:260] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.202998 16965 leader_election.cc:290] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:48.172500 17038 consensus_queue.cc:237] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:48.210434 17043 raft_consensus.cc:493] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.211311 17043 raft_consensus.cc:515] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:48.214757 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc00a2c7a04450a9c9ce82457ab573c" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:48.215679 16690 raft_consensus.cc:2468] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
I20260709 13:05:48.217248 16804 leader_election.cc:304] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd; no voters: 
I20260709 13:05:48.220764 16913 raft_consensus.cc:2468] T d965337ae0df4ca7aba0e4f9549a8ca9 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
I20260709 13:05:48.221567 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d281c9020d454b23a8bd21ccfadfa93c" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
W20260709 13:05:48.223240 16654 leader_election.cc:343] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.224063 17050 raft_consensus.cc:2804] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:48.224684 17050 raft_consensus.cc:493] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.168501 16877 leader_election.cc:304] T 16b4be927a834597b7190497210b9169 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:48.225946 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d281c9020d454b23a8bd21ccfadfa93c" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:48.226718 16914 raft_consensus.cc:3060] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.225165 17050 raft_consensus.cc:3060] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.229628 16994 leader_election.cc:290] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:48.229933 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d411124ca242a3b8b4fbb5b0a90b66" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:48.233767 16960 ts_tablet_manager.cc:1434] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.154s	user 0.008s	sys 0.000s
I20260709 13:05:48.235029 16960 tablet_bootstrap.cc:492] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:48.235409 17000 leader_election.cc:290] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:48.236244 16967 raft_consensus.cc:493] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.248164 16967 raft_consensus.cc:515] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.251494 17039 raft_consensus.cc:515] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.251999 16967 leader_election.cc:290] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:48.252831 16912 raft_consensus.cc:2393] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 622433288cac4964aea9ea5a24ba77fd in current term 1: Already voted for candidate 7197bc10b2304fccb972da2da7749e3b in this term.
I20260709 13:05:48.255970 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a0ed4bc207489699e41033ec224d3a" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:48.256978 16975 consensus_queue.cc:1048] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:05:48.257552 16879 leader_election.cc:343] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.258878 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a0ed4bc207489699e41033ec224d3a" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:48.259419 16960 tablet_bootstrap.cc:654] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.259591 16839 raft_consensus.cc:2468] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:48.260882 16878 leader_election.cc:304] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:48.261155 17039 leader_election.cc:290] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:48.260087 16586 catalog_manager.cc:5697] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 622433288cac4964aea9ea5a24ba77fd (127.8.4.67). New cstate: current_term: 1 leader_uuid: "622433288cac4964aea9ea5a24ba77fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:48.238988 16914 raft_consensus.cc:2468] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 1.
I20260709 13:05:48.239331 17050 raft_consensus.cc:515] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:48.239295 16962 tablet_bootstrap.cc:492] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:48.241339 16959 ts_tablet_manager.cc:1434] T 9bc00a2c7a04450a9c9ce82457ab573c P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.120s	user 0.018s	sys 0.030s
I20260709 13:05:48.265988 16962 ts_tablet_manager.cc:1403] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.269s	user 0.076s	sys 0.118s
I20260709 13:05:48.266634 16959 tablet_bootstrap.cc:492] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:48.241238 17051 raft_consensus.cc:2749] T 16b4be927a834597b7190497210b9169 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:48.242250 16961 tablet_bootstrap.cc:492] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:48.272558 16961 ts_tablet_manager.cc:1403] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.266s	user 0.016s	sys 0.005s
I20260709 13:05:48.242018 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc00a2c7a04450a9c9ce82457ab573c" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:48.273536 16764 raft_consensus.cc:2468] T 9bc00a2c7a04450a9c9ce82457ab573c P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
I20260709 13:05:48.272938 17050 leader_election.cc:290] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Requested vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:48.243816 16995 raft_consensus.cc:697] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Becoming Leader. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:05:48.274318 16959 tablet_bootstrap.cc:654] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.275024 16995 consensus_queue.cc:237] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:48.275458 16961 raft_consensus.cc:359] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.276177 16961 raft_consensus.cc:385] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.276528 16961 raft_consensus.cc:740] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.245118 17043 leader_election.cc:290] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:48.276311 16962 raft_consensus.cc:359] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.277842 16962 raft_consensus.cc:385] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.277714 16961 consensus_queue.cc:260] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.278270 16962 raft_consensus.cc:740] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.279263 16962 consensus_queue.cc:260] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.281522 17041 raft_consensus.cc:493] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.282109 17041 raft_consensus.cc:515] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.285768 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc00a2c7a04450a9c9ce82457ab573c" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:48.286429 16764 raft_consensus.cc:3060] T 9bc00a2c7a04450a9c9ce82457ab573c P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.286996 16962 ts_tablet_manager.cc:1434] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.006s
I20260709 13:05:48.288111 16962 tablet_bootstrap.cc:492] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:48.289315 17043 raft_consensus.cc:493] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.264878 16967 raft_consensus.cc:2804] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:48.289870 17043 raft_consensus.cc:515] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.290417 16967 raft_consensus.cc:493] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.290849 16967 raft_consensus.cc:3060] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.292467 17043 leader_election.cc:290] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
W20260709 13:05:48.297715 16877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:33887, user_credentials={real_user=slave}} blocked reactor thread for 129829us
I20260709 13:05:48.297861 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc00a2c7a04450a9c9ce82457ab573c" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:48.298998 16690 raft_consensus.cc:3060] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.300050 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d411124ca242a3b8b4fbb5b0a90b66" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:48.300941 16765 raft_consensus.cc:2393] T a8d411124ca242a3b8b4fbb5b0a90b66 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7197bc10b2304fccb972da2da7749e3b in current term 1: Already voted for candidate 622433288cac4964aea9ea5a24ba77fd in this term.
I20260709 13:05:48.301692 16962 tablet_bootstrap.cc:654] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.308880 16959 tablet_bootstrap.cc:492] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:48.309497 16959 ts_tablet_manager.cc:1403] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.010s
I20260709 13:05:48.311517 16960 tablet_bootstrap.cc:492] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:48.312371 16959 raft_consensus.cc:359] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:48.314554 16959 raft_consensus.cc:385] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.314716 16960 ts_tablet_manager.cc:1403] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.005s
I20260709 13:05:48.313856 17041 leader_election.cc:290] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:48.313519 16967 raft_consensus.cc:515] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.331513 16967 leader_election.cc:290] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:48.331324 16653 leader_election.cc:304] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b; no voters: 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:48.314927 16959 raft_consensus.cc:740] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.332931 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a0ed4bc207489699e41033ec224d3a" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:48.317276 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce42d5cbca2144e8a54bab8a8cf31763" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:48.333071 16959 consensus_queue.cc:260] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:48.333951 16837 raft_consensus.cc:3060] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.318346 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce42d5cbca2144e8a54bab8a8cf31763" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:48.335628 16959 ts_tablet_manager.cc:1434] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:05:48.336747 16959 tablet_bootstrap.cc:492] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
W20260709 13:05:48.338016 16728 leader_election.cc:343] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.336522 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a0ed4bc207489699e41033ec224d3a" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:48.342340 16689 raft_consensus.cc:3060] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:48.342564 16802 leader_election.cc:343] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.344522 16959 tablet_bootstrap.cc:654] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.331312 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d411124ca242a3b8b4fbb5b0a90b66" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:48.346709 16961 ts_tablet_manager.cc:1434] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.074s	user 0.003s	sys 0.004s
I20260709 13:05:48.319936 16586 catalog_manager.cc:5697] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7197bc10b2304fccb972da2da7749e3b (127.8.4.68). New cstate: current_term: 1 leader_uuid: "7197bc10b2304fccb972da2da7749e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:48.323861 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce42d5cbca2144e8a54bab8a8cf31763" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:48.324108 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce42d5cbca2144e8a54bab8a8cf31763" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:48.341554 17045 raft_consensus.cc:2804] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:48.353826 16765 raft_consensus.cc:2468] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
I20260709 13:05:48.354486 17045 raft_consensus.cc:697] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:05:48.355535 17045 consensus_queue.cc:237] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.356151 16802 leader_election.cc:304] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:48.353915 16838 raft_consensus.cc:2468] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 0.
I20260709 13:05:48.357614 17043 raft_consensus.cc:2804] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:48.358139 17043 raft_consensus.cc:493] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.358585 17043 raft_consensus.cc:3060] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.322477 16960 raft_consensus.cc:359] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.360476 16960 raft_consensus.cc:385] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.364001 16960 raft_consensus.cc:740] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.363726 16729 leader_election.cc:304] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:48.365137 16960 consensus_queue.cc:260] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.365828 17041 raft_consensus.cc:2804] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:48.366434 17041 raft_consensus.cc:493] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.366811 17041 raft_consensus.cc:3060] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.348033 16961 tablet_bootstrap.cc:492] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:48.368268 16960 ts_tablet_manager.cc:1434] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.000s
I20260709 13:05:48.369282 16960 tablet_bootstrap.cc:492] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:48.348433 16690 raft_consensus.cc:2468] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:48.370690 16804 leader_election.cc:304] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd; no voters: 
I20260709 13:05:48.352613 16878 leader_election.cc:304] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:48.371559 17050 raft_consensus.cc:2804] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:48.372051 16967 raft_consensus.cc:2749] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:48.372107 17050 raft_consensus.cc:697] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Becoming Leader. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:05:48.373314 17050 consensus_queue.cc:237] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:48.377599 16959 tablet_bootstrap.cc:492] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:48.378312 16959 ts_tablet_manager.cc:1403] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.002s
I20260709 13:05:48.381824 16959 raft_consensus.cc:359] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:48.383103 16959 raft_consensus.cc:385] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.383517 16959 raft_consensus.cc:740] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.352051 16764 raft_consensus.cc:2468] T 9bc00a2c7a04450a9c9ce82457ab573c P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:48.363734 16689 raft_consensus.cc:2468] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:48.400537 16960 tablet_bootstrap.cc:654] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.401235 16879 leader_election.cc:304] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:48.398150 16959 consensus_queue.cc:260] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:48.409981 16959 ts_tablet_manager.cc:1434] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.001s
I20260709 13:05:48.410866 16959 tablet_bootstrap.cc:492] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:48.398581 17043 raft_consensus.cc:515] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.414059 16961 tablet_bootstrap.cc:654] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.416126 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce42d5cbca2144e8a54bab8a8cf31763" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:48.416671 16959 tablet_bootstrap.cc:654] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.416242 16586 catalog_manager.cc:5697] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.402571 17041 raft_consensus.cc:515] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.402209 16967 raft_consensus.cc:2804] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:48.388998 16587 catalog_manager.cc:5697] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 reported cstate change: term changed from 0 to 1, leader changed from <none> to d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d0ea3afb898b4eb5b21faeb676627011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.428129 16967 raft_consensus.cc:697] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Becoming Leader. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:05:48.429139 16967 consensus_queue.cc:237] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.401743 16837 raft_consensus.cc:2468] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:48.418392 17043 leader_election.cc:290] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:48.423022 16960 tablet_bootstrap.cc:492] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:48.419049 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce42d5cbca2144e8a54bab8a8cf31763" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:48.431564 16960 ts_tablet_manager.cc:1403] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.003s
I20260709 13:05:48.432181 16959 tablet_bootstrap.cc:492] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:48.434172 16959 ts_tablet_manager.cc:1403] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.008s
I20260709 13:05:48.434540 16764 raft_consensus.cc:2393] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 622433288cac4964aea9ea5a24ba77fd in current term 1: Already voted for candidate d0ea3afb898b4eb5b21faeb676627011 in this term.
I20260709 13:05:48.435655 16960 raft_consensus.cc:359] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.436357 16960 raft_consensus.cc:385] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.436626 16960 raft_consensus.cc:740] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
W20260709 13:05:48.433827 16802 leader_election.cc:343] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.437099 16959 raft_consensus.cc:359] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:48.437444 16960 consensus_queue.cc:260] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.438014 16959 raft_consensus.cc:385] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.438095 16802 leader_election.cc:304] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd; no voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:48.438445 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce42d5cbca2144e8a54bab8a8cf31763" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:48.439193 17041 leader_election.cc:290] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:48.439383 16837 raft_consensus.cc:2393] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d0ea3afb898b4eb5b21faeb676627011 in current term 1: Already voted for candidate 622433288cac4964aea9ea5a24ba77fd in this term.
I20260709 13:05:48.439839 16960 ts_tablet_manager.cc:1434] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:48.441069 16960 tablet_bootstrap.cc:492] T 9b51d554de084a5594e8c14973873edc P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:48.438341 16959 raft_consensus.cc:740] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.441015 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce42d5cbca2144e8a54bab8a8cf31763" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:48.441715 17043 raft_consensus.cc:2749] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:48.442883 16959 consensus_queue.cc:260] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
W20260709 13:05:48.444413 16728 leader_election.cc:343] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.444478 16584 catalog_manager.cc:5697] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 622433288cac4964aea9ea5a24ba77fd (127.8.4.67). New cstate: current_term: 1 leader_uuid: "622433288cac4964aea9ea5a24ba77fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.445693 16961 tablet_bootstrap.cc:492] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:48.449188 16728 leader_election.cc:304] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:48.449223 16961 ts_tablet_manager.cc:1403] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.101s	user 0.013s	sys 0.000s
I20260709 13:05:48.450224 16962 tablet_bootstrap.cc:492] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:48.450798 16962 ts_tablet_manager.cc:1403] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.163s	user 0.015s	sys 0.010s
I20260709 13:05:48.450896 16995 raft_consensus.cc:2749] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:48.454213 16962 raft_consensus.cc:359] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:48.455116 16962 raft_consensus.cc:385] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.455363 17038 raft_consensus.cc:493] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.455538 16962 raft_consensus.cc:740] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.456101 17038 raft_consensus.cc:515] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.456895 16962 consensus_queue.cc:260] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:48.458686 17038 leader_election.cc:290] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:48.459673 16962 ts_tablet_manager.cc:1434] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:48.460489 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e348c32749d48f68c70dc32267e38c0" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:48.460791 16962 tablet_bootstrap.cc:492] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:48.453042 16961 raft_consensus.cc:359] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:48.461835 16961 raft_consensus.cc:385] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.462105 16961 raft_consensus.cc:740] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.462744 16961 consensus_queue.cc:260] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:48.466631 16959 ts_tablet_manager.cc:1434] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:05:48.467849 16961 ts_tablet_manager.cc:1434] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:05:48.469689 16959 tablet_bootstrap.cc:492] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
W20260709 13:05:48.471765 16878 leader_election.cc:343] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.473210 16961 tablet_bootstrap.cc:492] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:48.473551 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e348c32749d48f68c70dc32267e38c0" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
W20260709 13:05:48.475116 16879 leader_election.cc:343] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.475611 16879 leader_election.cc:304] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:48.476750 16967 raft_consensus.cc:2749] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:48.481284 16961 tablet_bootstrap.cc:654] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.482385 16587 catalog_manager.cc:5697] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7197bc10b2304fccb972da2da7749e3b (127.8.4.68). New cstate: current_term: 1 leader_uuid: "7197bc10b2304fccb972da2da7749e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:48.489348 16960 tablet_bootstrap.cc:654] T 9b51d554de084a5594e8c14973873edc P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.498332 16959 tablet_bootstrap.cc:654] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.502910 16961 tablet_bootstrap.cc:492] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:48.503451 16961 ts_tablet_manager.cc:1403] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.007s
I20260709 13:05:48.506280 16961 raft_consensus.cc:359] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.506785 16962 tablet_bootstrap.cc:654] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.507068 16961 raft_consensus.cc:385] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.507524 16961 raft_consensus.cc:740] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.508411 16961 consensus_queue.cc:260] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.510706 17041 raft_consensus.cc:493] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.510823 16961 ts_tablet_manager.cc:1434] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.003s
I20260709 13:05:48.511433 17041 raft_consensus.cc:515] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:48.514649 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16b4be927a834597b7190497210b9169" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:48.515105 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16b4be927a834597b7190497210b9169" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:48.515409 16914 raft_consensus.cc:2468] T 16b4be927a834597b7190497210b9169 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 0.
I20260709 13:05:48.515965 16961 tablet_bootstrap.cc:492] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
W20260709 13:05:48.516867 16730 leader_election.cc:343] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.517427 16967 raft_consensus.cc:493] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.517657 16728 leader_election.cc:304] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:48.518004 16967 raft_consensus.cc:515] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.518913 17041 leader_election.cc:290] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:48.518703 16995 raft_consensus.cc:2804] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:48.519714 16995 raft_consensus.cc:493] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.520072 16995 raft_consensus.cc:3060] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.520566 16967 leader_election.cc:290] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:48.521945 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e9d9f32bec4123a2f10e3a20f1067b" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
W20260709 13:05:48.523710 16878 leader_election.cc:343] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.526010 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e9d9f32bec4123a2f10e3a20f1067b" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:48.527696 16962 tablet_bootstrap.cc:492] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
W20260709 13:05:48.527647 16877 leader_election.cc:343] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.528378 16962 ts_tablet_manager.cc:1403] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.068s	user 0.011s	sys 0.002s
I20260709 13:05:48.528357 16877 leader_election.cc:304] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:48.529346 16967 raft_consensus.cc:2749] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:48.531913 17041 raft_consensus.cc:493] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.532442 17041 raft_consensus.cc:515] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:48.533800 16995 raft_consensus.cc:515] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:48.535820 17041 leader_election.cc:290] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:48.537338 16961 tablet_bootstrap.cc:654] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.537608 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b89e067aed8497a9c9c70577ac56c77" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:48.538545 16962 raft_consensus.cc:359] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
W20260709 13:05:48.539561 16729 leader_election.cc:343] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.539949 16962 raft_consensus.cc:385] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.540336 16962 raft_consensus.cc:740] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.541152 16962 consensus_queue.cc:260] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:48.542294 17000 raft_consensus.cc:493] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.542805 17000 raft_consensus.cc:515] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:48.543613 16962 ts_tablet_manager.cc:1434] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:05:48.544716 16962 tablet_bootstrap.cc:492] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:48.535648 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b89e067aed8497a9c9c70577ac56c77" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:48.550818 16960 tablet_bootstrap.cc:492] T 9b51d554de084a5594e8c14973873edc P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:48.551440 16960 ts_tablet_manager.cc:1403] T 9b51d554de084a5594e8c14973873edc P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.111s	user 0.010s	sys 0.003s
I20260709 13:05:48.546550 17000 leader_election.cc:290] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
W20260709 13:05:48.552253 16730 leader_election.cc:343] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.552534 16962 tablet_bootstrap.cc:654] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.552817 16730 leader_election.cc:304] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:48.553853 17041 raft_consensus.cc:2749] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:48.550827 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2500d1c1df2649d99c7a5e1146e771d9" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:48.555058 16837 raft_consensus.cc:2468] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 0.
I20260709 13:05:48.554800 16960 raft_consensus.cc:359] T 9b51d554de084a5594e8c14973873edc P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:48.555660 16960 raft_consensus.cc:385] T 9b51d554de084a5594e8c14973873edc P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.555980 16960 raft_consensus.cc:740] T 9b51d554de084a5594e8c14973873edc P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.546838 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2500d1c1df2649d99c7a5e1146e771d9" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:48.556807 16654 leader_election.cc:304] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd; no voters: 
I20260709 13:05:48.556756 16960 consensus_queue.cc:260] T 9b51d554de084a5594e8c14973873edc P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:48.558246 17000 raft_consensus.cc:2804] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:48.558707 17000 raft_consensus.cc:493] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.559096 17000 raft_consensus.cc:3060] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.559373 16960 ts_tablet_manager.cc:1434] T 9b51d554de084a5594e8c14973873edc P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:48.560853 16960 tablet_bootstrap.cc:492] T ce42d5cbca2144e8a54bab8a8cf31763 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:48.563864 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16b4be927a834597b7190497210b9169" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:48.564564 16914 raft_consensus.cc:3060] T 16b4be927a834597b7190497210b9169 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.556845 16764 raft_consensus.cc:2468] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 0.
I20260709 13:05:48.567981 16960 tablet_bootstrap.cc:654] T ce42d5cbca2144e8a54bab8a8cf31763 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.569914 17000 raft_consensus.cc:515] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:48.573896 16914 raft_consensus.cc:2468] T 16b4be927a834597b7190497210b9169 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
I20260709 13:05:48.575902 16728 leader_election.cc:304] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:48.577237 17041 raft_consensus.cc:2804] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:48.577978 17041 raft_consensus.cc:697] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Becoming Leader. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:05:48.579210 17041 consensus_queue.cc:237] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:48.577559 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2500d1c1df2649d99c7a5e1146e771d9" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:48.580821 16764 raft_consensus.cc:3060] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.582710 16962 tablet_bootstrap.cc:492] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:48.583421 16962 ts_tablet_manager.cc:1403] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.009s
I20260709 13:05:48.586655 16962 raft_consensus.cc:359] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:48.587113 16967 raft_consensus.cc:493] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.587411 16962 raft_consensus.cc:385] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.588178 16962 raft_consensus.cc:740] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.587910 16967 raft_consensus.cc:515] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.589385 16962 consensus_queue.cc:260] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:48.591053 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2500d1c1df2649d99c7a5e1146e771d9" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:48.591130 16967 leader_election.cc:290] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:48.591759 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061a5313535a475ea9385383b611b52d" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:48.592437 17000 leader_election.cc:290] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:48.592510 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061a5313535a475ea9385383b611b52d" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:48.593830 16764 raft_consensus.cc:2468] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 1.
W20260709 13:05:48.594070 16878 leader_election.cc:343] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.591758 16837 raft_consensus.cc:3060] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.595016 16653 leader_election.cc:304] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 
W20260709 13:05:48.595098 16879 leader_election.cc:343] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.596693 17000 raft_consensus.cc:2804] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:48.597370 17000 raft_consensus.cc:697] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:05:48.597647 16962 ts_tablet_manager.cc:1434] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:05:48.598237 17000 consensus_queue.cc:237] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:48.598404 16879 leader_election.cc:304] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:48.598780 16962 tablet_bootstrap.cc:492] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:48.599431 16967 raft_consensus.cc:2749] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:48.593889 16959 tablet_bootstrap.cc:492] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:48.600859 16959 ts_tablet_manager.cc:1403] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.133s	user 0.017s	sys 0.004s
I20260709 13:05:48.601946 16961 tablet_bootstrap.cc:492] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:48.602476 16961 ts_tablet_manager.cc:1403] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.087s	user 0.016s	sys 0.003s
I20260709 13:05:48.603971 16837 raft_consensus.cc:2468] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 1.
I20260709 13:05:48.603863 16959 raft_consensus.cc:359] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:48.604679 16959 raft_consensus.cc:385] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.605523 16961 raft_consensus.cc:359] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.606256 16961 raft_consensus.cc:385] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.606426 16962 tablet_bootstrap.cc:654] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.609680 16961 raft_consensus.cc:740] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.610937 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16b4be927a834597b7190497210b9169" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:48.610719 16961 consensus_queue.cc:260] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.613032 16995 leader_election.cc:290] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:48.613754 16961 ts_tablet_manager.cc:1434] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:05:48.615267 16961 tablet_bootstrap.cc:492] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:48.617328 16962 tablet_bootstrap.cc:492] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:48.617939 16962 ts_tablet_manager.cc:1403] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:05:48.604992 16959 raft_consensus.cc:740] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.621299 16961 tablet_bootstrap.cc:654] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.621348 16959 consensus_queue.cc:260] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
W20260709 13:05:48.617357 16730 leader_election.cc:343] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.622170 16587 catalog_manager.cc:5697] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:48.625190 16959 ts_tablet_manager.cc:1434] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:05:48.626400 16959 tablet_bootstrap.cc:492] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:48.637498 16962 raft_consensus.cc:359] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.638648 16962 raft_consensus.cc:385] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.639153 16962 raft_consensus.cc:740] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.638401 16584 catalog_manager.cc:5697] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 reported cstate change: term changed from 0 to 1, leader changed from <none> to d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d0ea3afb898b4eb5b21faeb676627011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.640198 16959 tablet_bootstrap.cc:654] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.642549 16960 tablet_bootstrap.cc:492] T ce42d5cbca2144e8a54bab8a8cf31763 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:48.643144 16960 ts_tablet_manager.cc:1403] T ce42d5cbca2144e8a54bab8a8cf31763 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.022s
I20260709 13:05:48.643167 16962 consensus_queue.cc:260] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.647964 16960 raft_consensus.cc:359] T ce42d5cbca2144e8a54bab8a8cf31763 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.651810 16962 ts_tablet_manager.cc:1434] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:05:48.653594 16962 tablet_bootstrap.cc:492] T 16b4be927a834597b7190497210b9169 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:48.656932 16961 tablet_bootstrap.cc:492] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:48.652273 16960 raft_consensus.cc:385] T ce42d5cbca2144e8a54bab8a8cf31763 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.657424 16960 raft_consensus.cc:740] T ce42d5cbca2144e8a54bab8a8cf31763 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.657527 16961 ts_tablet_manager.cc:1403] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.025s
I20260709 13:05:48.658495 16960 consensus_queue.cc:260] T ce42d5cbca2144e8a54bab8a8cf31763 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.664706 16962 tablet_bootstrap.cc:654] T 16b4be927a834597b7190497210b9169 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.664276 16961 raft_consensus.cc:359] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.664798 16995 raft_consensus.cc:493] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.666388 16959 tablet_bootstrap.cc:492] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:48.665445 16960 ts_tablet_manager.cc:1434] T ce42d5cbca2144e8a54bab8a8cf31763 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.005s
I20260709 13:05:48.666026 16995 raft_consensus.cc:515] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:48.666901 16959 ts_tablet_manager.cc:1403] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.006s
I20260709 13:05:48.668602 16995 leader_election.cc:290] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:48.669749 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f0d93c13e344f40b065cabcbc63d751" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:48.670295 16960 tablet_bootstrap.cc:492] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:48.670447 16837 raft_consensus.cc:2468] T 4f0d93c13e344f40b065cabcbc63d751 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 0.
I20260709 13:05:48.671312 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f0d93c13e344f40b065cabcbc63d751" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:48.671968 16729 leader_election.cc:304] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:48.672886 16995 raft_consensus.cc:2804] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:48.671968 16689 raft_consensus.cc:2468] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 0.
I20260709 13:05:48.673348 16995 raft_consensus.cc:493] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.673756 16995 raft_consensus.cc:3060] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.677423 16961 raft_consensus.cc:385] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.677907 16961 raft_consensus.cc:740] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.678860 16961 consensus_queue.cc:260] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.680354 17041 consensus_queue.cc:1048] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:48.688418 16961 ts_tablet_manager.cc:1434] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.003s
I20260709 13:05:48.689971 16961 tablet_bootstrap.cc:492] T 47e91185676f4335a4100a6d3fa40c8d P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:48.681897 16995 raft_consensus.cc:515] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:48.670465 16959 raft_consensus.cc:359] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.691069 16959 raft_consensus.cc:385] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.691403 16959 raft_consensus.cc:740] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.692215 16959 consensus_queue.cc:260] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.701273 16959 ts_tablet_manager.cc:1434] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:05:48.709242 16960 tablet_bootstrap.cc:654] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.710035 17045 raft_consensus.cc:493] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.710609 17045 raft_consensus.cc:515] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.714838 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab71409c1cf4356817b8f83a1686482" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:48.717394 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab71409c1cf4356817b8f83a1686482" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:48.718305 16961 tablet_bootstrap.cc:654] T 47e91185676f4335a4100a6d3fa40c8d P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.720129 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f0d93c13e344f40b065cabcbc63d751" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:48.720790 16837 raft_consensus.cc:3060] T 4f0d93c13e344f40b065cabcbc63d751 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:48.720147 16654 leader_election.cc:343] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:48.722285 16653 leader_election.cc:343] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.722754 16653 leader_election.cc:304] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8; no voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:48.723621 16997 raft_consensus.cc:2749] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:48.724597 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f0d93c13e344f40b065cabcbc63d751" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:48.725306 16689 raft_consensus.cc:3060] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.729094 16837 raft_consensus.cc:2468] T 4f0d93c13e344f40b065cabcbc63d751 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
I20260709 13:05:48.730458 16729 leader_election.cc:304] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:48.731463 17041 raft_consensus.cc:2804] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:48.732039 17041 raft_consensus.cc:697] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Becoming Leader. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:05:48.712908 17045 leader_election.cc:290] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:48.732919 17041 consensus_queue.cc:237] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:48.740772 16689 raft_consensus.cc:2468] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
I20260709 13:05:48.743237 17043 consensus_queue.cc:1048] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:48.745831 16959 tablet_bootstrap.cc:492] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:48.744688 16995 leader_election.cc:290] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Requested vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:48.768020 17050 consensus_queue.cc:1048] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:48.785414 17043 consensus_queue.cc:1048] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:48.794196 16960 tablet_bootstrap.cc:492] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:48.793931 16967 consensus_queue.cc:1048] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:48.794813 16960 ts_tablet_manager.cc:1403] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.125s	user 0.015s	sys 0.020s
I20260709 13:05:48.812996 16960 raft_consensus.cc:359] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.813891 16960 raft_consensus.cc:385] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.814218 16960 raft_consensus.cc:740] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.814119 17042 consensus_queue.cc:1048] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:48.815238 16960 consensus_queue.cc:260] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.827679 16960 ts_tablet_manager.cc:1434] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:05:48.828779 16960 tablet_bootstrap.cc:492] T e5445951d8c04b35838db7ef8df62694 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:48.831600 16961 tablet_bootstrap.cc:492] T 47e91185676f4335a4100a6d3fa40c8d P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:48.832325 16961 ts_tablet_manager.cc:1403] T 47e91185676f4335a4100a6d3fa40c8d P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.143s	user 0.016s	sys 0.011s
I20260709 13:05:48.840718 16914 raft_consensus.cc:3060] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.845413 16688 raft_consensus.cc:3060] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.850436 17043 raft_consensus.cc:493] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.851089 17043 raft_consensus.cc:515] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.844914 17050 consensus_queue.cc:1048] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:05:48.855852 16687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e348c32749d48f68c70dc32267e38c0" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:48.857208 17043 leader_election.cc:290] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
W20260709 13:05:48.858204 16804 leader_election.cc:343] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.859304 16961 raft_consensus.cc:359] T 47e91185676f4335a4100a6d3fa40c8d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:48.859665 16962 tablet_bootstrap.cc:492] T 16b4be927a834597b7190497210b9169 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:48.860162 16961 raft_consensus.cc:385] T 47e91185676f4335a4100a6d3fa40c8d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.860461 16962 ts_tablet_manager.cc:1403] T 16b4be927a834597b7190497210b9169 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.207s	user 0.057s	sys 0.063s
I20260709 13:05:48.864200 16962 raft_consensus.cc:359] T 16b4be927a834597b7190497210b9169 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:48.860499 16961 raft_consensus.cc:740] T 47e91185676f4335a4100a6d3fa40c8d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.894022 16961 consensus_queue.cc:260] T 47e91185676f4335a4100a6d3fa40c8d P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:48.896168 16961 ts_tablet_manager.cc:1434] T 47e91185676f4335a4100a6d3fa40c8d P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.005s
W20260709 13:05:48.887332 16636 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:48.889482 17036 raft_consensus.cc:493] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.897177 17036 raft_consensus.cc:515] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:48.897864 16961 tablet_bootstrap.cc:492] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:48.898383 16837 raft_consensus.cc:3060] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.865830 17038 consensus_queue.cc:1048] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:48.866719 16959 tablet_bootstrap.cc:654] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.891858 16960 tablet_bootstrap.cc:654] T e5445951d8c04b35838db7ef8df62694 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.872586 17047 raft_consensus.cc:493] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.906168 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d281c9020d454b23a8bd21ccfadfa93c" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:48.876996 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e348c32749d48f68c70dc32267e38c0" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:48.907224 16913 raft_consensus.cc:2393] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 622433288cac4964aea9ea5a24ba77fd in current term 1: Already voted for candidate 1cbe303821774e4d936ea3d54875dcb8 in this term.
I20260709 13:05:48.907119 16912 raft_consensus.cc:2468] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
I20260709 13:05:48.906159 17042 raft_consensus.cc:493] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.905520 17036 leader_election.cc:290] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:48.908079 17047 raft_consensus.cc:515] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.910257 16962 raft_consensus.cc:385] T 16b4be927a834597b7190497210b9169 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.910683 16961 tablet_bootstrap.cc:654] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.910791 16962 raft_consensus.cc:740] T 16b4be927a834597b7190497210b9169 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.908641 17042 raft_consensus.cc:515] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:48.911959 16962 consensus_queue.cc:260] T 16b4be927a834597b7190497210b9169 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:48.913794 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e9d9f32bec4123a2f10e3a20f1067b" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:48.914297 17047 leader_election.cc:290] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:48.914834 16962 ts_tablet_manager.cc:1434] T 16b4be927a834597b7190497210b9169 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.054s	user 0.013s	sys 0.000s
I20260709 13:05:48.874755 16585 catalog_manager.cc:5697] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 reported cstate change: term changed from 0 to 1, leader changed from <none> to d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d0ea3afb898b4eb5b21faeb676627011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:48.918238 16911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e9d9f32bec4123a2f10e3a20f1067b" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:48.919118 16911 raft_consensus.cc:2468] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 0.
I20260709 13:05:48.922206 16959 tablet_bootstrap.cc:492] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:48.923008 16959 ts_tablet_manager.cc:1403] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.185s	user 0.013s	sys 0.004s
I20260709 13:05:48.935096 16959 raft_consensus.cc:359] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:48.936342 16959 raft_consensus.cc:385] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.941077 16688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b51d554de084a5594e8c14973873edc" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
W20260709 13:05:48.927690 16729 leader_election.cc:343] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:48.942875 16730 leader_election.cc:343] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.944015 16728 leader_election.cc:304] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:48.916942 17042 leader_election.cc:290] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:48.944831 16962 tablet_bootstrap.cc:492] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:48.945284 17047 raft_consensus.cc:2804] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:48.945801 17047 raft_consensus.cc:493] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.946221 17047 raft_consensus.cc:3060] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.949429 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d281c9020d454b23a8bd21ccfadfa93c" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:48.950908 16960 tablet_bootstrap.cc:492] T e5445951d8c04b35838db7ef8df62694 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:48.951542 16960 ts_tablet_manager.cc:1403] T e5445951d8c04b35838db7ef8df62694 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.123s	user 0.016s	sys 0.001s
I20260709 13:05:48.951548 16997 consensus_queue.cc:1048] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:48.954716 16960 raft_consensus.cc:359] T e5445951d8c04b35838db7ef8df62694 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.955624 16960 raft_consensus.cc:385] T e5445951d8c04b35838db7ef8df62694 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.955964 16960 raft_consensus.cc:740] T e5445951d8c04b35838db7ef8df62694 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.958884 16960 consensus_queue.cc:260] T e5445951d8c04b35838db7ef8df62694 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.961305 16960 ts_tablet_manager.cc:1434] T e5445951d8c04b35838db7ef8df62694 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:05:48.965305 17047 raft_consensus.cc:515] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:48.944834 16802 leader_election.cc:304] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:48.968972 16911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e9d9f32bec4123a2f10e3a20f1067b" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:48.969791 16911 raft_consensus.cc:3060] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.970301 17043 raft_consensus.cc:2804] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:48.972730 17043 raft_consensus.cc:493] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.973318 17043 raft_consensus.cc:3060] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.971997 16804 leader_election.cc:304] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd; no voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:48.973511 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e9d9f32bec4123a2f10e3a20f1067b" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
W20260709 13:05:48.978489 16729 leader_election.cc:343] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.979835 16687 raft_consensus.cc:3060] T 16b4be927a834597b7190497210b9169 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.980844 16997 consensus_queue.cc:1048] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:48.978457 17050 raft_consensus.cc:2749] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:48.983174 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b51d554de084a5594e8c14973873edc" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:48.984543 16912 raft_consensus.cc:2468] T 9b51d554de084a5594e8c14973873edc P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 0.
I20260709 13:05:48.986092 16728 leader_election.cc:304] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:48.987107 16995 raft_consensus.cc:2804] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:48.987519 16995 raft_consensus.cc:493] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.975113 16962 tablet_bootstrap.cc:654] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.987866 16995 raft_consensus.cc:3060] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.993499 16960 tablet_bootstrap.cc:492] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:48.936734 16959 raft_consensus.cc:740] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.001601 16959 consensus_queue.cc:260] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:49.003551 16995 raft_consensus.cc:515] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:49.005492 17038 consensus_queue.cc:1048] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:49.010313 16959 ts_tablet_manager.cc:1434] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.087s	user 0.009s	sys 0.000s
I20260709 13:05:49.011523 16959 tablet_bootstrap.cc:492] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:49.011811 16961 tablet_bootstrap.cc:492] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:49.012364 16961 ts_tablet_manager.cc:1403] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.115s	user 0.015s	sys 0.016s
I20260709 13:05:49.012734 16997 consensus_queue.cc:1048] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:49.014536 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b51d554de084a5594e8c14973873edc" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:49.015442 16913 raft_consensus.cc:3060] T 9b51d554de084a5594e8c14973873edc P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.019399 17038 raft_consensus.cc:493] T ce42d5cbca2144e8a54bab8a8cf31763 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.020761 17091 consensus_queue.cc:1048] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:49.022727 16911 raft_consensus.cc:2468] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
I20260709 13:05:49.022956 16688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b51d554de084a5594e8c14973873edc" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:49.023762 17047 leader_election.cc:290] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:49.020318 17038 raft_consensus.cc:515] T ce42d5cbca2144e8a54bab8a8cf31763 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:49.024384 16995 leader_election.cc:290] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:49.015455 16961 raft_consensus.cc:359] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:49.025384 16728 leader_election.cc:304] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:49.028939 16763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce42d5cbca2144e8a54bab8a8cf31763" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
W20260709 13:05:49.025732 16730 leader_election.cc:343] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.029865 16763 raft_consensus.cc:2393] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7197bc10b2304fccb972da2da7749e3b in current term 1: Already voted for candidate d0ea3afb898b4eb5b21faeb676627011 in this term.
I20260709 13:05:49.030294 16960 tablet_bootstrap.cc:654] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.032222 17038 leader_election.cc:290] T ce42d5cbca2144e8a54bab8a8cf31763 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:49.034065 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce42d5cbca2144e8a54bab8a8cf31763" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:49.034729 16995 raft_consensus.cc:2804] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:49.035100 16839 raft_consensus.cc:2393] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7197bc10b2304fccb972da2da7749e3b in current term 1: Already voted for candidate 622433288cac4964aea9ea5a24ba77fd in this term.
I20260709 13:05:49.035373 16995 raft_consensus.cc:697] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Becoming Leader. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:05:49.037406 16878 leader_election.cc:304] T ce42d5cbca2144e8a54bab8a8cf31763 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:49.025894 16961 raft_consensus.cc:385] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.039052 16961 raft_consensus.cc:740] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.040354 16961 consensus_queue.cc:260] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:49.041509 17038 raft_consensus.cc:3060] T ce42d5cbca2144e8a54bab8a8cf31763 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.046311 16959 tablet_bootstrap.cc:654] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.043514 16961 ts_tablet_manager.cc:1434] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.003s
I20260709 13:05:49.048038 16961 tablet_bootstrap.cc:492] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:49.032683 16913 raft_consensus.cc:2468] T 9b51d554de084a5594e8c14973873edc P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
I20260709 13:05:49.053336 16728 leader_election.cc:304] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:49.056659 17047 raft_consensus.cc:2804] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:49.057183 17047 raft_consensus.cc:697] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Becoming Leader. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:05:49.058115 17047 consensus_queue.cc:237] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:49.036439 16995 consensus_queue.cc:237] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:49.075409 16960 tablet_bootstrap.cc:492] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:49.076458 16960 ts_tablet_manager.cc:1403] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.083s	user 0.014s	sys 0.005s
I20260709 13:05:49.087287 16961 tablet_bootstrap.cc:654] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.090360 17038 raft_consensus.cc:2749] T ce42d5cbca2144e8a54bab8a8cf31763 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:49.093979 17042 consensus_queue.cc:1048] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:49.103228 17038 raft_consensus.cc:493] T e5445951d8c04b35838db7ef8df62694 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.103997 17038 raft_consensus.cc:515] T e5445951d8c04b35838db7ef8df62694 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:49.127370 17036 raft_consensus.cc:493] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.145177 17042 raft_consensus.cc:493] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.145809 17042 raft_consensus.cc:515] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:49.148068 17042 leader_election.cc:290] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:49.147655 17043 raft_consensus.cc:515] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:49.128491 16997 consensus_queue.cc:1048] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:05:49.153074 17036 raft_consensus.cc:515] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:49.159493 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e9d9f32bec4123a2f10e3a20f1067b" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:49.176937 16687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e348c32749d48f68c70dc32267e38c0" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
W20260709 13:05:49.178784 16804 leader_election.cc:343] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.179133 17038 leader_election.cc:290] T e5445951d8c04b35838db7ef8df62694 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:49.178630 16911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c91dff9e8c4ab78bacda0d282beacf" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:49.180604 17050 raft_consensus.cc:493] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.181634 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5445951d8c04b35838db7ef8df62694" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:49.182219 17042 consensus_queue.cc:1048] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:49.183310 16877 leader_election.cc:343] T e5445951d8c04b35838db7ef8df62694 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.181401 17050 raft_consensus.cc:515] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:49.186416 17050 leader_election.cc:290] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
W20260709 13:05:49.191025 16728 leader_election.cc:343] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.194139 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e348c32749d48f68c70dc32267e38c0" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:49.195024 16912 raft_consensus.cc:3060] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.196873 17043 leader_election.cc:290] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:49.197535 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d7f28a321a46919d282b9709ab84cb" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:49.201321 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5445951d8c04b35838db7ef8df62694" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:49.202623 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d7f28a321a46919d282b9709ab84cb" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:49.207713 16687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c91dff9e8c4ab78bacda0d282beacf" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
W20260709 13:05:49.209903 16730 leader_election.cc:343] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.210551 16730 leader_election.cc:304] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:49.211756 16995 raft_consensus.cc:2749] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:49.214866 16878 leader_election.cc:343] T e5445951d8c04b35838db7ef8df62694 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.215694 16878 leader_election.cc:304] T e5445951d8c04b35838db7ef8df62694 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:49.218847 16995 consensus_queue.cc:1048] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:49.221346 16960 raft_consensus.cc:359] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:49.222414 16960 raft_consensus.cc:385] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.222805 16960 raft_consensus.cc:740] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.223835 16960 consensus_queue.cc:260] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:49.225485 17091 raft_consensus.cc:2749] T e5445951d8c04b35838db7ef8df62694 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:49.227957 16802 leader_election.cc:343] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.239190 17036 leader_election.cc:290] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:49.239602 16995 consensus_queue.cc:1048] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:05:49.228958 16802 leader_election.cc:343] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.246379 16802 leader_election.cc:304] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd; no voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:49.252169 17099 raft_consensus.cc:2749] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:49.262370 17038 raft_consensus.cc:493] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.263234 17038 raft_consensus.cc:515] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:49.268539 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d7f28a321a46919d282b9709ab84cb" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
W20260709 13:05:49.271271 16877 leader_election.cc:343] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.278458 17038 leader_election.cc:290] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:49.282739 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d7f28a321a46919d282b9709ab84cb" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:49.284364 16839 raft_consensus.cc:2468] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:49.295210 16960 ts_tablet_manager.cc:1434] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.218s	user 0.004s	sys 0.003s
I20260709 13:05:49.297389 16960 tablet_bootstrap.cc:492] T 0d72e7ee195341ab8a8d3865c5013ac8 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:49.297724 17036 raft_consensus.cc:493] T 47e91185676f4335a4100a6d3fa40c8d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.298458 17036 raft_consensus.cc:515] T 47e91185676f4335a4100a6d3fa40c8d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:49.301450 16878 leader_election.cc:304] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:49.301811 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e91185676f4335a4100a6d3fa40c8d" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:49.302282 17036 leader_election.cc:290] T 47e91185676f4335a4100a6d3fa40c8d P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:49.302682 17091 raft_consensus.cc:2804] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:49.303174 17091 raft_consensus.cc:493] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.303529 17091 raft_consensus.cc:3060] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:49.303756 16804 leader_election.cc:343] T 47e91185676f4335a4100a6d3fa40c8d P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.314334 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e9d9f32bec4123a2f10e3a20f1067b" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:49.315315 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e91185676f4335a4100a6d3fa40c8d" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:49.315835 16913 raft_consensus.cc:2393] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 622433288cac4964aea9ea5a24ba77fd in current term 1: Already voted for candidate d0ea3afb898b4eb5b21faeb676627011 in this term.
I20260709 13:05:49.322886 16802 leader_election.cc:304] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd; no voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:49.324201 17036 raft_consensus.cc:3060] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:49.324985 16802 leader_election.cc:343] T 47e91185676f4335a4100a6d3fa40c8d P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.325984 16802 leader_election.cc:304] T 47e91185676f4335a4100a6d3fa40c8d P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd; no voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:49.352591 17099 raft_consensus.cc:2749] T 47e91185676f4335a4100a6d3fa40c8d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:49.361990 16962 tablet_bootstrap.cc:492] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:49.362567 16962 ts_tablet_manager.cc:1403] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.418s	user 0.028s	sys 0.028s
I20260709 13:05:49.367898 16962 raft_consensus.cc:359] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:49.377158 16962 raft_consensus.cc:385] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.377651 16962 raft_consensus.cc:740] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
W20260709 13:05:49.368573 16802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:33887, user_credentials={real_user=slave}} blocked reactor thread for 43674.8us
I20260709 13:05:49.393821 16962 consensus_queue.cc:260] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:49.405764 16962 ts_tablet_manager.cc:1434] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.043s	user 0.010s	sys 0.001s
I20260709 13:05:49.406801 16962 tablet_bootstrap.cc:492] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:49.413771 17036 raft_consensus.cc:2749] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:49.415202 17091 raft_consensus.cc:515] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:49.416275 16959 tablet_bootstrap.cc:492] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:49.416796 16959 ts_tablet_manager.cc:1403] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.405s	user 0.022s	sys 0.035s
I20260709 13:05:49.423106 16961 tablet_bootstrap.cc:492] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:49.423702 16961 ts_tablet_manager.cc:1403] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.376s	user 0.025s	sys 0.018s
I20260709 13:05:49.424767 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d7f28a321a46919d282b9709ab84cb" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
W20260709 13:05:49.426254 16877 leader_election.cc:343] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.429845 16961 raft_consensus.cc:359] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:49.430648 16961 raft_consensus.cc:385] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.430935 16961 raft_consensus.cc:740] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.431728 16961 consensus_queue.cc:260] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:49.433890 16961 ts_tablet_manager.cc:1434] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:05:49.434816 16961 tablet_bootstrap.cc:492] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:49.435760 16962 tablet_bootstrap.cc:654] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.438422 17091 leader_election.cc:290] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:49.441524 16912 raft_consensus.cc:2468] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:49.446902 16802 leader_election.cc:304] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:49.444909 16960 tablet_bootstrap.cc:654] T 0d72e7ee195341ab8a8d3865c5013ac8 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.448161 17114 raft_consensus.cc:2804] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:49.450743 17114 raft_consensus.cc:697] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Becoming Leader. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:05:49.451795 17114 consensus_queue.cc:237] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:49.458776 16962 tablet_bootstrap.cc:492] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:49.459442 16962 ts_tablet_manager.cc:1403] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.053s	user 0.006s	sys 0.004s
I20260709 13:05:49.463078 16962 raft_consensus.cc:359] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:49.463860 16962 raft_consensus.cc:385] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.464169 16962 raft_consensus.cc:740] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.438342 16959 raft_consensus.cc:359] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:49.465235 16959 raft_consensus.cc:385] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.464918 16962 consensus_queue.cc:260] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:49.465643 16959 raft_consensus.cc:740] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.466863 16962 ts_tablet_manager.cc:1434] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:49.467927 16962 tablet_bootstrap.cc:492] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:49.473302 16959 consensus_queue.cc:260] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:49.474861 16962 tablet_bootstrap.cc:654] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.476861 16959 ts_tablet_manager.cc:1434] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.002s
I20260709 13:05:49.491130 16962 tablet_bootstrap.cc:492] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:49.491751 16962 ts_tablet_manager.cc:1403] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.000s
I20260709 13:05:49.493463 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d7f28a321a46919d282b9709ab84cb" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:49.493790 16959 tablet_bootstrap.cc:492] T 13d7f28a321a46919d282b9709ab84cb P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:49.494170 16837 raft_consensus.cc:3060] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.494699 16962 raft_consensus.cc:359] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:49.495436 16962 raft_consensus.cc:385] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.495725 16962 raft_consensus.cc:740] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.492647 16585 catalog_manager.cc:5697] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 reported cstate change: term changed from 0 to 1, leader changed from <none> to d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d0ea3afb898b4eb5b21faeb676627011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:49.496722 16962 consensus_queue.cc:260] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:49.502420 16837 raft_consensus.cc:2468] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:49.503234 16960 tablet_bootstrap.cc:492] T 0d72e7ee195341ab8a8d3865c5013ac8 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:49.503892 16960 ts_tablet_manager.cc:1403] T 0d72e7ee195341ab8a8d3865c5013ac8 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.207s	user 0.018s	sys 0.030s
I20260709 13:05:49.504189 16962 ts_tablet_manager.cc:1434] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:05:49.503865 16878 leader_election.cc:304] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:49.505371 16962 tablet_bootstrap.cc:492] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:49.500126 16585 catalog_manager.cc:5697] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 reported cstate change: term changed from 0 to 1, leader changed from <none> to d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d0ea3afb898b4eb5b21faeb676627011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:49.505551 17091 raft_consensus.cc:2804] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:49.506131 17091 raft_consensus.cc:697] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Becoming Leader. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:05:49.496304 16961 tablet_bootstrap.cc:654] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.506958 17091 consensus_queue.cc:237] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:49.512563 16962 tablet_bootstrap.cc:654] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.515117 16959 tablet_bootstrap.cc:654] T 13d7f28a321a46919d282b9709ab84cb P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.516911 16960 raft_consensus.cc:359] T 0d72e7ee195341ab8a8d3865c5013ac8 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:49.521274 16960 raft_consensus.cc:385] T 0d72e7ee195341ab8a8d3865c5013ac8 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.525142 16960 raft_consensus.cc:740] T 0d72e7ee195341ab8a8d3865c5013ac8 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.526118 16960 consensus_queue.cc:260] T 0d72e7ee195341ab8a8d3865c5013ac8 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:49.528357 16960 ts_tablet_manager.cc:1434] T 0d72e7ee195341ab8a8d3865c5013ac8 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:05:49.530732 16960 tablet_bootstrap.cc:492] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:49.538733 16961 tablet_bootstrap.cc:492] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:49.539355 16961 ts_tablet_manager.cc:1403] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.105s	user 0.027s	sys 0.003s
I20260709 13:05:49.545568 16584 catalog_manager.cc:5697] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7197bc10b2304fccb972da2da7749e3b (127.8.4.68). New cstate: current_term: 1 leader_uuid: "7197bc10b2304fccb972da2da7749e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:49.546298 16961 raft_consensus.cc:359] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:49.554155 16961 raft_consensus.cc:385] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.554847 16961 raft_consensus.cc:740] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.557683 17047 consensus_queue.cc:1048] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:49.558804 16962 tablet_bootstrap.cc:492] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:49.559365 16962 ts_tablet_manager.cc:1403] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.054s	user 0.004s	sys 0.018s
I20260709 13:05:49.562484 16962 raft_consensus.cc:359] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:49.563233 16962 raft_consensus.cc:385] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.563040 16995 consensus_queue.cc:1048] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:49.563534 16962 raft_consensus.cc:740] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.564397 16962 consensus_queue.cc:260] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:49.567044 16962 ts_tablet_manager.cc:1434] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:05:49.568106 16962 tablet_bootstrap.cc:492] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:49.556766 16960 tablet_bootstrap.cc:654] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.570250 16961 consensus_queue.cc:260] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
W20260709 13:05:49.581076 16730 consensus_peers.cc:597] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:49.582484 16961 ts_tablet_manager.cc:1434] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.043s	user 0.010s	sys 0.000s
I20260709 13:05:49.584088 16961 tablet_bootstrap.cc:492] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:49.584297 16965 consensus_queue.cc:1048] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:49.600262 16959 tablet_bootstrap.cc:492] T 13d7f28a321a46919d282b9709ab84cb P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:49.600831 16959 ts_tablet_manager.cc:1403] T 13d7f28a321a46919d282b9709ab84cb P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.107s	user 0.019s	sys 0.021s
I20260709 13:05:49.605125 16959 raft_consensus.cc:359] T 13d7f28a321a46919d282b9709ab84cb P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:49.605839 16959 raft_consensus.cc:385] T 13d7f28a321a46919d282b9709ab84cb P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.606122 16959 raft_consensus.cc:740] T 13d7f28a321a46919d282b9709ab84cb P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.606582 16961 tablet_bootstrap.cc:654] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.606757 16962 tablet_bootstrap.cc:654] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.606885 16959 consensus_queue.cc:260] T 13d7f28a321a46919d282b9709ab84cb P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:49.607986 16965 raft_consensus.cc:493] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.608551 16965 raft_consensus.cc:515] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:49.608935 16959 ts_tablet_manager.cc:1434] T 13d7f28a321a46919d282b9709ab84cb P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:49.610703 16959 tablet_bootstrap.cc:492] T 2369d92de77f42e7be750810912daeef P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:49.611088 16965 leader_election.cc:290] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:49.611922 16687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e91185676f4335a4100a6d3fa40c8d" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:49.612262 16836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e91185676f4335a4100a6d3fa40c8d" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:49.613806 16836 raft_consensus.cc:2468] T 47e91185676f4335a4100a6d3fa40c8d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 0.
I20260709 13:05:49.614913 16687 raft_consensus.cc:2468] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 0.
I20260709 13:05:49.615396 16729 leader_election.cc:304] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:49.616451 16965 raft_consensus.cc:2804] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:49.616850 16965 raft_consensus.cc:493] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.617233 16965 raft_consensus.cc:3060] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.638685 16959 tablet_bootstrap.cc:654] T 2369d92de77f42e7be750810912daeef P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.634709 16965 raft_consensus.cc:515] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:49.646163 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e91185676f4335a4100a6d3fa40c8d" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:49.646826 16837 raft_consensus.cc:3060] T 47e91185676f4335a4100a6d3fa40c8d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.650375 16687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e91185676f4335a4100a6d3fa40c8d" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:49.650729 17042 raft_consensus.cc:493] T 13d7f28a321a46919d282b9709ab84cb P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.651057 16687 raft_consensus.cc:3060] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.651252 17042 raft_consensus.cc:515] T 13d7f28a321a46919d282b9709ab84cb P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:49.654255 17042 leader_election.cc:290] T 13d7f28a321a46919d282b9709ab84cb P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:49.657037 16911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d7f28a321a46919d282b9709ab84cb" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:49.659861 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d7f28a321a46919d282b9709ab84cb" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:49.660843 16838 raft_consensus.cc:2393] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d0ea3afb898b4eb5b21faeb676627011 in current term 1: Already voted for candidate 7197bc10b2304fccb972da2da7749e3b in this term.
I20260709 13:05:49.662257 16729 leader_election.cc:304] T 13d7f28a321a46919d282b9709ab84cb P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:49.663419 17047 raft_consensus.cc:3060] T 13d7f28a321a46919d282b9709ab84cb P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.666394 16965 leader_election.cc:290] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Requested vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:49.669792 16837 raft_consensus.cc:2468] T 47e91185676f4335a4100a6d3fa40c8d P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
I20260709 13:05:49.671447 16729 leader_election.cc:304] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:49.672626 16965 raft_consensus.cc:2804] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:49.679492 17114 raft_consensus.cc:493] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.680126 17114 raft_consensus.cc:515] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:49.683177 17045 raft_consensus.cc:493] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.683840 17045 raft_consensus.cc:515] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:49.684482 16688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369d92de77f42e7be750810912daeef" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:49.685206 16688 raft_consensus.cc:2468] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
I20260709 13:05:49.683202 17114 leader_election.cc:290] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:49.686077 17045 leader_election.cc:290] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:49.687346 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369d92de77f42e7be750810912daeef" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
W20260709 13:05:49.690584 16802 leader_election.cc:343] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.696373 16804 leader_election.cc:304] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd; no voters: d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:49.701514 17114 raft_consensus.cc:2804] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:49.702159 17114 raft_consensus.cc:493] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.702621 17114 raft_consensus.cc:3060] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.706947 16687 raft_consensus.cc:2468] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
I20260709 13:05:49.716603 17043 raft_consensus.cc:493] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.717387 17043 raft_consensus.cc:515] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:49.720288 17043 leader_election.cc:290] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:49.722541 16688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061a5313535a475ea9385383b611b52d" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:49.722822 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061a5313535a475ea9385383b611b52d" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:49.723798 16913 raft_consensus.cc:2468] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
I20260709 13:05:49.724210 16965 raft_consensus.cc:697] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Becoming Leader. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
W20260709 13:05:49.724721 16804 leader_election.cc:343] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.725399 16965 consensus_queue.cc:237] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:49.725903 16802 leader_election.cc:304] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:49.727228 17036 raft_consensus.cc:2804] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:49.727721 17036 raft_consensus.cc:493] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.728276 17036 raft_consensus.cc:3060] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.730185 17114 raft_consensus.cc:515] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:49.733424 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c91dff9e8c4ab78bacda0d282beacf" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:49.717401 17000 raft_consensus.cc:493] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.734169 16764 raft_consensus.cc:2468] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 0.
I20260709 13:05:49.734745 17000 raft_consensus.cc:515] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:49.736086 16959 tablet_bootstrap.cc:492] T 2369d92de77f42e7be750810912daeef P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:49.735961 16653 leader_election.cc:304] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:49.736804 16959 ts_tablet_manager.cc:1403] T 2369d92de77f42e7be750810912daeef P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.126s	user 0.014s	sys 0.001s
I20260709 13:05:49.737586 16997 raft_consensus.cc:2804] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:49.738015 16997 raft_consensus.cc:493] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.738355 16997 raft_consensus.cc:3060] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.741950 16688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369d92de77f42e7be750810912daeef" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:49.742550 17000 leader_election.cc:290] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:49.743257 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e348c32749d48f68c70dc32267e38c0" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:49.746649 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369d92de77f42e7be750810912daeef" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:49.748354 17114 leader_election.cc:290] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Requested vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:49.740393 16959 raft_consensus.cc:359] T 2369d92de77f42e7be750810912daeef P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:49.749560 16959 raft_consensus.cc:385] T 2369d92de77f42e7be750810912daeef P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.749878 16959 raft_consensus.cc:740] T 2369d92de77f42e7be750810912daeef P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.750622 16959 consensus_queue.cc:260] T 2369d92de77f42e7be750810912daeef P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:49.751997 16764 raft_consensus.cc:3060] T 2369d92de77f42e7be750810912daeef P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.753153 16959 ts_tablet_manager.cc:1434] T 2369d92de77f42e7be750810912daeef P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:05:49.754227 16959 tablet_bootstrap.cc:492] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:49.756458 16960 tablet_bootstrap.cc:492] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:49.767733 16960 ts_tablet_manager.cc:1403] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.237s	user 0.030s	sys 0.017s
I20260709 13:05:49.760226 16959 tablet_bootstrap.cc:654] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.764020 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e348c32749d48f68c70dc32267e38c0" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:49.771812 16913 raft_consensus.cc:2393] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1cbe303821774e4d936ea3d54875dcb8 in current term 1: Already voted for candidate 622433288cac4964aea9ea5a24ba77fd in this term.
I20260709 13:05:49.774000 16653 leader_election.cc:304] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8; no voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:49.760748 17047 raft_consensus.cc:2749] T 13d7f28a321a46919d282b9709ab84cb P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:49.742645 16688 raft_consensus.cc:3060] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.776230 16960 raft_consensus.cc:359] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:49.777705 16960 raft_consensus.cc:385] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.778291 16960 raft_consensus.cc:740] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.778756 17045 raft_consensus.cc:3060] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.779990 16960 consensus_queue.cc:260] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:49.784464 17091 raft_consensus.cc:493] T 0d72e7ee195341ab8a8d3865c5013ac8 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.785249 16586 catalog_manager.cc:5697] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 622433288cac4964aea9ea5a24ba77fd (127.8.4.67). New cstate: current_term: 1 leader_uuid: "622433288cac4964aea9ea5a24ba77fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:49.785322 17091 raft_consensus.cc:515] T 0d72e7ee195341ab8a8d3865c5013ac8 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:49.773722 17036 raft_consensus.cc:515] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:49.789753 17091 leader_election.cc:290] T 0d72e7ee195341ab8a8d3865c5013ac8 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:49.792366 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061a5313535a475ea9385383b611b52d" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:49.793151 16913 raft_consensus.cc:3060] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.794734 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d72e7ee195341ab8a8d3865c5013ac8" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
W20260709 13:05:49.797135 16879 leader_election.cc:343] T 0d72e7ee195341ab8a8d3865c5013ac8 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.790868 17036 leader_election.cc:290] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:49.791581 16911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c91dff9e8c4ab78bacda0d282beacf" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:49.791704 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d72e7ee195341ab8a8d3865c5013ac8" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:49.800836 16960 ts_tablet_manager.cc:1434] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 13:05:49.801369 16913 raft_consensus.cc:2468] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
W20260709 13:05:49.802462 16878 leader_election.cc:343] T 0d72e7ee195341ab8a8d3865c5013ac8 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.807412 16878 leader_election.cc:304] T 0d72e7ee195341ab8a8d3865c5013ac8 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:49.808715 17091 raft_consensus.cc:2749] T 0d72e7ee195341ab8a8d3865c5013ac8 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:49.802765 16960 tablet_bootstrap.cc:492] T aab71409c1cf4356817b8f83a1686482 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:49.816423 16961 tablet_bootstrap.cc:492] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:49.803304 16911 raft_consensus.cc:2468] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 0.
I20260709 13:05:49.806524 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061a5313535a475ea9385383b611b52d" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:49.817054 16961 ts_tablet_manager.cc:1403] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.233s	user 0.075s	sys 0.104s
I20260709 13:05:49.817301 16802 leader_election.cc:304] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:49.818315 17036 raft_consensus.cc:2804] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:49.818912 17036 raft_consensus.cc:697] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Becoming Leader. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:05:49.819896 16764 raft_consensus.cc:2468] T 2369d92de77f42e7be750810912daeef P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:49.819814 17036 consensus_queue.cc:237] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:49.820204 16961 raft_consensus.cc:359] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:49.820959 16961 raft_consensus.cc:385] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.821282 16961 raft_consensus.cc:740] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.821959 16961 consensus_queue.cc:260] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:49.823052 16802 leader_election.cc:304] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:49.823880 17114 raft_consensus.cc:2804] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:49.824081 16961 ts_tablet_manager.cc:1434] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:49.824455 17114 raft_consensus.cc:697] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Becoming Leader. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:05:49.825205 16961 tablet_bootstrap.cc:492] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:49.825467 17114 consensus_queue.cc:237] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:49.826973 16962 tablet_bootstrap.cc:492] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:49.827468 16962 ts_tablet_manager.cc:1403] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.260s	user 0.009s	sys 0.011s
I20260709 13:05:49.830224 16960 tablet_bootstrap.cc:654] T aab71409c1cf4356817b8f83a1686482 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.830587 16962 raft_consensus.cc:359] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:49.831331 16962 raft_consensus.cc:385] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.831629 16962 raft_consensus.cc:740] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.832337 16962 consensus_queue.cc:260] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:49.837683 16961 tablet_bootstrap.cc:654] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:49.838516 16804 leader_election.cc:343] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:49.750322 16997 raft_consensus.cc:515] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:49.855651 16688 raft_consensus.cc:2468] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:49.861474 17045 raft_consensus.cc:2749] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:49.865175 16585 catalog_manager.cc:5697] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 622433288cac4964aea9ea5a24ba77fd (127.8.4.67). New cstate: current_term: 1 leader_uuid: "622433288cac4964aea9ea5a24ba77fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:49.906549 16653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:45033, user_credentials={real_user=slave}} blocked reactor thread for 66359.4us
I20260709 13:05:49.912032 16911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c91dff9e8c4ab78bacda0d282beacf" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:49.915478 16960 tablet_bootstrap.cc:492] T aab71409c1cf4356817b8f83a1686482 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:49.916313 16960 ts_tablet_manager.cc:1403] T aab71409c1cf4356817b8f83a1686482 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.114s	user 0.017s	sys 0.002s
W20260709 13:05:49.906045 16730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37355, user_credentials={real_user=slave}} blocked reactor thread for 65180.3us
I20260709 13:05:49.915766 16911 raft_consensus.cc:3060] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.929278 16962 ts_tablet_manager.cc:1434] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.101s	user 0.009s	sys 0.003s
I20260709 13:05:49.931058 16962 tablet_bootstrap.cc:492] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:49.918561 16997 leader_election.cc:290] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:49.927583 17114 consensus_queue.cc:1048] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:49.933482 16585 catalog_manager.cc:5697] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 622433288cac4964aea9ea5a24ba77fd (127.8.4.67). New cstate: current_term: 1 leader_uuid: "622433288cac4964aea9ea5a24ba77fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:49.935396 16959 tablet_bootstrap.cc:492] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:49.935940 16959 ts_tablet_manager.cc:1403] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.182s	user 0.022s	sys 0.025s
I20260709 13:05:49.939559 16962 tablet_bootstrap.cc:654] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.941701 16911 raft_consensus.cc:2468] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 1.
I20260709 13:05:49.924857 17091 consensus_queue.cc:1048] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:05:49.948455 17114 consensus_queue.cc:1048] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:49.969121 16653 leader_election.cc:304] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:49.970340 17145 raft_consensus.cc:2804] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:49.970928 17145 raft_consensus.cc:697] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:05:49.971787 17145 consensus_queue.cc:237] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:49.992219 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c91dff9e8c4ab78bacda0d282beacf" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:49.992923 16764 raft_consensus.cc:3060] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.002295 16959 raft_consensus.cc:359] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:50.003093 16959 raft_consensus.cc:385] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.003388 16959 raft_consensus.cc:740] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.004091 16959 consensus_queue.cc:260] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:50.004352 17038 consensus_queue.cc:1048] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:50.008810 16959 ts_tablet_manager.cc:1434] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.002s
I20260709 13:05:50.017495 16959 tablet_bootstrap.cc:492] T e5445951d8c04b35838db7ef8df62694 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:50.030453 16959 tablet_bootstrap.cc:654] T e5445951d8c04b35838db7ef8df62694 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.036293 16961 tablet_bootstrap.cc:492] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:50.036849 16961 ts_tablet_manager.cc:1403] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.212s	user 0.015s	sys 0.044s
I20260709 13:05:50.045081 16587 catalog_manager.cc:5697] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 reported cstate change: term changed from 0 to 1, leader changed from <none> to d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d0ea3afb898b4eb5b21faeb676627011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:50.052711 16636 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:50.065128 16960 raft_consensus.cc:359] T aab71409c1cf4356817b8f83a1686482 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:50.065868 16960 raft_consensus.cc:385] T aab71409c1cf4356817b8f83a1686482 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.066107 16960 raft_consensus.cc:740] T aab71409c1cf4356817b8f83a1686482 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.066761 16960 consensus_queue.cc:260] T aab71409c1cf4356817b8f83a1686482 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:50.069872 16960 ts_tablet_manager.cc:1434] T aab71409c1cf4356817b8f83a1686482 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.153s	user 0.007s	sys 0.000s
I20260709 13:05:50.071403 16960 tablet_bootstrap.cc:492] T 82e52334c3ab4394b0a09b0a460e34d4 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:50.075011 16962 tablet_bootstrap.cc:492] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:50.075665 16962 ts_tablet_manager.cc:1403] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.145s	user 0.017s	sys 0.025s
I20260709 13:05:50.083457 17043 raft_consensus.cc:493] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.083240 16961 raft_consensus.cc:359] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:50.084161 16961 raft_consensus.cc:385] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.084131 17043 raft_consensus.cc:515] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:50.084654 16961 raft_consensus.cc:740] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.085691 16961 consensus_queue.cc:260] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:50.086493 17043 leader_election.cc:290] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:50.087757 16961 ts_tablet_manager.cc:1434] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.001s
I20260709 13:05:50.088878 16961 tablet_bootstrap.cc:492] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:50.089394 16763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce42d5cbca2144e8a54bab8a8cf31763" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:50.090090 16763 raft_consensus.cc:2468] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:50.090801 17114 raft_consensus.cc:493] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.091322 17114 raft_consensus.cc:515] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:50.093976 17114 leader_election.cc:290] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:50.094643 16688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b89e067aed8497a9c9c70577ac56c77" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
W20260709 13:05:50.096355 16804 leader_election.cc:343] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:50.097146 16962 raft_consensus.cc:359] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:50.097976 16962 raft_consensus.cc:385] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.098251 16962 raft_consensus.cc:740] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.099120 16802 leader_election.cc:304] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:50.099128 16962 consensus_queue.cc:260] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:50.099715 16762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b89e067aed8497a9c9c70577ac56c77" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:50.100468 16762 raft_consensus.cc:2468] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
I20260709 13:05:50.101979 16962 ts_tablet_manager.cc:1434] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:05:50.101872 16802 leader_election.cc:304] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:50.102340 17036 raft_consensus.cc:2804] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:50.102742 17036 raft_consensus.cc:493] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.103044 16962 tablet_bootstrap.cc:492] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:50.108198 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce42d5cbca2144e8a54bab8a8cf31763" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:50.109076 16913 raft_consensus.cc:2468] T ce42d5cbca2144e8a54bab8a8cf31763 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:50.103070 17036 raft_consensus.cc:3060] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.116533 17043 raft_consensus.cc:2804] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:50.121726 16962 tablet_bootstrap.cc:654] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.121151 17043 raft_consensus.cc:493] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.122957 16764 raft_consensus.cc:2468] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 1.
I20260709 13:05:50.132310 17043 raft_consensus.cc:3060] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.138240 16995 consensus_queue.cc:1048] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:50.151464 16961 tablet_bootstrap.cc:654] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.174922 16960 tablet_bootstrap.cc:654] T 82e52334c3ab4394b0a09b0a460e34d4 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.176893 16959 tablet_bootstrap.cc:492] T e5445951d8c04b35838db7ef8df62694 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:50.178882 16959 ts_tablet_manager.cc:1403] T e5445951d8c04b35838db7ef8df62694 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.162s	user 0.014s	sys 0.010s
W20260709 13:05:50.175817 16802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:45033, user_credentials={real_user=slave}} blocked reactor thread for 54153.3us
I20260709 13:05:50.192787 17036 raft_consensus.cc:515] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:50.192363 16959 raft_consensus.cc:359] T e5445951d8c04b35838db7ef8df62694 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:50.194311 16959 raft_consensus.cc:385] T e5445951d8c04b35838db7ef8df62694 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.194844 16959 raft_consensus.cc:740] T e5445951d8c04b35838db7ef8df62694 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.196204 17036 leader_election.cc:290] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:50.195734 16959 consensus_queue.cc:260] T e5445951d8c04b35838db7ef8df62694 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:50.198146 16961 tablet_bootstrap.cc:492] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:50.198715 16961 ts_tablet_manager.cc:1403] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.110s	user 0.018s	sys 0.004s
I20260709 13:05:50.200887 16959 ts_tablet_manager.cc:1434] T e5445951d8c04b35838db7ef8df62694 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:05:50.201987 16959 tablet_bootstrap.cc:492] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:50.207872 16961 raft_consensus.cc:359] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:50.208638 16961 raft_consensus.cc:385] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.208931 16961 raft_consensus.cc:740] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.209638 16961 consensus_queue.cc:260] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:50.210291 17042 raft_consensus.cc:493] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.211309 17042 raft_consensus.cc:515] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:50.212078 16961 ts_tablet_manager.cc:1434] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:50.213131 16961 tablet_bootstrap.cc:492] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:50.213598 17042 leader_election.cc:290] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
W20260709 13:05:50.180449 16804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37355, user_credentials={real_user=slave}} blocked reactor thread for 63091.5us
I20260709 13:05:50.215793 16687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e52334c3ab4394b0a09b0a460e34d4" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:50.216826 16687 raft_consensus.cc:2468] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 0.
I20260709 13:05:50.218412 16730 leader_election.cc:304] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:50.219189 17042 raft_consensus.cc:2804] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:50.219660 17042 raft_consensus.cc:493] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.220122 17042 raft_consensus.cc:3060] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.219807 16911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e52334c3ab4394b0a09b0a460e34d4" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:50.221930 16961 tablet_bootstrap.cc:654] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:50.222249 16728 leader_election.cc:343] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:50.228603 16962 tablet_bootstrap.cc:492] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:50.229344 16962 ts_tablet_manager.cc:1403] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.127s	user 0.035s	sys 0.044s
I20260709 13:05:50.229431 16689 raft_consensus.cc:3060] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.230090 17043 raft_consensus.cc:515] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:50.232275 16995 consensus_queue.cc:1048] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:50.232390 16962 raft_consensus.cc:359] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:50.233361 16962 raft_consensus.cc:385] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.233675 16962 raft_consensus.cc:740] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.238584 16962 consensus_queue.cc:260] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:50.244997 16911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce42d5cbca2144e8a54bab8a8cf31763" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:50.245723 16911 raft_consensus.cc:3060] T ce42d5cbca2144e8a54bab8a8cf31763 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.251266 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce42d5cbca2144e8a54bab8a8cf31763" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:50.251992 16765 raft_consensus.cc:3060] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.252365 17043 leader_election.cc:290] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Requested vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:50.256441 16962 ts_tablet_manager.cc:1434] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 13:05:50.257478 16962 tablet_bootstrap.cc:492] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:50.268415 17042 raft_consensus.cc:515] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:50.268872 17036 raft_consensus.cc:493] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.269556 17036 raft_consensus.cc:515] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:50.271857 16960 tablet_bootstrap.cc:492] T 82e52334c3ab4394b0a09b0a460e34d4 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:50.272509 16960 ts_tablet_manager.cc:1403] T 82e52334c3ab4394b0a09b0a460e34d4 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.201s	user 0.025s	sys 0.013s
I20260709 13:05:50.273160 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b89e067aed8497a9c9c70577ac56c77" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:50.273880 16764 raft_consensus.cc:3060] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.271857 17036 leader_election.cc:290] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:50.276268 16960 raft_consensus.cc:359] T 82e52334c3ab4394b0a09b0a460e34d4 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:50.277104 16960 raft_consensus.cc:385] T 82e52334c3ab4394b0a09b0a460e34d4 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.278101 17000 raft_consensus.cc:493] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.279933 17000 raft_consensus.cc:515] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:50.280892 16763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5445951d8c04b35838db7ef8df62694" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:50.281507 16688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b89e067aed8497a9c9c70577ac56c77" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:50.281656 16763 raft_consensus.cc:2468] T e5445951d8c04b35838db7ef8df62694 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
I20260709 13:05:50.282181 16688 raft_consensus.cc:3060] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.283102 17043 consensus_queue.cc:1048] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:50.284499 17000 leader_election.cc:290] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:50.285246 16960 raft_consensus.cc:740] T 82e52334c3ab4394b0a09b0a460e34d4 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.286285 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061a5313535a475ea9385383b611b52d" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:50.288098 16911 raft_consensus.cc:2468] T ce42d5cbca2144e8a54bab8a8cf31763 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 2.
I20260709 13:05:50.278939 16765 raft_consensus.cc:2468] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 2.
I20260709 13:05:50.290457 16959 tablet_bootstrap.cc:654] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.287247 16960 consensus_queue.cc:260] T 82e52334c3ab4394b0a09b0a460e34d4 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:50.285805 16584 catalog_manager.cc:5697] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:50.293176 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061a5313535a475ea9385383b611b52d" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:50.293969 16913 raft_consensus.cc:2468] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 1.
I20260709 13:05:50.296612 16960 ts_tablet_manager.cc:1434] T 82e52334c3ab4394b0a09b0a460e34d4 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:05:50.297571 16960 tablet_bootstrap.cc:492] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:50.307305 16653 leader_election.cc:304] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b; no voters: 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:50.310719 17000 raft_consensus.cc:2804] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:50.311182 17000 raft_consensus.cc:493] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.311545 17000 raft_consensus.cc:3060] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.311829 16802 leader_election.cc:304] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:50.312649 17036 raft_consensus.cc:2804] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:50.312822 16802 leader_election.cc:304] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:50.313228 17036 raft_consensus.cc:697] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Becoming Leader. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:05:50.313819 17156 raft_consensus.cc:2804] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:50.314064 17042 leader_election.cc:290] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:50.305102 17043 consensus_queue.cc:1048] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:05:50.310765 16962 tablet_bootstrap.cc:654] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.314222 17156 raft_consensus.cc:493] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.323319 17156 raft_consensus.cc:3060] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.324708 16764 raft_consensus.cc:2468] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:50.328760 16961 tablet_bootstrap.cc:492] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:50.329442 16961 ts_tablet_manager.cc:1403] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.117s	user 0.006s	sys 0.009s
I20260709 13:05:50.329641 16802 leader_election.cc:304] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:50.330611 17114 raft_consensus.cc:2804] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:50.331576 16960 tablet_bootstrap.cc:654] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.309414 16911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5445951d8c04b35838db7ef8df62694" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:50.320264 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e52334c3ab4394b0a09b0a460e34d4" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:50.318532 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e52334c3ab4394b0a09b0a460e34d4" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:50.343698 16961 raft_consensus.cc:359] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:50.345996 16961 raft_consensus.cc:385] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.346417 16961 raft_consensus.cc:740] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.331911 17114 raft_consensus.cc:697] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Becoming Leader. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:05:50.375356 17114 consensus_queue.cc:237] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:50.349221 16912 raft_consensus.cc:3060] T 82e52334c3ab4394b0a09b0a460e34d4 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.347474 16961 consensus_queue.cc:260] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:50.314162 17036 consensus_queue.cc:237] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:50.345266 16911 raft_consensus.cc:2468] T e5445951d8c04b35838db7ef8df62694 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
I20260709 13:05:50.373778 16689 raft_consensus.cc:3060] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.394620 17145 consensus_queue.cc:1048] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:50.399117 16962 tablet_bootstrap.cc:492] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:50.399709 16962 ts_tablet_manager.cc:1403] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.142s	user 0.020s	sys 0.033s
I20260709 13:05:50.418267 16961 ts_tablet_manager.cc:1434] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.088s	user 0.008s	sys 0.001s
I20260709 13:05:50.425230 16961 tablet_bootstrap.cc:492] T d51df8e7709946bbb3f3d5ec1c541307 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:50.432132 16962 raft_consensus.cc:359] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:50.437409 16962 raft_consensus.cc:385] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.438014 16962 raft_consensus.cc:740] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.440317 16959 tablet_bootstrap.cc:492] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:50.441299 16959 ts_tablet_manager.cc:1403] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.240s	user 0.016s	sys 0.005s
I20260709 13:05:50.451704 17156 raft_consensus.cc:515] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:50.456106 16689 raft_consensus.cc:2468] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
I20260709 13:05:50.460361 16959 raft_consensus.cc:359] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:50.461481 16959 raft_consensus.cc:385] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.461957 16959 raft_consensus.cc:740] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.463042 17036 consensus_queue.cc:1048] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:50.465929 16997 consensus_queue.cc:1048] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:50.478550 17155 consensus_queue.cc:1048] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:50.479676 17157 raft_consensus.cc:493] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.480262 17157 raft_consensus.cc:515] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:50.482574 17157 leader_election.cc:290] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:50.409910 17000 raft_consensus.cc:515] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:50.490283 16686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d72e7ee195341ab8a8d3865c5013ac8" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:50.490892 16690 raft_consensus.cc:1240] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Rejecting Update request from peer 622433288cac4964aea9ea5a24ba77fd for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:05:50.447033 16962 consensus_queue.cc:260] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:50.494652 16961 tablet_bootstrap.cc:654] T d51df8e7709946bbb3f3d5ec1c541307 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.494650 16959 consensus_queue.cc:260] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:50.495920 16586 catalog_manager.cc:5697] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 622433288cac4964aea9ea5a24ba77fd (127.8.4.67). New cstate: current_term: 1 leader_uuid: "622433288cac4964aea9ea5a24ba77fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.505528 16586 catalog_manager.cc:5697] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd reported cstate change: term changed from 0 to 2, leader changed from <none> to 622433288cac4964aea9ea5a24ba77fd (127.8.4.67). New cstate: current_term: 2 leader_uuid: "622433288cac4964aea9ea5a24ba77fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:50.515537 16960 tablet_bootstrap.cc:492] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:50.498257 17000 leader_election.cc:290] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:50.516389 16960 ts_tablet_manager.cc:1403] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.219s	user 0.016s	sys 0.001s
I20260709 13:05:50.506640 17036 consensus_queue.cc:1059] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:05:50.520357 17157 raft_consensus.cc:493] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.528786 17157 raft_consensus.cc:515] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:50.529496 17036 raft_consensus.cc:3055] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:50.531212 17036 raft_consensus.cc:740] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:05:50.520491 16730 leader_election.cc:304] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:50.500398 16686 raft_consensus.cc:2468] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
I20260709 13:05:50.544195 16959 ts_tablet_manager.cc:1434] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.102s	user 0.010s	sys 0.000s
I20260709 13:05:50.515302 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d72e7ee195341ab8a8d3865c5013ac8" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:50.549258 16959 tablet_bootstrap.cc:492] T d51df8e7709946bbb3f3d5ec1c541307 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:50.537968 17157 leader_election.cc:290] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:50.550877 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061a5313535a475ea9385383b611b52d" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:50.527982 16688 raft_consensus.cc:2468] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:50.553370 16911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab71409c1cf4356817b8f83a1686482" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:50.561923 16911 raft_consensus.cc:2468] T aab71409c1cf4356817b8f83a1686482 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
I20260709 13:05:50.563562 16802 leader_election.cc:304] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:50.564812 17157 raft_consensus.cc:2804] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:50.565320 17157 raft_consensus.cc:493] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.565703 17157 raft_consensus.cc:3060] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.552127 17042 raft_consensus.cc:2804] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:50.569509 17042 raft_consensus.cc:697] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Becoming Leader. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:05:50.570393 17042 consensus_queue.cc:237] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:50.571280 16959 tablet_bootstrap.cc:654] T d51df8e7709946bbb3f3d5ec1c541307 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.576673 16763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5445951d8c04b35838db7ef8df62694" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:50.577589 16962 ts_tablet_manager.cc:1434] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.178s	user 0.013s	sys 0.000s
I20260709 13:05:50.577713 16763 raft_consensus.cc:3060] T e5445951d8c04b35838db7ef8df62694 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.579824 16962 tablet_bootstrap.cc:492] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:50.558276 16913 raft_consensus.cc:2468] T 0d72e7ee195341ab8a8d3865c5013ac8 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
I20260709 13:05:50.595846 16962 tablet_bootstrap.cc:654] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:50.582652 17171 log.cc:927] Time spent T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:05:50.597270 16912 raft_consensus.cc:2468] T 82e52334c3ab4394b0a09b0a460e34d4 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
I20260709 13:05:50.532264 17036 consensus_queue.cc:260] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:50.593977 16960 raft_consensus.cc:359] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:50.590852 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061a5313535a475ea9385383b611b52d" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:50.600240 16960 raft_consensus.cc:385] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.601415 16960 raft_consensus.cc:740] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.608230 16960 consensus_queue.cc:260] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:50.582834 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab71409c1cf4356817b8f83a1686482" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:50.609576 16690 raft_consensus.cc:2468] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
I20260709 13:05:50.601769 17156 leader_election.cc:290] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:50.623265 16959 tablet_bootstrap.cc:492] T d51df8e7709946bbb3f3d5ec1c541307 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:50.623979 16959 ts_tablet_manager.cc:1403] T d51df8e7709946bbb3f3d5ec1c541307 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.079s	user 0.019s	sys 0.000s
I20260709 13:05:50.628386 16804 leader_election.cc:304] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd; no voters: 
I20260709 13:05:50.631353 17114 raft_consensus.cc:2804] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:50.631805 17114 raft_consensus.cc:493] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.632128 17114 raft_consensus.cc:3060] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.633459 17036 raft_consensus.cc:3060] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.640512 16763 raft_consensus.cc:2468] T e5445951d8c04b35838db7ef8df62694 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:50.642176 16802 leader_election.cc:304] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:50.643218 17156 raft_consensus.cc:2804] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:50.643821 17156 raft_consensus.cc:697] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Becoming Leader. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:05:50.645146 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5445951d8c04b35838db7ef8df62694" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:50.645954 16913 raft_consensus.cc:3060] T e5445951d8c04b35838db7ef8df62694 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.650038 17157 raft_consensus.cc:515] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:50.645028 17156 consensus_queue.cc:237] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:50.660244 16959 raft_consensus.cc:359] T d51df8e7709946bbb3f3d5ec1c541307 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:50.663978 16959 raft_consensus.cc:385] T d51df8e7709946bbb3f3d5ec1c541307 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.664412 16959 raft_consensus.cc:740] T d51df8e7709946bbb3f3d5ec1c541307 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.667059 16686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab71409c1cf4356817b8f83a1686482" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:50.667958 17157 leader_election.cc:290] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:50.668087 16686 raft_consensus.cc:3060] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.666503 16959 consensus_queue.cc:260] T d51df8e7709946bbb3f3d5ec1c541307 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:50.673420 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab71409c1cf4356817b8f83a1686482" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:50.682200 16912 raft_consensus.cc:3060] T aab71409c1cf4356817b8f83a1686482 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.683338 16913 raft_consensus.cc:2468] T e5445951d8c04b35838db7ef8df62694 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:50.693117 16837 raft_consensus.cc:2410] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1cbe303821774e4d936ea3d54875dcb8 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:05:50.697255 16959 ts_tablet_manager.cc:1434] T d51df8e7709946bbb3f3d5ec1c541307 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.073s	user 0.009s	sys 0.000s
I20260709 13:05:50.698788 16959 tablet_bootstrap.cc:492] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
W20260709 13:05:50.701735 16878 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:39929, user_credentials={real_user=slave}} blocked reactor thread for 103138us
I20260709 13:05:50.676309 17114 raft_consensus.cc:515] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:50.717757 16960 ts_tablet_manager.cc:1434] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.193s	user 0.017s	sys 0.032s
I20260709 13:05:50.719760 16961 tablet_bootstrap.cc:492] T d51df8e7709946bbb3f3d5ec1c541307 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:50.720369 16961 ts_tablet_manager.cc:1403] T d51df8e7709946bbb3f3d5ec1c541307 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.301s	user 0.015s	sys 0.013s
I20260709 13:05:50.710889 16654 leader_election.cc:304] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8; no voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:50.739313 17000 raft_consensus.cc:2749] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.745570 16686 raft_consensus.cc:2468] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:50.747030 16804 leader_election.cc:304] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd; no voters: 
I20260709 13:05:50.748147 16585 catalog_manager.cc:5697] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 reported cstate change: term changed from 0 to 1, leader changed from <none> to d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d0ea3afb898b4eb5b21faeb676627011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.759231 17183 raft_consensus.cc:493] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.761618 17183 raft_consensus.cc:515] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:50.765606 17183 leader_election.cc:290] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:50.767382 16962 tablet_bootstrap.cc:492] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:50.767797 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51df8e7709946bbb3f3d5ec1c541307" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:50.770839 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51df8e7709946bbb3f3d5ec1c541307" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:50.772643 16961 raft_consensus.cc:359] T d51df8e7709946bbb3f3d5ec1c541307 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:50.773309 16764 raft_consensus.cc:2468] T d51df8e7709946bbb3f3d5ec1c541307 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:50.750263 17036 raft_consensus.cc:2804] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:50.774466 17036 raft_consensus.cc:697] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Becoming Leader. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:05:50.764843 16912 raft_consensus.cc:2468] T aab71409c1cf4356817b8f83a1686482 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:50.774540 16962 ts_tablet_manager.cc:1403] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.195s	user 0.014s	sys 0.016s
I20260709 13:05:50.774775 16877 leader_election.cc:304] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:50.773432 16961 raft_consensus.cc:385] T d51df8e7709946bbb3f3d5ec1c541307 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.777575 16961 raft_consensus.cc:740] T d51df8e7709946bbb3f3d5ec1c541307 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.771899 16959 tablet_bootstrap.cc:654] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.778796 17183 raft_consensus.cc:2804] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:50.785910 17183 raft_consensus.cc:493] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.781425 16584 catalog_manager.cc:5697] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 622433288cac4964aea9ea5a24ba77fd (127.8.4.67). New cstate: current_term: 1 leader_uuid: "622433288cac4964aea9ea5a24ba77fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:50.786499 17183 raft_consensus.cc:3060] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.783002 16962 raft_consensus.cc:359] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:50.788650 16962 raft_consensus.cc:385] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.793521 16962 raft_consensus.cc:740] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.794528 16962 consensus_queue.cc:260] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:50.797217 17183 raft_consensus.cc:515] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:50.799391 17183 leader_election.cc:290] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:50.799592 16962 ts_tablet_manager.cc:1434] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:05:50.786088 16960 tablet_bootstrap.cc:492] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:50.788722 16686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d72e7ee195341ab8a8d3865c5013ac8" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:50.784343 17114 leader_election.cc:290] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:50.802058 16686 raft_consensus.cc:3060] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.802776 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51df8e7709946bbb3f3d5ec1c541307" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:50.803434 16764 raft_consensus.cc:3060] T d51df8e7709946bbb3f3d5ec1c541307 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.803534 16836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51df8e7709946bbb3f3d5ec1c541307" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:50.809440 16960 tablet_bootstrap.cc:654] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.814543 16686 raft_consensus.cc:2468] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:50.781822 17036 consensus_queue.cc:237] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:50.811707 16959 tablet_bootstrap.cc:492] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:50.818758 16959 ts_tablet_manager.cc:1403] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.120s	user 0.015s	sys 0.004s
I20260709 13:05:50.821645 16764 raft_consensus.cc:2468] T d51df8e7709946bbb3f3d5ec1c541307 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:50.823068 16877 leader_election.cc:304] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:50.792467 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d72e7ee195341ab8a8d3865c5013ac8" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:50.778559 16961 consensus_queue.cc:260] T d51df8e7709946bbb3f3d5ec1c541307 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:50.825232 16912 raft_consensus.cc:3060] T 0d72e7ee195341ab8a8d3865c5013ac8 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.825516 16837 raft_consensus.cc:2468] T d51df8e7709946bbb3f3d5ec1c541307 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:50.826726 16961 ts_tablet_manager.cc:1434] T d51df8e7709946bbb3f3d5ec1c541307 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.106s	user 0.005s	sys 0.003s
I20260709 13:05:50.827827 16961 tablet_bootstrap.cc:492] T 82e662a1c0204e5bab9a5b5e50b81561 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:50.813977 16962 tablet_bootstrap.cc:492] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:50.831893 16912 raft_consensus.cc:2468] T 0d72e7ee195341ab8a8d3865c5013ac8 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:50.832526 17183 raft_consensus.cc:2804] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:50.833181 17183 raft_consensus.cc:697] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Becoming Leader. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:05:50.833386 16802 leader_election.cc:304] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:50.833995 16961 tablet_bootstrap.cc:654] T 82e662a1c0204e5bab9a5b5e50b81561 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.834179 17183 consensus_queue.cc:237] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:50.835223 17114 raft_consensus.cc:2804] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:50.835801 17114 raft_consensus.cc:697] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Becoming Leader. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:05:50.836649 17114 consensus_queue.cc:237] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:50.837029 16959 raft_consensus.cc:359] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:50.837769 16959 raft_consensus.cc:385] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.838066 16959 raft_consensus.cc:740] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.844511 17157 consensus_queue.cc:1048] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:50.846304 16959 consensus_queue.cc:260] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:50.853137 17174 raft_consensus.cc:493] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.854182 16962 tablet_bootstrap.cc:654] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.853896 17174 raft_consensus.cc:515] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:50.859849 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b51d554de084a5594e8c14973873edc" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:50.856799 17174 leader_election.cc:290] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:50.864799 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b51d554de084a5594e8c14973873edc" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:50.866612 16653 leader_election.cc:304] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8; no voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:50.867908 17174 raft_consensus.cc:2749] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:50.868537 16764 raft_consensus.cc:1275] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Refusing update from remote peer 622433288cac4964aea9ea5a24ba77fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:05:50.869374 16584 catalog_manager.cc:5697] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 622433288cac4964aea9ea5a24ba77fd (127.8.4.67). New cstate: current_term: 1 leader_uuid: "622433288cac4964aea9ea5a24ba77fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:50.870327 17157 consensus_queue.cc:1048] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:50.875468 16959 ts_tablet_manager.cc:1434] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 13:05:50.876551 16959 tablet_bootstrap.cc:492] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:50.877017 16965 raft_consensus.cc:493] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.877751 16965 raft_consensus.cc:515] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:50.882380 16965 leader_election.cc:290] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:50.883697 16686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6e4009e1d445a1b055538cf3006287" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
W20260709 13:05:50.885320 16730 leader_election.cc:343] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:50.887845 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6e4009e1d445a1b055538cf3006287" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
W20260709 13:05:50.891873 16728 leader_election.cc:343] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:50.892339 16728 leader_election.cc:304] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:50.892580 16584 catalog_manager.cc:5697] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 622433288cac4964aea9ea5a24ba77fd (127.8.4.67). New cstate: current_term: 1 leader_uuid: "622433288cac4964aea9ea5a24ba77fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:50.898226 16961 tablet_bootstrap.cc:492] T 82e662a1c0204e5bab9a5b5e50b81561 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:50.898767 16961 ts_tablet_manager.cc:1403] T 82e662a1c0204e5bab9a5b5e50b81561 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.007s
I20260709 13:05:50.899436 17042 raft_consensus.cc:2749] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:50.899259 17036 consensus_queue.cc:1048] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:50.901612 16961 raft_consensus.cc:359] T 82e662a1c0204e5bab9a5b5e50b81561 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:50.902371 16961 raft_consensus.cc:385] T 82e662a1c0204e5bab9a5b5e50b81561 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.902655 16961 raft_consensus.cc:740] T 82e662a1c0204e5bab9a5b5e50b81561 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.903391 16961 consensus_queue.cc:260] T 82e662a1c0204e5bab9a5b5e50b81561 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:50.904898 16959 tablet_bootstrap.cc:654] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.905993 16961 ts_tablet_manager.cc:1434] T 82e662a1c0204e5bab9a5b5e50b81561 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:50.906733 17139 raft_consensus.cc:493] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.907502 16961 tablet_bootstrap.cc:492] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:50.907244 17139 raft_consensus.cc:515] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:50.912051 17139 leader_election.cc:290] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:50.913704 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e662a1c0204e5bab9a5b5e50b81561" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
W20260709 13:05:50.916062 16730 leader_election.cc:343] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:50.913725 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e662a1c0204e5bab9a5b5e50b81561" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:50.918258 16837 raft_consensus.cc:2468] T 82e662a1c0204e5bab9a5b5e50b81561 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 0.
I20260709 13:05:50.918671 16961 tablet_bootstrap.cc:654] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.917332 16960 tablet_bootstrap.cc:492] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:50.919628 16960 ts_tablet_manager.cc:1403] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.134s	user 0.014s	sys 0.023s
I20260709 13:05:50.919710 16729 leader_election.cc:304] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:50.926903 17139 raft_consensus.cc:2804] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:50.933238 17139 raft_consensus.cc:493] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.933930 17139 raft_consensus.cc:3060] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.936349 16961 tablet_bootstrap.cc:492] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:50.936903 16961 ts_tablet_manager.cc:1403] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.004s
I20260709 13:05:50.940289 16961 raft_consensus.cc:359] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:50.940991 16961 raft_consensus.cc:385] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.941286 16961 raft_consensus.cc:740] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.941972 16961 consensus_queue.cc:260] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:50.944255 16961 ts_tablet_manager.cc:1434] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:50.945171 16961 tablet_bootstrap.cc:492] T 4723ff8bcfab41bfad7b411c81cd0386 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:50.951494 16961 tablet_bootstrap.cc:654] T 4723ff8bcfab41bfad7b411c81cd0386 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.956111 17139 raft_consensus.cc:515] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:50.962930 17139 leader_election.cc:290] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Requested vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:50.963094 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e662a1c0204e5bab9a5b5e50b81561" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:50.963768 16837 raft_consensus.cc:3060] T 82e662a1c0204e5bab9a5b5e50b81561 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.970152 16962 tablet_bootstrap.cc:492] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:50.970834 16962 ts_tablet_manager.cc:1403] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.157s	user 0.011s	sys 0.019s
I20260709 13:05:50.971261 16686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e662a1c0204e5bab9a5b5e50b81561" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:50.958491 16959 tablet_bootstrap.cc:492] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:50.923233 16960 raft_consensus.cc:359] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:50.972321 16960 raft_consensus.cc:385] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.972702 16960 raft_consensus.cc:740] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.973489 16960 consensus_queue.cc:260] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:50.973919 16962 raft_consensus.cc:359] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:50.974635 16962 raft_consensus.cc:385] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.974912 16962 raft_consensus.cc:740] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.976228 16960 ts_tablet_manager.cc:1434] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 13:05:50.970813 16837 raft_consensus.cc:2468] T 82e662a1c0204e5bab9a5b5e50b81561 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
I20260709 13:05:50.977458 16960 tablet_bootstrap.cc:492] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:50.977864 16729 leader_election.cc:304] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:50.979023 17139 raft_consensus.cc:2804] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:50.979790 16962 consensus_queue.cc:260] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:50.981563 16686 raft_consensus.cc:3060] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:50.984223 16959 ts_tablet_manager.cc:1403] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.108s	user 0.016s	sys 0.010s
I20260709 13:05:50.980794 17139 raft_consensus.cc:697] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Becoming Leader. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:05:50.985723 17139 consensus_queue.cc:237] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:50.987689 16959 raft_consensus.cc:359] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:50.995747 16959 raft_consensus.cc:385] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.996089 16959 raft_consensus.cc:740] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.993392 16585 catalog_manager.cc:5697] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7197bc10b2304fccb972da2da7749e3b (127.8.4.68). New cstate: current_term: 1 leader_uuid: "7197bc10b2304fccb972da2da7749e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.996881 16959 consensus_queue.cc:260] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:50.998407 16912 raft_consensus.cc:1275] T ce42d5cbca2144e8a54bab8a8cf31763 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Refusing update from remote peer 622433288cac4964aea9ea5a24ba77fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:05:50.998948 16686 raft_consensus.cc:2468] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
I20260709 13:05:50.999430 16959 ts_tablet_manager.cc:1434] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:05:51.000571 16959 tablet_bootstrap.cc:492] T 3c96e991f59b4bc298a3819b579eaa15 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:50.988215 16962 ts_tablet_manager.cc:1434] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 13:05:51.003307 16962 tablet_bootstrap.cc:492] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:50.988953 16960 tablet_bootstrap.cc:654] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.024580 16959 tablet_bootstrap.cc:654] T 3c96e991f59b4bc298a3819b579eaa15 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.024808 17114 consensus_queue.cc:1048] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:51.037164 16965 consensus_queue.cc:1048] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:51.114240 16962 tablet_bootstrap.cc:654] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.119596 16961 tablet_bootstrap.cc:492] T 4723ff8bcfab41bfad7b411c81cd0386 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:51.120339 16961 ts_tablet_manager.cc:1403] T 4723ff8bcfab41bfad7b411c81cd0386 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.175s	user 0.062s	sys 0.047s
I20260709 13:05:51.129101 16584 catalog_manager.cc:5697] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 reported cstate change: term changed from 0 to 1, leader changed from <none> to d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d0ea3afb898b4eb5b21faeb676627011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.134572 16959 tablet_bootstrap.cc:492] T 3c96e991f59b4bc298a3819b579eaa15 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:51.135427 16959 ts_tablet_manager.cc:1403] T 3c96e991f59b4bc298a3819b579eaa15 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.135s	user 0.021s	sys 0.071s
I20260709 13:05:51.135138 16961 raft_consensus.cc:359] T 4723ff8bcfab41bfad7b411c81cd0386 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:51.136046 16961 raft_consensus.cc:385] T 4723ff8bcfab41bfad7b411c81cd0386 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.136413 16961 raft_consensus.cc:740] T 4723ff8bcfab41bfad7b411c81cd0386 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.137182 16961 consensus_queue.cc:260] T 4723ff8bcfab41bfad7b411c81cd0386 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:51.139264 16961 ts_tablet_manager.cc:1434] T 4723ff8bcfab41bfad7b411c81cd0386 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 13:05:51.141129 16961 tablet_bootstrap.cc:492] T 2088afc1f50443139a328a7e3bb10212 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:51.144901 16959 raft_consensus.cc:359] T 3c96e991f59b4bc298a3819b579eaa15 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:51.145897 16959 raft_consensus.cc:385] T 3c96e991f59b4bc298a3819b579eaa15 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.146252 16959 raft_consensus.cc:740] T 3c96e991f59b4bc298a3819b579eaa15 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.148664 17043 consensus_queue.cc:1048] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:51.147210 16959 consensus_queue.cc:260] T 3c96e991f59b4bc298a3819b579eaa15 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:51.158195 16959 ts_tablet_manager.cc:1434] T 3c96e991f59b4bc298a3819b579eaa15 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:05:51.159600 16965 raft_consensus.cc:493] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.159724 16959 tablet_bootstrap.cc:492] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:51.160223 16965 raft_consensus.cc:515] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:51.162462 17139 consensus_queue.cc:1048] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:51.165864 16965 leader_election.cc:290] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:51.167850 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4723ff8bcfab41bfad7b411c81cd0386" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:51.168767 16836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4723ff8bcfab41bfad7b411c81cd0386" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:51.169492 16836 raft_consensus.cc:2468] T 4723ff8bcfab41bfad7b411c81cd0386 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 0.
I20260709 13:05:51.170583 16961 tablet_bootstrap.cc:654] T 2088afc1f50443139a328a7e3bb10212 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.171054 16729 leader_election.cc:304] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
W20260709 13:05:51.172295 16730 leader_election.cc:343] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.173391 16959 tablet_bootstrap.cc:654] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.178817 17139 raft_consensus.cc:2804] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.179303 17139 raft_consensus.cc:493] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.179627 17139 raft_consensus.cc:3060] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.195269 16961 tablet_bootstrap.cc:492] T 2088afc1f50443139a328a7e3bb10212 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:51.195923 16961 ts_tablet_manager.cc:1403] T 2088afc1f50443139a328a7e3bb10212 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.003s
I20260709 13:05:51.203150 17139 raft_consensus.cc:515] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:51.204255 17114 consensus_queue.cc:1048] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:51.206545 16690 raft_consensus.cc:3060] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.218904 17114 raft_consensus.cc:493] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.219650 17114 raft_consensus.cc:515] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:51.210693 17043 consensus_queue.cc:1048] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:51.223327 16836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4723ff8bcfab41bfad7b411c81cd0386" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:51.224118 16836 raft_consensus.cc:3060] T 4723ff8bcfab41bfad7b411c81cd0386 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.228523 16959 tablet_bootstrap.cc:492] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:51.229193 16959 ts_tablet_manager.cc:1403] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.070s	user 0.032s	sys 0.020s
I20260709 13:05:51.229071 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848db4f370a472f9baa6f3d547cb966" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
W20260709 13:05:51.230707 16802 leader_election.cc:343] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.232074 16959 raft_consensus.cc:359] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:51.233017 17114 leader_election.cc:290] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:51.233768 16911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848db4f370a472f9baa6f3d547cb966" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
W20260709 13:05:51.236536 16802 leader_election.cc:343] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.237098 16802 leader_election.cc:304] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd; no voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:51.239244 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4723ff8bcfab41bfad7b411c81cd0386" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:51.240376 16960 tablet_bootstrap.cc:492] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:51.240953 16960 ts_tablet_manager.cc:1403] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.264s	user 0.005s	sys 0.016s
I20260709 13:05:51.241180 16836 raft_consensus.cc:2468] T 4723ff8bcfab41bfad7b411c81cd0386 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
I20260709 13:05:51.242585 16729 leader_election.cc:304] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:51.212880 16961 raft_consensus.cc:359] T 2088afc1f50443139a328a7e3bb10212 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:51.243436 16961 raft_consensus.cc:385] T 2088afc1f50443139a328a7e3bb10212 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.243510 16965 raft_consensus.cc:2804] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.243817 16961 raft_consensus.cc:740] T 2088afc1f50443139a328a7e3bb10212 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.243852 17043 raft_consensus.cc:2749] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:51.244252 16965 raft_consensus.cc:697] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Becoming Leader. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:05:51.232951 16959 raft_consensus.cc:385] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.244839 17043 consensus_queue.cc:1048] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:51.245518 16959 raft_consensus.cc:740] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.245338 16965 consensus_queue.cc:237] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:51.246286 16959 consensus_queue.cc:260] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
W20260709 13:05:51.247612 16730 leader_election.cc:343] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.248594 16959 ts_tablet_manager.cc:1434] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:05:51.249614 16959 tablet_bootstrap.cc:492] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:51.250527 17139 leader_election.cc:290] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Requested vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:51.255452 16961 consensus_queue.cc:260] T 2088afc1f50443139a328a7e3bb10212 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:51.258093 16959 tablet_bootstrap.cc:654] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.260682 16960 raft_consensus.cc:359] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:51.261538 16960 raft_consensus.cc:385] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.261831 16960 raft_consensus.cc:740] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.259958 16961 ts_tablet_manager.cc:1434] T 2088afc1f50443139a328a7e3bb10212 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 13:05:51.268165 17042 raft_consensus.cc:493] T 3c96e991f59b4bc298a3819b579eaa15 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.268869 17042 raft_consensus.cc:515] T 3c96e991f59b4bc298a3819b579eaa15 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:51.269824 16959 tablet_bootstrap.cc:492] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:51.270396 16959 ts_tablet_manager.cc:1403] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.002s
I20260709 13:05:51.270628 17043 consensus_queue.cc:1048] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:51.271231 17042 leader_election.cc:290] T 3c96e991f59b4bc298a3819b579eaa15 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:51.273149 16911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c96e991f59b4bc298a3819b579eaa15" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:51.273263 16959 raft_consensus.cc:359] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:51.274108 16959 raft_consensus.cc:385] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.274400 16959 raft_consensus.cc:740] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.275084 16959 consensus_queue.cc:260] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:51.278053 16959 ts_tablet_manager.cc:1434] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:51.279109 16959 tablet_bootstrap.cc:492] T f2eb3c14d44647a7a2a6e4a88d64df71 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:51.288590 16962 tablet_bootstrap.cc:492] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:51.289208 16962 ts_tablet_manager.cc:1403] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.286s	user 0.023s	sys 0.016s
I20260709 13:05:51.283499 16836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c96e991f59b4bc298a3819b579eaa15" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:51.292425 16959 tablet_bootstrap.cc:654] T f2eb3c14d44647a7a2a6e4a88d64df71 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:51.294185 16729 leader_election.cc:343] T 3c96e991f59b4bc298a3819b579eaa15 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.288425 16585 catalog_manager.cc:5697] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 reported cstate change: term changed from 0 to 1, leader changed from <none> to d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d0ea3afb898b4eb5b21faeb676627011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:51.311251 16728 leader_election.cc:343] T 3c96e991f59b4bc298a3819b579eaa15 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.311836 16728 leader_election.cc:304] T 3c96e991f59b4bc298a3819b579eaa15 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:51.314157 16965 raft_consensus.cc:2749] T 3c96e991f59b4bc298a3819b579eaa15 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:51.317294 16961 tablet_bootstrap.cc:492] T af9f8110756a49c082a81e072eed60b3 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:51.321640 16960 consensus_queue.cc:260] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:51.306138 16962 raft_consensus.cc:359] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:51.325659 16962 raft_consensus.cc:385] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.325976 16962 raft_consensus.cc:740] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.326709 16962 consensus_queue.cc:260] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:51.329682 16962 ts_tablet_manager.cc:1434] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.002s
I20260709 13:05:51.330694 16962 tablet_bootstrap.cc:492] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:51.326572 16960 ts_tablet_manager.cc:1434] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.000s
I20260709 13:05:51.334630 16960 tablet_bootstrap.cc:492] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:51.334473 16836 raft_consensus.cc:3060] T d51df8e7709946bbb3f3d5ec1c541307 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.337672 16962 tablet_bootstrap.cc:654] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.339239 16961 tablet_bootstrap.cc:654] T af9f8110756a49c082a81e072eed60b3 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.340756 17183 raft_consensus.cc:493] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.341612 17183 raft_consensus.cc:515] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
W20260709 13:05:51.342926 16636 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:51.344420 17183 leader_election.cc:290] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:51.345907 16763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6e4009e1d445a1b055538cf3006287" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:51.341612 17114 consensus_queue.cc:1048] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:05:51.346689 16763 raft_consensus.cc:2468] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:51.355302 16877 leader_election.cc:304] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:51.348505 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6e4009e1d445a1b055538cf3006287" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:51.356527 16689 raft_consensus.cc:2468] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:51.359053 17183 raft_consensus.cc:2804] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.359812 17183 raft_consensus.cc:493] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.352010 17180 raft_consensus.cc:493] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.360535 17183 raft_consensus.cc:3060] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.360713 17180 raft_consensus.cc:515] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:51.366386 17180 leader_election.cc:290] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:51.367316 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2088afc1f50443139a328a7e3bb10212" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:51.368491 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2088afc1f50443139a328a7e3bb10212" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
W20260709 13:05:51.368898 16879 leader_election.cc:343] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.369272 16837 raft_consensus.cc:2468] T 2088afc1f50443139a328a7e3bb10212 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:51.370800 16878 leader_election.cc:304] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:51.372200 17218 raft_consensus.cc:2804] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.372738 17218 raft_consensus.cc:493] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.372793 16962 tablet_bootstrap.cc:492] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:51.373319 17218 raft_consensus.cc:3060] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.373531 16962 ts_tablet_manager.cc:1403] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.003s
I20260709 13:05:51.384296 16962 raft_consensus.cc:359] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:51.385294 16962 raft_consensus.cc:385] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.385587 16962 raft_consensus.cc:740] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.386360 16962 consensus_queue.cc:260] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:51.389039 16962 ts_tablet_manager.cc:1434] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:51.390417 16962 tablet_bootstrap.cc:492] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:51.392195 16960 tablet_bootstrap.cc:654] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.400013 16962 tablet_bootstrap.cc:654] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.406054 17183 raft_consensus.cc:515] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:51.411880 17183 leader_election.cc:290] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Requested vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:51.413491 16763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6e4009e1d445a1b055538cf3006287" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:51.414855 16763 raft_consensus.cc:3060] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.417695 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6e4009e1d445a1b055538cf3006287" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:51.418916 16689 raft_consensus.cc:3060] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.434703 16763 raft_consensus.cc:2468] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:51.436612 16877 leader_election.cc:304] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:51.437762 17183 raft_consensus.cc:2804] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.438284 17183 raft_consensus.cc:697] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Becoming Leader. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:05:51.439685 17183 consensus_queue.cc:237] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:51.440793 16962 tablet_bootstrap.cc:492] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:51.441404 16962 ts_tablet_manager.cc:1403] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.009s
I20260709 13:05:51.445096 16962 raft_consensus.cc:359] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:51.446290 16962 raft_consensus.cc:385] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.446648 16962 raft_consensus.cc:740] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.447570 16962 consensus_queue.cc:260] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:51.448477 17180 consensus_queue.cc:1048] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:51.451481 16962 ts_tablet_manager.cc:1434] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:51.455049 16962 tablet_bootstrap.cc:492] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:51.461351 17180 consensus_queue.cc:1048] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:51.467097 16960 tablet_bootstrap.cc:492] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:51.467792 16960 ts_tablet_manager.cc:1403] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.133s	user 0.021s	sys 0.003s
I20260709 13:05:51.472035 17139 consensus_queue.cc:1048] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:51.477361 16965 raft_consensus.cc:493] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.485788 17218 raft_consensus.cc:515] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:51.487743 16689 raft_consensus.cc:2468] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:51.491459 16997 raft_consensus.cc:493] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.478101 16965 raft_consensus.cc:515] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:51.491990 16997 raft_consensus.cc:515] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:51.494139 16965 leader_election.cc:290] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:51.494980 16911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d0c8416cdc43289eceaddcbd00a20e" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
W20260709 13:05:51.496882 16728 leader_election.cc:343] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.497393 16763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4723ff8bcfab41bfad7b411c81cd0386" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:51.498592 16997 leader_election.cc:290] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:51.499255 16687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d0c8416cdc43289eceaddcbd00a20e" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:51.499586 16836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4723ff8bcfab41bfad7b411c81cd0386" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:51.500537 16836 raft_consensus.cc:2393] T 4723ff8bcfab41bfad7b411c81cd0386 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1cbe303821774e4d936ea3d54875dcb8 in current term 1: Already voted for candidate d0ea3afb898b4eb5b21faeb676627011 in this term.
W20260709 13:05:51.501572 16730 leader_election.cc:343] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.502117 16730 leader_election.cc:304] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:51.502897 16654 leader_election.cc:304] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8; no voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:51.503451 17139 raft_consensus.cc:2749] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:51.513211 16959 tablet_bootstrap.cc:492] T f2eb3c14d44647a7a2a6e4a88d64df71 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:51.513832 16959 ts_tablet_manager.cc:1403] T f2eb3c14d44647a7a2a6e4a88d64df71 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.235s	user 0.057s	sys 0.076s
I20260709 13:05:51.509634 16997 raft_consensus.cc:3060] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:51.517230 16877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:33887, user_credentials={real_user=slave}} blocked reactor thread for 51518us
I20260709 13:05:51.523077 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2088afc1f50443139a328a7e3bb10212" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:51.524062 16838 raft_consensus.cc:3060] T 2088afc1f50443139a328a7e3bb10212 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.525102 16959 raft_consensus.cc:359] T f2eb3c14d44647a7a2a6e4a88d64df71 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:51.526075 16959 raft_consensus.cc:385] T f2eb3c14d44647a7a2a6e4a88d64df71 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.526805 17000 raft_consensus.cc:493] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.527421 17000 raft_consensus.cc:515] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:51.530638 17000 leader_election.cc:290] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:51.526405 16959 raft_consensus.cc:740] T f2eb3c14d44647a7a2a6e4a88d64df71 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.531060 16997 raft_consensus.cc:2749] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:51.531935 16911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2088afc1f50443139a328a7e3bb10212" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:51.532523 16959 consensus_queue.cc:260] T f2eb3c14d44647a7a2a6e4a88d64df71 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:51.533519 16911 raft_consensus.cc:2393] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1cbe303821774e4d936ea3d54875dcb8 in current term 1: Already voted for candidate 7197bc10b2304fccb972da2da7749e3b in this term.
I20260709 13:05:51.535245 16959 ts_tablet_manager.cc:1434] T f2eb3c14d44647a7a2a6e4a88d64df71 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:05:51.537739 16959 tablet_bootstrap.cc:492] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:51.535784 16965 raft_consensus.cc:493] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.538846 16965 raft_consensus.cc:515] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:51.541759 16965 leader_election.cc:290] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:51.542704 16836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2088afc1f50443139a328a7e3bb10212" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:51.543025 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848db4f370a472f9baa6f3d547cb966" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:51.544073 16839 raft_consensus.cc:2468] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 0.
I20260709 13:05:51.546600 16729 leader_election.cc:304] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:51.549214 16965 raft_consensus.cc:2804] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.549678 16965 raft_consensus.cc:493] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.550074 16965 raft_consensus.cc:3060] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.550832 16959 tablet_bootstrap.cc:654] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.566805 16654 leader_election.cc:304] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8; no voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:51.567721 17000 raft_consensus.cc:3060] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.568226 16911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848db4f370a472f9baa6f3d547cb966" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
W20260709 13:05:51.570839 16728 leader_election.cc:343] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.576519 17000 raft_consensus.cc:2749] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:51.543030 16962 tablet_bootstrap.cc:654] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.578061 17218 leader_election.cc:290] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:51.585837 16687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2088afc1f50443139a328a7e3bb10212" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:51.597694 17139 consensus_queue.cc:1048] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:51.600731 16838 raft_consensus.cc:2468] T 2088afc1f50443139a328a7e3bb10212 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:51.612587 16878 leader_election.cc:304] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:51.614403 16965 raft_consensus.cc:515] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:51.617120 16965 leader_election.cc:290] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:51.617834 16965 raft_consensus.cc:493] T f2eb3c14d44647a7a2a6e4a88d64df71 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.620237 16959 tablet_bootstrap.cc:492] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:51.623986 16959 ts_tablet_manager.cc:1403] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.087s	user 0.013s	sys 0.009s
I20260709 13:05:51.630784 17180 raft_consensus.cc:2804] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.631352 17180 raft_consensus.cc:697] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Becoming Leader. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:05:51.632301 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848db4f370a472f9baa6f3d547cb966" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:51.633116 16837 raft_consensus.cc:3060] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.632197 17180 consensus_queue.cc:237] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:51.632340 16961 tablet_bootstrap.cc:492] T af9f8110756a49c082a81e072eed60b3 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:51.627643 16960 raft_consensus.cc:359] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:51.636438 16961 ts_tablet_manager.cc:1403] T af9f8110756a49c082a81e072eed60b3 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.319s	user 0.060s	sys 0.066s
I20260709 13:05:51.636843 16960 raft_consensus.cc:385] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.637233 16960 raft_consensus.cc:740] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.640240 16588 catalog_manager.cc:5697] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7197bc10b2304fccb972da2da7749e3b (127.8.4.68). New cstate: current_term: 1 leader_uuid: "7197bc10b2304fccb972da2da7749e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.642421 16960 consensus_queue.cc:260] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:51.626683 16965 raft_consensus.cc:515] T f2eb3c14d44647a7a2a6e4a88d64df71 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:51.651777 16961 raft_consensus.cc:359] T af9f8110756a49c082a81e072eed60b3 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:51.652536 16960 ts_tablet_manager.cc:1434] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.178s	user 0.008s	sys 0.000s
I20260709 13:05:51.653731 16960 tablet_bootstrap.cc:492] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:51.654673 16911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848db4f370a472f9baa6f3d547cb966" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
W20260709 13:05:51.657478 16728 leader_election.cc:343] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.661196 16965 leader_election.cc:290] T f2eb3c14d44647a7a2a6e4a88d64df71 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:51.663750 16686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2eb3c14d44647a7a2a6e4a88d64df71" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
W20260709 13:05:51.667094 16730 leader_election.cc:343] T f2eb3c14d44647a7a2a6e4a88d64df71 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.668996 16959 raft_consensus.cc:359] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:51.669888 16959 raft_consensus.cc:385] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.670222 16959 raft_consensus.cc:740] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.646345 16687 raft_consensus.cc:2468] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:51.673599 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2eb3c14d44647a7a2a6e4a88d64df71" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:51.652930 16961 raft_consensus.cc:385] T af9f8110756a49c082a81e072eed60b3 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.674767 16961 raft_consensus.cc:740] T af9f8110756a49c082a81e072eed60b3 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
W20260709 13:05:51.675659 16729 leader_election.cc:343] T f2eb3c14d44647a7a2a6e4a88d64df71 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.675623 16961 consensus_queue.cc:260] T af9f8110756a49c082a81e072eed60b3 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:51.676265 16729 leader_election.cc:304] T f2eb3c14d44647a7a2a6e4a88d64df71 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:51.678486 16959 consensus_queue.cc:260] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:51.685278 16965 raft_consensus.cc:2749] T f2eb3c14d44647a7a2a6e4a88d64df71 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:51.696687 16960 tablet_bootstrap.cc:654] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.704370 16961 ts_tablet_manager.cc:1434] T af9f8110756a49c082a81e072eed60b3 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.067s	user 0.003s	sys 0.005s
I20260709 13:05:51.708462 16959 ts_tablet_manager.cc:1434] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.001s
I20260709 13:05:51.711500 16959 tablet_bootstrap.cc:492] T 7013ecc82f234c109dc955f8dca102b2 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:51.716622 16961 tablet_bootstrap.cc:492] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:51.689637 17228 raft_consensus.cc:493] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.721256 17228 raft_consensus.cc:515] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:51.725265 17228 leader_election.cc:290] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:51.726935 16686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9f8110756a49c082a81e072eed60b3" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:51.728134 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9f8110756a49c082a81e072eed60b3" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
W20260709 13:05:51.728647 16879 leader_election.cc:343] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.728817 16838 raft_consensus.cc:2468] T af9f8110756a49c082a81e072eed60b3 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:51.730217 16878 leader_election.cc:304] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:51.733191 17228 raft_consensus.cc:2804] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.733606 17228 raft_consensus.cc:493] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.733942 17228 raft_consensus.cc:3060] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.712101 16837 raft_consensus.cc:2468] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
I20260709 13:05:51.747797 17139 consensus_queue.cc:1048] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:05:51.752895 16962 tablet_bootstrap.cc:492] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:51.759243 16962 ts_tablet_manager.cc:1403] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.305s	user 0.014s	sys 0.010s
I20260709 13:05:51.753773 16729 leader_election.cc:304] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:51.765293 17042 raft_consensus.cc:2804] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.762614 16585 catalog_manager.cc:5697] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7197bc10b2304fccb972da2da7749e3b (127.8.4.68). New cstate: current_term: 1 leader_uuid: "7197bc10b2304fccb972da2da7749e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.787459 16959 tablet_bootstrap.cc:654] T 7013ecc82f234c109dc955f8dca102b2 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.773466 17042 raft_consensus.cc:697] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Becoming Leader. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:05:51.801802 17239 raft_consensus.cc:493] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.802568 17239 raft_consensus.cc:515] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:51.806659 16911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f610e2abe7b467facd521257722760d" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:51.806980 17042 consensus_queue.cc:237] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:51.816797 16960 tablet_bootstrap.cc:492] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:51.817461 16960 ts_tablet_manager.cc:1403] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.164s	user 0.017s	sys 0.020s
I20260709 13:05:51.820842 16960 raft_consensus.cc:359] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:51.821573 16960 raft_consensus.cc:385] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:51.821609 16728 leader_election.cc:343] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.821910 16960 raft_consensus.cc:740] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.823342 16962 raft_consensus.cc:359] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:51.824311 16962 raft_consensus.cc:385] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.824506 16962 raft_consensus.cc:740] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.823204 16960 consensus_queue.cc:260] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:51.827394 16961 tablet_bootstrap.cc:654] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.831270 16960 ts_tablet_manager.cc:1434] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:51.832355 16960 tablet_bootstrap.cc:492] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:51.832069 16962 consensus_queue.cc:260] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:51.834589 16962 ts_tablet_manager.cc:1434] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.075s	user 0.004s	sys 0.002s
I20260709 13:05:51.835652 16962 tablet_bootstrap.cc:492] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:51.838989 16960 tablet_bootstrap.cc:654] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.842782 16959 tablet_bootstrap.cc:492] T 7013ecc82f234c109dc955f8dca102b2 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:51.843348 16959 ts_tablet_manager.cc:1403] T 7013ecc82f234c109dc955f8dca102b2 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.132s	user 0.016s	sys 0.006s
I20260709 13:05:51.849609 16959 raft_consensus.cc:359] T 7013ecc82f234c109dc955f8dca102b2 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:51.850385 16959 raft_consensus.cc:385] T 7013ecc82f234c109dc955f8dca102b2 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.850659 16959 raft_consensus.cc:740] T 7013ecc82f234c109dc955f8dca102b2 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.851298 16959 consensus_queue.cc:260] T 7013ecc82f234c109dc955f8dca102b2 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:51.852247 17239 leader_election.cc:290] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:51.853122 16959 ts_tablet_manager.cc:1434] T 7013ecc82f234c109dc955f8dca102b2 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:51.854321 16959 tablet_bootstrap.cc:492] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:51.849663 16962 tablet_bootstrap.cc:654] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.864387 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f610e2abe7b467facd521257722760d" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:51.866299 16586 catalog_manager.cc:5697] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 reported cstate change: term changed from 0 to 1, leader changed from <none> to d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d0ea3afb898b4eb5b21faeb676627011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.853137 17228 raft_consensus.cc:515] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:51.872881 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9f8110756a49c082a81e072eed60b3" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:51.875494 16838 raft_consensus.cc:3060] T af9f8110756a49c082a81e072eed60b3 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.880089 17218 consensus_queue.cc:1048] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:51.886180 16961 tablet_bootstrap.cc:492] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:51.889601 16961 ts_tablet_manager.cc:1403] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.178s	user 0.013s	sys 0.006s
I20260709 13:05:51.894623 16960 tablet_bootstrap.cc:492] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:51.895157 16959 tablet_bootstrap.cc:654] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.895232 16960 ts_tablet_manager.cc:1403] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.010s
I20260709 13:05:51.903049 17241 consensus_queue.cc:1048] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:51.906842 16960 raft_consensus.cc:359] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:51.907603 16960 raft_consensus.cc:385] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.907864 16960 raft_consensus.cc:740] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.908812 16960 consensus_queue.cc:260] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:51.910394 16960 ts_tablet_manager.cc:1434] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:05:51.919736 16960 tablet_bootstrap.cc:492] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:51.936102 16960 tablet_bootstrap.cc:654] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:51.944208 16730 leader_election.cc:343] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.945155 16730 leader_election.cc:304] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:51.949563 16838 raft_consensus.cc:2468] T af9f8110756a49c082a81e072eed60b3 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:51.951090 17239 raft_consensus.cc:2749] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:51.952131 16878 leader_election.cc:304] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:51.953325 17180 raft_consensus.cc:2804] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.953835 17180 raft_consensus.cc:697] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Becoming Leader. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:05:51.954842 17180 consensus_queue.cc:237] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:51.957558 16961 raft_consensus.cc:359] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:52.024514 16961 raft_consensus.cc:385] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.016407 17253 raft_consensus.cc:493] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 622433288cac4964aea9ea5a24ba77fd)
W20260709 13:05:52.019582 16729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:39929, user_credentials={real_user=slave}} blocked reactor thread for 48214.8us
I20260709 13:05:52.025241 17226 raft_consensus.cc:493] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.026010 17226 raft_consensus.cc:515] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:52.026755 17253 raft_consensus.cc:515] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:52.020232 16962 tablet_bootstrap.cc:492] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:52.030580 16763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c96e991f59b4bc298a3819b579eaa15" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:52.031371 16962 ts_tablet_manager.cc:1403] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.196s	user 0.063s	sys 0.083s
I20260709 13:05:52.031431 16763 raft_consensus.cc:2468] T 3c96e991f59b4bc298a3819b579eaa15 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:52.034499 16877 leader_election.cc:304] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:52.030409 17226 leader_election.cc:290] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:52.035635 17226 raft_consensus.cc:2804] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.036008 17226 raft_consensus.cc:493] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.036368 17226 raft_consensus.cc:3060] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.040181 16959 tablet_bootstrap.cc:492] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:52.040872 16959 ts_tablet_manager.cc:1403] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.187s	user 0.026s	sys 0.024s
I20260709 13:05:52.044051 17226 raft_consensus.cc:515] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:52.045437 16962 raft_consensus.cc:359] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:52.046296 16962 raft_consensus.cc:385] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.046581 16962 raft_consensus.cc:740] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.047406 16962 consensus_queue.cc:260] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:52.049556 16962 ts_tablet_manager.cc:1434] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:05:52.050529 16962 tablet_bootstrap.cc:492] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:52.052453 17253 leader_election.cc:290] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:52.058404 16687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9f8110756a49c082a81e072eed60b3" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:52.058619 17226 leader_election.cc:290] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:52.060665 16962 tablet_bootstrap.cc:654] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.062804 16687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061a5313535a475ea9385383b611b52d" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:52.064116 16687 raft_consensus.cc:2393] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7197bc10b2304fccb972da2da7749e3b in current term 2: Already voted for candidate 1cbe303821774e4d936ea3d54875dcb8 in this term.
W20260709 13:05:52.070533 16879 leader_election.cc:343] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.072067 17226 consensus_queue.cc:1048] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:52.081687 16585 catalog_manager.cc:5697] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7197bc10b2304fccb972da2da7749e3b (127.8.4.68). New cstate: current_term: 1 leader_uuid: "7197bc10b2304fccb972da2da7749e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.086274 17228 leader_election.cc:290] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
W20260709 13:05:52.088197 16729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:39929, user_credentials={real_user=slave}} blocked reactor thread for 55737.7us
I20260709 13:05:52.089496 16959 raft_consensus.cc:359] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:52.090451 16959 raft_consensus.cc:385] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.024924 16961 raft_consensus.cc:740] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.090723 16959 raft_consensus.cc:740] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
W20260709 13:05:52.089195 16730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37355, user_credentials={real_user=slave}} blocked reactor thread for 65284us
I20260709 13:05:52.094477 16763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c96e991f59b4bc298a3819b579eaa15" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:52.095213 16763 raft_consensus.cc:3060] T 3c96e991f59b4bc298a3819b579eaa15 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.091435 16959 consensus_queue.cc:260] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:52.101959 16959 ts_tablet_manager.cc:1434] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.001s
I20260709 13:05:52.108269 16959 tablet_bootstrap.cc:492] T 9de37f630dc142a28db71d81fa427ab4 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:52.091435 16961 consensus_queue.cc:260] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:52.110931 16961 ts_tablet_manager.cc:1434] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.221s	user 0.007s	sys 0.000s
I20260709 13:05:52.106920 16763 raft_consensus.cc:2468] T 3c96e991f59b4bc298a3819b579eaa15 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:52.118116 16877 leader_election.cc:304] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:52.118306 16962 tablet_bootstrap.cc:492] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:52.118760 16959 tablet_bootstrap.cc:654] T 9de37f630dc142a28db71d81fa427ab4 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.119056 16962 ts_tablet_manager.cc:1403] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.069s	user 0.025s	sys 0.032s
I20260709 13:05:52.121481 17253 raft_consensus.cc:2804] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.122165 17253 raft_consensus.cc:697] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Becoming Leader. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:05:52.134119 17253 consensus_queue.cc:237] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:52.138428 16962 raft_consensus.cc:359] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:52.139452 16962 raft_consensus.cc:385] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.139729 16962 raft_consensus.cc:740] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.143911 16962 consensus_queue.cc:260] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:52.146800 16962 ts_tablet_manager.cc:1434] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:05:52.148114 16962 tablet_bootstrap.cc:492] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:52.150161 17235 raft_consensus.cc:493] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.150878 17235 raft_consensus.cc:515] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:52.155478 17235 leader_election.cc:290] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:52.161515 16959 tablet_bootstrap.cc:492] T 9de37f630dc142a28db71d81fa427ab4 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:52.162226 16959 ts_tablet_manager.cc:1403] T 9de37f630dc142a28db71d81fa427ab4 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.054s	user 0.024s	sys 0.000s
I20260709 13:05:52.165179 16959 raft_consensus.cc:359] T 9de37f630dc142a28db71d81fa427ab4 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:52.165513 16962 tablet_bootstrap.cc:654] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.165920 16959 raft_consensus.cc:385] T 9de37f630dc142a28db71d81fa427ab4 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.166301 16959 raft_consensus.cc:740] T 9de37f630dc142a28db71d81fa427ab4 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.173682 16959 consensus_queue.cc:260] T 9de37f630dc142a28db71d81fa427ab4 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:52.185102 16961 tablet_bootstrap.cc:492] T 3c96e991f59b4bc298a3819b579eaa15 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:52.187882 17250 raft_consensus.cc:493] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.188432 16959 ts_tablet_manager.cc:1434] T 9de37f630dc142a28db71d81fa427ab4 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:05:52.188520 17250 raft_consensus.cc:515] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:52.189805 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d0c8416cdc43289eceaddcbd00a20e" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:52.190717 16765 raft_consensus.cc:2468] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 0.
I20260709 13:05:52.192662 16653 leader_election.cc:304] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:52.192811 16965 raft_consensus.cc:493] T 7013ecc82f234c109dc955f8dca102b2 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.201326 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2eb3c14d44647a7a2a6e4a88d64df71" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:52.202117 16765 raft_consensus.cc:2468] T f2eb3c14d44647a7a2a6e4a88d64df71 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
I20260709 13:05:52.202214 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061a5313535a475ea9385383b611b52d" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:52.203488 16838 raft_consensus.cc:2468] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 2.
I20260709 13:05:52.203859 16687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2eb3c14d44647a7a2a6e4a88d64df71" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:52.204909 17235 raft_consensus.cc:2804] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.198612 17250 leader_election.cc:290] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:52.193701 16965 raft_consensus.cc:515] T 7013ecc82f234c109dc955f8dca102b2 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:52.210583 16687 raft_consensus.cc:2468] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
I20260709 13:05:52.224437 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c96e991f59b4bc298a3819b579eaa15" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:52.222054 17235 raft_consensus.cc:493] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.226691 16962 tablet_bootstrap.cc:492] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:52.240705 16962 ts_tablet_manager.cc:1403] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.093s	user 0.023s	sys 0.003s
I20260709 13:05:52.233762 16836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c96e991f59b4bc298a3819b579eaa15" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:52.235112 16911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d0c8416cdc43289eceaddcbd00a20e" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:52.237756 16878 leader_election.cc:304] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:52.239109 17252 consensus_queue.cc:1048] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:52.239513 16959 tablet_bootstrap.cc:492] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:52.243829 16962 raft_consensus.cc:359] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:52.244668 16962 raft_consensus.cc:385] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.244964 16962 raft_consensus.cc:740] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.245657 16962 consensus_queue.cc:260] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:52.216810 16802 leader_election.cc:304] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:52.251322 17252 raft_consensus.cc:2804] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:52.251873 17252 raft_consensus.cc:493] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 622433288cac4964aea9ea5a24ba77fd)
I20260709 13:05:52.252277 17252 raft_consensus.cc:3060] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.252313 17249 raft_consensus.cc:2804] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.252882 17249 raft_consensus.cc:493] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.253543 17249 raft_consensus.cc:3060] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.253832 16965 leader_election.cc:290] T 7013ecc82f234c109dc955f8dca102b2 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:52.245617 17235 raft_consensus.cc:3060] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.255215 16911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7013ecc82f234c109dc955f8dca102b2" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
W20260709 13:05:52.256939 16728 leader_election.cc:343] T 7013ecc82f234c109dc955f8dca102b2 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.248657 16587 catalog_manager.cc:5697] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7197bc10b2304fccb972da2da7749e3b (127.8.4.68). New cstate: current_term: 1 leader_uuid: "7197bc10b2304fccb972da2da7749e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:52.268774 16836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7013ecc82f234c109dc955f8dca102b2" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
W20260709 13:05:52.276980 16729 leader_election.cc:343] T 7013ecc82f234c109dc955f8dca102b2 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.295372 16960 tablet_bootstrap.cc:492] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:52.296341 16960 ts_tablet_manager.cc:1403] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.377s	user 0.054s	sys 0.088s
I20260709 13:05:52.300508 16965 raft_consensus.cc:493] T 9de37f630dc142a28db71d81fa427ab4 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.303174 16962 ts_tablet_manager.cc:1434] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.062s	user 0.033s	sys 0.001s
W20260709 13:05:52.297318 16653 leader_election.cc:343] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.306142 16962 tablet_bootstrap.cc:492] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:52.297371 16729 leader_election.cc:304] T 7013ecc82f234c109dc955f8dca102b2 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:52.302657 16965 raft_consensus.cc:515] T 9de37f630dc142a28db71d81fa427ab4 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:52.310209 17241 raft_consensus.cc:2749] T 7013ecc82f234c109dc955f8dca102b2 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:52.312546 16878 leader_election.cc:343] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.321641 17232 raft_consensus.cc:493] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.322314 17232 raft_consensus.cc:515] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:52.314358 16965 leader_election.cc:290] T 9de37f630dc142a28db71d81fa427ab4 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:52.341723 16960 raft_consensus.cc:359] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:52.342456 16960 raft_consensus.cc:385] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.342976 16960 raft_consensus.cc:740] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.338577 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de37f630dc142a28db71d81fa427ab4" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
W20260709 13:05:52.347306 16878 leader_election.cc:343] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.347859 17235 raft_consensus.cc:515] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
W20260709 13:05:52.350697 16728 leader_election.cc:343] T 9de37f630dc142a28db71d81fa427ab4 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.343653 16960 consensus_queue.cc:260] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:52.358774 16960 ts_tablet_manager.cc:1434] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.062s	user 0.004s	sys 0.002s
I20260709 13:05:52.362293 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de37f630dc142a28db71d81fa427ab4" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:52.350752 17226 raft_consensus.cc:493] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.363376 17226 raft_consensus.cc:515] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:52.364630 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d0c8416cdc43289eceaddcbd00a20e" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:52.337167 17232 leader_election.cc:290] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:52.365788 16911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061a5313535a475ea9385383b611b52d" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
W20260709 13:05:52.366089 16653 leader_election.cc:343] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:52.372898 16729 leader_election.cc:343] T 9de37f630dc142a28db71d81fa427ab4 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.373596 16729 leader_election.cc:304] T 9de37f630dc142a28db71d81fa427ab4 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:52.374845 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848db4f370a472f9baa6f3d547cb966" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:52.375355 17239 raft_consensus.cc:2749] T 9de37f630dc142a28db71d81fa427ab4 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.377389 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061a5313535a475ea9385383b611b52d" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:52.378389 16839 raft_consensus.cc:2410] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1cbe303821774e4d936ea3d54875dcb8 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:05:52.388036 17226 leader_election.cc:290] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:52.396296 17263 raft_consensus.cc:493] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.397452 17263 raft_consensus.cc:515] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:52.397938 17042 consensus_queue.cc:1048] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:52.399510 16836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848db4f370a472f9baa6f3d547cb966" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:52.400766 16836 raft_consensus.cc:2393] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7197bc10b2304fccb972da2da7749e3b in current term 1: Already voted for candidate d0ea3afb898b4eb5b21faeb676627011 in this term.
I20260709 13:05:52.400964 17263 leader_election.cc:290] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:52.405229 17226 consensus_queue.cc:1048] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:52.406827 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f610e2abe7b467facd521257722760d" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:52.407560 16913 raft_consensus.cc:2468] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 0.
I20260709 13:05:52.410188 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f610e2abe7b467facd521257722760d" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:52.410885 16765 raft_consensus.cc:2468] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 0.
I20260709 13:05:52.415684 16959 tablet_bootstrap.cc:654] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.415517 16878 leader_election.cc:304] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:52.423069 16912 raft_consensus.cc:3060] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.417537 16653 leader_election.cc:304] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:52.437353 17231 raft_consensus.cc:2804] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.438033 17231 raft_consensus.cc:493] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.438544 17231 raft_consensus.cc:3060] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.441422 17249 raft_consensus.cc:515] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:52.419349 17235 leader_election.cc:290] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:52.392984 16961 tablet_bootstrap.cc:654] T 3c96e991f59b4bc298a3819b579eaa15 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.443951 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d0c8416cdc43289eceaddcbd00a20e" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:52.444676 16765 raft_consensus.cc:3060] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.446851 16960 tablet_bootstrap.cc:492] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
W20260709 13:05:52.478463 17262 log.cc:927] Time spent T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:05:52.485560 16962 tablet_bootstrap.cc:654] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.478924 17252 raft_consensus.cc:515] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:52.503768 16765 raft_consensus.cc:2468] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 1.
I20260709 13:05:52.498594 17235 raft_consensus.cc:493] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.510982 17235 raft_consensus.cc:515] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:52.514312 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2eb3c14d44647a7a2a6e4a88d64df71" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:52.514734 17235 leader_election.cc:290] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:52.515056 16690 raft_consensus.cc:3060] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.529289 16911 raft_consensus.cc:2410] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1cbe303821774e4d936ea3d54875dcb8 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:05:52.517588 17239 raft_consensus.cc:493] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.531260 17239 raft_consensus.cc:515] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:52.535418 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f0df42f20d4d9398c8d4b5b3cba4ea" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:52.540040 16653 leader_election.cc:304] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:52.542030 17226 raft_consensus.cc:2749] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.542500 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9f8110756a49c082a81e072eed60b3" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:52.545899 17261 raft_consensus.cc:2804] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.553532 16688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f0df42f20d4d9398c8d4b5b3cba4ea" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
W20260709 13:05:52.554545 16729 leader_election.cc:343] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.557220 16836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9f8110756a49c082a81e072eed60b3" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:52.558905 16836 raft_consensus.cc:2393] T af9f8110756a49c082a81e072eed60b3 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1cbe303821774e4d936ea3d54875dcb8 in current term 1: Already voted for candidate 7197bc10b2304fccb972da2da7749e3b in this term.
I20260709 13:05:52.561055 17239 leader_election.cc:290] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
W20260709 13:05:52.563159 16730 leader_election.cc:343] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.563853 17249 leader_election.cc:290] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Requested vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:52.568035 16960 tablet_bootstrap.cc:654] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.581521 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2eb3c14d44647a7a2a6e4a88d64df71" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:52.581943 16689 raft_consensus.cc:3060] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.582484 16765 raft_consensus.cc:3060] T f2eb3c14d44647a7a2a6e4a88d64df71 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.595039 16653 leader_election.cc:304] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8; no voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:52.603521 17228 consensus_queue.cc:1048] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:52.614344 16765 raft_consensus.cc:2468] T f2eb3c14d44647a7a2a6e4a88d64df71 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:52.616987 16802 leader_election.cc:304] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:52.655498 17155 raft_consensus.cc:2804] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.563871 16730 leader_election.cc:304] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:52.646096 16653 leader_election.cc:304] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8; no voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:52.661276 17263 raft_consensus.cc:2749] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:52.666725 16688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061a5313535a475ea9385383b611b52d" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:52.667872 16688 raft_consensus.cc:2393] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7197bc10b2304fccb972da2da7749e3b in current term 2: Already voted for candidate 1cbe303821774e4d936ea3d54875dcb8 in this term.
I20260709 13:05:52.670614 17155 raft_consensus.cc:697] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Becoming Leader. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:05:52.671627 17155 consensus_queue.cc:237] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:52.674211 17239 raft_consensus.cc:2749] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:52.674419 16730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37355, user_credentials={real_user=slave}} blocked reactor thread for 111337us
I20260709 13:05:52.675477 16959 tablet_bootstrap.cc:492] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:52.676041 16959 ts_tablet_manager.cc:1403] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.437s	user 0.029s	sys 0.001s
I20260709 13:05:52.678928 16959 raft_consensus.cc:359] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:52.679682 16959 raft_consensus.cc:385] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.680013 16959 raft_consensus.cc:740] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.679764 17252 leader_election.cc:290] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:52.680579 17231 raft_consensus.cc:515] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:52.680898 16959 consensus_queue.cc:260] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:52.698129 16959 ts_tablet_manager.cc:1434] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:05:52.699455 16961 tablet_bootstrap.cc:492] T 3c96e991f59b4bc298a3819b579eaa15 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:52.700057 16961 ts_tablet_manager.cc:1403] T 3c96e991f59b4bc298a3819b579eaa15 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.521s	user 0.037s	sys 0.032s
I20260709 13:05:52.703867 16961 raft_consensus.cc:359] T 3c96e991f59b4bc298a3819b579eaa15 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:52.704640 16961 raft_consensus.cc:385] T 3c96e991f59b4bc298a3819b579eaa15 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.704957 16961 raft_consensus.cc:740] T 3c96e991f59b4bc298a3819b579eaa15 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.707510 16961 consensus_queue.cc:260] T 3c96e991f59b4bc298a3819b579eaa15 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
W20260709 13:05:52.690644 16636 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:52.692029 16690 raft_consensus.cc:2468] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:52.694456 17239 consensus_queue.cc:1048] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:52.708621 16959 tablet_bootstrap.cc:492] T 1ceff4a1d9cf4d75994e64ebab75c551 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:52.719740 16961 ts_tablet_manager.cc:1434] T 3c96e991f59b4bc298a3819b579eaa15 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:05:52.724249 16961 tablet_bootstrap.cc:492] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:52.713405 17261 raft_consensus.cc:697] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:05:52.736706 16960 tablet_bootstrap.cc:492] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:52.737340 16960 ts_tablet_manager.cc:1403] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.366s	user 0.024s	sys 0.036s
I20260709 13:05:52.740351 16962 tablet_bootstrap.cc:492] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:52.741056 16962 ts_tablet_manager.cc:1403] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.437s	user 0.009s	sys 0.034s
I20260709 13:05:52.792552 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061a5313535a475ea9385383b611b52d" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
W20260709 13:05:52.796115 16878 consensus_peers.cc:597] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b -> Peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Couldn't send request to peer 622433288cac4964aea9ea5a24ba77fd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:52.801230 16587 catalog_manager.cc:5697] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 622433288cac4964aea9ea5a24ba77fd (127.8.4.67). New cstate: current_term: 1 leader_uuid: "622433288cac4964aea9ea5a24ba77fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:52.808547 16960 raft_consensus.cc:359] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:52.810765 16960 raft_consensus.cc:385] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.811125 16960 raft_consensus.cc:740] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.811990 16960 consensus_queue.cc:260] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:52.803332 17231 leader_election.cc:290] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:52.780869 17261 consensus_queue.cc:237] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:52.823849 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f610e2abe7b467facd521257722760d" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:52.825327 17252 consensus_queue.cc:1048] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:52.833710 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f610e2abe7b467facd521257722760d" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:52.839314 16959 tablet_bootstrap.cc:654] T 1ceff4a1d9cf4d75994e64ebab75c551 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.844019 16960 ts_tablet_manager.cc:1434] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.106s	user 0.007s	sys 0.001s
I20260709 13:05:52.850224 16960 tablet_bootstrap.cc:492] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:52.852787 16765 raft_consensus.cc:3060] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.856902 16960 tablet_bootstrap.cc:654] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.847796 16913 raft_consensus.cc:3060] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.848325 17232 raft_consensus.cc:2749] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.891994 17226 consensus_queue.cc:1048] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:52.892747 16839 raft_consensus.cc:2468] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 2.
I20260709 13:05:52.897804 16913 raft_consensus.cc:2468] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 1.
I20260709 13:05:52.906533 16961 tablet_bootstrap.cc:654] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.920660 16653 leader_election.cc:304] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:52.922143 16765 raft_consensus.cc:2468] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 1.
I20260709 13:05:52.923282 16878 leader_election.cc:304] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:52.926323 17249 raft_consensus.cc:493] T 3c96e991f59b4bc298a3819b579eaa15 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.927090 17226 raft_consensus.cc:2804] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:52.928004 17226 raft_consensus.cc:697] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 2 LEADER]: Becoming Leader. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:05:52.929306 17235 raft_consensus.cc:2804] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.929085 17249 raft_consensus.cc:515] T 3c96e991f59b4bc298a3819b579eaa15 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:52.929926 17235 raft_consensus.cc:697] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:05:52.930826 17235 consensus_queue.cc:237] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:52.931463 17249 leader_election.cc:290] T 3c96e991f59b4bc298a3819b579eaa15 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:52.935855 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c96e991f59b4bc298a3819b579eaa15" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:52.939600 16960 tablet_bootstrap.cc:492] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:52.941561 16960 ts_tablet_manager.cc:1403] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.091s	user 0.024s	sys 0.003s
I20260709 13:05:52.944621 16960 raft_consensus.cc:359] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:52.945442 16960 raft_consensus.cc:385] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.945744 16960 raft_consensus.cc:740] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.947532 16960 consensus_queue.cc:260] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:52.950443 16960 ts_tablet_manager.cc:1434] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:52.950016 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c96e991f59b4bc298a3819b579eaa15" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:52.946192 17226 consensus_queue.cc:237] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:52.952306 16802 leader_election.cc:304] T 3c96e991f59b4bc298a3819b579eaa15 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd; no voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:52.950316 16962 raft_consensus.cc:359] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:52.954793 16962 raft_consensus.cc:385] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.955099 16962 raft_consensus.cc:740] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.955152 16960 tablet_bootstrap.cc:492] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:52.955848 16962 consensus_queue.cc:260] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:52.958837 17249 raft_consensus.cc:2749] T 3c96e991f59b4bc298a3819b579eaa15 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.980419 16960 tablet_bootstrap.cc:654] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.988085 16962 ts_tablet_manager.cc:1434] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.225s	user 0.002s	sys 0.005s
I20260709 13:05:52.989032 17275 raft_consensus.cc:493] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.989495 16962 tablet_bootstrap.cc:492] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:52.989565 17275 raft_consensus.cc:515] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:52.992082 17275 leader_election.cc:290] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:52.994797 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d82e412df245e1a4f614cc8c60539c" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:52.996014 16959 tablet_bootstrap.cc:492] T 1ceff4a1d9cf4d75994e64ebab75c551 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
W20260709 13:05:52.996445 16878 leader_election.cc:343] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.996739 16959 ts_tablet_manager.cc:1403] T 1ceff4a1d9cf4d75994e64ebab75c551 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.288s	user 0.030s	sys 0.017s
I20260709 13:05:52.994840 16585 catalog_manager.cc:5697] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.998788 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d82e412df245e1a4f614cc8c60539c" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:52.999809 16690 raft_consensus.cc:2468] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:53.000929 16959 raft_consensus.cc:359] T 1ceff4a1d9cf4d75994e64ebab75c551 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:53.001888 16959 raft_consensus.cc:385] T 1ceff4a1d9cf4d75994e64ebab75c551 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.002202 16959 raft_consensus.cc:740] T 1ceff4a1d9cf4d75994e64ebab75c551 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.003080 16959 consensus_queue.cc:260] T 1ceff4a1d9cf4d75994e64ebab75c551 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:53.003917 16879 leader_election.cc:304] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b; no voters: 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:53.005285 17275 raft_consensus.cc:2804] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.005918 17275 raft_consensus.cc:493] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.006286 17275 raft_consensus.cc:3060] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.015118 16961 tablet_bootstrap.cc:492] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:53.015906 16961 ts_tablet_manager.cc:1403] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.295s	user 0.021s	sys 0.014s
I20260709 13:05:53.017181 16962 tablet_bootstrap.cc:654] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.018924 16961 raft_consensus.cc:359] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:53.019728 16961 raft_consensus.cc:385] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.020042 16961 raft_consensus.cc:740] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.024852 16962 tablet_bootstrap.cc:492] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:53.025465 16962 ts_tablet_manager.cc:1403] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.036s	user 0.004s	sys 0.008s
I20260709 13:05:53.028441 16962 raft_consensus.cc:359] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:53.029268 16962 raft_consensus.cc:385] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.029537 16962 raft_consensus.cc:740] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.032538 16965 raft_consensus.cc:493] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.033666 16965 raft_consensus.cc:515] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:53.035852 16965 leader_election.cc:290] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:53.036275 16959 ts_tablet_manager.cc:1434] T 1ceff4a1d9cf4d75994e64ebab75c551 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.039s	user 0.002s	sys 0.005s
I20260709 13:05:53.037437 16959 tablet_bootstrap.cc:492] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:53.038462 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f17f39ebb642ac9ff48f3820305d1a" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:53.038288 17275 raft_consensus.cc:515] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:53.040620 17275 leader_election.cc:290] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:53.044497 16959 tablet_bootstrap.cc:654] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.045324 16962 consensus_queue.cc:260] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:53.046396 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d82e412df245e1a4f614cc8c60539c" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:53.047952 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f17f39ebb642ac9ff48f3820305d1a" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:53.049232 16962 ts_tablet_manager.cc:1434] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
W20260709 13:05:53.049904 16728 leader_election.cc:343] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:53.050697 16878 leader_election.cc:343] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:53.051486 16730 leader_election.cc:343] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.051766 16962 tablet_bootstrap.cc:492] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:53.051627 16687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d82e412df245e1a4f614cc8c60539c" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:53.051994 16730 leader_election.cc:304] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:53.052333 16687 raft_consensus.cc:3060] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.052275 16585 catalog_manager.cc:5697] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.060503 17271 raft_consensus.cc:2749] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:53.064545 16961 consensus_queue.cc:260] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:53.072393 16962 tablet_bootstrap.cc:654] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.075696 16959 tablet_bootstrap.cc:492] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:53.067051 16586 catalog_manager.cc:5697] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b reported cstate change: term changed from 1 to 2, leader changed from 622433288cac4964aea9ea5a24ba77fd (127.8.4.67) to 7197bc10b2304fccb972da2da7749e3b (127.8.4.68). New cstate: current_term: 2 leader_uuid: "7197bc10b2304fccb972da2da7749e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.086264 16959 ts_tablet_manager.cc:1403] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.002s
I20260709 13:05:53.067233 16961 ts_tablet_manager.cc:1434] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 13:05:53.090092 16961 tablet_bootstrap.cc:492] T 95d82e412df245e1a4f614cc8c60539c P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:53.097962 16959 raft_consensus.cc:359] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:53.098800 16959 raft_consensus.cc:385] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.099080 16959 raft_consensus.cc:740] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.099610 17157 consensus_queue.cc:1048] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.099797 16959 consensus_queue.cc:260] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:53.102010 16959 ts_tablet_manager.cc:1434] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:05:53.103060 16959 tablet_bootstrap.cc:492] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:53.103582 16839 raft_consensus.cc:3060] T 3c96e991f59b4bc298a3819b579eaa15 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.104842 16687 raft_consensus.cc:2468] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:53.108537 16961 tablet_bootstrap.cc:654] T 95d82e412df245e1a4f614cc8c60539c P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.109479 16879 leader_election.cc:304] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b; no voters: 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:53.111373 17275 raft_consensus.cc:2804] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:53.112005 17275 raft_consensus.cc:697] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Becoming Leader. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:05:53.113122 17275 consensus_queue.cc:237] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:53.116894 16962 tablet_bootstrap.cc:492] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:53.117482 16962 ts_tablet_manager.cc:1403] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.000s
I20260709 13:05:53.122660 16962 raft_consensus.cc:359] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:53.123399 16962 raft_consensus.cc:385] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.126806 17249 consensus_queue.cc:1048] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:53.126861 16960 tablet_bootstrap.cc:492] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:53.128116 16960 ts_tablet_manager.cc:1403] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.173s	user 0.019s	sys 0.008s
I20260709 13:05:53.136116 17226 raft_consensus.cc:493] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.137917 17226 raft_consensus.cc:515] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:53.140192 17226 leader_election.cc:290] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:53.123675 16962 raft_consensus.cc:740] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.143934 16962 consensus_queue.cc:260] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:53.149865 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d0c8416cdc43289eceaddcbd00a20e" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:53.150645 16959 tablet_bootstrap.cc:654] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.150836 16765 raft_consensus.cc:2393] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7197bc10b2304fccb972da2da7749e3b in current term 1: Already voted for candidate 1cbe303821774e4d936ea3d54875dcb8 in this term.
I20260709 13:05:53.161082 17278 raft_consensus.cc:493] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.161895 17278 raft_consensus.cc:515] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:53.149268 16962 ts_tablet_manager.cc:1434] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:05:53.166040 16962 tablet_bootstrap.cc:492] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:53.167064 16836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f0df42f20d4d9398c8d4b5b3cba4ea" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
W20260709 13:05:53.169417 16654 leader_election.cc:343] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.170212 17278 leader_election.cc:290] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:53.143955 16960 raft_consensus.cc:359] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:53.174196 16960 raft_consensus.cc:385] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.174449 16960 raft_consensus.cc:740] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.175107 16960 consensus_queue.cc:260] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:53.179250 16960 ts_tablet_manager.cc:1434] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:05:53.180819 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f0df42f20d4d9398c8d4b5b3cba4ea" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:53.187561 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d0c8416cdc43289eceaddcbd00a20e" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:53.187861 16764 raft_consensus.cc:2468] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 0.
I20260709 13:05:53.189507 16879 leader_election.cc:304] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:53.189507 16653 leader_election.cc:304] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:53.194294 17275 raft_consensus.cc:3060] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.196030 17278 raft_consensus.cc:2804] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.197194 17278 raft_consensus.cc:493] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.197664 17278 raft_consensus.cc:3060] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.204411 17275 raft_consensus.cc:2749] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:53.185232 16962 tablet_bootstrap.cc:654] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.212632 16585 catalog_manager.cc:5697] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7197bc10b2304fccb972da2da7749e3b (127.8.4.68). New cstate: current_term: 1 leader_uuid: "7197bc10b2304fccb972da2da7749e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.229332 16962 tablet_bootstrap.cc:492] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:53.229962 16962 ts_tablet_manager.cc:1403] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.001s
I20260709 13:05:53.238077 16960 tablet_bootstrap.cc:492] T 7013ecc82f234c109dc955f8dca102b2 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:53.249413 16961 tablet_bootstrap.cc:492] T 95d82e412df245e1a4f614cc8c60539c P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:53.249979 16961 ts_tablet_manager.cc:1403] T 95d82e412df245e1a4f614cc8c60539c P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.160s	user 0.021s	sys 0.028s
I20260709 13:05:53.250433 17278 raft_consensus.cc:515] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:53.250874 17249 raft_consensus.cc:493] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.251513 17249 raft_consensus.cc:515] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:53.252959 17278 leader_election.cc:290] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:53.253625 17249 leader_election.cc:290] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:53.254321 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f0df42f20d4d9398c8d4b5b3cba4ea" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:53.247423 16962 raft_consensus.cc:359] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:53.255761 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f0df42f20d4d9398c8d4b5b3cba4ea" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:53.255944 16962 raft_consensus.cc:385] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.256408 16764 raft_consensus.cc:3060] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.256387 16962 raft_consensus.cc:740] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.261059 16763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7013ecc82f234c109dc955f8dca102b2" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:53.261693 16959 tablet_bootstrap.cc:492] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:53.262207 16959 ts_tablet_manager.cc:1403] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.159s	user 0.012s	sys 0.029s
I20260709 13:05:53.262018 16763 raft_consensus.cc:2468] T 7013ecc82f234c109dc955f8dca102b2 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
W20260709 13:05:53.263070 16654 leader_election.cc:343] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.263877 16802 leader_election.cc:304] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:53.264879 17249 raft_consensus.cc:2804] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.265313 17249 raft_consensus.cc:493] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.265691 17249 raft_consensus.cc:3060] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.266615 16959 raft_consensus.cc:359] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:53.262018 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7013ecc82f234c109dc955f8dca102b2" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:53.267402 16959 raft_consensus.cc:385] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.267864 16959 raft_consensus.cc:740] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
W20260709 13:05:53.268527 16802 leader_election.cc:343] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.268532 16959 consensus_queue.cc:260] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:53.271062 16959 ts_tablet_manager.cc:1434] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:53.272094 16959 tablet_bootstrap.cc:492] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:53.278337 16959 tablet_bootstrap.cc:654] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.278645 16960 tablet_bootstrap.cc:654] T 7013ecc82f234c109dc955f8dca102b2 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.278179 17249 raft_consensus.cc:515] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:53.281466 16763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7013ecc82f234c109dc955f8dca102b2" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:53.282055 16763 raft_consensus.cc:3060] T 7013ecc82f234c109dc955f8dca102b2 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.283195 16764 raft_consensus.cc:2468] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 1.
I20260709 13:05:53.286962 16653 leader_election.cc:304] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:53.258616 16962 consensus_queue.cc:260] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:53.288746 17226 raft_consensus.cc:493] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.289342 17226 raft_consensus.cc:515] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:53.290171 16962 ts_tablet_manager.cc:1434] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 13:05:53.288803 17235 raft_consensus.cc:2804] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:53.292436 17235 raft_consensus.cc:697] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:05:53.292317 16961 raft_consensus.cc:359] T 95d82e412df245e1a4f614cc8c60539c P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:53.292816 16763 raft_consensus.cc:2468] T 7013ecc82f234c109dc955f8dca102b2 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:53.293452 17235 consensus_queue.cc:237] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:53.294080 16962 tablet_bootstrap.cc:492] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:53.325788 16802 leader_election.cc:304] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:53.326773 17157 raft_consensus.cc:2804] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:53.327406 17157 raft_consensus.cc:697] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Becoming Leader. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:05:53.328325 17157 consensus_queue.cc:237] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:53.294911 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f17f39ebb642ac9ff48f3820305d1a" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:53.331496 16764 raft_consensus.cc:2468] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:53.295110 17226 leader_election.cc:290] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:53.332974 16877 leader_election.cc:304] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:53.333817 17226 raft_consensus.cc:2804] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.334190 17226 raft_consensus.cc:493] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.334558 17226 raft_consensus.cc:3060] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.299340 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7013ecc82f234c109dc955f8dca102b2" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:53.294608 17249 leader_election.cc:290] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:53.311527 17278 raft_consensus.cc:493] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.342252 17278 raft_consensus.cc:515] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:53.329906 16965 raft_consensus.cc:493] T 1ceff4a1d9cf4d75994e64ebab75c551 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.344883 16965 raft_consensus.cc:515] T 1ceff4a1d9cf4d75994e64ebab75c551 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:53.346547 16960 tablet_bootstrap.cc:492] T 7013ecc82f234c109dc955f8dca102b2 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:53.347224 16960 ts_tablet_manager.cc:1403] T 7013ecc82f234c109dc955f8dca102b2 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.109s	user 0.032s	sys 0.017s
I20260709 13:05:53.347316 16965 leader_election.cc:290] T 1ceff4a1d9cf4d75994e64ebab75c551 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:53.330567 16962 tablet_bootstrap.cc:654] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.294309 16961 raft_consensus.cc:385] T 95d82e412df245e1a4f614cc8c60539c P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.350812 16961 raft_consensus.cc:740] T 95d82e412df245e1a4f614cc8c60539c P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.350538 16960 raft_consensus.cc:359] T 7013ecc82f234c109dc955f8dca102b2 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:53.351460 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ceff4a1d9cf4d75994e64ebab75c551" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:53.351557 16960 raft_consensus.cc:385] T 7013ecc82f234c109dc955f8dca102b2 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.351679 16961 consensus_queue.cc:260] T 95d82e412df245e1a4f614cc8c60539c P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:53.352296 16960 raft_consensus.cc:740] T 7013ecc82f234c109dc955f8dca102b2 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.352469 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f17f39ebb642ac9ff48f3820305d1a" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:53.297981 16687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f17f39ebb642ac9ff48f3820305d1a" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
W20260709 13:05:53.352998 16728 leader_election.cc:343] T 1ceff4a1d9cf4d75994e64ebab75c551 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.353556 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ceff4a1d9cf4d75994e64ebab75c551" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:53.353472 16960 consensus_queue.cc:260] T 7013ecc82f234c109dc955f8dca102b2 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
W20260709 13:05:53.355098 16729 leader_election.cc:343] T 1ceff4a1d9cf4d75994e64ebab75c551 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.355577 16729 leader_election.cc:304] T 1ceff4a1d9cf4d75994e64ebab75c551 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:53.356343 17271 raft_consensus.cc:2749] T 1ceff4a1d9cf4d75994e64ebab75c551 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:53.353565 16687 raft_consensus.cc:2468] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:53.357620 17278 leader_election.cc:290] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:53.358711 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f17f39ebb642ac9ff48f3820305d1a" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:53.359369 16764 raft_consensus.cc:2468] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 0.
W20260709 13:05:53.360216 16802 leader_election.cc:343] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.360723 16653 leader_election.cc:304] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:53.361652 16961 ts_tablet_manager.cc:1434] T 95d82e412df245e1a4f614cc8c60539c P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.111s	user 0.008s	sys 0.000s
I20260709 13:05:53.362771 16961 tablet_bootstrap.cc:492] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:53.362926 17235 raft_consensus.cc:2804] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.363374 17235 raft_consensus.cc:493] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.363729 17235 raft_consensus.cc:3060] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.364020 16960 ts_tablet_manager.cc:1434] T 7013ecc82f234c109dc955f8dca102b2 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:05:53.365181 16960 tablet_bootstrap.cc:492] T 7e97f3430b8a49e2a9476402b7d46203 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:53.368902 17278 raft_consensus.cc:493] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.369473 17278 raft_consensus.cc:515] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:53.372630 16960 tablet_bootstrap.cc:654] T 7e97f3430b8a49e2a9476402b7d46203 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.372792 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e97f3430b8a49e2a9476402b7d46203" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
W20260709 13:05:53.374200 16654 leader_election.cc:343] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.375042 16961 tablet_bootstrap.cc:654] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.374965 17275 raft_consensus.cc:493] T 7013ecc82f234c109dc955f8dca102b2 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.375741 17275 raft_consensus.cc:515] T 7013ecc82f234c109dc955f8dca102b2 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:53.378384 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e97f3430b8a49e2a9476402b7d46203" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:53.378782 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7013ecc82f234c109dc955f8dca102b2" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:53.379599 16764 raft_consensus.cc:2393] T 7013ecc82f234c109dc955f8dca102b2 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7197bc10b2304fccb972da2da7749e3b in current term 1: Already voted for candidate 622433288cac4964aea9ea5a24ba77fd in this term.
W20260709 13:05:53.379508 16653 leader_election.cc:343] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.381115 16653 leader_election.cc:304] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8; no voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:53.382634 17280 raft_consensus.cc:2749] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:53.391438 17278 leader_election.cc:290] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:53.392925 17275 leader_election.cc:290] T 7013ecc82f234c109dc955f8dca102b2 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:53.394447 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7013ecc82f234c109dc955f8dca102b2" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:53.396361 16878 leader_election.cc:304] T 7013ecc82f234c109dc955f8dca102b2 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:53.397217 16586 catalog_manager.cc:5697] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 622433288cac4964aea9ea5a24ba77fd (127.8.4.67). New cstate: current_term: 1 leader_uuid: "622433288cac4964aea9ea5a24ba77fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.399858 17275 raft_consensus.cc:3060] T 7013ecc82f234c109dc955f8dca102b2 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.407806 17278 consensus_queue.cc:1048] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.048s
I20260709 13:05:53.412370 17275 raft_consensus.cc:2749] T 7013ecc82f234c109dc955f8dca102b2 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:53.417232 16839 raft_consensus.cc:1275] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Refusing update from remote peer 7197bc10b2304fccb972da2da7749e3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.459322 16959 tablet_bootstrap.cc:492] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:53.460009 16960 tablet_bootstrap.cc:492] T 7e97f3430b8a49e2a9476402b7d46203 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:53.460749 16960 ts_tablet_manager.cc:1403] T 7e97f3430b8a49e2a9476402b7d46203 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.096s	user 0.038s	sys 0.040s
I20260709 13:05:53.461225 17275 consensus_queue.cc:1048] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.406912 16588 catalog_manager.cc:5697] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.462700 16961 tablet_bootstrap.cc:492] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:53.463331 16961 ts_tablet_manager.cc:1403] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.101s	user 0.006s	sys 0.013s
I20260709 13:05:53.460086 16959 ts_tablet_manager.cc:1403] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.188s	user 0.029s	sys 0.024s
I20260709 13:05:53.465168 16960 raft_consensus.cc:359] T 7e97f3430b8a49e2a9476402b7d46203 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:53.466241 16960 raft_consensus.cc:385] T 7e97f3430b8a49e2a9476402b7d46203 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.466624 16960 raft_consensus.cc:740] T 7e97f3430b8a49e2a9476402b7d46203 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.467715 16960 consensus_queue.cc:260] T 7e97f3430b8a49e2a9476402b7d46203 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:53.469488 16959 raft_consensus.cc:359] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:53.470292 16959 raft_consensus.cc:385] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.470628 16959 raft_consensus.cc:740] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.471534 16959 consensus_queue.cc:260] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:53.474242 17280 consensus_queue.cc:1048] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:53.475765 16960 ts_tablet_manager.cc:1434] T 7e97f3430b8a49e2a9476402b7d46203 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:05:53.476950 16960 tablet_bootstrap.cc:492] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:53.480208 16961 raft_consensus.cc:359] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:53.480883 16961 raft_consensus.cc:385] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.481187 16961 raft_consensus.cc:740] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.474269 16959 ts_tablet_manager.cc:1434] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:05:53.454003 17226 raft_consensus.cc:515] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:53.484732 16960 tablet_bootstrap.cc:654] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.484911 16959 tablet_bootstrap.cc:492] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:53.501890 16912 raft_consensus.cc:2393] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1cbe303821774e4d936ea3d54875dcb8 in current term 1: Already voted for candidate 7197bc10b2304fccb972da2da7749e3b in this term.
I20260709 13:05:53.503201 17226 leader_election.cc:290] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Requested vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:53.467278 17235 raft_consensus.cc:515] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:53.551551 17235 leader_election.cc:290] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:53.504067 16687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f17f39ebb642ac9ff48f3820305d1a" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:53.552681 16687 raft_consensus.cc:2393] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7197bc10b2304fccb972da2da7749e3b in current term 1: Already voted for candidate 1cbe303821774e4d936ea3d54875dcb8 in this term.
I20260709 13:05:53.506880 16763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f17f39ebb642ac9ff48f3820305d1a" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:53.553323 16763 raft_consensus.cc:3060] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.487146 16962 tablet_bootstrap.cc:492] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:53.557686 16962 ts_tablet_manager.cc:1403] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.264s	user 0.012s	sys 0.012s
I20260709 13:05:53.559809 16959 tablet_bootstrap.cc:654] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.487490 16961 consensus_queue.cc:260] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:53.523866 16689 raft_consensus.cc:1275] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Refusing update from remote peer 7197bc10b2304fccb972da2da7749e3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.560559 17228 consensus_queue.cc:1048] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.562726 16961 ts_tablet_manager.cc:1434] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.099s	user 0.009s	sys 0.002s
I20260709 13:05:53.564302 17157 raft_consensus.cc:493] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.564884 17157 raft_consensus.cc:515] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:53.566114 16962 raft_consensus.cc:359] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:53.566779 16962 raft_consensus.cc:385] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.567034 16962 raft_consensus.cc:740] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.567724 16962 consensus_queue.cc:260] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:53.571655 16763 raft_consensus.cc:2468] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:53.573045 16877 leader_election.cc:304] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:53.574204 17218 raft_consensus.cc:2804] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:53.574337 17226 consensus_queue.cc:1048] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:53.575027 17218 raft_consensus.cc:697] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Becoming Leader. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:05:53.576213 17218 consensus_queue.cc:237] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:53.578547 16962 ts_tablet_manager.cc:1434] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.002s
I20260709 13:05:53.579609 16962 tablet_bootstrap.cc:492] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:53.583438 16965 raft_consensus.cc:493] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.583959 16965 raft_consensus.cc:515] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:53.587201 16960 tablet_bootstrap.cc:492] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:53.587708 16960 ts_tablet_manager.cc:1403] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.034s
I20260709 13:05:53.584935 16962 tablet_bootstrap.cc:654] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.590938 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6a383a050745a791b07441a3b93828" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:53.585985 16965 leader_election.cc:290] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:53.591001 16960 raft_consensus.cc:359] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:53.593840 16960 raft_consensus.cc:385] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.594164 16960 raft_consensus.cc:740] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.594841 16959 tablet_bootstrap.cc:492] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
W20260709 13:05:53.592655 16730 leader_election.cc:343] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.595412 16959 ts_tablet_manager.cc:1403] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.112s	user 0.019s	sys 0.011s
I20260709 13:05:53.597119 16836 raft_consensus.cc:3060] T 95d82e412df245e1a4f614cc8c60539c P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.598254 16961 tablet_bootstrap.cc:492] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:53.598093 16959 raft_consensus.cc:359] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:53.598851 16959 raft_consensus.cc:385] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.599121 16959 raft_consensus.cc:740] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.599747 16959 consensus_queue.cc:260] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:53.596961 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6a383a050745a791b07441a3b93828" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
W20260709 13:05:53.602600 16729 leader_election.cc:343] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.603103 16959 ts_tablet_manager.cc:1434] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:53.603209 16729 leader_election.cc:304] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:53.604250 16959 tablet_bootstrap.cc:492] T 6ce874d8c223464585bd12c973d333b6 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:53.604794 17239 raft_consensus.cc:2749] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:53.622541 16959 tablet_bootstrap.cc:654] T 6ce874d8c223464585bd12c973d333b6 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.624639 17157 leader_election.cc:290] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:53.625164 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e97f3430b8a49e2a9476402b7d46203" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:53.626058 16912 raft_consensus.cc:2468] T 7e97f3430b8a49e2a9476402b7d46203 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
I20260709 13:05:53.627415 16802 leader_election.cc:304] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:53.628623 16685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e97f3430b8a49e2a9476402b7d46203" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:53.629390 16685 raft_consensus.cc:2468] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
I20260709 13:05:53.631464 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f17f39ebb642ac9ff48f3820305d1a" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:53.594903 16960 consensus_queue.cc:260] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:53.632022 16962 tablet_bootstrap.cc:492] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:53.632575 16962 ts_tablet_manager.cc:1403] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.003s
I20260709 13:05:53.634019 16763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f17f39ebb642ac9ff48f3820305d1a" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:53.634866 16960 ts_tablet_manager.cc:1434] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 13:05:53.634979 16763 raft_consensus.cc:2393] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1cbe303821774e4d936ea3d54875dcb8 in current term 1: Already voted for candidate 7197bc10b2304fccb972da2da7749e3b in this term.
I20260709 13:05:53.636391 17155 raft_consensus.cc:2804] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.636881 17155 raft_consensus.cc:493] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.637434 17155 raft_consensus.cc:3060] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.639076 16960 tablet_bootstrap.cc:492] T c80dc47d27a749eab1ffa183f231f036 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:53.643788 16962 raft_consensus.cc:359] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:53.644469 16962 raft_consensus.cc:385] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.644752 16962 raft_consensus.cc:740] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.645519 16962 consensus_queue.cc:260] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:53.649430 17155 raft_consensus.cc:515] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:53.656071 16962 ts_tablet_manager.cc:1434] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:05:53.657342 16962 tablet_bootstrap.cc:492] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:53.659121 16961 tablet_bootstrap.cc:654] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.660238 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e97f3430b8a49e2a9476402b7d46203" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:53.661191 16913 raft_consensus.cc:3060] T 7e97f3430b8a49e2a9476402b7d46203 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.687587 17280 consensus_queue.cc:1048] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:53.689935 17280 consensus_queue.cc:1048] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:53.689687 16587 catalog_manager.cc:5697] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7197bc10b2304fccb972da2da7749e3b (127.8.4.68). New cstate: current_term: 1 leader_uuid: "7197bc10b2304fccb972da2da7749e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.695873 16962 tablet_bootstrap.cc:654] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.698642 16965 raft_consensus.cc:493] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.699470 16965 raft_consensus.cc:515] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:53.701514 16965 leader_election.cc:290] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:53.697924 16653 leader_election.cc:304] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8; no voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:53.704239 17280 raft_consensus.cc:2749] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:53.705046 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80dc47d27a749eab1ffa183f231f036" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:53.705621 16960 tablet_bootstrap.cc:654] T c80dc47d27a749eab1ffa183f231f036 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:53.706722 16728 leader_election.cc:343] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.708400 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80dc47d27a749eab1ffa183f231f036" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:53.709162 16690 raft_consensus.cc:2468] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 0.
I20260709 13:05:53.710500 16730 leader_election.cc:304] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:53.711985 16965 raft_consensus.cc:2804] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.712464 16965 raft_consensus.cc:493] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.712007 17155 leader_election.cc:290] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:53.724388 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e97f3430b8a49e2a9476402b7d46203" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:53.733805 16689 raft_consensus.cc:3060] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.712847 16965 raft_consensus.cc:3060] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:53.732862 16654 consensus_peers.cc:597] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 -> Peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Couldn't send request to peer 622433288cac4964aea9ea5a24ba77fd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:53.741585 17228 consensus_queue.cc:1048] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.747229 17278 raft_consensus.cc:493] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.747859 17278 raft_consensus.cc:515] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:53.750159 17278 leader_election.cc:290] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:53.754592 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6a383a050745a791b07441a3b93828" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
W20260709 13:05:53.756474 16654 leader_election.cc:343] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.754514 17157 consensus_queue.cc:1048] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:53.757671 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6a383a050745a791b07441a3b93828" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:53.758392 16765 raft_consensus.cc:2468] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 0.
I20260709 13:05:53.760661 17239 raft_consensus.cc:493] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.761262 17239 raft_consensus.cc:515] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:53.765129 17239 leader_election.cc:290] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:53.766213 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772bb23805934270899495ae7c8cbb07" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
W20260709 13:05:53.768062 16730 leader_election.cc:343] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.770615 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772bb23805934270899495ae7c8cbb07" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
W20260709 13:05:53.780062 16729 leader_election.cc:343] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.781469 16729 leader_election.cc:304] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:53.782629 17239 raft_consensus.cc:2749] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:53.790043 16653 leader_election.cc:304] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:53.793385 16961 tablet_bootstrap.cc:492] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:53.797278 16961 ts_tablet_manager.cc:1403] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.199s	user 0.018s	sys 0.000s
I20260709 13:05:53.798624 16960 tablet_bootstrap.cc:492] T c80dc47d27a749eab1ffa183f231f036 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:53.799145 16960 ts_tablet_manager.cc:1403] T c80dc47d27a749eab1ffa183f231f036 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.160s	user 0.015s	sys 0.008s
I20260709 13:05:53.800405 17155 consensus_queue.cc:1048] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.802030 16913 raft_consensus.cc:2468] T 7e97f3430b8a49e2a9476402b7d46203 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:53.804303 17278 raft_consensus.cc:2804] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.804731 17278 raft_consensus.cc:493] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.805099 17278 raft_consensus.cc:3060] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.807271 16802 leader_election.cc:304] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:53.808149 17155 raft_consensus.cc:2804] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:53.808705 17155 raft_consensus.cc:697] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Becoming Leader. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:05:53.810278 16959 tablet_bootstrap.cc:492] T 6ce874d8c223464585bd12c973d333b6 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:53.779889 16965 raft_consensus.cc:515] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:53.810890 16959 ts_tablet_manager.cc:1403] T 6ce874d8c223464585bd12c973d333b6 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.207s	user 0.049s	sys 0.038s
I20260709 13:05:53.800040 16961 raft_consensus.cc:359] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:53.812131 16961 raft_consensus.cc:385] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.812414 16961 raft_consensus.cc:740] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.796522 16689 raft_consensus.cc:2468] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:53.814954 16965 leader_election.cc:290] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:53.816970 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80dc47d27a749eab1ffa183f231f036" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:53.818077 16690 raft_consensus.cc:3060] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.820024 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80dc47d27a749eab1ffa183f231f036" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:53.823282 16959 raft_consensus.cc:359] T 6ce874d8c223464585bd12c973d333b6 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:53.809895 17155 consensus_queue.cc:237] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:53.824055 16959 raft_consensus.cc:385] T 6ce874d8c223464585bd12c973d333b6 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.824400 16959 raft_consensus.cc:740] T 6ce874d8c223464585bd12c973d333b6 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
W20260709 13:05:53.827785 16728 leader_election.cc:343] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.830399 16960 raft_consensus.cc:359] T c80dc47d27a749eab1ffa183f231f036 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:53.831198 16960 raft_consensus.cc:385] T c80dc47d27a749eab1ffa183f231f036 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.794441 16962 tablet_bootstrap.cc:492] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:53.831488 16960 raft_consensus.cc:740] T c80dc47d27a749eab1ffa183f231f036 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.831925 16962 ts_tablet_manager.cc:1403] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.175s	user 0.014s	sys 0.007s
I20260709 13:05:53.832525 16959 consensus_queue.cc:260] T 6ce874d8c223464585bd12c973d333b6 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:53.834872 16959 ts_tablet_manager.cc:1434] T 6ce874d8c223464585bd12c973d333b6 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:05:53.835831 16959 tablet_bootstrap.cc:492] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:53.830793 17278 raft_consensus.cc:515] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:53.838917 16960 consensus_queue.cc:260] T c80dc47d27a749eab1ffa183f231f036 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:53.841226 16960 ts_tablet_manager.cc:1434] T c80dc47d27a749eab1ffa183f231f036 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.001s
I20260709 13:05:53.844950 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6a383a050745a791b07441a3b93828" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
W20260709 13:05:53.846745 16654 leader_election.cc:343] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.847715 17278 leader_election.cc:290] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:53.853838 16959 tablet_bootstrap.cc:654] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.854228 16690 raft_consensus.cc:2468] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
I20260709 13:05:53.855562 16730 leader_election.cc:304] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:53.857193 16960 tablet_bootstrap.cc:492] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:53.857601 17239 raft_consensus.cc:2804] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:53.858292 17239 raft_consensus.cc:697] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Becoming Leader. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:05:53.859092 17239 consensus_queue.cc:237] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:53.861645 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6a383a050745a791b07441a3b93828" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:53.862296 16764 raft_consensus.cc:3060] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.863648 16960 tablet_bootstrap.cc:654] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.880245 16764 raft_consensus.cc:2468] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 1.
I20260709 13:05:53.881531 16653 leader_election.cc:304] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:53.882341 17278 consensus_queue.cc:1048] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.883761 17278 raft_consensus.cc:2804] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:53.884238 17278 raft_consensus.cc:697] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:05:53.884971 17278 consensus_queue.cc:237] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:53.898420 16960 tablet_bootstrap.cc:492] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:53.899024 16960 ts_tablet_manager.cc:1403] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.003s
I20260709 13:05:53.905504 16961 consensus_queue.cc:260] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:53.908493 16961 ts_tablet_manager.cc:1434] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.111s	user 0.007s	sys 0.000s
I20260709 13:05:53.909762 16961 tablet_bootstrap.cc:492] T 9de37f630dc142a28db71d81fa427ab4 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:53.923388 16962 raft_consensus.cc:359] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:53.923565 16960 raft_consensus.cc:359] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:53.937477 16962 raft_consensus.cc:385] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.937487 16960 raft_consensus.cc:385] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.933880 16587 catalog_manager.cc:5697] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 622433288cac4964aea9ea5a24ba77fd (127.8.4.67). New cstate: current_term: 1 leader_uuid: "622433288cac4964aea9ea5a24ba77fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.925669 16588 catalog_manager.cc:5697] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.938216 16960 raft_consensus.cc:740] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.941319 16960 consensus_queue.cc:260] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:53.938203 16962 raft_consensus.cc:740] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.943076 16962 consensus_queue.cc:260] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:53.943984 16960 ts_tablet_manager.cc:1434] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.002s
I20260709 13:05:53.945526 16962 ts_tablet_manager.cc:1434] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.113s	user 0.007s	sys 0.001s
I20260709 13:05:53.946535 16962 tablet_bootstrap.cc:492] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:53.950744 16960 tablet_bootstrap.cc:492] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:53.954771 16961 tablet_bootstrap.cc:654] T 9de37f630dc142a28db71d81fa427ab4 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.960541 16962 tablet_bootstrap.cc:654] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.966909 16960 tablet_bootstrap.cc:654] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.975389 16961 tablet_bootstrap.cc:492] T 9de37f630dc142a28db71d81fa427ab4 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:53.976073 16961 ts_tablet_manager.cc:1403] T 9de37f630dc142a28db71d81fa427ab4 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.067s	user 0.017s	sys 0.000s
I20260709 13:05:53.980497 16961 raft_consensus.cc:359] T 9de37f630dc142a28db71d81fa427ab4 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:53.980582 16586 catalog_manager.cc:5697] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 reported cstate change: term changed from 0 to 1, leader changed from <none> to d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d0ea3afb898b4eb5b21faeb676627011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:53.996588 16961 raft_consensus.cc:385] T 9de37f630dc142a28db71d81fa427ab4 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.996961 16961 raft_consensus.cc:740] T 9de37f630dc142a28db71d81fa427ab4 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.997869 16961 consensus_queue.cc:260] T 9de37f630dc142a28db71d81fa427ab4 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:53.986254 17226 consensus_queue.cc:1048] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:53.999799 17226 raft_consensus.cc:493] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.000324 17226 raft_consensus.cc:515] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:54.001259 17218 raft_consensus.cc:493] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.001813 17218 raft_consensus.cc:515] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:54.002458 17226 leader_election.cc:290] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:53.992664 17239 raft_consensus.cc:493] T 6ce874d8c223464585bd12c973d333b6 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.985127 16959 tablet_bootstrap.cc:492] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:54.003123 17239 raft_consensus.cc:515] T 6ce874d8c223464585bd12c973d333b6 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:54.003773 16959 ts_tablet_manager.cc:1403] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.168s	user 0.016s	sys 0.027s
I20260709 13:05:54.004101 17218 leader_election.cc:290] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:54.005223 17239 leader_election.cc:290] T 6ce874d8c223464585bd12c973d333b6 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:54.006652 16959 raft_consensus.cc:359] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:54.007333 16959 raft_consensus.cc:385] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.007587 16959 raft_consensus.cc:740] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.007768 16961 ts_tablet_manager.cc:1434] T 9de37f630dc142a28db71d81fa427ab4 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:05:54.008898 16961 tablet_bootstrap.cc:492] T 0f6a383a050745a791b07441a3b93828 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:54.009083 16836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e79d615b8ac14c149720027be9d4dee2" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:54.009495 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce874d8c223464585bd12c973d333b6" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:54.010596 16763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de37f630dc142a28db71d81fa427ab4" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:54.011240 16763 raft_consensus.cc:2468] T 9de37f630dc142a28db71d81fa427ab4 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:54.011528 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce874d8c223464585bd12c973d333b6" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:54.012639 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de37f630dc142a28db71d81fa427ab4" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:54.012774 16965 raft_consensus.cc:493] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.013280 16837 raft_consensus.cc:2468] T 9de37f630dc142a28db71d81fa427ab4 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:54.013353 16965 raft_consensus.cc:515] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:54.014914 16877 leader_election.cc:304] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 
W20260709 13:05:54.016098 16878 leader_election.cc:343] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.016757 17226 raft_consensus.cc:2804] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:05:54.016796 16730 leader_election.cc:343] T 6ce874d8c223464585bd12c973d333b6 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.017144 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e79d615b8ac14c149720027be9d4dee2" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:54.015565 16965 leader_election.cc:290] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:54.017940 16690 raft_consensus.cc:2468] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:54.015532 16961 tablet_bootstrap.cc:654] T 0f6a383a050745a791b07441a3b93828 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.019323 16879 leader_election.cc:304] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b; no voters: 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:54.017385 17226 raft_consensus.cc:493] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.020458 17228 raft_consensus.cc:2804] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:54.020788 17226 raft_consensus.cc:3060] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.020859 17228 raft_consensus.cc:493] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.021538 17228 raft_consensus.cc:3060] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:54.019347 16728 leader_election.cc:343] T 6ce874d8c223464585bd12c973d333b6 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.023710 16728 leader_election.cc:304] T 6ce874d8c223464585bd12c973d333b6 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:54.024493 16965 raft_consensus.cc:2749] T 6ce874d8c223464585bd12c973d333b6 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:54.025229 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522eefb992a4533ad3a9f3ba6634bc8" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:54.025512 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522eefb992a4533ad3a9f3ba6634bc8" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:54.025386 16959 consensus_queue.cc:260] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
W20260709 13:05:54.027097 16729 leader_election.cc:343] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:54.028422 16728 leader_election.cc:343] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.031852 16728 leader_election.cc:304] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:54.031965 16961 tablet_bootstrap.cc:492] T 0f6a383a050745a791b07441a3b93828 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:54.033257 17239 raft_consensus.cc:2749] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:54.033540 16961 ts_tablet_manager.cc:1403] T 0f6a383a050745a791b07441a3b93828 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.006s
I20260709 13:05:54.036005 16962 tablet_bootstrap.cc:492] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:54.036545 16962 ts_tablet_manager.cc:1403] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.090s	user 0.023s	sys 0.010s
I20260709 13:05:54.037475 16965 raft_consensus.cc:493] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.037959 16965 raft_consensus.cc:515] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:54.041407 17228 raft_consensus.cc:515] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:54.037873 16959 ts_tablet_manager.cc:1434] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:05:54.045356 16962 raft_consensus.cc:359] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:54.046200 16962 raft_consensus.cc:385] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.046550 16962 raft_consensus.cc:740] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.046965 16959 tablet_bootstrap.cc:492] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:54.047629 16962 consensus_queue.cc:260] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:54.050112 16962 ts_tablet_manager.cc:1434] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:05:54.052086 16962 tablet_bootstrap.cc:492] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:54.062074 16965 leader_election.cc:290] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:54.063697 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e93c7f885494add9735d842339e740a" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
W20260709 13:05:54.064392 16636 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:54.036695 16961 raft_consensus.cc:359] T 0f6a383a050745a791b07441a3b93828 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:54.065374 16961 raft_consensus.cc:385] T 0f6a383a050745a791b07441a3b93828 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.065663 16961 raft_consensus.cc:740] T 0f6a383a050745a791b07441a3b93828 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.066311 16959 tablet_bootstrap.cc:654] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.045573 16960 tablet_bootstrap.cc:492] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:54.066383 16961 consensus_queue.cc:260] T 0f6a383a050745a791b07441a3b93828 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:54.070003 16960 ts_tablet_manager.cc:1403] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.125s	user 0.021s	sys 0.000s
W20260709 13:05:54.070403 16728 leader_election.cc:343] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.071717 16961 ts_tablet_manager.cc:1434] T 0f6a383a050745a791b07441a3b93828 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.038s	user 0.002s	sys 0.003s
I20260709 13:05:54.072738 16961 tablet_bootstrap.cc:492] T 1ceff4a1d9cf4d75994e64ebab75c551 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:54.073834 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e79d615b8ac14c149720027be9d4dee2" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:54.042430 17226 raft_consensus.cc:515] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:54.074949 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e93c7f885494add9735d842339e740a" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:54.075660 16689 raft_consensus.cc:2468] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 0.
I20260709 13:05:54.076275 17226 leader_election.cc:290] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:54.077131 16960 raft_consensus.cc:359] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:54.077904 16960 raft_consensus.cc:385] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.078260 16960 raft_consensus.cc:740] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.079651 16730 leader_election.cc:304] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:54.080799 17271 raft_consensus.cc:2804] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:54.080905 16961 tablet_bootstrap.cc:654] T 1ceff4a1d9cf4d75994e64ebab75c551 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.081220 17271 raft_consensus.cc:493] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.081591 17271 raft_consensus.cc:3060] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.086858 17226 consensus_queue.cc:1048] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:54.091109 16960 consensus_queue.cc:260] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
W20260709 13:05:54.092577 16878 leader_election.cc:343] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.068084 17228 leader_election.cc:290] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:54.069716 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e79d615b8ac14c149720027be9d4dee2" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:54.096961 16690 raft_consensus.cc:3060] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.099944 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de37f630dc142a28db71d81fa427ab4" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:54.100663 16765 raft_consensus.cc:3060] T 9de37f630dc142a28db71d81fa427ab4 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.104065 16962 tablet_bootstrap.cc:654] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.108898 17271 raft_consensus.cc:515] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:54.110895 16690 raft_consensus.cc:2468] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:54.109635 16960 ts_tablet_manager.cc:1434] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:05:54.112897 16960 tablet_bootstrap.cc:492] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:54.124114 17271 leader_election.cc:290] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:54.133029 16687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e93c7f885494add9735d842339e740a" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:54.133297 16879 leader_election.cc:304] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b; no voters: 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:54.133800 16687 raft_consensus.cc:3060] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.134833 17226 raft_consensus.cc:2804] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.135394 17226 raft_consensus.cc:697] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Becoming Leader. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:05:54.139190 16960 tablet_bootstrap.cc:654] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.155370 16687 raft_consensus.cc:2468] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
I20260709 13:05:54.156704 16959 tablet_bootstrap.cc:492] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:54.156690 16730 leader_election.cc:304] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:54.157505 16959 ts_tablet_manager.cc:1403] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.111s	user 0.009s	sys 0.016s
I20260709 13:05:54.161305 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e93c7f885494add9735d842339e740a" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:54.161582 17271 raft_consensus.cc:2804] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.162707 17271 raft_consensus.cc:697] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Becoming Leader. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:05:54.163604 17271 consensus_queue.cc:237] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:54.164837 16959 raft_consensus.cc:359] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:54.165625 16959 raft_consensus.cc:385] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.165886 16959 raft_consensus.cc:740] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.166680 16959 consensus_queue.cc:260] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:54.170172 16959 ts_tablet_manager.cc:1434] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:05:54.171578 16959 tablet_bootstrap.cc:492] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:54.179554 16959 tablet_bootstrap.cc:654] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.184687 17226 consensus_queue.cc:237] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:54.191200 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de37f630dc142a28db71d81fa427ab4" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:54.191871 16837 raft_consensus.cc:3060] T 9de37f630dc142a28db71d81fa427ab4 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.202210 17155 raft_consensus.cc:493] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.202826 17155 raft_consensus.cc:515] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:54.203227 16765 raft_consensus.cc:2468] T 9de37f630dc142a28db71d81fa427ab4 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
W20260709 13:05:54.204564 16728 leader_election.cc:343] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.206260 16877 leader_election.cc:304] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:54.207147 17218 raft_consensus.cc:2804] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.207630 17218 raft_consensus.cc:697] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Becoming Leader. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:05:54.208357 17155 leader_election.cc:290] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:54.208468 17218 consensus_queue.cc:237] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:54.221686 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f0df42f20d4d9398c8d4b5b3cba4ea" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:54.223973 16837 raft_consensus.cc:2468] T 9de37f630dc142a28db71d81fa427ab4 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:54.225380 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f0df42f20d4d9398c8d4b5b3cba4ea" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:54.227190 16802 leader_election.cc:304] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd; no voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:54.229933 17155 raft_consensus.cc:2749] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:54.240263 16965 raft_consensus.cc:493] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.240996 16965 raft_consensus.cc:515] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:54.243197 16965 leader_election.cc:290] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:54.246551 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3d4f25ea4e4b14b6dd55a052daf82c" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:54.246901 16961 tablet_bootstrap.cc:492] T 1ceff4a1d9cf4d75994e64ebab75c551 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:54.247324 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3d4f25ea4e4b14b6dd55a052daf82c" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
W20260709 13:05:54.247870 16729 leader_election.cc:343] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:54.249806 16730 leader_election.cc:343] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.250213 16730 leader_election.cc:304] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:54.251946 17239 raft_consensus.cc:2749] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:54.247362 16961 ts_tablet_manager.cc:1403] T 1ceff4a1d9cf4d75994e64ebab75c551 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.175s	user 0.018s	sys 0.034s
I20260709 13:05:54.255393 17157 consensus_queue.cc:1048] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.257421 16959 tablet_bootstrap.cc:492] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:54.258064 16959 ts_tablet_manager.cc:1403] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.087s	user 0.014s	sys 0.005s
I20260709 13:05:54.262072 16959 raft_consensus.cc:359] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:54.265205 16959 raft_consensus.cc:385] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.265575 16959 raft_consensus.cc:740] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.263854 16961 raft_consensus.cc:359] T 1ceff4a1d9cf4d75994e64ebab75c551 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:54.266255 16961 raft_consensus.cc:385] T 1ceff4a1d9cf4d75994e64ebab75c551 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.266544 16961 raft_consensus.cc:740] T 1ceff4a1d9cf4d75994e64ebab75c551 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.267294 16961 consensus_queue.cc:260] T 1ceff4a1d9cf4d75994e64ebab75c551 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:54.268682 16836 raft_consensus.cc:3060] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.269663 16961 ts_tablet_manager.cc:1434] T 1ceff4a1d9cf4d75994e64ebab75c551 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:05:54.270342 16959 consensus_queue.cc:260] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:54.273530 16959 ts_tablet_manager.cc:1434] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 13:05:54.274672 16959 tablet_bootstrap.cc:492] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:54.277266 16961 tablet_bootstrap.cc:492] T e79d615b8ac14c149720027be9d4dee2 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:54.278374 17155 consensus_queue.cc:1048] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.281489 16959 tablet_bootstrap.cc:654] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.300922 17239 consensus_queue.cc:1048] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:54.308219 17316 consensus_queue.cc:1048] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.310636 16588 catalog_manager.cc:5697] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 reported cstate change: term changed from 0 to 1, leader changed from <none> to d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d0ea3afb898b4eb5b21faeb676627011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:54.320559 16962 tablet_bootstrap.cc:492] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:54.321336 16962 ts_tablet_manager.cc:1403] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.269s	user 0.011s	sys 0.007s
I20260709 13:05:54.330632 17218 raft_consensus.cc:493] T c80dc47d27a749eab1ffa183f231f036 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.331357 17218 raft_consensus.cc:515] T c80dc47d27a749eab1ffa183f231f036 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:54.336275 16960 tablet_bootstrap.cc:492] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:54.339407 16962 raft_consensus.cc:359] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:54.343660 16962 raft_consensus.cc:385] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.345417 16962 raft_consensus.cc:740] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.342589 17218 leader_election.cc:290] T c80dc47d27a749eab1ffa183f231f036 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:54.347322 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80dc47d27a749eab1ffa183f231f036" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:54.352723 16837 raft_consensus.cc:3060] T 0f6a383a050745a791b07441a3b93828 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.375167 17316 consensus_queue.cc:1048] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.376847 16960 ts_tablet_manager.cc:1403] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.224s	user 0.037s	sys 0.038s
I20260709 13:05:54.381853 16961 tablet_bootstrap.cc:654] T e79d615b8ac14c149720027be9d4dee2 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:54.397598 16728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:45033, user_credentials={real_user=slave}} blocked reactor thread for 154636us
W20260709 13:05:54.406864 16879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37355, user_credentials={real_user=slave}} blocked reactor thread for 46627.7us
I20260709 13:05:54.416785 16910 raft_consensus.cc:3060] T c80dc47d27a749eab1ffa183f231f036 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.418283 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80dc47d27a749eab1ffa183f231f036" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:54.419754 16960 raft_consensus.cc:359] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:54.419519 16586 catalog_manager.cc:5697] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7197bc10b2304fccb972da2da7749e3b (127.8.4.68). New cstate: current_term: 1 leader_uuid: "7197bc10b2304fccb972da2da7749e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.420523 16960 raft_consensus.cc:385] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.432339 16960 raft_consensus.cc:740] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.436107 16877 leader_election.cc:304] T c80dc47d27a749eab1ffa183f231f036 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:54.433360 16960 consensus_queue.cc:260] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:54.431226 16962 consensus_queue.cc:260] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:54.448493 17235 raft_consensus.cc:493] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.450611 17235 raft_consensus.cc:515] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:54.460093 16586 catalog_manager.cc:5697] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7197bc10b2304fccb972da2da7749e3b (127.8.4.68). New cstate: current_term: 1 leader_uuid: "7197bc10b2304fccb972da2da7749e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:54.461961 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772bb23805934270899495ae7c8cbb07" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:54.462729 16765 raft_consensus.cc:2468] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 0.
I20260709 13:05:54.465502 16962 ts_tablet_manager.cc:1434] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.144s	user 0.008s	sys 0.002s
I20260709 13:05:54.466828 16962 tablet_bootstrap.cc:492] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:54.478791 16653 leader_election.cc:304] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:54.484516 16960 ts_tablet_manager.cc:1434] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.107s	user 0.007s	sys 0.000s
I20260709 13:05:54.482239 17316 raft_consensus.cc:2804] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:54.491173 17316 raft_consensus.cc:493] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.491576 17316 raft_consensus.cc:3060] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.493660 17275 raft_consensus.cc:2749] T c80dc47d27a749eab1ffa183f231f036 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:54.497467 16960 tablet_bootstrap.cc:492] T 4e93c7f885494add9735d842339e740a P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:54.497298 17218 raft_consensus.cc:493] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.498024 17218 raft_consensus.cc:515] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:54.498234 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772bb23805934270899495ae7c8cbb07" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:54.500514 17218 leader_election.cc:290] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
W20260709 13:05:54.500722 16654 leader_election.cc:343] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.502219 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ceff4a1d9cf4d75994e64ebab75c551" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:54.477872 17235 leader_election.cc:290] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:54.502941 16837 raft_consensus.cc:2468] T 1ceff4a1d9cf4d75994e64ebab75c551 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:54.503743 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ceff4a1d9cf4d75994e64ebab75c551" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:54.504443 16765 raft_consensus.cc:2468] T 1ceff4a1d9cf4d75994e64ebab75c551 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:54.504480 16878 leader_election.cc:304] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:54.509442 17218 raft_consensus.cc:2804] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:54.509908 17218 raft_consensus.cc:493] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.510277 17218 raft_consensus.cc:3060] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.520761 17271 consensus_queue.cc:1048] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:54.523254 17218 raft_consensus.cc:515] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:54.532335 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ceff4a1d9cf4d75994e64ebab75c551" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:54.533118 16765 raft_consensus.cc:3060] T 1ceff4a1d9cf4d75994e64ebab75c551 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.535729 16960 tablet_bootstrap.cc:654] T 4e93c7f885494add9735d842339e740a P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.549798 16765 raft_consensus.cc:2468] T 1ceff4a1d9cf4d75994e64ebab75c551 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:54.550753 16959 tablet_bootstrap.cc:492] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:54.551362 16959 ts_tablet_manager.cc:1403] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.277s	user 0.036s	sys 0.057s
I20260709 13:05:54.551184 16877 leader_election.cc:304] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:54.552187 17275 raft_consensus.cc:2804] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.552750 17275 raft_consensus.cc:697] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Becoming Leader. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:05:54.553218 17271 raft_consensus.cc:493] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.553675 17275 consensus_queue.cc:237] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:54.553947 17271 raft_consensus.cc:515] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:54.555289 16959 raft_consensus.cc:359] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:54.556221 16959 raft_consensus.cc:385] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.558501 16959 raft_consensus.cc:740] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.559247 17271 leader_election.cc:290] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:54.559098 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49036bff00949ec88900c3537cf5edc" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:54.559098 16836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49036bff00949ec88900c3537cf5edc" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:54.559298 16959 consensus_queue.cc:260] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
W20260709 13:05:54.561154 16730 leader_election.cc:343] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.562737 16959 ts_tablet_manager.cc:1434] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:05:54.566210 16959 tablet_bootstrap.cc:492] T 5f7a4cb12b194107a5bba9336ed37819 P d0ea3afb898b4eb5b21faeb676627011: Bootstrap starting.
I20260709 13:05:54.564960 16961 tablet_bootstrap.cc:492] T e79d615b8ac14c149720027be9d4dee2 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:54.569475 16961 ts_tablet_manager.cc:1403] T e79d615b8ac14c149720027be9d4dee2 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.292s	user 0.020s	sys 0.003s
I20260709 13:05:54.579396 17353 consensus_queue.cc:1048] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:54.572623 16961 raft_consensus.cc:359] T e79d615b8ac14c149720027be9d4dee2 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:54.581758 16961 raft_consensus.cc:385] T e79d615b8ac14c149720027be9d4dee2 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:54.585958 16729 leader_election.cc:343] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.593670 16729 leader_election.cc:304] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:54.594641 17353 raft_consensus.cc:2749] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:54.586316 16961 raft_consensus.cc:740] T e79d615b8ac14c149720027be9d4dee2 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.596679 16961 consensus_queue.cc:260] T e79d615b8ac14c149720027be9d4dee2 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:54.598531 16961 ts_tablet_manager.cc:1434] T e79d615b8ac14c149720027be9d4dee2 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:05:54.599172 16836 raft_consensus.cc:3060] T e79d615b8ac14c149720027be9d4dee2 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.580971 16959 tablet_bootstrap.cc:654] T 5f7a4cb12b194107a5bba9336ed37819 P d0ea3afb898b4eb5b21faeb676627011: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.609035 16961 tablet_bootstrap.cc:492] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:54.613256 17180 consensus_queue.cc:1048] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:54.625742 17239 raft_consensus.cc:493] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.626331 17239 raft_consensus.cc:515] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:54.628785 17239 leader_election.cc:290] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:54.632283 16836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e863dd66af3949e78a0e9882520673fb" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
W20260709 13:05:54.639214 16729 leader_election.cc:343] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.639989 16961 tablet_bootstrap.cc:654] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.650358 17228 consensus_queue.cc:1048] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:54.658704 16962 tablet_bootstrap.cc:654] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.663075 16959 tablet_bootstrap.cc:492] T 5f7a4cb12b194107a5bba9336ed37819 P d0ea3afb898b4eb5b21faeb676627011: No bootstrap required, opened a new log
I20260709 13:05:54.663368 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ceff4a1d9cf4d75994e64ebab75c551" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:54.698998 16837 raft_consensus.cc:3060] T 1ceff4a1d9cf4d75994e64ebab75c551 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.699097 16959 ts_tablet_manager.cc:1403] T 5f7a4cb12b194107a5bba9336ed37819 P d0ea3afb898b4eb5b21faeb676627011: Time spent bootstrapping tablet: real 0.133s	user 0.012s	sys 0.004s
I20260709 13:05:54.663168 17218 leader_election.cc:290] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:54.706648 16837 raft_consensus.cc:2468] T 1ceff4a1d9cf4d75994e64ebab75c551 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:54.707196 16959 raft_consensus.cc:359] T 5f7a4cb12b194107a5bba9336ed37819 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:54.708462 16959 raft_consensus.cc:385] T 5f7a4cb12b194107a5bba9336ed37819 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.708853 16959 raft_consensus.cc:740] T 5f7a4cb12b194107a5bba9336ed37819 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.711874 16959 consensus_queue.cc:260] T 5f7a4cb12b194107a5bba9336ed37819 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:54.638891 17316 raft_consensus.cc:515] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:54.668376 16585 catalog_manager.cc:5697] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7197bc10b2304fccb972da2da7749e3b (127.8.4.68). New cstate: current_term: 1 leader_uuid: "7197bc10b2304fccb972da2da7749e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:54.679605 16961 tablet_bootstrap.cc:492] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:54.718634 16961 ts_tablet_manager.cc:1403] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.110s	user 0.010s	sys 0.007s
I20260709 13:05:54.682165 17228 consensus_queue.cc:1048] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.696480 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e863dd66af3949e78a0e9882520673fb" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:54.726974 16961 raft_consensus.cc:359] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:54.727819 16961 raft_consensus.cc:385] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.728140 16961 raft_consensus.cc:740] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.730661 16961 consensus_queue.cc:260] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:54.760634 17367 raft_consensus.cc:493] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.761355 17367 raft_consensus.cc:515] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:54.764979 17367 leader_election.cc:290] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:54.767477 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772bb23805934270899495ae7c8cbb07" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:54.768543 16689 raft_consensus.cc:2393] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 622433288cac4964aea9ea5a24ba77fd in current term 1: Already voted for candidate 1cbe303821774e4d936ea3d54875dcb8 in this term.
I20260709 13:05:54.772418 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772bb23805934270899495ae7c8cbb07" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:54.773175 16764 raft_consensus.cc:3060] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.779428 16959 ts_tablet_manager.cc:1434] T 5f7a4cb12b194107a5bba9336ed37819 P d0ea3afb898b4eb5b21faeb676627011: Time spent starting tablet: real 0.079s	user 0.009s	sys 0.000s
I20260709 13:05:54.790443 16961 ts_tablet_manager.cc:1434] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.001s
I20260709 13:05:54.814576 16961 tablet_bootstrap.cc:492] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:54.826503 16764 raft_consensus.cc:2468] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 1.
I20260709 13:05:54.827914 16653 leader_election.cc:304] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:54.793239 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772bb23805934270899495ae7c8cbb07" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:54.804893 16762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772bb23805934270899495ae7c8cbb07" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:54.834407 16961 tablet_bootstrap.cc:654] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.842531 16762 raft_consensus.cc:2393] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 622433288cac4964aea9ea5a24ba77fd in current term 1: Already voted for candidate 1cbe303821774e4d936ea3d54875dcb8 in this term.
I20260709 13:05:54.838816 16839 raft_consensus.cc:3060] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.792263 17316 leader_election.cc:290] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:54.844869 16802 leader_election.cc:304] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd; no voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:54.834447 17235 raft_consensus.cc:2804] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:05:54.857520 16728 leader_election.cc:343] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.858161 16728 leader_election.cc:304] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:54.859499 17353 raft_consensus.cc:2749] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:54.857574 17235 raft_consensus.cc:697] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:05:54.866943 16960 tablet_bootstrap.cc:492] T 4e93c7f885494add9735d842339e740a P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:54.867683 16960 ts_tablet_manager.cc:1403] T 4e93c7f885494add9735d842339e740a P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.371s	user 0.074s	sys 0.123s
I20260709 13:05:54.870749 16960 raft_consensus.cc:359] T 4e93c7f885494add9735d842339e740a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:54.871583 16960 raft_consensus.cc:385] T 4e93c7f885494add9735d842339e740a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.871678 16839 raft_consensus.cc:2468] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 1.
I20260709 13:05:54.871987 16960 raft_consensus.cc:740] T 4e93c7f885494add9735d842339e740a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.873190 17366 raft_consensus.cc:2749] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:54.872917 16960 consensus_queue.cc:260] T 4e93c7f885494add9735d842339e740a P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:54.880330 17228 raft_consensus.cc:493] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.880852 17228 raft_consensus.cc:515] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:54.883008 16960 ts_tablet_manager.cc:1434] T 4e93c7f885494add9735d842339e740a P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
W20260709 13:05:54.883730 16728 consensus_peers.cc:597] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 -> Peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Couldn't send request to peer 7197bc10b2304fccb972da2da7749e3b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:54.883947 17218 consensus_queue.cc:1048] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.887485 17228 leader_election.cc:290] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:54.890414 16960 tablet_bootstrap.cc:492] T e3aa4f2f9c5f43b383113ff0d0ad296d P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:54.890821 17235 consensus_queue.cc:237] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:54.894488 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f906a9d133f4a90b55f8dd4ba7d917a" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:54.903098 16960 tablet_bootstrap.cc:654] T e3aa4f2f9c5f43b383113ff0d0ad296d P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:54.911839 16879 leader_election.cc:343] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.914644 16965 raft_consensus.cc:493] T 5f7a4cb12b194107a5bba9336ed37819 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.915244 16965 raft_consensus.cc:515] T 5f7a4cb12b194107a5bba9336ed37819 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:54.921686 16965 leader_election.cc:290] T 5f7a4cb12b194107a5bba9336ed37819 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:54.923712 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7a4cb12b194107a5bba9336ed37819" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
W20260709 13:05:54.936437 16728 leader_election.cc:343] T 5f7a4cb12b194107a5bba9336ed37819 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.942498 16962 tablet_bootstrap.cc:492] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:54.943022 16962 ts_tablet_manager.cc:1403] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.476s	user 0.016s	sys 0.017s
I20260709 13:05:54.941641 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f906a9d133f4a90b55f8dd4ba7d917a" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:54.957886 16960 tablet_bootstrap.cc:492] T e3aa4f2f9c5f43b383113ff0d0ad296d P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:54.973430 16960 ts_tablet_manager.cc:1403] T e3aa4f2f9c5f43b383113ff0d0ad296d P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.012s
I20260709 13:05:54.961184 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7a4cb12b194107a5bba9336ed37819" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:54.977034 16961 tablet_bootstrap.cc:492] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:54.991132 16961 ts_tablet_manager.cc:1403] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.177s	user 0.014s	sys 0.000s
I20260709 13:05:54.977545 16960 raft_consensus.cc:359] T e3aa4f2f9c5f43b383113ff0d0ad296d P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:54.991534 16960 raft_consensus.cc:385] T e3aa4f2f9c5f43b383113ff0d0ad296d P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.991895 16960 raft_consensus.cc:740] T e3aa4f2f9c5f43b383113ff0d0ad296d P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.992643 16960 consensus_queue.cc:260] T e3aa4f2f9c5f43b383113ff0d0ad296d P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:54.994907 16960 ts_tablet_manager.cc:1434] T e3aa4f2f9c5f43b383113ff0d0ad296d P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:05:54.996131 16960 tablet_bootstrap.cc:492] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
W20260709 13:05:55.000383 16878 leader_election.cc:343] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.000917 16878 leader_election.cc:304] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:55.002089 17218 raft_consensus.cc:2749] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.007539 16962 raft_consensus.cc:359] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:55.008373 16962 raft_consensus.cc:385] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.008642 16962 raft_consensus.cc:740] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
W20260709 13:05:55.009325 16730 leader_election.cc:343] T 5f7a4cb12b194107a5bba9336ed37819 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.009858 16730 leader_election.cc:304] T 5f7a4cb12b194107a5bba9336ed37819 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:55.011163 17353 raft_consensus.cc:2749] T 5f7a4cb12b194107a5bba9336ed37819 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.014307 16961 raft_consensus.cc:359] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:55.020565 16961 raft_consensus.cc:385] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.020948 16961 raft_consensus.cc:740] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.009326 16962 consensus_queue.cc:260] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:55.021838 16961 consensus_queue.cc:260] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:55.024082 16962 ts_tablet_manager.cc:1434] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.000s
I20260709 13:05:55.025068 16962 tablet_bootstrap.cc:492] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:55.028916 16961 ts_tablet_manager.cc:1434] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.000s
I20260709 13:05:55.030311 16961 tablet_bootstrap.cc:492] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:55.036092 16962 tablet_bootstrap.cc:654] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.020193 16960 tablet_bootstrap.cc:654] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.040156 16961 tablet_bootstrap.cc:654] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.044507 17226 consensus_queue.cc:1048] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:55.051918 16585 catalog_manager.cc:5697] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.090276 17365 raft_consensus.cc:493] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.093909 17226 raft_consensus.cc:493] T e3aa4f2f9c5f43b383113ff0d0ad296d P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.094574 17226 raft_consensus.cc:515] T e3aa4f2f9c5f43b383113ff0d0ad296d P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:55.090826 17365 raft_consensus.cc:515] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:55.100124 17226 leader_election.cc:290] T e3aa4f2f9c5f43b383113ff0d0ad296d P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:55.100662 17218 consensus_queue.cc:1048] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:55.103477 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f906a9d133f4a90b55f8dd4ba7d917a" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:55.103987 16836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aa4f2f9c5f43b383113ff0d0ad296d" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:55.104184 16912 raft_consensus.cc:2468] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
I20260709 13:05:55.105402 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aa4f2f9c5f43b383113ff0d0ad296d" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:55.108254 16802 leader_election.cc:304] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:55.109428 17366 raft_consensus.cc:2804] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.109866 17366 raft_consensus.cc:493] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.110307 17366 raft_consensus.cc:3060] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.114166 16962 tablet_bootstrap.cc:492] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:55.114749 16962 ts_tablet_manager.cc:1403] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.090s	user 0.018s	sys 0.020s
I20260709 13:05:55.117835 16962 raft_consensus.cc:359] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:55.118614 16962 raft_consensus.cc:385] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.118917 16962 raft_consensus.cc:740] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.119750 16962 consensus_queue.cc:260] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:55.120177 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f906a9d133f4a90b55f8dd4ba7d917a" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:55.120872 16690 raft_consensus.cc:2468] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
I20260709 13:05:55.122375 17365 leader_election.cc:290] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:55.123528 16962 ts_tablet_manager.cc:1434] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 13:05:55.124657 16962 tablet_bootstrap.cc:492] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
W20260709 13:05:55.110321 16878 leader_election.cc:343] T e3aa4f2f9c5f43b383113ff0d0ad296d P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:55.125941 16879 leader_election.cc:343] T e3aa4f2f9c5f43b383113ff0d0ad296d P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.128158 16879 leader_election.cc:304] T e3aa4f2f9c5f43b383113ff0d0ad296d P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:55.129288 17218 raft_consensus.cc:2749] T e3aa4f2f9c5f43b383113ff0d0ad296d P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.132115 17366 raft_consensus.cc:515] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:55.136147 16960 tablet_bootstrap.cc:492] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:55.136721 16960 ts_tablet_manager.cc:1403] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.141s	user 0.002s	sys 0.009s
I20260709 13:05:55.139813 16960 raft_consensus.cc:359] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:55.140540 16960 raft_consensus.cc:385] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.140836 16960 raft_consensus.cc:740] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.149632 16960 consensus_queue.cc:260] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
W20260709 13:05:55.183367 16636 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:55.208014 16960 ts_tablet_manager.cc:1434] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.001s
I20260709 13:05:55.192389 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f906a9d133f4a90b55f8dd4ba7d917a" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:55.294902 16912 raft_consensus.cc:3060] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.297075 16960 tablet_bootstrap.cc:492] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:55.205739 17218 raft_consensus.cc:493] T 4e93c7f885494add9735d842339e740a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.217463 16961 tablet_bootstrap.cc:492] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:55.306258 17218 raft_consensus.cc:515] T 4e93c7f885494add9735d842339e740a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:55.307922 16961 ts_tablet_manager.cc:1403] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.278s	user 0.011s	sys 0.008s
I20260709 13:05:55.168895 16962 tablet_bootstrap.cc:654] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.207297 17366 leader_election.cc:290] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:55.333146 16960 tablet_bootstrap.cc:654] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.313814 17218 leader_election.cc:290] T 4e93c7f885494add9735d842339e740a P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:55.359606 16961 raft_consensus.cc:359] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:55.394591 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f906a9d133f4a90b55f8dd4ba7d917a" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:55.406898 16686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e93c7f885494add9735d842339e740a" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:55.408365 16913 raft_consensus.cc:3060] T 4e93c7f885494add9735d842339e740a P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.416604 16690 raft_consensus.cc:3060] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.423710 17390 raft_consensus.cc:493] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.424753 17390 raft_consensus.cc:515] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:55.411680 16961 raft_consensus.cc:385] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.439334 16961 raft_consensus.cc:740] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.464603 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e93c7f885494add9735d842339e740a" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:55.470053 17390 leader_election.cc:290] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:55.481170 16912 raft_consensus.cc:2468] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:55.507778 16877 leader_election.cc:304] T 4e93c7f885494add9735d842339e740a P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011
W20260709 13:05:55.522703 16878 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:39929, user_credentials={real_user=slave}} blocked reactor thread for 165362us
I20260709 13:05:55.496358 16961 consensus_queue.cc:260] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:55.541808 16761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49036bff00949ec88900c3537cf5edc" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:55.542981 16761 raft_consensus.cc:2468] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 0.
I20260709 13:05:55.564342 17393 raft_consensus.cc:493] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.565044 17393 raft_consensus.cc:515] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:55.567653 17393 leader_election.cc:290] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:55.569789 16802 leader_election.cc:304] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:55.571411 17367 raft_consensus.cc:2804] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.571975 17367 raft_consensus.cc:697] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Becoming Leader. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:05:55.592602 16690 raft_consensus.cc:2468] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:55.621845 16686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aa4f2f9c5f43b383113ff0d0ad296d" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:55.630466 16961 ts_tablet_manager.cc:1434] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.322s	user 0.010s	sys 0.006s
W20260709 13:05:55.632797 16804 leader_election.cc:343] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.659584 17396 raft_consensus.cc:493] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.660466 17396 raft_consensus.cc:515] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:55.669275 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aa4f2f9c5f43b383113ff0d0ad296d" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:55.670274 16914 raft_consensus.cc:2468] T e3aa4f2f9c5f43b383113ff0d0ad296d P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 0.
I20260709 13:05:55.670887 17396 leader_election.cc:290] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:55.665038 17235 consensus_queue.cc:1048] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:55.668337 16962 tablet_bootstrap.cc:492] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:55.605772 17367 consensus_queue.cc:237] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:55.674428 16960 tablet_bootstrap.cc:492] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:55.678043 16962 ts_tablet_manager.cc:1403] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.554s	user 0.021s	sys 0.008s
I20260709 13:05:55.682011 16960 ts_tablet_manager.cc:1403] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.382s	user 0.023s	sys 0.029s
I20260709 13:05:55.687619 17228 raft_consensus.cc:2749] T 4e93c7f885494add9735d842339e740a P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.692174 16961 tablet_bootstrap.cc:492] T bf3d4f25ea4e4b14b6dd55a052daf82c P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:55.694204 16960 raft_consensus.cc:359] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:55.695227 16960 raft_consensus.cc:385] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.695611 16960 raft_consensus.cc:740] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.700088 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce874d8c223464585bd12c973d333b6" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:55.700982 16765 raft_consensus.cc:2468] T 6ce874d8c223464585bd12c973d333b6 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:55.697062 16960 consensus_queue.cc:260] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:55.704123 16687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce874d8c223464585bd12c973d333b6" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:55.704424 16960 ts_tablet_manager.cc:1434] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.002s
I20260709 13:05:55.705878 16877 leader_election.cc:304] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:55.707886 17395 raft_consensus.cc:2804] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.708362 17395 raft_consensus.cc:493] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.708770 17395 raft_consensus.cc:3060] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.722178 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49036bff00949ec88900c3537cf5edc" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:55.727166 16653 leader_election.cc:304] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 
W20260709 13:05:55.727994 16653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:33887, user_credentials={real_user=slave}} blocked reactor thread for 79293us
I20260709 13:05:55.735762 17390 raft_consensus.cc:2804] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.736230 17390 raft_consensus.cc:493] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.736672 17390 raft_consensus.cc:3060] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:55.737357 16654 leader_election.cc:343] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.743007 16962 raft_consensus.cc:359] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:55.743985 16962 raft_consensus.cc:385] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.744359 16962 raft_consensus.cc:740] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
W20260709 13:05:55.738765 16879 leader_election.cc:343] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.780616 16960 tablet_bootstrap.cc:492] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:55.788901 16962 consensus_queue.cc:260] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:55.795883 17316 consensus_queue.cc:1048] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:55.799117 16802 leader_election.cc:304] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:55.800539 17155 raft_consensus.cc:2804] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.803968 17155 raft_consensus.cc:493] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.798489 17395 raft_consensus.cc:515] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:55.832536 16962 ts_tablet_manager.cc:1434] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.154s	user 0.006s	sys 0.004s
I20260709 13:05:55.841337 16962 tablet_bootstrap.cc:492] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:55.824232 17155 raft_consensus.cc:3060] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.862038 16961 tablet_bootstrap.cc:654] T bf3d4f25ea4e4b14b6dd55a052daf82c P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.864733 17404 raft_consensus.cc:493] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.874105 17404 raft_consensus.cc:515] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:55.877342 17404 leader_election.cc:290] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:55.878181 17407 raft_consensus.cc:493] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.879194 16960 tablet_bootstrap.cc:654] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.882131 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522eefb992a4533ad3a9f3ba6634bc8" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:55.882162 16833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522eefb992a4533ad3a9f3ba6634bc8" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:55.863443 17390 raft_consensus.cc:515] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
W20260709 13:05:55.890321 16729 leader_election.cc:343] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.893229 16833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49036bff00949ec88900c3537cf5edc" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
W20260709 13:05:55.895382 16654 leader_election.cc:343] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.892038 17390 leader_election.cc:290] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:55.878770 17407 raft_consensus.cc:515] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:55.905612 17395 leader_election.cc:290] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Requested vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:55.906555 16761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49036bff00949ec88900c3537cf5edc" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:55.907460 16761 raft_consensus.cc:3060] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.908433 16910 raft_consensus.cc:2468] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 0.
I20260709 13:05:55.909363 16835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522eefb992a4533ad3a9f3ba6634bc8" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:55.910895 16765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522eefb992a4533ad3a9f3ba6634bc8" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
W20260709 13:05:55.911177 16878 leader_election.cc:343] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.911659 16765 raft_consensus.cc:2468] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:55.915076 16728 leader_election.cc:304] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:55.916669 16965 raft_consensus.cc:2804] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.917150 16965 raft_consensus.cc:493] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.917508 16965 raft_consensus.cc:3060] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.907610 17407 leader_election.cc:290] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:55.922396 16685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce874d8c223464585bd12c973d333b6" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:55.923121 16685 raft_consensus.cc:3060] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.910953 16762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce874d8c223464585bd12c973d333b6" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:55.925215 16762 raft_consensus.cc:3060] T 6ce874d8c223464585bd12c973d333b6 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.950255 16962 tablet_bootstrap.cc:654] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.955428 16965 raft_consensus.cc:515] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:55.976155 16965 leader_election.cc:290] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:55.991590 16685 raft_consensus.cc:2468] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:55.993237 16877 leader_election.cc:304] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:55.994529 16879 leader_election.cc:304] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:55.995988 17398 raft_consensus.cc:2804] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.996395 17398 raft_consensus.cc:493] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.996765 17398 raft_consensus.cc:3060] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.998680 16833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522eefb992a4533ad3a9f3ba6634bc8" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:55.996526 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522eefb992a4533ad3a9f3ba6634bc8" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
W20260709 13:05:56.001601 16729 leader_election.cc:343] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.996413 17395 raft_consensus.cc:2804] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:56.005951 17395 raft_consensus.cc:697] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Becoming Leader. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:05:56.006958 17395 consensus_queue.cc:237] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:56.020929 16762 raft_consensus.cc:2468] T 6ce874d8c223464585bd12c973d333b6 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:56.032266 17398 raft_consensus.cc:515] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:56.034049 16910 raft_consensus.cc:2393] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d0ea3afb898b4eb5b21faeb676627011 in current term 1: Already voted for candidate 7197bc10b2304fccb972da2da7749e3b in this term.
I20260709 13:05:56.033679 17155 raft_consensus.cc:515] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:56.037954 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522eefb992a4533ad3a9f3ba6634bc8" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:56.038851 16764 raft_consensus.cc:2393] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7197bc10b2304fccb972da2da7749e3b in current term 1: Already voted for candidate d0ea3afb898b4eb5b21faeb676627011 in this term.
I20260709 13:05:56.034591 17398 leader_election.cc:290] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:56.043545 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aa4f2f9c5f43b383113ff0d0ad296d" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:56.044289 16912 raft_consensus.cc:3060] T e3aa4f2f9c5f43b383113ff0d0ad296d P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.044847 17155 leader_election.cc:290] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:56.050838 16686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aa4f2f9c5f43b383113ff0d0ad296d" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:56.055172 16834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522eefb992a4533ad3a9f3ba6634bc8" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
W20260709 13:05:56.057550 16878 leader_election.cc:343] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.058039 16878 leader_election.cc:304] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011
W20260709 13:05:56.059919 16804 leader_election.cc:343] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.060350 17180 raft_consensus.cc:2749] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:56.066663 16728 leader_election.cc:304] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:56.070410 16960 tablet_bootstrap.cc:492] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:56.071130 16960 ts_tablet_manager.cc:1403] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.292s	user 0.008s	sys 0.006s
I20260709 13:05:56.033628 16761 raft_consensus.cc:2468] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 1.
I20260709 13:05:56.073001 16912 raft_consensus.cc:2468] T e3aa4f2f9c5f43b383113ff0d0ad296d P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:56.073912 17403 raft_consensus.cc:2749] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:56.075086 16585 catalog_manager.cc:5697] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 622433288cac4964aea9ea5a24ba77fd (127.8.4.67). New cstate: current_term: 1 leader_uuid: "622433288cac4964aea9ea5a24ba77fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.076785 16653 leader_election.cc:304] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:56.080173 16802 leader_election.cc:304] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:56.081624 16961 tablet_bootstrap.cc:492] T bf3d4f25ea4e4b14b6dd55a052daf82c P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:56.082476 16961 ts_tablet_manager.cc:1403] T bf3d4f25ea4e4b14b6dd55a052daf82c P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.391s	user 0.017s	sys 0.000s
I20260709 13:05:56.082509 17155 raft_consensus.cc:2804] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:56.083160 17155 raft_consensus.cc:697] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Becoming Leader. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:05:56.080468 17280 raft_consensus.cc:2804] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:56.084100 16960 raft_consensus.cc:359] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:56.084026 17155 consensus_queue.cc:237] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:56.085690 17280 raft_consensus.cc:697] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:05:56.085994 16960 raft_consensus.cc:385] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.087528 17280 consensus_queue.cc:237] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:56.081624 16962 tablet_bootstrap.cc:492] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:56.090982 16962 ts_tablet_manager.cc:1403] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.250s	user 0.015s	sys 0.000s
I20260709 13:05:56.086455 16960 raft_consensus.cc:740] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.092078 16960 consensus_queue.cc:260] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:56.095156 16960 ts_tablet_manager.cc:1434] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 13:05:56.096347 16960 tablet_bootstrap.cc:492] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:56.098795 16962 raft_consensus.cc:359] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:56.099810 16962 raft_consensus.cc:385] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.100183 16962 raft_consensus.cc:740] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.101334 16961 raft_consensus.cc:359] T bf3d4f25ea4e4b14b6dd55a052daf82c P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:56.102211 16961 raft_consensus.cc:385] T bf3d4f25ea4e4b14b6dd55a052daf82c P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.090129 16586 catalog_manager.cc:5697] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7197bc10b2304fccb972da2da7749e3b (127.8.4.68). New cstate: current_term: 1 leader_uuid: "7197bc10b2304fccb972da2da7749e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.102931 16961 raft_consensus.cc:740] T bf3d4f25ea4e4b14b6dd55a052daf82c P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.104875 16961 consensus_queue.cc:260] T bf3d4f25ea4e4b14b6dd55a052daf82c P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:56.106623 16960 tablet_bootstrap.cc:654] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.114037 16962 consensus_queue.cc:260] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:56.114948 16961 ts_tablet_manager.cc:1434] T bf3d4f25ea4e4b14b6dd55a052daf82c P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:05:56.112993 16588 catalog_manager.cc:5697] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.118786 16962 ts_tablet_manager.cc:1434] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 13:05:56.119947 16962 tablet_bootstrap.cc:492] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:56.137341 16961 tablet_bootstrap.cc:492] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:56.140946 16960 tablet_bootstrap.cc:492] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:56.141614 16960 ts_tablet_manager.cc:1403] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.002s
I20260709 13:05:56.145143 16960 raft_consensus.cc:359] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:56.146154 16960 raft_consensus.cc:385] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.146543 16960 raft_consensus.cc:740] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.147702 16960 consensus_queue.cc:260] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:56.150007 16962 tablet_bootstrap.cc:654] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.151322 16960 ts_tablet_manager.cc:1434] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:56.153519 16960 tablet_bootstrap.cc:492] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b: Bootstrap starting.
I20260709 13:05:56.161350 16961 tablet_bootstrap.cc:654] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.164127 16962 tablet_bootstrap.cc:492] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:56.164740 16962 ts_tablet_manager.cc:1403] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.001s
I20260709 13:05:56.168334 16960 tablet_bootstrap.cc:654] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.170017 16962 raft_consensus.cc:359] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:56.173211 16962 raft_consensus.cc:385] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.173979 16962 raft_consensus.cc:740] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.174786 16962 consensus_queue.cc:260] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:56.177413 16962 ts_tablet_manager.cc:1434] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:05:56.178887 16962 tablet_bootstrap.cc:492] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:56.180600 16961 tablet_bootstrap.cc:492] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:56.181274 16961 ts_tablet_manager.cc:1403] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.006s
I20260709 13:05:56.185859 17403 raft_consensus.cc:493] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.186894 17403 raft_consensus.cc:515] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:56.192346 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3d4f25ea4e4b14b6dd55a052daf82c" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:56.201350 16685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3d4f25ea4e4b14b6dd55a052daf82c" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:56.201396 17395 raft_consensus.cc:493] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.202450 17395 raft_consensus.cc:515] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
W20260709 13:05:56.203526 16730 leader_election.cc:343] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.200747 17403 leader_election.cc:290] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:56.200697 16838 raft_consensus.cc:2468] T bf3d4f25ea4e4b14b6dd55a052daf82c P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 0.
I20260709 13:05:56.204922 17395 leader_election.cc:290] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:56.205530 16729 leader_election.cc:304] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:56.206676 17403 raft_consensus.cc:2804] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:56.207050 17403 raft_consensus.cc:493] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.207379 17403 raft_consensus.cc:3060] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.207273 17367 consensus_queue.cc:1048] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:56.211232 16761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e863dd66af3949e78a0e9882520673fb" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:56.211714 16962 tablet_bootstrap.cc:654] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.212113 16761 raft_consensus.cc:2468] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:56.217804 16961 raft_consensus.cc:359] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:56.224104 17155 consensus_queue.cc:1048] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:56.248248 16961 raft_consensus.cc:385] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.248624 16961 raft_consensus.cc:740] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.249421 16961 consensus_queue.cc:260] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:56.249775 16877 leader_election.cc:304] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:56.251232 16961 ts_tablet_manager.cc:1434] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 13:05:56.252558 16961 tablet_bootstrap.cc:492] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:56.253643 17407 raft_consensus.cc:2804] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:56.254118 17407 raft_consensus.cc:493] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.254459 17407 raft_consensus.cc:3060] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.256214 17180 raft_consensus.cc:493] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.256759 17180 raft_consensus.cc:515] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:56.228243 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e863dd66af3949e78a0e9882520673fb" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:56.258147 16838 raft_consensus.cc:2468] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:56.259086 17180 leader_election.cc:290] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:56.260041 16689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7a4cb12b194107a5bba9336ed37819" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
W20260709 13:05:56.261555 16879 leader_election.cc:343] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.262996 16761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7a4cb12b194107a5bba9336ed37819" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:56.263787 16960 tablet_bootstrap.cc:492] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b: No bootstrap required, opened a new log
I20260709 13:05:56.265900 16960 ts_tablet_manager.cc:1403] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b: Time spent bootstrapping tablet: real 0.113s	user 0.019s	sys 0.015s
I20260709 13:05:56.263756 16761 raft_consensus.cc:2468] T 5f7a4cb12b194107a5bba9336ed37819 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 0.
I20260709 13:05:56.270218 16877 leader_election.cc:304] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:56.271945 17398 raft_consensus.cc:2804] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:56.272342 17398 raft_consensus.cc:493] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.272708 17398 raft_consensus.cc:3060] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.245698 16585 catalog_manager.cc:5697] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 622433288cac4964aea9ea5a24ba77fd (127.8.4.67). New cstate: current_term: 1 leader_uuid: "622433288cac4964aea9ea5a24ba77fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.231891 17403 raft_consensus.cc:515] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:56.287638 17235 raft_consensus.cc:493] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.288275 17235 raft_consensus.cc:515] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:56.290783 17235 leader_election.cc:290] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:56.293213 16961 tablet_bootstrap.cc:654] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.291031 16960 raft_consensus.cc:359] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:56.296774 16960 raft_consensus.cc:385] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.288684 17407 raft_consensus.cc:515] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:56.297191 16960 raft_consensus.cc:740] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.298291 16960 consensus_queue.cc:260] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:56.296027 16833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3d4f25ea4e4b14b6dd55a052daf82c" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:56.300879 16833 raft_consensus.cc:3060] T bf3d4f25ea4e4b14b6dd55a052daf82c P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.304371 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2a62af17746bcba9f94b6a1053f28" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:56.298944 16835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2a62af17746bcba9f94b6a1053f28" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:56.299674 16761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e863dd66af3949e78a0e9882520673fb" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:56.307889 16761 raft_consensus.cc:3060] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:56.308606 16654 leader_election.cc:343] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.309989 16685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3d4f25ea4e4b14b6dd55a052daf82c" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
W20260709 13:05:56.313283 16730 leader_election.cc:343] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.323370 16761 raft_consensus.cc:2468] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:56.324759 16877 leader_election.cc:304] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:56.325945 17396 raft_consensus.cc:2804] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:56.326453 17396 raft_consensus.cc:697] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Becoming Leader. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:05:56.295488 17403 leader_election.cc:290] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Requested vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:56.327299 17396 consensus_queue.cc:237] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:56.328403 16910 raft_consensus.cc:2468] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 0.
I20260709 13:05:56.330780 16653 leader_election.cc:304] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b; no voters: 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:56.332042 17390 raft_consensus.cc:2804] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:56.332515 17390 raft_consensus.cc:493] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.332926 17390 raft_consensus.cc:3060] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.336248 17407 leader_election.cc:290] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:56.338698 16960 ts_tablet_manager.cc:1434] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b: Time spent starting tablet: real 0.052s	user 0.001s	sys 0.005s
I20260709 13:05:56.343391 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e863dd66af3949e78a0e9882520673fb" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:56.352360 16838 raft_consensus.cc:3060] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.347648 16962 tablet_bootstrap.cc:492] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:56.363147 16962 ts_tablet_manager.cc:1403] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.185s	user 0.008s	sys 0.018s
I20260709 13:05:56.349156 16833 raft_consensus.cc:2468] T bf3d4f25ea4e4b14b6dd55a052daf82c P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
I20260709 13:05:56.364516 16729 leader_election.cc:304] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:56.367713 17398 raft_consensus.cc:515] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:56.365702 17403 raft_consensus.cc:2804] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:56.374538 17403 raft_consensus.cc:697] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Becoming Leader. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:05:56.375761 17403 consensus_queue.cc:237] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:56.388988 17398 leader_election.cc:290] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Requested vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:56.380232 16838 raft_consensus.cc:2468] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:56.387223 16962 raft_consensus.cc:359] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:56.393846 16962 raft_consensus.cc:385] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.394373 16962 raft_consensus.cc:740] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.396046 16761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7a4cb12b194107a5bba9336ed37819" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:56.396926 16761 raft_consensus.cc:3060] T 5f7a4cb12b194107a5bba9336ed37819 P d0ea3afb898b4eb5b21faeb676627011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.396982 16962 consensus_queue.cc:260] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:56.401798 17390 raft_consensus.cc:515] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
W20260709 13:05:56.410364 16636 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:56.419463 16685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7a4cb12b194107a5bba9336ed37819" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
I20260709 13:05:56.421713 16685 raft_consensus.cc:3060] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.426820 16761 raft_consensus.cc:2468] T 5f7a4cb12b194107a5bba9336ed37819 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:56.428375 16877 leader_election.cc:304] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:56.429335 17395 raft_consensus.cc:2804] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:56.429883 17395 raft_consensus.cc:697] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Becoming Leader. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:05:56.430753 17395 consensus_queue.cc:237] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:56.431715 16685 raft_consensus.cc:2468] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:56.437856 16961 tablet_bootstrap.cc:492] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:56.438086 16586 catalog_manager.cc:5697] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7197bc10b2304fccb972da2da7749e3b (127.8.4.68). New cstate: current_term: 1 leader_uuid: "7197bc10b2304fccb972da2da7749e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:56.442276 16961 ts_tablet_manager.cc:1403] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.190s	user 0.014s	sys 0.016s
I20260709 13:05:56.445935 16961 raft_consensus.cc:359] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:56.446827 16961 raft_consensus.cc:385] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.447144 16961 raft_consensus.cc:740] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.447903 16961 consensus_queue.cc:260] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:56.451325 16961 ts_tablet_manager.cc:1434] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:05:56.457800 16962 ts_tablet_manager.cc:1434] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.094s	user 0.008s	sys 0.000s
I20260709 13:05:56.459810 16962 tablet_bootstrap.cc:492] T bf3d4f25ea4e4b14b6dd55a052daf82c P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:56.458225 16961 tablet_bootstrap.cc:492] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:56.467726 17390 leader_election.cc:290] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:56.472245 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2a62af17746bcba9f94b6a1053f28" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:56.484182 16912 raft_consensus.cc:3060] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.476101 16961 tablet_bootstrap.cc:654] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.479421 16833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2a62af17746bcba9f94b6a1053f28" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:56.485539 16833 raft_consensus.cc:3060] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.501164 17390 raft_consensus.cc:493] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.501771 17390 raft_consensus.cc:515] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:56.503530 16833 raft_consensus.cc:2468] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 1.
I20260709 13:05:56.505208 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aa4f2f9c5f43b383113ff0d0ad296d" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:56.505474 16835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aa4f2f9c5f43b383113ff0d0ad296d" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:56.506078 16914 raft_consensus.cc:2393] T e3aa4f2f9c5f43b383113ff0d0ad296d P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1cbe303821774e4d936ea3d54875dcb8 in current term 1: Already voted for candidate 622433288cac4964aea9ea5a24ba77fd in this term.
I20260709 13:05:56.504012 17390 leader_election.cc:290] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:56.507750 16653 leader_election.cc:304] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8; no voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:56.508534 17390 raft_consensus.cc:3060] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.511965 16654 leader_election.cc:304] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd; no voters: 
I20260709 13:05:56.511344 16588 catalog_manager.cc:5697] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 reported cstate change: term changed from 0 to 1, leader changed from <none> to d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "d0ea3afb898b4eb5b21faeb676627011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.517800 17180 consensus_queue.cc:1048] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.511941 16585 catalog_manager.cc:5697] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7197bc10b2304fccb972da2da7749e3b (127.8.4.68). New cstate: current_term: 1 leader_uuid: "7197bc10b2304fccb972da2da7749e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.519258 17280 raft_consensus.cc:2804] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:56.527367 17280 raft_consensus.cc:697] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
W20260709 13:05:56.521821 16654 consensus_peers.cc:597] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 -> Peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Couldn't send request to peer 622433288cac4964aea9ea5a24ba77fd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:56.528280 17280 consensus_queue.cc:237] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:56.532615 17390 raft_consensus.cc:2749] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:56.540338 16961 tablet_bootstrap.cc:492] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:56.540971 16961 ts_tablet_manager.cc:1403] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.083s	user 0.012s	sys 0.012s
I20260709 13:05:56.543680 17400 consensus_queue.cc:1048] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:56.544183 16961 raft_consensus.cc:359] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:56.545074 16961 raft_consensus.cc:385] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.545396 16961 raft_consensus.cc:740] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.550625 16961 consensus_queue.cc:260] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:56.559588 16961 ts_tablet_manager.cc:1434] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 13:05:56.562032 16961 tablet_bootstrap.cc:492] T c522eefb992a4533ad3a9f3ba6634bc8 P 622433288cac4964aea9ea5a24ba77fd: Bootstrap starting.
I20260709 13:05:56.569614 16961 tablet_bootstrap.cc:654] T c522eefb992a4533ad3a9f3ba6634bc8 P 622433288cac4964aea9ea5a24ba77fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.574577 16912 raft_consensus.cc:2468] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 1.
I20260709 13:05:56.581701 16961 tablet_bootstrap.cc:492] T c522eefb992a4533ad3a9f3ba6634bc8 P 622433288cac4964aea9ea5a24ba77fd: No bootstrap required, opened a new log
I20260709 13:05:56.582312 16961 ts_tablet_manager.cc:1403] T c522eefb992a4533ad3a9f3ba6634bc8 P 622433288cac4964aea9ea5a24ba77fd: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 13:05:56.585850 16961 raft_consensus.cc:359] T c522eefb992a4533ad3a9f3ba6634bc8 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:56.586891 16961 raft_consensus.cc:385] T c522eefb992a4533ad3a9f3ba6634bc8 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.587267 16961 raft_consensus.cc:740] T c522eefb992a4533ad3a9f3ba6634bc8 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.588009 16961 consensus_queue.cc:260] T c522eefb992a4533ad3a9f3ba6634bc8 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:56.591892 16961 ts_tablet_manager.cc:1434] T c522eefb992a4533ad3a9f3ba6634bc8 P 622433288cac4964aea9ea5a24ba77fd: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:05:56.592357 16962 tablet_bootstrap.cc:654] T bf3d4f25ea4e4b14b6dd55a052daf82c P 1cbe303821774e4d936ea3d54875dcb8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.600519 17180 consensus_queue.cc:1048] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:56.607493 17393 consensus_queue.cc:1048] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:56.648284 17280 consensus_queue.cc:1048] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.648170 16585 catalog_manager.cc:5697] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:56.671317 16962 tablet_bootstrap.cc:492] T bf3d4f25ea4e4b14b6dd55a052daf82c P 1cbe303821774e4d936ea3d54875dcb8: No bootstrap required, opened a new log
I20260709 13:05:56.671864 16962 ts_tablet_manager.cc:1403] T bf3d4f25ea4e4b14b6dd55a052daf82c P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.212s	user 0.024s	sys 0.020s
I20260709 13:05:56.676987 16962 raft_consensus.cc:359] T bf3d4f25ea4e4b14b6dd55a052daf82c P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:56.679064 16962 raft_consensus.cc:385] T bf3d4f25ea4e4b14b6dd55a052daf82c P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.679339 16962 raft_consensus.cc:740] T bf3d4f25ea4e4b14b6dd55a052daf82c P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.681447 16962 consensus_queue.cc:260] T bf3d4f25ea4e4b14b6dd55a052daf82c P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:56.683557 16962 ts_tablet_manager.cc:1434] T bf3d4f25ea4e4b14b6dd55a052daf82c P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:05:56.771068 17180 consensus_queue.cc:1048] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.771803 17396 consensus_queue.cc:1048] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.801978 17367 raft_consensus.cc:493] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.802616 17367 raft_consensus.cc:515] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:56.813300 16685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49036bff00949ec88900c3537cf5edc" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cbe303821774e4d936ea3d54875dcb8" is_pre_election: true
I20260709 13:05:56.817054 16761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49036bff00949ec88900c3537cf5edc" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:56.818751 16802 leader_election.cc:304] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd; no voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:56.819614 17393 raft_consensus.cc:2749] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:56.820057 17367 leader_election.cc:290] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:56.846307 17403 consensus_queue.cc:1048] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:56.862448 16685 raft_consensus.cc:3060] T bf3d4f25ea4e4b14b6dd55a052daf82c P 1cbe303821774e4d936ea3d54875dcb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.876747 17404 consensus_queue.cc:1048] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.895550 17395 consensus_queue.cc:1048] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.916033 17395 consensus_queue.cc:1048] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.980172 16833 raft_consensus.cc:3060] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.027283 17392 consensus_queue.cc:1048] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.040742 17280 consensus_queue.cc:1048] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:57.047194 17400 raft_consensus.cc:493] T c522eefb992a4533ad3a9f3ba6634bc8 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.047770 17400 raft_consensus.cc:515] T c522eefb992a4533ad3a9f3ba6634bc8 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:57.050993 16762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522eefb992a4533ad3a9f3ba6634bc8" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:57.052207 16762 raft_consensus.cc:2393] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 622433288cac4964aea9ea5a24ba77fd in current term 1: Already voted for candidate d0ea3afb898b4eb5b21faeb676627011 in this term.
I20260709 13:05:57.052902 17400 leader_election.cc:290] T c522eefb992a4533ad3a9f3ba6634bc8 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:05:57.054472 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522eefb992a4533ad3a9f3ba6634bc8" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:57.055385 16912 raft_consensus.cc:2393] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 622433288cac4964aea9ea5a24ba77fd in current term 1: Already voted for candidate 7197bc10b2304fccb972da2da7749e3b in this term.
I20260709 13:05:57.056859 16802 leader_election.cc:304] T c522eefb992a4533ad3a9f3ba6634bc8 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd; no voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:57.057933 17400 raft_consensus.cc:3060] T c522eefb992a4533ad3a9f3ba6634bc8 P 622433288cac4964aea9ea5a24ba77fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.070281 17400 raft_consensus.cc:2749] T c522eefb992a4533ad3a9f3ba6634bc8 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:57.473971 16636 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:57.647495 17395 raft_consensus.cc:493] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.648104 17395 raft_consensus.cc:515] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:57.650089 17395 leader_election.cc:290] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:57.650738 16762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522eefb992a4533ad3a9f3ba6634bc8" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:57.651459 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522eefb992a4533ad3a9f3ba6634bc8" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:57.651647 16762 raft_consensus.cc:2468] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:57.652076 16838 raft_consensus.cc:2468] T c522eefb992a4533ad3a9f3ba6634bc8 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:57.652894 16877 leader_election.cc:304] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:57.654150 17395 raft_consensus.cc:2804] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:57.654522 17395 raft_consensus.cc:493] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.654865 17395 raft_consensus.cc:3060] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.662325 17395 raft_consensus.cc:515] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:57.665153 17395 leader_election.cc:290] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:57.665071 16762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522eefb992a4533ad3a9f3ba6634bc8" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:57.665800 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522eefb992a4533ad3a9f3ba6634bc8" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:57.665968 16762 raft_consensus.cc:3060] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.666404 16838 raft_consensus.cc:3060] T c522eefb992a4533ad3a9f3ba6634bc8 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.674069 16762 raft_consensus.cc:2468] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 2.
I20260709 13:05:57.674278 16838 raft_consensus.cc:2468] T c522eefb992a4533ad3a9f3ba6634bc8 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 2.
I20260709 13:05:57.675691 16878 leader_election.cc:304] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:57.676586 17395 raft_consensus.cc:2804] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:57.677151 17395 raft_consensus.cc:697] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [term 2 LEADER]: Becoming Leader. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:05:57.677939 17395 consensus_queue.cc:237] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:05:57.687512 16585 catalog_manager.cc:5697] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b reported cstate change: term changed from 0 to 2, leader changed from <none> to 7197bc10b2304fccb972da2da7749e3b (127.8.4.68). New cstate: current_term: 2 leader_uuid: "7197bc10b2304fccb972da2da7749e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:58.127307 16761 raft_consensus.cc:1275] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Refusing update from remote peer 7197bc10b2304fccb972da2da7749e3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:05:58.129534 17453 consensus_queue.cc:1048] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.149976 16833 raft_consensus.cc:1275] T c522eefb992a4533ad3a9f3ba6634bc8 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Refusing update from remote peer 7197bc10b2304fccb972da2da7749e3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:05:58.151427 17395 consensus_queue.cc:1048] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.246140  8209 tablet_server.cc:179] TabletServer@127.8.4.65:0 shutting down...
W20260709 13:05:58.290130 16879 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 512 similar messages]
W20260709 13:05:58.298497 16879 consensus_peers.cc:597] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.304150  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:58.306329  8209 tablet_replica.cc:333] T bf3d4f25ea4e4b14b6dd55a052daf82c P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.307264  8209 raft_consensus.cc:2243] T bf3d4f25ea4e4b14b6dd55a052daf82c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.307772  8209 raft_consensus.cc:2272] T bf3d4f25ea4e4b14b6dd55a052daf82c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:58.308156 16804 consensus_peers.cc:597] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.310057  8209 tablet_replica.cc:333] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.310781  8209 raft_consensus.cc:2243] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.311221  8209 raft_consensus.cc:2272] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.313877  8209 tablet_replica.cc:333] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.314845  8209 raft_consensus.cc:2243] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:58.315910  8209 raft_consensus.cc:2272] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.318712  8209 tablet_replica.cc:333] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.319787  8209 raft_consensus.cc:2243] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:58.320891  8209 raft_consensus.cc:2272] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.324904  8209 tablet_replica.cc:333] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.326082  8209 raft_consensus.cc:2243] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.326944  8209 raft_consensus.cc:2272] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.330350  8209 tablet_replica.cc:333] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.331135  8209 raft_consensus.cc:2243] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:05:58.331552 16730 consensus_peers.cc:597] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.332074  8209 raft_consensus.cc:2272] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.334998  8209 tablet_replica.cc:333] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.336210  8209 raft_consensus.cc:2243] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.336863  8209 raft_consensus.cc:2272] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.340385  8209 tablet_replica.cc:333] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
W20260709 13:05:58.340358 16879 consensus_peers.cc:597] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.342463  8209 raft_consensus.cc:2243] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.342929  8209 raft_consensus.cc:2272] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.344759  8209 tablet_replica.cc:333] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.346036  8209 raft_consensus.cc:2243] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:58.347162  8209 raft_consensus.cc:2272] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:58.349361 16879 consensus_peers.cc:597] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.350229  8209 tablet_replica.cc:333] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.351325  8209 raft_consensus.cc:2243] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:58.352326  8209 raft_consensus.cc:2272] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.354871  8209 tablet_replica.cc:333] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.355607  8209 raft_consensus.cc:2243] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.356143  8209 raft_consensus.cc:2272] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.358611  8209 tablet_replica.cc:333] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.359316  8209 raft_consensus.cc:2243] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:58.360656  8209 raft_consensus.cc:2272] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.364032  8209 tablet_replica.cc:333] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.364943  8209 raft_consensus.cc:2243] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.365574  8209 raft_consensus.cc:2272] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:58.365970 16879 consensus_peers.cc:597] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.369189  8209 tablet_replica.cc:333] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.370064  8209 raft_consensus.cc:2243] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.370500  8209 raft_consensus.cc:2272] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.373334  8209 tablet_replica.cc:333] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.374019  8209 raft_consensus.cc:2243] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.374475  8209 raft_consensus.cc:2272] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.377377  8209 tablet_replica.cc:333] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.378221  8209 raft_consensus.cc:2243] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.378818  8209 raft_consensus.cc:2272] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.382004  8209 tablet_replica.cc:333] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.382911  8209 raft_consensus.cc:2243] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.383536  8209 raft_consensus.cc:2272] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:58.385349 16730 consensus_peers.cc:597] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.386788  8209 tablet_replica.cc:333] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.387544  8209 raft_consensus.cc:2243] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.388088  8209 raft_consensus.cc:2272] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.390512  8209 tablet_replica.cc:333] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.391249  8209 raft_consensus.cc:2243] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:58.392169  8209 raft_consensus.cc:2272] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.394659  8209 tablet_replica.cc:333] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.395517  8209 raft_consensus.cc:2243] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.396123  8209 raft_consensus.cc:2272] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.399317  8209 tablet_replica.cc:333] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.400046  8209 raft_consensus.cc:2243] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.400604  8209 raft_consensus.cc:2272] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:58.401623 16730 consensus_peers.cc:597] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.403095  8209 tablet_replica.cc:333] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.403888  8209 raft_consensus.cc:2243] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.404393  8209 raft_consensus.cc:2272] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.407112  8209 tablet_replica.cc:333] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.408002  8209 raft_consensus.cc:2243] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.408644  8209 raft_consensus.cc:2272] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:58.408460 16730 consensus_peers.cc:597] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.411382  8209 tablet_replica.cc:333] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.412061  8209 raft_consensus.cc:2243] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.412550  8209 raft_consensus.cc:2272] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.415668  8209 tablet_replica.cc:333] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.416491  8209 raft_consensus.cc:2243] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.417295  8209 raft_consensus.cc:2272] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.420408  8209 tablet_replica.cc:333] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.421051  8209 raft_consensus.cc:2243] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.421527  8209 raft_consensus.cc:2272] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.423979  8209 tablet_replica.cc:333] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.424714  8209 raft_consensus.cc:2243] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:58.425751  8209 raft_consensus.cc:2272] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.428311  8209 tablet_replica.cc:333] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
W20260709 13:05:58.428586 16730 consensus_peers.cc:597] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.429158  8209 raft_consensus.cc:2243] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.429659  8209 raft_consensus.cc:2272] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.431802  8209 tablet_replica.cc:333] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.432621  8209 raft_consensus.cc:2243] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.433132  8209 raft_consensus.cc:2272] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.436511  8209 tablet_replica.cc:333] T 16b4be927a834597b7190497210b9169 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.437348  8209 raft_consensus.cc:2243] T 16b4be927a834597b7190497210b9169 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:58.437429 16804 consensus_peers.cc:597] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.437960  8209 raft_consensus.cc:2272] T 16b4be927a834597b7190497210b9169 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.440922  8209 tablet_replica.cc:333] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.441867  8209 raft_consensus.cc:2243] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:58.443323  8209 raft_consensus.cc:2272] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.447283  8209 tablet_replica.cc:333] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.448225  8209 raft_consensus.cc:2243] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.448824  8209 raft_consensus.cc:2272] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:58.449326 16804 consensus_peers.cc:597] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.452059  8209 tablet_replica.cc:333] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.452877  8209 raft_consensus.cc:2243] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.453537  8209 raft_consensus.cc:2272] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:58.454226 16879 consensus_peers.cc:597] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.456586  8209 tablet_replica.cc:333] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.457479  8209 raft_consensus.cc:2243] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.457896  8209 raft_consensus.cc:2272] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.460084  8209 tablet_replica.cc:333] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.460685  8209 raft_consensus.cc:2243] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.461148  8209 raft_consensus.cc:2272] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.463874  8209 tablet_replica.cc:333] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.464627  8209 raft_consensus.cc:2243] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:58.465623  8209 raft_consensus.cc:2272] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.467918  8209 tablet_replica.cc:333] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.468498  8209 raft_consensus.cc:2243] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.468961  8209 raft_consensus.cc:2272] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.471014  8209 tablet_replica.cc:333] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.471869  8209 raft_consensus.cc:2243] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:58.472658  8209 raft_consensus.cc:2272] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.474745  8209 tablet_replica.cc:333] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.475343  8209 raft_consensus.cc:2243] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.475824  8209 raft_consensus.cc:2272] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.478271  8209 tablet_replica.cc:333] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.478889  8209 raft_consensus.cc:2243] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:58.480013  8209 raft_consensus.cc:2272] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.482895  8209 tablet_replica.cc:333] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.484237  8209 raft_consensus.cc:2243] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.485100  8209 raft_consensus.cc:2272] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:58.486203 16879 consensus_peers.cc:597] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.488576  8209 tablet_replica.cc:333] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.489392  8209 raft_consensus.cc:2243] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.489995  8209 raft_consensus.cc:2272] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.493194  8209 tablet_replica.cc:333] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.493916  8209 raft_consensus.cc:2243] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.494557  8209 raft_consensus.cc:2272] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:58.495085 16879 consensus_peers.cc:597] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.497184  8209 tablet_replica.cc:333] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.497920  8209 raft_consensus.cc:2243] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:58.499158  8209 raft_consensus.cc:2272] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.501883  8209 tablet_replica.cc:333] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8: stopping tablet replica
I20260709 13:05:58.502511  8209 raft_consensus.cc:2243] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.503111  8209 raft_consensus.cc:2272] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:58.508582 16879 consensus_peers.cc:597] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:58.510056 16730 consensus_peers.cc:597] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:58.541116 16804 consensus_peers.cc:597] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:58.542141 16804 consensus_peers.cc:597] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:58.570326 16730 consensus_peers.cc:597] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:58.574030 16804 consensus_peers.cc:597] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:58.576828 16730 consensus_peers.cc:597] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:58.578636 16730 consensus_peers.cc:597] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.588714  8209 tablet_server.cc:196] TabletServer@127.8.4.65:0 shutdown complete.
W20260709 13:05:58.601761 16804 consensus_peers.cc:597] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:58.615331 16879 consensus_peers.cc:597] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:58.644865 16804 consensus_peers.cc:597] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:58.670312 16730 consensus_peers.cc:597] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.692252  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:58.702361 17475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:58.705185 17476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:58.712018 16879 consensus_peers.cc:597] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:58.718387 16804 consensus_peers.cc:597] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:58.719051 16804 consensus_peers.cc:597] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:58.720479 17478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:58.722086  8209 server_base.cc:1061] running on GCE node
W20260709 13:05:58.727049 16730 consensus_peers.cc:597] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.730120  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:58.730582  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:58.730876  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602358730854 us; error 0 us; skew 500 ppm
I20260709 13:05:58.731914  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:58.737610  8209 webserver.cc:533] Webserver started at http://127.8.4.65:45733/ using document root <none> and password file <none>
I20260709 13:05:58.738269  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:58.738466  8209 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 13:05:58.741703 16879 consensus_peers.cc:597] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.744369  8209 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:05:58.757187 17484 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:58.758097  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:05:58.758450  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-0-root
uuid: "1cbe303821774e4d936ea3d54875dcb8"
format_stamp: "Formatted at 2026-07-09 13:05:44 on dist-test-slave-008w"
I20260709 13:05:58.759002  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602095438975-8209-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:58.782027  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:58.783702  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:58.785876  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:58.792992 17491 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:05:59.155418  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:05:59.155825  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.364s	user 0.009s	sys 0.001s
I20260709 13:05:59.156158  8209 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:05:59.169229 17491 tablet_bootstrap.cc:492] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:59.213212 17491 tablet_bootstrap.cc:492] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:59.214121 17491 tablet_bootstrap.cc:492] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:05:59.214740 17491 ts_tablet_manager.cc:1403] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.046s	user 0.026s	sys 0.016s
I20260709 13:05:59.216951 17491 raft_consensus.cc:359] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:59.217782 17491 raft_consensus.cc:740] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.218454 17491 consensus_queue.cc:260] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:59.220929 17491 ts_tablet_manager.cc:1434] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:05:59.221787 17491 tablet_bootstrap.cc:492] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:59.241264 17491 tablet_bootstrap.cc:492] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:59.242254 17491 tablet_bootstrap.cc:492] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:05:59.242908 17491 ts_tablet_manager.cc:1403] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 13:05:59.244861 17491 raft_consensus.cc:359] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:59.245533 17491 raft_consensus.cc:740] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.246198 17491 consensus_queue.cc:260] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:59.247648 17491 ts_tablet_manager.cc:1434] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:59.248299 17491 tablet_bootstrap.cc:492] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:59.269634 17491 tablet_bootstrap.cc:492] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:59.270664 17491 tablet_bootstrap.cc:492] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:05:59.271602 17491 ts_tablet_manager.cc:1403] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.000s
I20260709 13:05:59.274281 17491 raft_consensus.cc:359] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:59.274968 17491 raft_consensus.cc:740] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.275772 17491 consensus_queue.cc:260] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:59.279230 17491 ts_tablet_manager.cc:1434] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:05:59.280052 17491 tablet_bootstrap.cc:492] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:59.303335 17491 tablet_bootstrap.cc:492] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:59.304419 17491 tablet_bootstrap.cc:492] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:05:59.305058 17492 raft_consensus.cc:493] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.305217 17491 ts_tablet_manager.cc:1403] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.000s
I20260709 13:05:59.305701 17492 raft_consensus.cc:515] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:59.308207 17491 raft_consensus.cc:359] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:59.309113 17491 raft_consensus.cc:740] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.309861 17491 consensus_queue.cc:260] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:59.310254 17492 leader_election.cc:290] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:59.311046 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772bb23805934270899495ae7c8cbb07" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:59.312441 17491 ts_tablet_manager.cc:1434] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:59.313534 17491 tablet_bootstrap.cc:492] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:59.323342 17396 raft_consensus.cc:493] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.323958 17396 raft_consensus.cc:515] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:59.327610 17492 raft_consensus.cc:493] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.328205 17492 raft_consensus.cc:515] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:59.330042 17491 tablet_bootstrap.cc:492] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:59.330605 17492 leader_election.cc:290] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:59.331071 17491 tablet_bootstrap.cc:492] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:05:59.331849 17491 ts_tablet_manager.cc:1403] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 13:05:59.335064 17491 raft_consensus.cc:359] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:59.335779 17491 raft_consensus.cc:740] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.336608 17491 consensus_queue.cc:260] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:59.336629 17396 leader_election.cc:290] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:59.337106 16761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f610e2abe7b467facd521257722760d" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:59.338354 17463 raft_consensus.cc:493] T 0f6a383a050745a791b07441a3b93828 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.338665 17491 ts_tablet_manager.cc:1434] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:59.338992 17463 raft_consensus.cc:515] T 0f6a383a050745a791b07441a3b93828 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:59.339579 17491 tablet_bootstrap.cc:492] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:59.341507 17463 leader_election.cc:290] T 0f6a383a050745a791b07441a3b93828 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:59.339778 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d0c8416cdc43289eceaddcbd00a20e" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
W20260709 13:05:59.348179 16804 leader_election.cc:336] T 0f6a383a050745a791b07441a3b93828 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:05:59.348361 16761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6a383a050745a791b07441a3b93828" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:59.349999 16802 leader_election.cc:304] T 0f6a383a050745a791b07441a3b93828 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd; no voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:59.351155 17463 raft_consensus.cc:2749] T 0f6a383a050745a791b07441a3b93828 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.370666 17453 raft_consensus.cc:493] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.371446 17453 raft_consensus.cc:515] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:59.377472 17453 leader_election.cc:290] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:59.383894 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d0c8416cdc43289eceaddcbd00a20e" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:59.384867 16764 raft_consensus.cc:2468] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:59.388598 16877 leader_election.cc:304] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:59.390076 17493 raft_consensus.cc:2804] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:59.390576 17493 raft_consensus.cc:493] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.390936 17493 raft_consensus.cc:3060] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:59.402633 16879 leader_election.cc:336] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:05:59.407166 16879 leader_election.cc:304] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:59.410683 17497 raft_consensus.cc:493] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.411352 17497 raft_consensus.cc:515] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
W20260709 13:05:59.426875 16804 leader_election.cc:336] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:05:59.434021 17395 raft_consensus.cc:2749] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.440919 17498 raft_consensus.cc:493] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.441258 17497 leader_election.cc:290] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:59.441553 17498 raft_consensus.cc:515] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:59.443729 16762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f0df42f20d4d9398c8d4b5b3cba4ea" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:59.446787 17498 leader_election.cc:290] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
W20260709 13:05:59.450659 16879 leader_election.cc:336] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:05:59.453228 17395 raft_consensus.cc:493] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.453902 17395 raft_consensus.cc:515] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:59.460057 16762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e982a881834665b4845c226db01020" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:59.461443 16802 leader_election.cc:304] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd; no voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:59.463099 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c91dff9e8c4ab78bacda0d282beacf" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:59.463333 17502 raft_consensus.cc:2749] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.468272 17395 leader_election.cc:290] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:59.470875 17502 raft_consensus.cc:493] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.471581 17502 raft_consensus.cc:515] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:59.475356 17502 leader_election.cc:290] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
W20260709 13:05:59.482878 16879 leader_election.cc:336] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:05:59.483486 16879 leader_election.cc:304] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:59.484337 17453 raft_consensus.cc:2749] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.485330 17493 raft_consensus.cc:515] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:59.488543 16762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49036bff00949ec88900c3537cf5edc" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
W20260709 13:05:59.491480 16730 leader_election.cc:336] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:05:59.492008 16730 leader_election.cc:304] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:59.492791 17492 raft_consensus.cc:2749] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:59.493855 16730 leader_election.cc:336] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:05:59.494284 16730 leader_election.cc:304] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:59.495033 17492 raft_consensus.cc:2749] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.495362 16762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d0c8416cdc43289eceaddcbd00a20e" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:59.496120 16762 raft_consensus.cc:3060] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:59.502677 16879 leader_election.cc:336] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:05:59.506351 16762 raft_consensus.cc:2468] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 2.
W20260709 13:05:59.507100 16730 leader_election.cc:336] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:05:59.506383 17493 leader_election.cc:290] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 election: Requested vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:59.507805 16877 leader_election.cc:304] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:59.509374 16730 leader_election.cc:304] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:59.510320 17492 raft_consensus.cc:2749] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.510440 17493 raft_consensus.cc:2804] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:59.511754 17493 raft_consensus.cc:697] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 2 LEADER]: Becoming Leader. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:05:59.513018 17491 tablet_bootstrap.cc:492] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:59.512861 17493 consensus_queue.cc:237] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:59.514019 17491 tablet_bootstrap.cc:492] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:05:59.514725 17491 ts_tablet_manager.cc:1403] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.175s	user 0.046s	sys 0.111s
W20260709 13:05:59.508669 16804 leader_election.cc:336] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:05:59.515766 16804 leader_election.cc:304] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd; no voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:59.518182 17491 raft_consensus.cc:359] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:59.519130 17491 raft_consensus.cc:740] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.519304 17497 raft_consensus.cc:2749] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.520241 17491 consensus_queue.cc:260] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:59.524613 17497 raft_consensus.cc:493] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.525234 17497 raft_consensus.cc:515] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:59.528107 17453 raft_consensus.cc:493] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.528721 17453 raft_consensus.cc:515] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:59.531052 17453 leader_election.cc:290] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:59.535514 17497 leader_election.cc:290] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
W20260709 13:05:59.536605 16879 leader_election.cc:336] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:05:59.539193 17491 ts_tablet_manager.cc:1434] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:05:59.542997 17491 tablet_bootstrap.cc:492] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:59.541561 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2a62af17746bcba9f94b6a1053f28" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:59.544307  8209 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:05:59.544739  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.389s	user 0.346s	sys 0.001s
I20260709 13:05:59.545173 16762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2500d1c1df2649d99c7a5e1146e771d9" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:59.546311 16878 leader_election.cc:304] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:59.547458 17453 raft_consensus.cc:2749] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.549088 17497 raft_consensus.cc:493] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.549981 17497 raft_consensus.cc:515] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:59.553902 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661f1f2dcacb42bca7e3b25195dbdfe1" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:59.562358 17497 leader_election.cc:290] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:59.570000 17491 tablet_bootstrap.cc:492] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:59.571249 17491 tablet_bootstrap.cc:492] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:05:59.571978 17491 ts_tablet_manager.cc:1403] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.029s	user 0.023s	sys 0.000s
I20260709 13:05:59.575793 17491 raft_consensus.cc:359] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:59.576143 17492 raft_consensus.cc:493] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.576668 17491 raft_consensus.cc:740] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.576805 17492 raft_consensus.cc:515] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:59.577970 17491 consensus_queue.cc:260] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:59.579173 17492 leader_election.cc:290] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:59.580335 17491 ts_tablet_manager.cc:1434] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:05:59.581458 17491 tablet_bootstrap.cc:492] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
W20260709 13:05:59.587518 16730 leader_election.cc:336] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:05:59.587110 16585 catalog_manager.cc:5697] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b reported cstate change: term changed from 1 to 2, leader changed from 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65) to 7197bc10b2304fccb972da2da7749e3b (127.8.4.68). New cstate: current_term: 2 leader_uuid: "7197bc10b2304fccb972da2da7749e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.601958 17395 raft_consensus.cc:493] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.603971 17395 raft_consensus.cc:515] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:59.607335 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d281c9020d454b23a8bd21ccfadfa93c" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:59.618757 17395 leader_election.cc:290] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
W20260709 13:05:59.619304 16879 leader_election.cc:336] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:05:59.621179 16879 leader_election.cc:304] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:59.622660 17395 raft_consensus.cc:2749] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.626616 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff8e33f0af546a8a976e5547b1b437e" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:59.641382 16729 leader_election.cc:304] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd
I20260709 13:05:59.642735 17492 raft_consensus.cc:2749] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.644173 17493 raft_consensus.cc:493] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.655161 17493 raft_consensus.cc:515] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
W20260709 13:05:59.662575 16879 leader_election.cc:336] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:05:59.667465 16762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c91dff9e8c4ab78bacda0d282beacf" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:59.668419 16762 raft_consensus.cc:2468] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:59.670044 16877 leader_election.cc:304] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:59.670987 17453 raft_consensus.cc:2804] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:59.671418 17453 raft_consensus.cc:493] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.671833 17453 raft_consensus.cc:3060] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.677158 17493 leader_election.cc:290] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
W20260709 13:05:59.678980 16804 leader_election.cc:336] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:05:59.681948 16804 leader_election.cc:304] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd; no voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:05:59.683753 17497 raft_consensus.cc:2749] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:59.685057 16804 leader_election.cc:336] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:05:59.685385 17491 tablet_bootstrap.cc:492] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:59.685489 16804 leader_election.cc:304] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd; no voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:05:59.686893 17491 tablet_bootstrap.cc:492] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:05:59.687022 17497 raft_consensus.cc:2749] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.689533 17491 ts_tablet_manager.cc:1403] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.108s	user 0.044s	sys 0.045s
I20260709 13:05:59.689595 17502 raft_consensus.cc:493] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.690217 17502 raft_consensus.cc:515] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:59.692276 17502 leader_election.cc:290] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:59.692468 17491 raft_consensus.cc:359] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:59.693825 17491 raft_consensus.cc:740] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.693854 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2a62af17746bcba9f94b6a1053f28" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:59.694679 17491 consensus_queue.cc:260] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:59.694977 16914 raft_consensus.cc:2468] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:59.695963 17453 raft_consensus.cc:515] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:59.696514 17491 ts_tablet_manager.cc:1434] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:05:59.696858 16802 leader_election.cc:304] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:59.697870 17497 raft_consensus.cc:2804] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:59.698222 17453 leader_election.cc:290] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 election: Requested vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:59.700150 17502 raft_consensus.cc:493] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.700716 17502 raft_consensus.cc:515] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:59.700829 17492 raft_consensus.cc:493] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.698241 17497 raft_consensus.cc:493] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.701973 17497 raft_consensus.cc:3060] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.701714 17492 raft_consensus.cc:515] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:59.702517 17491 tablet_bootstrap.cc:492] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:59.702853 17502 leader_election.cc:290] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:59.704125 16762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c91dff9e8c4ab78bacda0d282beacf" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:59.708721 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e982a881834665b4845c226db01020" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:59.709434 16912 raft_consensus.cc:2468] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
I20260709 13:05:59.710367 16762 raft_consensus.cc:3060] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:59.711112 16879 leader_election.cc:336] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:05:59.704535 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d281c9020d454b23a8bd21ccfadfa93c" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:59.713718 16914 raft_consensus.cc:2468] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:59.711254 16728 leader_election.cc:304] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:59.715010 17499 raft_consensus.cc:2804] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:59.715368 16802 leader_election.cc:304] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:59.716337 17502 raft_consensus.cc:2804] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:59.715441 17499 raft_consensus.cc:493] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.716722 17502 raft_consensus.cc:493] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.717182 17499 raft_consensus.cc:3060] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.718830 17492 leader_election.cc:290] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
W20260709 13:05:59.720561 16730 leader_election.cc:336] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:05:59.717226 17502 raft_consensus.cc:3060] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.725026 17492 raft_consensus.cc:493] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.725646 17492 raft_consensus.cc:515] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:59.729223 17498 raft_consensus.cc:493] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.729982 17498 raft_consensus.cc:515] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
W20260709 13:05:59.707234 16804 leader_election.cc:336] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:05:59.732554 17498 leader_election.cc:290] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:59.735841 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f610e2abe7b467facd521257722760d" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:05:59.738260 17453 raft_consensus.cc:493] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.738140 17497 raft_consensus.cc:515] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:59.739056 17453 raft_consensus.cc:515] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:59.739550 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6a383a050745a791b07441a3b93828" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:59.740311 16838 raft_consensus.cc:2468] T 0f6a383a050745a791b07441a3b93828 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
I20260709 13:05:59.740767 17502 raft_consensus.cc:515] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:59.739573 17499 raft_consensus.cc:515] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:59.743245 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661f1f2dcacb42bca7e3b25195dbdfe1" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:59.744046 16838 raft_consensus.cc:2468] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 1.
I20260709 13:05:59.744463 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d281c9020d454b23a8bd21ccfadfa93c" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:59.744918 17499 leader_election.cc:290] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:59.745218 16912 raft_consensus.cc:3060] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.745541 16878 leader_election.cc:304] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:59.746562 17493 raft_consensus.cc:2804] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:59.746966 17493 raft_consensus.cc:493] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.747361 17493 raft_consensus.cc:3060] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.737350 16914 raft_consensus.cc:2468] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
W20260709 13:05:59.745748 16804 leader_election.cc:336] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:05:59.749567 17463 raft_consensus.cc:493] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.750098 17463 raft_consensus.cc:515] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:59.750697 16729 leader_election.cc:304] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:59.752331 16728 leader_election.cc:304] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:59.752353 17463 leader_election.cc:290] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:59.753674 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff8e33f0af546a8a976e5547b1b437e" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:59.754336 16764 raft_consensus.cc:2468] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:59.755664 16802 leader_election.cc:304] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:59.756539 17463 raft_consensus.cc:2804] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:59.756695 17402 raft_consensus.cc:2804] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:59.757047 17463 raft_consensus.cc:493] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.757405 17402 raft_consensus.cc:493] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.753713 17498 raft_consensus.cc:2804] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:59.758199 17402 raft_consensus.cc:3060] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.761569 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2a62af17746bcba9f94b6a1053f28" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:59.762244 16910 raft_consensus.cc:3060] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.757891 17463 raft_consensus.cc:3060] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.769119 17498 raft_consensus.cc:493] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.769775 17498 raft_consensus.cc:3060] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.771708 16910 raft_consensus.cc:2468] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 2.
I20260709 13:05:59.773149 16802 leader_election.cc:304] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:59.773914 17400 raft_consensus.cc:2804] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:59.779534 17497 leader_election.cc:290] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:59.779652 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e982a881834665b4845c226db01020" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:59.758545 17493 raft_consensus.cc:515] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:59.736752 16762 raft_consensus.cc:2468] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 2.
I20260709 13:05:59.782629 16914 raft_consensus.cc:3060] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.783727 16877 leader_election.cc:304] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:59.788218 17395 raft_consensus.cc:2804] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:59.791661 17395 raft_consensus.cc:697] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [term 2 LEADER]: Becoming Leader. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:05:59.792964 17502 leader_election.cc:290] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:59.802017 17492 leader_election.cc:290] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:59.791961 17402 raft_consensus.cc:515] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:59.804363 17400 raft_consensus.cc:697] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Becoming Leader. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:05:59.779953 16912 raft_consensus.cc:2468] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 2.
I20260709 13:05:59.793381 17395 consensus_queue.cc:237] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:59.805999 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f610e2abe7b467facd521257722760d" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:05:59.807132 16913 raft_consensus.cc:3060] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:59.812292 16879 leader_election.cc:336] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:05:59.813469 17493 leader_election.cc:290] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:59.817173 17498 raft_consensus.cc:515] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:59.805375 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661f1f2dcacb42bca7e3b25195dbdfe1" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:59.823647 17491 tablet_bootstrap.cc:492] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:59.818514 17402 leader_election.cc:290] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:59.824940 17402 raft_consensus.cc:493] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.805375 17400 consensus_queue.cc:237] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:59.834313 17498 leader_election.cc:290] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 election: Requested vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:59.796516 17463 raft_consensus.cc:515] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:59.825155 17499 raft_consensus.cc:493] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.838948 17499 raft_consensus.cc:515] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:59.841311 17499 leader_election.cc:290] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:59.842128 16762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff8e33f0af546a8a976e5547b1b437e" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:05:59.842900 16762 raft_consensus.cc:3060] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.827773 17402 raft_consensus.cc:515] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:59.824045 16838 raft_consensus.cc:3060] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.847744 17532 raft_consensus.cc:493] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.848344 17532 raft_consensus.cc:515] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:59.850694 17532 leader_election.cc:290] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:05:59.852545 16761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772bb23805934270899495ae7c8cbb07" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:05:59.853488 17453 leader_election.cc:290] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:05:59.853886 16761 raft_consensus.cc:2468] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 1.
I20260709 13:05:59.855051 17402 leader_election.cc:290] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
W20260709 13:05:59.856487 16730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37355, user_credentials={real_user=slave}} blocked reactor thread for 60746.5us
I20260709 13:05:59.824851 17491 tablet_bootstrap.cc:492] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
W20260709 13:05:59.858165 16804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.65:37355, user_credentials={real_user=slave}} blocked reactor thread for 70375.7us
I20260709 13:05:59.860102 16802 leader_election.cc:304] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:59.861804 17532 raft_consensus.cc:2804] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:59.862316 17532 raft_consensus.cc:493] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.862941 17532 raft_consensus.cc:3060] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.863541 16802 leader_election.cc:304] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:05:59.865053 17502 raft_consensus.cc:2804] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:59.865649 17502 raft_consensus.cc:697] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Becoming Leader. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:05:59.866514 17502 consensus_queue.cc:237] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:59.876288 16913 raft_consensus.cc:2468] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 2.
I20260709 13:05:59.877318 17491 ts_tablet_manager.cc:1403] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.175s	user 0.020s	sys 0.027s
I20260709 13:05:59.881140 17463 leader_election.cc:290] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 election: Requested vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
W20260709 13:05:59.892961 16879 leader_election.cc:336] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:05:59.893026 16762 raft_consensus.cc:2468] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 2.
I20260709 13:05:59.911219 16802 leader_election.cc:304] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:59.899924 16728 leader_election.cc:304] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:59.909487 17491 raft_consensus.cc:359] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:59.913278 17491 raft_consensus.cc:740] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.914131 17491 consensus_queue.cc:260] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:59.915647 17502 raft_consensus.cc:2804] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:59.916414 17502 raft_consensus.cc:697] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Becoming Leader. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:05:59.920605 17491 ts_tablet_manager.cc:1434] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:05:59.903520 16585 catalog_manager.cc:5697] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b reported cstate change: term changed from 1 to 2, leader changed from 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65) to 7197bc10b2304fccb972da2da7749e3b (127.8.4.68). New cstate: current_term: 2 leader_uuid: "7197bc10b2304fccb972da2da7749e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:59.922835 16730 leader_election.cc:336] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
W20260709 13:05:59.923605 16730 leader_election.cc:336] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
W20260709 13:05:59.924355 16730 leader_election.cc:336] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:05:59.924358 16587 catalog_manager.cc:5697] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd reported cstate change: term changed from 1 to 2, leader changed from 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65) to 622433288cac4964aea9ea5a24ba77fd (127.8.4.67). New cstate: current_term: 2 leader_uuid: "622433288cac4964aea9ea5a24ba77fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.933192 17491 tablet_bootstrap.cc:492] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:05:59.935389 16838 raft_consensus.cc:2468] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 2.
I20260709 13:05:59.937445 16878 leader_election.cc:304] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:05:59.938665 17395 raft_consensus.cc:2804] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:59.939853 17395 raft_consensus.cc:697] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 2 LEADER]: Becoming Leader. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:05:59.944190 16835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6a383a050745a791b07441a3b93828" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:05:59.945170 16835 raft_consensus.cc:3060] T 0f6a383a050745a791b07441a3b93828 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.941032 17395 consensus_queue.cc:237] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:05:59.966188 16833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f0df42f20d4d9398c8d4b5b3cba4ea" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:59.967224 16833 raft_consensus.cc:2468] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
I20260709 13:05:59.968307 16834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2500d1c1df2649d99c7a5e1146e771d9" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:05:59.969110 16834 raft_consensus.cc:2468] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
I20260709 13:05:59.968967 16835 raft_consensus.cc:2468] T 0f6a383a050745a791b07441a3b93828 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 2.
I20260709 13:05:59.932857 17534 raft_consensus.cc:2804] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:59.974846 17534 raft_consensus.cc:697] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [term 2 LEADER]: Becoming Leader. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:05:59.901485 17492 raft_consensus.cc:493] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.975878 17534 consensus_queue.cc:237] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:59.976564 17492 raft_consensus.cc:515] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:05:59.979234 17492 leader_election.cc:290] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:05:59.973228 16729 leader_election.cc:304] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:59.986656 16729 leader_election.cc:304] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:05:59.987462 17498 raft_consensus.cc:2804] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:59.987610 17402 raft_consensus.cc:2804] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:59.988063 17498 raft_consensus.cc:493] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:05:59.988767 17498 raft_consensus.cc:3060] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.988941 17502 consensus_queue.cc:237] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:05:59.993364 16761 raft_consensus.cc:1275] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Refusing update from remote peer 7197bc10b2304fccb972da2da7749e3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.995806 17491 tablet_bootstrap.cc:492] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:59.996160 17395 consensus_queue.cc:1048] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:59.988142 17402 raft_consensus.cc:493] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:06:00.002104 17402 raft_consensus.cc:3060] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.012643 17491 tablet_bootstrap.cc:492] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:00.013523 17491 ts_tablet_manager.cc:1403] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.092s	user 0.016s	sys 0.002s
I20260709 13:06:00.005770 16585 catalog_manager.cc:5697] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b reported cstate change: term changed from 1 to 2, leader changed from 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65) to 7197bc10b2304fccb972da2da7749e3b (127.8.4.68). New cstate: current_term: 2 leader_uuid: "7197bc10b2304fccb972da2da7749e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:00.019057 16804 leader_election.cc:336] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
W20260709 13:06:00.020226 16804 leader_election.cc:336] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:06:00.023921 17532 raft_consensus.cc:515] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:00.027729 17532 leader_election.cc:290] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 election: Requested vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:06:00.029271 16914 raft_consensus.cc:2468] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 2.
I20260709 13:06:00.036782 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49036bff00949ec88900c3537cf5edc" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:06:00.037595 16838 raft_consensus.cc:2468] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 1.
W20260709 13:06:00.039192 16804 leader_election.cc:336] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
W20260709 13:06:00.041652 16804 leader_election.cc:336] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
W20260709 13:06:00.066406 16804 leader_election.cc:336] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:06:00.052788 16587 catalog_manager.cc:5697] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd reported cstate change: term changed from 1 to 2, leader changed from 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65) to 622433288cac4964aea9ea5a24ba77fd (127.8.4.67). New cstate: current_term: 2 leader_uuid: "622433288cac4964aea9ea5a24ba77fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.079386 16587 catalog_manager.cc:5697] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd reported cstate change: term changed from 1 to 2, leader changed from 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65) to 622433288cac4964aea9ea5a24ba77fd (127.8.4.67). New cstate: current_term: 2 leader_uuid: "622433288cac4964aea9ea5a24ba77fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:00.082123 16728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:45033, user_credentials={real_user=slave}} blocked reactor thread for 68909.1us
W20260709 13:06:00.092723 16804 leader_election.cc:336] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:06:00.094543 17402 raft_consensus.cc:515] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:00.096743 17402 leader_election.cc:290] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 election: Requested vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
W20260709 13:06:00.098986 16879 consensus_peers.cc:597] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:00.102404 17491 raft_consensus.cc:359] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:00.103183 17491 raft_consensus.cc:740] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.103929 17491 consensus_queue.cc:260] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
W20260709 13:06:00.108114 16729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:39929, user_credentials={real_user=slave}} blocked reactor thread for 91728.5us
I20260709 13:06:00.110781 16762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772bb23805934270899495ae7c8cbb07" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:06:00.111816 16762 raft_consensus.cc:3060] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.110929 17491 ts_tablet_manager.cc:1434] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.097s	user 0.005s	sys 0.002s
I20260709 13:06:00.115681 17491 tablet_bootstrap.cc:492] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:00.121886 16833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2500d1c1df2649d99c7a5e1146e771d9" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:06:00.129499 16833 raft_consensus.cc:3060] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.141197 16585 catalog_manager.cc:5697] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 reported cstate change: term changed from 1 to 2, leader changed from 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65) to d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66). New cstate: current_term: 2 leader_uuid: "d0ea3afb898b4eb5b21faeb676627011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:00.146258 17498 raft_consensus.cc:515] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:00.148228 17498 leader_election.cc:290] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 election: Requested vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:06:00.158797 16762 raft_consensus.cc:2468] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 2.
I20260709 13:06:00.158324 16729 leader_election.cc:304] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
W20260709 13:06:00.166419 16730 leader_election.cc:336] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
W20260709 13:06:00.167907 16730 leader_election.cc:336] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
W20260709 13:06:00.169107 16730 leader_election.cc:336] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
W20260709 13:06:00.170130 16730 leader_election.cc:336] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:06:00.181913 16729 leader_election.cc:304] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
W20260709 13:06:00.187536 16728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:45033, user_credentials={real_user=slave}} blocked reactor thread for 100549us
I20260709 13:06:00.167305 17498 raft_consensus.cc:2804] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:00.188469 16728 leader_election.cc:304] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:06:00.189662 16833 raft_consensus.cc:2468] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 2.
I20260709 13:06:00.195307 17498 raft_consensus.cc:697] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [term 2 LEADER]: Becoming Leader. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:06:00.196266 17498 consensus_queue.cc:237] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:00.205345 17499 raft_consensus.cc:2804] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:00.205873 17499 raft_consensus.cc:493] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:06:00.206264 17499 raft_consensus.cc:3060] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.203532 16729 leader_election.cc:304] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:06:00.215968 17551 raft_consensus.cc:2804] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:00.216727 17551 raft_consensus.cc:697] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [term 2 LEADER]: Becoming Leader. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:06:00.217149 17549 raft_consensus.cc:2804] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:00.217770 17549 raft_consensus.cc:697] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 2 LEADER]: Becoming Leader. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:06:00.218197 16764 raft_consensus.cc:1275] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Refusing update from remote peer 7197bc10b2304fccb972da2da7749e3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.218789 17549 consensus_queue.cc:237] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:00.221414 16802 leader_election.cc:304] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8
W20260709 13:06:00.222922 16730 leader_election.cc:336] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:06:00.226410 17497 raft_consensus.cc:2804] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:00.226969 17497 raft_consensus.cc:697] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Becoming Leader. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:06:00.227814 17497 consensus_queue.cc:237] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:00.226207 17395 consensus_queue.cc:1048] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:00.217770 17551 consensus_queue.cc:237] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:00.257110 17499 raft_consensus.cc:515] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:00.243350 16833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f0df42f20d4d9398c8d4b5b3cba4ea" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:06:00.272445 17499 leader_election.cc:290] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 election: Requested vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:06:00.286047 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49036bff00949ec88900c3537cf5edc" candidate_uuid: "d0ea3afb898b4eb5b21faeb676627011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:06:00.286947 16838 raft_consensus.cc:3060] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.269074 16833 raft_consensus.cc:3060] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:00.290961 16879 consensus_peers.cc:597] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:00.305217 16730 leader_election.cc:336] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:06:00.320910 16838 raft_consensus.cc:2468] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 2.
I20260709 13:06:00.332492 17491 tablet_bootstrap.cc:492] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:00.334420 17491 tablet_bootstrap.cc:492] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:00.338047 16833 raft_consensus.cc:2468] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ea3afb898b4eb5b21faeb676627011 in term 2.
I20260709 13:06:00.338728 17491 ts_tablet_manager.cc:1403] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.223s	user 0.028s	sys 0.000s
W20260709 13:06:00.341607 16730 leader_election.cc:336] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:06:00.342414 17491 raft_consensus.cc:359] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:00.345661 17491 raft_consensus.cc:740] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.346968 17491 consensus_queue.cc:260] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
W20260709 13:06:00.350301 16730 leader_election.cc:336] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:06:00.367751 16910 raft_consensus.cc:1275] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Refusing update from remote peer 622433288cac4964aea9ea5a24ba77fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.369794 16729 leader_election.cc:304] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:06:00.374104 16729 leader_election.cc:304] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:06:00.379227 17551 raft_consensus.cc:2804] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:00.379897 17551 raft_consensus.cc:697] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 2 LEADER]: Becoming Leader. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:06:00.380828 17551 consensus_queue.cc:237] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:00.382220 16585 catalog_manager.cc:5697] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd reported cstate change: term changed from 1 to 2, leader changed from 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65) to 622433288cac4964aea9ea5a24ba77fd (127.8.4.67). New cstate: current_term: 2 leader_uuid: "622433288cac4964aea9ea5a24ba77fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:00.383663 17502 consensus_queue.cc:1048] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:00.392504 16910 raft_consensus.cc:1275] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Refusing update from remote peer 622433288cac4964aea9ea5a24ba77fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.399271 17549 raft_consensus.cc:2804] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:00.400125 17549 raft_consensus.cc:697] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 2 LEADER]: Becoming Leader. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:06:00.404325 17491 ts_tablet_manager.cc:1434] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.004s
I20260709 13:06:00.406056 17491 tablet_bootstrap.cc:492] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:00.405862 17549 consensus_queue.cc:237] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:00.408378 17502 consensus_queue.cc:1048] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:06:00.435407 16765 raft_consensus.cc:1275] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Refusing update from remote peer 622433288cac4964aea9ea5a24ba77fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.444928 17539 consensus_queue.cc:1048] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:00.474622 16804 consensus_peers.cc:597] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:00.475647 16804 consensus_peers.cc:597] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:00.478396 16879 consensus_peers.cc:597] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:00.481762 16804 consensus_peers.cc:597] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:00.545609 16730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37355, user_credentials={real_user=slave}} blocked reactor thread for 47331.9us
W20260709 13:06:00.554477 17568 log.cc:927] Time spent T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011: Append to log took a long time: real 0.065s	user 0.000s	sys 0.002s
I20260709 13:06:00.558565 16838 raft_consensus.cc:1275] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Refusing update from remote peer 7197bc10b2304fccb972da2da7749e3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.570719 17493 consensus_queue.cc:1048] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:00.579077 16585 catalog_manager.cc:5697] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 reported cstate change: term changed from 1 to 2, leader changed from 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65) to d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66). New cstate: current_term: 2 leader_uuid: "d0ea3afb898b4eb5b21faeb676627011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.594470 16585 catalog_manager.cc:5697] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 reported cstate change: term changed from 1 to 2, leader changed from 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65) to d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66). New cstate: current_term: 2 leader_uuid: "d0ea3afb898b4eb5b21faeb676627011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.596382 16585 catalog_manager.cc:5697] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 reported cstate change: term changed from 1 to 2, leader changed from 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65) to d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66). New cstate: current_term: 2 leader_uuid: "d0ea3afb898b4eb5b21faeb676627011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:00.640187 16585 catalog_manager.cc:5697] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 reported cstate change: term changed from 1 to 2, leader changed from 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65) to d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66). New cstate: current_term: 2 leader_uuid: "d0ea3afb898b4eb5b21faeb676627011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.643999 16585 catalog_manager.cc:5697] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 reported cstate change: term changed from 1 to 2, leader changed from 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65) to d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66). New cstate: current_term: 2 leader_uuid: "d0ea3afb898b4eb5b21faeb676627011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.668920 17491 tablet_bootstrap.cc:492] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:00.689250 17504 raft_consensus.cc:493] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.689241 17491 tablet_bootstrap.cc:492] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:00.690210 16911 raft_consensus.cc:1275] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Refusing update from remote peer d0ea3afb898b4eb5b21faeb676627011: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.691190 17491 ts_tablet_manager.cc:1403] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.285s	user 0.022s	sys 0.006s
I20260709 13:06:00.714459 17491 raft_consensus.cc:359] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:00.719691 17491 raft_consensus.cc:740] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.720506 17491 consensus_queue.cc:260] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:00.729525 17574 consensus_queue.cc:1048] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:00.828173 17544 log.cc:927] Time spent T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:06:00.842105 16802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:45033, user_credentials={real_user=slave}} blocked reactor thread for 84921.5us
I20260709 13:06:00.689865 17504 raft_consensus.cc:515] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:00.764142 16833 raft_consensus.cc:1275] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Refusing update from remote peer d0ea3afb898b4eb5b21faeb676627011: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.856521 17504 leader_election.cc:290] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:06:00.857594 17504 raft_consensus.cc:493] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:00.865839 17517 log.cc:927] Time spent T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:06:00.904990 17491 ts_tablet_manager.cc:1434] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.213s	user 0.037s	sys 0.037s
I20260709 13:06:00.930414 17491 tablet_bootstrap.cc:492] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:00.880916 17504 raft_consensus.cc:515] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:00.948699 16913 raft_consensus.cc:1275] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Refusing update from remote peer d0ea3afb898b4eb5b21faeb676627011: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:00.971419 16730 consensus_peers.cc:597] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:00.975827 16730 consensus_peers.cc:597] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:00.987553 16838 raft_consensus.cc:1275] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Refusing update from remote peer d0ea3afb898b4eb5b21faeb676627011: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.961527 17574 consensus_queue.cc:1048] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:06:00.998507 17582 raft_consensus.cc:493] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.999130 17582 raft_consensus.cc:515] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:01.001104 17492 consensus_queue.cc:1048] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:00.997215 16833 raft_consensus.cc:1275] T 0f6a383a050745a791b07441a3b93828 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Refusing update from remote peer d0ea3afb898b4eb5b21faeb676627011: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.996896 17498 consensus_queue.cc:1048] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:06:01.008548 17504 leader_election.cc:290] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:06:01.030426 17504 raft_consensus.cc:493] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.031281 17504 raft_consensus.cc:515] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:01.035341 17504 leader_election.cc:290] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:06:01.005350 17584 raft_consensus.cc:493] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.047180 17584 raft_consensus.cc:515] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
W20260709 13:06:01.059981 16804 consensus_peers.cc:597] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:01.060913 16804 consensus_peers.cc:597] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:01.074790 16879 consensus_peers.cc:597] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:01.083163 16879 consensus_peers.cc:597] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:01.083864 16879 consensus_peers.cc:597] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:01.089561 16878 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:39929, user_credentials={real_user=slave}} blocked reactor thread for 110788us
W20260709 13:06:01.093297 16729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:39929, user_credentials={real_user=slave}} blocked reactor thread for 98786.1us
I20260709 13:06:01.107925 16762 raft_consensus.cc:1275] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Refusing update from remote peer 622433288cac4964aea9ea5a24ba77fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:01.128378 16879 consensus_peers.cc:597] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:01.120592 17582 leader_election.cc:290] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:06:01.201239 17586 consensus_queue.cc:1048] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:06:01.208217 17541 consensus_queue.cc:1048] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
W20260709 13:06:01.214936 16879 consensus_peers.cc:597] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:01.222836 16728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:45033, user_credentials={real_user=slave}} blocked reactor thread for 62584.4us
I20260709 13:06:01.203878 17582 raft_consensus.cc:493] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:01.234220 16878 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:39929, user_credentials={real_user=slave}} blocked reactor thread for 137084us
W20260709 13:06:01.307041 16728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.68:45033, user_credentials={real_user=slave}} blocked reactor thread for 48333.8us
I20260709 13:06:01.239280 17582 raft_consensus.cc:515] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:01.298846 16835 raft_consensus.cc:1275] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Refusing update from remote peer d0ea3afb898b4eb5b21faeb676627011: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:01.304294 17504 raft_consensus.cc:493] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.340058 17504 raft_consensus.cc:515] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
W20260709 13:06:01.352870 17610 log.cc:927] Time spent T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:06:01.373821 17582 leader_election.cc:290] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:06:01.362164 17504 leader_election.cc:290] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:06:01.392450 17584 leader_election.cc:290] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
W20260709 13:06:01.394546 16804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37355, user_credentials={real_user=slave}} blocked reactor thread for 92642.9us
W20260709 13:06:01.403719 16878 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:39929, user_credentials={real_user=slave}} blocked reactor thread for 140748us
W20260709 13:06:01.425959 17621 log.cc:927] Time spent T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011: Append to log took a long time: real 0.067s	user 0.003s	sys 0.000s
I20260709 13:06:01.451457 17491 tablet_bootstrap.cc:492] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:01.508890 17545 consensus_queue.cc:1048] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:01.513859 17584 raft_consensus.cc:493] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.514885 17584 raft_consensus.cc:515] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:01.517613 17584 leader_election.cc:290] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:06:01.538393 17491 tablet_bootstrap.cc:492] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:01.539551 17491 ts_tablet_manager.cc:1403] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.634s	user 0.029s	sys 0.041s
W20260709 13:06:01.555821 16804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37355, user_credentials={real_user=slave}} blocked reactor thread for 49287.9us
W20260709 13:06:01.557099 16804 consensus_peers.cc:597] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:01.558396 16804 consensus_peers.cc:597] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:01.559087 16804 consensus_peers.cc:597] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:01.574059 17584 raft_consensus.cc:493] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.574800 17584 raft_consensus.cc:515] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:01.580928 17504 raft_consensus.cc:493] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.581605 17504 raft_consensus.cc:515] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:01.582813 17491 raft_consensus.cc:359] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:01.583587 17491 raft_consensus.cc:740] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.583887 17504 leader_election.cc:290] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:06:01.584980 17491 consensus_queue.cc:260] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:01.587885 16762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772bb23805934270899495ae7c8cbb07" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:06:01.598203 17491 ts_tablet_manager.cc:1434] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 13:06:01.604084 16762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e662a1c0204e5bab9a5b5e50b81561" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
W20260709 13:06:01.618208 16804 consensus_peers.cc:597] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:01.623605 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3526ae05dd1141aaaaa2aaea2391b108" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
W20260709 13:06:01.624089 16879 consensus_peers.cc:597] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:01.630025 16879 consensus_peers.cc:597] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:01.625478 17491 tablet_bootstrap.cc:492] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:01.626845 16762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7a4cb12b194107a5bba9336ed37819" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:06:01.636294 17584 leader_election.cc:290] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:06:01.653290 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a0ed4bc207489699e41033ec224d3a" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:06:01.669982 16762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e91185676f4335a4100a6d3fa40c8d" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:06:01.681630 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772bb23805934270899495ae7c8cbb07" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:06:01.688993 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e662a1c0204e5bab9a5b5e50b81561" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:06:01.691113 16912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e348c32749d48f68c70dc32267e38c0" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:06:01.731500 16838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e91185676f4335a4100a6d3fa40c8d" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:06:01.736111 16763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3526ae05dd1141aaaaa2aaea2391b108" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:06:01.737699 16837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e348c32749d48f68c70dc32267e38c0" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:06:01.739204 16836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e79d615b8ac14c149720027be9d4dee2" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:06:01.739877 16832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a0ed4bc207489699e41033ec224d3a" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:06:01.741211 16830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9f8110756a49c082a81e072eed60b3" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:06:01.741631 16833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2a62af17746bcba9f94b6a1053f28" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
W20260709 13:06:01.786870 16804 consensus_peers.cc:597] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:01.787802 16804 consensus_peers.cc:597] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:01.788467 16804 consensus_peers.cc:597] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:01.789762 16804 consensus_peers.cc:597] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:01.790721 16804 consensus_peers.cc:597] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:01.791035 17607 log.cc:927] Time spent T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:06:01.811650 16909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9f8110756a49c082a81e072eed60b3" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:06:01.807849 17485 leader_election.cc:304] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8; no voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:06:01.929349 16911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2a62af17746bcba9f94b6a1053f28" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
W20260709 13:06:01.930051 17486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:39929, user_credentials={real_user=slave}} blocked reactor thread for 81061.4us
I20260709 13:06:01.932338 17584 raft_consensus.cc:2749] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:01.932526 17485 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:33887, user_credentials={real_user=slave}} blocked reactor thread for 158926us
I20260709 13:06:01.933705 17485 leader_election.cc:304] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8; no voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011
W20260709 13:06:01.971596 17643 log.cc:927] Time spent T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:06:01.972553 17504 raft_consensus.cc:2749] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:01.963645 17584 raft_consensus.cc:493] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:01.999886 16730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37355, user_credentials={real_user=slave}} blocked reactor thread for 69070.1us
W20260709 13:06:02.055764 16730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37355, user_credentials={real_user=slave}} blocked reactor thread for 55065.8us
I20260709 13:06:02.073050 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e79d615b8ac14c149720027be9d4dee2" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
W20260709 13:06:02.076695 16879 consensus_peers.cc:597] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:02.077503 16879 consensus_peers.cc:597] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:02.077957 16879 consensus_peers.cc:597] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:02.078616 16879 consensus_peers.cc:597] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:02.000865 17584 raft_consensus.cc:515] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:02.079259 17485 leader_election.cc:304] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8; no voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011
W20260709 13:06:02.118986 16730 consensus_peers.cc:597] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:02.120582 16730 consensus_peers.cc:597] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:02.125200 16730 consensus_peers.cc:597] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:02.145743 16908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7a4cb12b194107a5bba9336ed37819" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
W20260709 13:06:02.151707 16730 consensus_peers.cc:597] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:02.121825 17504 raft_consensus.cc:2749] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:02.153832 17485 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:33887, user_credentials={real_user=slave}} blocked reactor thread for 85875.1us
I20260709 13:06:02.180418 17485 leader_election.cc:304] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8; no voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:06:02.182487 17485 leader_election.cc:304] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8; no voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:06:02.160277 17504 raft_consensus.cc:493] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.198082 17504 raft_consensus.cc:515] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:02.188381 17584 leader_election.cc:290] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:06:02.202513 17584 raft_consensus.cc:2749] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.203485 17584 raft_consensus.cc:2749] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.190248 16834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d281c9020d454b23a8bd21ccfadfa93c" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "622433288cac4964aea9ea5a24ba77fd" is_pre_election: true
I20260709 13:06:02.200722 17504 leader_election.cc:290] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
W20260709 13:06:02.274577 16730 consensus_peers.cc:597] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:02.275156 16730 consensus_peers.cc:597] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:02.275770 16730 consensus_peers.cc:597] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:02.276489 16730 consensus_peers.cc:597] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:02.302196 17491 tablet_bootstrap.cc:492] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:02.303260 17491 tablet_bootstrap.cc:492] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:02.303983 17491 ts_tablet_manager.cc:1403] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.679s	user 0.022s	sys 0.006s
W20260709 13:06:02.323702 16730 consensus_peers.cc:597] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:02.324251 16730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37355, user_credentials={real_user=slave}} blocked reactor thread for 47242us
I20260709 13:06:02.343968 17491 raft_consensus.cc:359] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:02.345084 17491 raft_consensus.cc:740] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
W20260709 13:06:02.348762 16730 consensus_peers.cc:597] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:02.349944 17491 consensus_queue.cc:260] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:02.362004 17491 ts_tablet_manager.cc:1434] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.000s
W20260709 13:06:02.365748 16730 consensus_peers.cc:597] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:02.367102 17491 tablet_bootstrap.cc:492] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
W20260709 13:06:02.388406 17485 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.68:45033, user_credentials={real_user=slave}} blocked reactor thread for 206052us
I20260709 13:06:02.389889 17485 leader_election.cc:304] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8; no voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:06:02.391959 17485 leader_election.cc:304] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8; no voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:06:02.393364 17653 raft_consensus.cc:2749] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.394433 17653 raft_consensus.cc:2749] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.401060 17485 leader_election.cc:304] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8; no voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:06:02.402526 17657 raft_consensus.cc:2749] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.403280 17485 leader_election.cc:304] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8; no voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:06:02.404520 17657 raft_consensus.cc:2749] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.405160 17485 leader_election.cc:304] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8; no voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:06:02.409318 17657 raft_consensus.cc:2749] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.409413 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e52334c3ab4394b0a09b0a460e34d4" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d0ea3afb898b4eb5b21faeb676627011" is_pre_election: true
I20260709 13:06:02.425089 17491 tablet_bootstrap.cc:492] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:02.426424 17491 tablet_bootstrap.cc:492] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:02.427224 17491 ts_tablet_manager.cc:1403] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.060s	user 0.018s	sys 0.004s
I20260709 13:06:02.431150 17491 raft_consensus.cc:359] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:02.431998 17491 raft_consensus.cc:740] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.433182 17491 consensus_queue.cc:260] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:02.443809 17491 ts_tablet_manager.cc:1434] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 13:06:02.444959 17491 tablet_bootstrap.cc:492] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
W20260709 13:06:02.468382 16878 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:39929, user_credentials={real_user=slave}} blocked reactor thread for 59318.8us
I20260709 13:06:02.470935 17491 tablet_bootstrap.cc:492] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:02.475076 17491 tablet_bootstrap.cc:492] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:02.475939 17491 ts_tablet_manager.cc:1403] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.008s
I20260709 13:06:02.489818 17491 raft_consensus.cc:359] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:02.490521 17491 raft_consensus.cc:740] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.491168 17491 consensus_queue.cc:260] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:02.532594 16909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d281c9020d454b23a8bd21ccfadfa93c" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:06:02.534670 16909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e52334c3ab4394b0a09b0a460e34d4" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7197bc10b2304fccb972da2da7749e3b" is_pre_election: true
I20260709 13:06:02.538513 17491 ts_tablet_manager.cc:1434] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.000s
I20260709 13:06:02.539487 17491 tablet_bootstrap.cc:492] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:02.542603 17485 leader_election.cc:304] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8; no voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b
I20260709 13:06:02.544087 17657 raft_consensus.cc:2749] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.546636 17485 leader_election.cc:304] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8; no voters: 7197bc10b2304fccb972da2da7749e3b, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:06:02.547884 17657 raft_consensus.cc:2749] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.588099 17491 tablet_bootstrap.cc:492] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:02.589226 17491 tablet_bootstrap.cc:492] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:02.589956 17491 ts_tablet_manager.cc:1403] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.051s	user 0.024s	sys 0.005s
I20260709 13:06:02.592376 17491 raft_consensus.cc:359] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:02.593124 17491 raft_consensus.cc:740] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.593940 17491 consensus_queue.cc:260] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:02.595851 17491 ts_tablet_manager.cc:1434] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:02.597343 17491 tablet_bootstrap.cc:492] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
W20260709 13:06:02.598878 16730 consensus_peers.cc:597] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:02.627110 17491 tablet_bootstrap.cc:492] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:02.628223 17491 tablet_bootstrap.cc:492] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:02.628958 17491 ts_tablet_manager.cc:1403] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.014s
I20260709 13:06:02.631767 17491 raft_consensus.cc:359] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:02.632462 17491 raft_consensus.cc:740] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.633314 17491 consensus_queue.cc:260] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:02.638886 17491 ts_tablet_manager.cc:1434] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 13:06:02.639735 17491 tablet_bootstrap.cc:492] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:02.691958 17491 tablet_bootstrap.cc:492] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:06:02.693109 16730 consensus_peers.cc:597] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:02.701721 17491 tablet_bootstrap.cc:492] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:02.702711 17491 ts_tablet_manager.cc:1403] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.000s
I20260709 13:06:02.705861 17491 raft_consensus.cc:359] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:02.706674 17491 raft_consensus.cc:740] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.707556 17491 consensus_queue.cc:260] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:02.710963 17491 ts_tablet_manager.cc:1434] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:06:02.711885 17491 tablet_bootstrap.cc:492] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
W20260709 13:06:02.758782 16730 consensus_peers.cc:597] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:02.764580 17491 tablet_bootstrap.cc:492] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:02.765998 17491 tablet_bootstrap.cc:492] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:02.766945 17491 ts_tablet_manager.cc:1403] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.006s
I20260709 13:06:02.769929 17491 raft_consensus.cc:359] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:02.770772 17491 raft_consensus.cc:740] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.771607 17491 consensus_queue.cc:260] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:02.784039 17491 ts_tablet_manager.cc:1434] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:06:02.785178 17491 tablet_bootstrap.cc:492] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:02.790337  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.65:37355
I20260709 13:06:02.790477 17688 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.65:37355 every 8 connection(s)
I20260709 13:06:02.850427 17491 tablet_bootstrap.cc:492] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:02.855326 17491 tablet_bootstrap.cc:492] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:02.857455 17491 ts_tablet_manager.cc:1403] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.073s	user 0.024s	sys 0.023s
I20260709 13:06:02.869343 17491 raft_consensus.cc:359] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:02.874658 17491 raft_consensus.cc:740] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
W20260709 13:06:02.886428 16730 consensus_peers.cc:597] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:02.875295 17491 consensus_queue.cc:260] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:02.890029 17491 ts_tablet_manager.cc:1434] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:06:02.890791 17491 tablet_bootstrap.cc:492] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:02.896610 17690 heartbeater.cc:344] Connected to a master server at 127.8.4.126:37545
I20260709 13:06:02.897301 17690 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:02.898758 17690 heartbeater.cc:507] Master 127.8.4.126:37545 requested a full tablet report, sending...
I20260709 13:06:02.905589 17491 tablet_bootstrap.cc:492] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:02.908252 17491 tablet_bootstrap.cc:492] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:02.908960 17491 ts_tablet_manager.cc:1403] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:06:02.911643 17491 raft_consensus.cc:359] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:02.912354 17491 raft_consensus.cc:740] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.913166 17491 consensus_queue.cc:260] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:02.915210 17491 ts_tablet_manager.cc:1434] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:02.915474 16585 ts_manager.cc:194] Re-registered known tserver with Master: 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:06:02.916090 17491 tablet_bootstrap.cc:492] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:02.933809 17491 tablet_bootstrap.cc:492] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:02.934861 17491 tablet_bootstrap.cc:492] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:02.935575 17491 ts_tablet_manager.cc:1403] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:06:02.938301 17491 raft_consensus.cc:359] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:02.939033 17491 raft_consensus.cc:740] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.939720 17491 consensus_queue.cc:260] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:02.941928 17491 ts_tablet_manager.cc:1434] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:06:02.942767 17491 tablet_bootstrap.cc:492] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:02.961575 17491 tablet_bootstrap.cc:492] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:02.962569 17491 tablet_bootstrap.cc:492] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:02.963258 17491 ts_tablet_manager.cc:1403] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.001s
I20260709 13:06:02.965946 17491 raft_consensus.cc:359] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:02.966403 16585 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39238
I20260709 13:06:02.966645 17491 raft_consensus.cc:740] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.967331 17491 consensus_queue.cc:260] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:02.969293 17491 ts_tablet_manager.cc:1434] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:06:02.970137 17491 tablet_bootstrap.cc:492] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:02.971873 17690 heartbeater.cc:499] Master 127.8.4.126:37545 was elected leader, sending a full tablet report...
I20260709 13:06:02.978921 17649 raft_consensus.cc:3060] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.987109 17491 tablet_bootstrap.cc:492] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:02.988243 17491 tablet_bootstrap.cc:492] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:02.988996 17491 ts_tablet_manager.cc:1403] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:06:02.992077 17491 raft_consensus.cc:359] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:02.993151 17491 raft_consensus.cc:740] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.994416 17491 consensus_queue.cc:260] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:02.997960 17491 ts_tablet_manager.cc:1434] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:06:02.998899 17491 tablet_bootstrap.cc:492] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:03.016382 17491 tablet_bootstrap.cc:492] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.017364 17491 tablet_bootstrap.cc:492] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:03.017997 17491 ts_tablet_manager.cc:1403] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.001s
I20260709 13:06:03.020058 17491 raft_consensus.cc:359] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:03.020634 17491 raft_consensus.cc:740] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.021414 17491 consensus_queue.cc:260] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:03.023641 17491 ts_tablet_manager.cc:1434] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:03.023510 17649 raft_consensus.cc:3060] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.024875 17491 tablet_bootstrap.cc:492] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:03.058516 17649 raft_consensus.cc:3060] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.058945 17491 tablet_bootstrap.cc:492] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.060403 17491 tablet_bootstrap.cc:492] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:03.061216 17491 ts_tablet_manager.cc:1403] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.037s	user 0.024s	sys 0.012s
I20260709 13:06:03.065366 17491 raft_consensus.cc:359] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:03.066085 17491 raft_consensus.cc:740] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.066768 17491 consensus_queue.cc:260] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:03.068809 17491 ts_tablet_manager.cc:1434] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.001s
I20260709 13:06:03.070228 17491 tablet_bootstrap.cc:492] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:03.088418 17491 tablet_bootstrap.cc:492] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.089493 17491 tablet_bootstrap.cc:492] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:03.090183 17491 ts_tablet_manager.cc:1403] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:06:03.092038 17491 raft_consensus.cc:359] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:03.092622 17491 raft_consensus.cc:740] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.093297 17491 consensus_queue.cc:260] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:03.095293 17491 ts_tablet_manager.cc:1434] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:03.096491 17491 tablet_bootstrap.cc:492] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:03.110505 17491 tablet_bootstrap.cc:492] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.111502 17491 tablet_bootstrap.cc:492] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:03.112059 17491 ts_tablet_manager.cc:1403] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:06:03.114557 17491 raft_consensus.cc:359] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:03.115211 17491 raft_consensus.cc:740] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.115749 17491 consensus_queue.cc:260] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:03.116202 17649 raft_consensus.cc:3060] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.117843 17491 ts_tablet_manager.cc:1434] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:06:03.119186 17491 tablet_bootstrap.cc:492] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:03.130695 17648 raft_consensus.cc:3060] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.156792 17654 raft_consensus.cc:3060] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.165171 17491 tablet_bootstrap.cc:492] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.166272 17491 tablet_bootstrap.cc:492] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:03.166958 17491 ts_tablet_manager.cc:1403] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.007s
I20260709 13:06:03.169593 17491 raft_consensus.cc:359] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:03.170284 17491 raft_consensus.cc:740] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.170976 17491 consensus_queue.cc:260] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:03.173275 17491 ts_tablet_manager.cc:1434] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:06:03.174261 17491 tablet_bootstrap.cc:492] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:03.244204 17648 raft_consensus.cc:3060] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.288687 17491 tablet_bootstrap.cc:492] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.289922 17491 tablet_bootstrap.cc:492] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:03.290520 17654 raft_consensus.cc:3060] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.290740 17491 ts_tablet_manager.cc:1403] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.117s	user 0.034s	sys 0.062s
I20260709 13:06:03.293447 17491 raft_consensus.cc:359] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:03.294143 17491 raft_consensus.cc:740] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.294905 17491 consensus_queue.cc:260] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:03.297667 17491 ts_tablet_manager.cc:1434] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:06:03.298507 17491 tablet_bootstrap.cc:492] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:03.302711 17648 raft_consensus.cc:3060] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.321924 17491 tablet_bootstrap.cc:492] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.323079 17491 tablet_bootstrap.cc:492] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:03.324326 17491 ts_tablet_manager.cc:1403] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.011s
I20260709 13:06:03.326862 17491 raft_consensus.cc:359] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:03.328899 17491 raft_consensus.cc:740] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.329770 17491 consensus_queue.cc:260] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:03.334358 17491 ts_tablet_manager.cc:1434] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:06:03.335764 17491 tablet_bootstrap.cc:492] T 16b4be927a834597b7190497210b9169 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:03.356153 17491 tablet_bootstrap.cc:492] T 16b4be927a834597b7190497210b9169 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.356971 17491 tablet_bootstrap.cc:492] T 16b4be927a834597b7190497210b9169 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:03.357625 17491 ts_tablet_manager.cc:1403] T 16b4be927a834597b7190497210b9169 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.022s	user 0.021s	sys 0.000s
I20260709 13:06:03.359822 17491 raft_consensus.cc:359] T 16b4be927a834597b7190497210b9169 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:03.360450 17491 raft_consensus.cc:740] T 16b4be927a834597b7190497210b9169 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.361243 17491 consensus_queue.cc:260] T 16b4be927a834597b7190497210b9169 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:03.363211 17491 ts_tablet_manager.cc:1434] T 16b4be927a834597b7190497210b9169 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:03.364697 17491 tablet_bootstrap.cc:492] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:03.384032 17491 tablet_bootstrap.cc:492] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.385783 17491 tablet_bootstrap.cc:492] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:03.386588 17491 ts_tablet_manager.cc:1403] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 13:06:03.388634 17491 raft_consensus.cc:359] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:03.389247 17491 raft_consensus.cc:740] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.389853 17491 consensus_queue.cc:260] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:03.391446 17491 ts_tablet_manager.cc:1434] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:03.392712 17491 tablet_bootstrap.cc:492] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
W20260709 13:06:03.408021 16879 consensus_peers.cc:597] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:03.416613 17491 tablet_bootstrap.cc:492] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.417891 17491 tablet_bootstrap.cc:492] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:03.418584 17491 ts_tablet_manager.cc:1403] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.003s
I20260709 13:06:03.422715 17491 raft_consensus.cc:359] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:03.424579 17491 raft_consensus.cc:740] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.425513 17491 consensus_queue.cc:260] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:03.427489 17491 ts_tablet_manager.cc:1434] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:06:03.429288 17491 tablet_bootstrap.cc:492] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:03.448937 17491 tablet_bootstrap.cc:492] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.449991 17491 tablet_bootstrap.cc:492] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:03.450757 17491 ts_tablet_manager.cc:1403] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.022s	user 0.020s	sys 0.000s
I20260709 13:06:03.454138 17491 raft_consensus.cc:359] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:03.454955 17491 raft_consensus.cc:740] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.456471 17491 consensus_queue.cc:260] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:03.459968 17491 ts_tablet_manager.cc:1434] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:06:03.461190 17491 tablet_bootstrap.cc:492] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:03.476588 17491 tablet_bootstrap.cc:492] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.477502 17491 tablet_bootstrap.cc:492] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:03.478464 17491 ts_tablet_manager.cc:1403] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:06:03.480594 17491 raft_consensus.cc:359] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:03.481209 17491 raft_consensus.cc:740] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.481935 17491 consensus_queue.cc:260] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:03.484222 17491 ts_tablet_manager.cc:1434] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:06:03.486442 17491 tablet_bootstrap.cc:492] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:03.505265 17491 tablet_bootstrap.cc:492] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.506213 17491 tablet_bootstrap.cc:492] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:03.506857 17491 ts_tablet_manager.cc:1403] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:06:03.510846 17491 raft_consensus.cc:359] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:03.511665 17491 raft_consensus.cc:740] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.512496 17491 consensus_queue.cc:260] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:03.515276 17491 ts_tablet_manager.cc:1434] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:06:03.516374 17491 tablet_bootstrap.cc:492] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:03.544675 17491 tablet_bootstrap.cc:492] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.545747 17491 tablet_bootstrap.cc:492] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:03.546455 17491 ts_tablet_manager.cc:1403] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.003s
I20260709 13:06:03.550647 17491 raft_consensus.cc:359] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:03.551383 17491 raft_consensus.cc:740] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.552177 17491 consensus_queue.cc:260] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:03.554458 17491 ts_tablet_manager.cc:1434] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:06:03.555312 17491 tablet_bootstrap.cc:492] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:03.576316 17491 tablet_bootstrap.cc:492] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.577471 17491 tablet_bootstrap.cc:492] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:03.578219 17491 ts_tablet_manager.cc:1403] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 13:06:03.580294 17491 raft_consensus.cc:359] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:03.580852 17491 raft_consensus.cc:740] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.581560 17491 consensus_queue.cc:260] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:03.584038 17491 ts_tablet_manager.cc:1434] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:03.586064 17491 tablet_bootstrap.cc:492] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:03.613572 17491 tablet_bootstrap.cc:492] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.614423 17491 tablet_bootstrap.cc:492] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:03.615108 17491 ts_tablet_manager.cc:1403] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.011s
I20260709 13:06:03.617228 17648 raft_consensus.cc:3060] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.617772 17491 raft_consensus.cc:359] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:03.618494 17491 raft_consensus.cc:740] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.619280 17491 consensus_queue.cc:260] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:03.621328 17491 ts_tablet_manager.cc:1434] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:06:03.625569 17491 tablet_bootstrap.cc:492] T bf3d4f25ea4e4b14b6dd55a052daf82c P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:03.688349 17649 raft_consensus.cc:3060] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.732254 17491 tablet_bootstrap.cc:492] T bf3d4f25ea4e4b14b6dd55a052daf82c P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.737207 17491 tablet_bootstrap.cc:492] T bf3d4f25ea4e4b14b6dd55a052daf82c P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:03.741833 17491 ts_tablet_manager.cc:1403] T bf3d4f25ea4e4b14b6dd55a052daf82c P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.116s	user 0.031s	sys 0.035s
I20260709 13:06:03.746829 17491 raft_consensus.cc:359] T bf3d4f25ea4e4b14b6dd55a052daf82c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:03.747641 17491 raft_consensus.cc:740] T bf3d4f25ea4e4b14b6dd55a052daf82c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.748505 17491 consensus_queue.cc:260] T bf3d4f25ea4e4b14b6dd55a052daf82c P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:03.753661 17491 ts_tablet_manager.cc:1434] T bf3d4f25ea4e4b14b6dd55a052daf82c P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:06:03.763278 17491 tablet_bootstrap.cc:492] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
W20260709 13:06:03.808436 16804 consensus_peers.cc:597] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:03.810040 17491 tablet_bootstrap.cc:492] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.811097 17491 tablet_bootstrap.cc:492] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:03.811762 17491 ts_tablet_manager.cc:1403] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.017s
I20260709 13:06:03.814193 17491 raft_consensus.cc:359] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:03.814869 17491 raft_consensus.cc:740] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.815583 17491 consensus_queue.cc:260] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:03.818113 17491 ts_tablet_manager.cc:1434] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:06:03.818954 17491 tablet_bootstrap.cc:492] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:03.832813 17491 tablet_bootstrap.cc:492] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.833825 17491 tablet_bootstrap.cc:492] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:03.834481 17491 ts_tablet_manager.cc:1403] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:06:03.836526 17491 raft_consensus.cc:359] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:03.837183 17491 raft_consensus.cc:740] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.837917 17491 consensus_queue.cc:260] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:03.840077 17491 ts_tablet_manager.cc:1434] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:03.841392 17491 tablet_bootstrap.cc:492] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap starting.
I20260709 13:06:03.860638 17491 tablet_bootstrap.cc:492] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.861922 17491 tablet_bootstrap.cc:492] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8: Bootstrap complete.
I20260709 13:06:03.862684 17491 ts_tablet_manager.cc:1403] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 13:06:03.865679 17491 raft_consensus.cc:359] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:03.866439 17491 raft_consensus.cc:740] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Initialized, Role: FOLLOWER
I20260709 13:06:03.867254 17491 consensus_queue.cc:260] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:03.874529 17491 ts_tablet_manager.cc:1434] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:06:03.943910 17648 raft_consensus.cc:3060] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.007612 17648 raft_consensus.cc:3060] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:05.540483 16879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37355, user_credentials={real_user=slave}} blocked reactor thread for 50374.1us
I20260709 13:06:12.850158  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:12.926664 16909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13d7f28a321a46919d282b9709ab84cb"
dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
mode: GRACEFUL
new_leader_uuid: "622433288cac4964aea9ea5a24ba77fd"
 from {username='slave'} at 127.0.0.1:47518
I20260709 13:06:12.927691 16909 raft_consensus.cc:606] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Received request to transfer leadership to TS 622433288cac4964aea9ea5a24ba77fd
I20260709 13:06:12.943136 16833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e348c32749d48f68c70dc32267e38c0"
dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
mode: GRACEFUL
new_leader_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:55706
I20260709 13:06:12.943758 16833 raft_consensus.cc:606] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Received request to transfer leadership to TS 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:06:12.951797 17762 raft_consensus.cc:993] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b: : Instructing follower 622433288cac4964aea9ea5a24ba77fd to start an election
I20260709 13:06:12.952450 17760 raft_consensus.cc:1081] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Signalling peer 622433288cac4964aea9ea5a24ba77fd to start an election
I20260709 13:06:12.954370 16833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13d7f28a321a46919d282b9709ab84cb"
dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
 from {username='slave'} at 127.0.0.1:39574
I20260709 13:06:12.955008 16833 raft_consensus.cc:493] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:12.955469 16833 raft_consensus.cc:3060] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:12.961328 16764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2500d1c1df2649d99c7a5e1146e771d9"
dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
mode: GRACEFUL
new_leader_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:46380
I20260709 13:06:12.962030 16764 raft_consensus.cc:606] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 2 LEADER]: Received request to transfer leadership to TS 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:06:12.963711 16833 raft_consensus.cc:515] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:06:12.965240 16831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ac2a62af17746bcba9f94b6a1053f28"
dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
mode: GRACEFUL
new_leader_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:55706
I20260709 13:06:12.965849 16831 raft_consensus.cc:606] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Received request to transfer leadership to TS 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:06:12.966550 16833 leader_election.cc:290] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:06:12.968189 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d7f28a321a46919d282b9709ab84cb" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:06:12.968008 16907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d7f28a321a46919d282b9709ab84cb" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:06:12.968935 16764 raft_consensus.cc:3060] T 13d7f28a321a46919d282b9709ab84cb P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:12.969203 16907 raft_consensus.cc:3055] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:12.969664 16833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b89e067aed8497a9c9c70577ac56c77"
dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
mode: GRACEFUL
new_leader_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:55706
I20260709 13:06:12.969662 16907 raft_consensus.cc:740] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:06:12.970460 16833 raft_consensus.cc:606] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Received request to transfer leadership to TS 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:06:12.971051 16907 consensus_queue.cc:260] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:06:12.973291 16907 raft_consensus.cc:3060] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:12.973551 16909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa6e4009e1d445a1b055538cf3006287"
dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
mode: GRACEFUL
new_leader_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:47518
I20260709 13:06:12.974191 16909 raft_consensus.cc:606] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Received request to transfer leadership to TS 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:06:12.975713  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:12.976635 16764 raft_consensus.cc:2468] T 13d7f28a321a46919d282b9709ab84cb P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 2.
I20260709 13:06:12.977810  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:12.977954 16802 leader_election.cc:304] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:06:12.979312 17759 raft_consensus.cc:2804] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:12.979857 17759 raft_consensus.cc:697] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Becoming Leader. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:06:12.980971 17759 consensus_queue.cc:237] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:06:12.982127 16907 raft_consensus.cc:2468] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 2.
I20260709 13:06:12.995630 16586 catalog_manager.cc:5697] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd reported cstate change: term changed from 1 to 2, leader changed from 7197bc10b2304fccb972da2da7749e3b (127.8.4.68) to 622433288cac4964aea9ea5a24ba77fd (127.8.4.67). New cstate: current_term: 2 leader_uuid: "622433288cac4964aea9ea5a24ba77fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.005158 17759 raft_consensus.cc:993] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd: : Instructing follower 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:13.006029 17761 raft_consensus.cc:1081] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Signalling peer 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:13.008143 17644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b89e067aed8497a9c9c70577ac56c77"
dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:41638
I20260709 13:06:13.008622 17644 raft_consensus.cc:493] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:13.008913 17644 raft_consensus.cc:3060] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.022987 17644 raft_consensus.cc:515] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:13.024946 17644 leader_election.cc:290] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:06:13.026314 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b89e067aed8497a9c9c70577ac56c77" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:06:13.026944 16764 raft_consensus.cc:3060] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.028749 16833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b89e067aed8497a9c9c70577ac56c77" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:06:13.029470 16833 raft_consensus.cc:3055] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:13.029808 16833 raft_consensus.cc:740] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:06:13.030675 16833 consensus_queue.cc:260] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:13.032155 16833 raft_consensus.cc:3060] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.034062 16764 raft_consensus.cc:2468] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 2.
I20260709 13:06:13.036172 17485 leader_election.cc:304] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:06:13.041846 16833 raft_consensus.cc:2468] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 2.
I20260709 13:06:13.046738 17774 raft_consensus.cc:2804] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:13.050136 17774 raft_consensus.cc:697] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:06:13.051156 17774 consensus_queue.cc:237] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:13.064670 16586 catalog_manager.cc:5697] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 1 to 2, leader changed from 622433288cac4964aea9ea5a24ba77fd (127.8.4.67) to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 2 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.223467 17764 raft_consensus.cc:993] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011: : Instructing follower 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:13.224185 17777 raft_consensus.cc:1081] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 2 LEADER]: Signalling peer 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:13.226142 17649 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2500d1c1df2649d99c7a5e1146e771d9"
dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:41644
I20260709 13:06:13.226625 17649 raft_consensus.cc:493] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:13.226994 17649 raft_consensus.cc:3060] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.232337 17649 raft_consensus.cc:515] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:13.234095 17649 leader_election.cc:290] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 3 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:06:13.235055 16831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2500d1c1df2649d99c7a5e1146e771d9" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:06:13.235224 16761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2500d1c1df2649d99c7a5e1146e771d9" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:06:13.235689 16831 raft_consensus.cc:3060] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.235875 16761 raft_consensus.cc:3055] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:13.236249 16761 raft_consensus.cc:740] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:06:13.237149 16761 consensus_queue.cc:260] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:13.238521 16761 raft_consensus.cc:3060] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.243062 16831 raft_consensus.cc:2468] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 3.
I20260709 13:06:13.243883 16833 raft_consensus.cc:1240] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Rejecting Update request from peer d0ea3afb898b4eb5b21faeb676627011 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:13.244632 17486 leader_election.cc:304] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd; no voters: 
I20260709 13:06:13.245713 17774 raft_consensus.cc:2804] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:13.246274 17774 raft_consensus.cc:697] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [term 3 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:06:13.246773 16761 raft_consensus.cc:2468] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 3.
I20260709 13:06:13.247205 17774 consensus_queue.cc:237] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:13.259549 16586 catalog_manager.cc:5697] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 2 to 3, leader changed from d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66) to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 3 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.290319 17762 raft_consensus.cc:993] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b: : Instructing follower 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:13.290928 17756 raft_consensus.cc:1081] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Signalling peer 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:13.293219 17644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa6e4009e1d445a1b055538cf3006287"
dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:06:13.293834 17644 raft_consensus.cc:493] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:13.294189 17644 raft_consensus.cc:3060] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.300735 17644 raft_consensus.cc:515] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:13.302276 17644 leader_election.cc:290] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:06:13.303241 16907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6e4009e1d445a1b055538cf3006287" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:06:13.303546 16761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6e4009e1d445a1b055538cf3006287" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:06:13.303903 16907 raft_consensus.cc:3055] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:13.304236 16761 raft_consensus.cc:3060] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.304472 16907 raft_consensus.cc:740] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:06:13.305431 16907 consensus_queue.cc:260] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:13.306576 16907 raft_consensus.cc:3060] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.310242 16761 raft_consensus.cc:2468] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 2.
I20260709 13:06:13.312445 17485 leader_election.cc:304] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:06:13.313374 17774 raft_consensus.cc:2804] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:13.313876 17774 raft_consensus.cc:697] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:06:13.314751 17774 consensus_queue.cc:237] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:13.329946 16907 raft_consensus.cc:2468] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 2.
I20260709 13:06:13.330842 16586 catalog_manager.cc:5697] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 1 to 2, leader changed from 7197bc10b2304fccb972da2da7749e3b (127.8.4.68) to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 2 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.360297 17759 raft_consensus.cc:993] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd: : Instructing follower 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:13.361415 17780 raft_consensus.cc:1081] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Signalling peer 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:13.363168 17644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e348c32749d48f68c70dc32267e38c0"
dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:41638
I20260709 13:06:13.363690 17644 raft_consensus.cc:493] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:13.364096 17644 raft_consensus.cc:3060] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.369673 17644 raft_consensus.cc:515] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:13.371945 17644 leader_election.cc:290] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:06:13.372287 16833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e348c32749d48f68c70dc32267e38c0" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:06:13.372941 16833 raft_consensus.cc:3055] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:13.373378 16907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e348c32749d48f68c70dc32267e38c0" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:06:13.373852 16833 raft_consensus.cc:740] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:06:13.374051 16907 raft_consensus.cc:3060] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.375288 16833 consensus_queue.cc:260] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
W20260709 13:06:13.376471 16805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.377403 16833 raft_consensus.cc:3060] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.381760 16907 raft_consensus.cc:2468] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 2.
I20260709 13:06:13.382988 17485 leader_election.cc:304] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:06:13.383837 17774 raft_consensus.cc:2804] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:13.384483 17774 raft_consensus.cc:697] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:06:13.384745 16833 raft_consensus.cc:2468] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 2.
I20260709 13:06:13.385340 17774 consensus_queue.cc:237] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:13.401701 16586 catalog_manager.cc:5697] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 1 to 2, leader changed from 622433288cac4964aea9ea5a24ba77fd (127.8.4.67) to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 2 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:13.437196 16833 raft_consensus.cc:1275] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:13.439426 17774 consensus_queue.cc:1048] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:13.462427 16761 raft_consensus.cc:1275] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:13.465430 17775 consensus_queue.cc:1048] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:13.495340 16761 raft_consensus.cc:1275] T 13d7f28a321a46919d282b9709ab84cb P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Refusing update from remote peer 622433288cac4964aea9ea5a24ba77fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:13.496737 17761 consensus_queue.cc:1048] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:13.507737 17761 raft_consensus.cc:993] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd: : Instructing follower 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:13.517102 17780 raft_consensus.cc:1081] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Signalling peer 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:13.520117 17644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ac2a62af17746bcba9f94b6a1053f28"
dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:41638
I20260709 13:06:13.520790 17644 raft_consensus.cc:493] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:13.523957 16909 raft_consensus.cc:1275] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Refusing update from remote peer 622433288cac4964aea9ea5a24ba77fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:13.527678 17761 consensus_queue.cc:1048] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:13.521253 17644 raft_consensus.cc:3060] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.535948 17644 raft_consensus.cc:515] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:13.539338 17644 leader_election.cc:290] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 3 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:06:13.540267 16831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2a62af17746bcba9f94b6a1053f28" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:06:13.540988 16831 raft_consensus.cc:3055] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:13.541154 16907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2a62af17746bcba9f94b6a1053f28" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:06:13.541379 16831 raft_consensus.cc:740] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:06:13.542049 16907 raft_consensus.cc:3060] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.542248 16831 consensus_queue.cc:260] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:13.543478 16831 raft_consensus.cc:3060] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.552201 16907 raft_consensus.cc:2468] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 3.
I20260709 13:06:13.553524 17485 leader_election.cc:304] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:06:13.554431 17774 raft_consensus.cc:2804] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:13.555255 16831 raft_consensus.cc:2468] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 3.
I20260709 13:06:13.555461 17774 raft_consensus.cc:697] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 3 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:06:13.556701 17774 consensus_queue.cc:237] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:13.567682 16586 catalog_manager.cc:5697] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 2 to 3, leader changed from 622433288cac4964aea9ea5a24ba77fd (127.8.4.67) to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 3 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:13.733346 16831 raft_consensus.cc:1275] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:13.734643 17774 consensus_queue.cc:1048] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.736552 16764 raft_consensus.cc:1275] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 3 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:13.738049 17774 consensus_queue.cc:1048] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.832374 16761 raft_consensus.cc:1275] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:13.833940 17797 consensus_queue.cc:1048] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:13.847532 16907 raft_consensus.cc:1275] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:13.849592 17796 consensus_queue.cc:1048] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:13.851487 16907 raft_consensus.cc:1275] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:13.854779 17796 consensus_queue.cc:1048] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:13.874122 16833 raft_consensus.cc:1275] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:13.884450 17775 consensus_queue.cc:1048] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:13.979387  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:14.026760  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:14.064333 16914 raft_consensus.cc:1275] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:14.065909 17774 consensus_queue.cc:1048] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.085857 16833 raft_consensus.cc:1275] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:14.088799 16831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f906a9d133f4a90b55f8dd4ba7d917a"
dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
mode: GRACEFUL
new_leader_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:55706
I20260709 13:06:14.089460 16831 raft_consensus.cc:606] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Received request to transfer leadership to TS 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:06:14.089466 17797 consensus_queue.cc:1048] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:14.092660 16907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30d0c8416cdc43289eceaddcbd00a20e"
dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
mode: GRACEFUL
new_leader_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:47518
I20260709 13:06:14.093255 16907 raft_consensus.cc:606] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 2 LEADER]: Received request to transfer leadership to TS 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:06:14.097959 16907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "661f1f2dcacb42bca7e3b25195dbdfe1"
dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
mode: GRACEFUL
new_leader_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:47518
I20260709 13:06:14.098840 16907 raft_consensus.cc:606] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 2 LEADER]: Received request to transfer leadership to TS 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:06:14.102551 16907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73a0ed4bc207489699e41033ec224d3a"
dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
mode: GRACEFUL
new_leader_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:47518
I20260709 13:06:14.103206 16907 raft_consensus.cc:606] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Received request to transfer leadership to TS 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:06:14.107247 16761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83f0df42f20d4d9398c8d4b5b3cba4ea"
dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
mode: GRACEFUL
new_leader_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:46380
I20260709 13:06:14.108330 16761 raft_consensus.cc:606] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 2 LEADER]: Received request to transfer leadership to TS 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:06:14.111224 16914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e863dd66af3949e78a0e9882520673fb"
dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
mode: GRACEFUL
new_leader_uuid: "622433288cac4964aea9ea5a24ba77fd"
 from {username='slave'} at 127.0.0.1:47518
I20260709 13:06:14.111891 16914 raft_consensus.cc:606] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Received request to transfer leadership to TS 622433288cac4964aea9ea5a24ba77fd
I20260709 13:06:14.114699  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:14.116629  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:14.273420 17802 raft_consensus.cc:993] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd: : Instructing follower 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:14.274118 17803 raft_consensus.cc:1081] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Signalling peer 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:14.275950 17644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f906a9d133f4a90b55f8dd4ba7d917a"
dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:41638
I20260709 13:06:14.276489 17644 raft_consensus.cc:493] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:14.276829 17644 raft_consensus.cc:3060] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.283779 17644 raft_consensus.cc:515] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:14.286563 16831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f906a9d133f4a90b55f8dd4ba7d917a" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:06:14.286526 17644 leader_election.cc:290] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:06:14.287097 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f906a9d133f4a90b55f8dd4ba7d917a" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:06:14.287353 16831 raft_consensus.cc:3055] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:14.287833 16914 raft_consensus.cc:3060] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.287858 16831 raft_consensus.cc:740] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:06:14.290884 16831 consensus_queue.cc:260] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:14.292297 16831 raft_consensus.cc:3060] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.295908 16914 raft_consensus.cc:2468] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 2.
I20260709 13:06:14.297248 17485 leader_election.cc:304] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:06:14.298130 17797 raft_consensus.cc:2804] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:14.298679 17797 raft_consensus.cc:697] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [term 2 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:06:14.299567 17797 consensus_queue.cc:237] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:14.311599 16831 raft_consensus.cc:2468] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 2.
I20260709 13:06:14.311909 16588 catalog_manager.cc:5697] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 1 to 2, leader changed from 622433288cac4964aea9ea5a24ba77fd (127.8.4.67) to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 2 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.353271 17777 raft_consensus.cc:993] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011: : Instructing follower 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:14.353979 17757 raft_consensus.cc:1081] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 2 LEADER]: Signalling peer 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:14.355607 17644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83f0df42f20d4d9398c8d4b5b3cba4ea"
dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:41644
I20260709 13:06:14.356151 17644 raft_consensus.cc:493] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:14.356542 17644 raft_consensus.cc:3060] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.362360 17644 raft_consensus.cc:515] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:14.364465 17644 leader_election.cc:290] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 3 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:06:14.365105 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f0df42f20d4d9398c8d4b5b3cba4ea" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:06:14.365854 16764 raft_consensus.cc:3055] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:14.366226 16764 raft_consensus.cc:740] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:06:14.366389 16831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f0df42f20d4d9398c8d4b5b3cba4ea" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:06:14.366982 16831 raft_consensus.cc:3060] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.366901 16764 consensus_queue.cc:260] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:14.367925 16764 raft_consensus.cc:3060] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.372200 16831 raft_consensus.cc:2468] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 3.
I20260709 13:06:14.372854 16764 raft_consensus.cc:2468] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 3.
I20260709 13:06:14.373562 17486 leader_election.cc:304] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd; no voters: 
I20260709 13:06:14.374596 17797 raft_consensus.cc:2804] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:14.375022 17797 raft_consensus.cc:697] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [term 3 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:06:14.375833 17797 consensus_queue.cc:237] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:14.385870 16588 catalog_manager.cc:5697] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 2 to 3, leader changed from d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66) to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 3 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:14.396508 17756 raft_consensus.cc:993] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b: : Instructing follower 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:14.397034 17756 raft_consensus.cc:1081] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 2 LEADER]: Signalling peer 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:14.398797 17644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30d0c8416cdc43289eceaddcbd00a20e"
dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:06:14.399411 17644 raft_consensus.cc:493] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:14.399816 17644 raft_consensus.cc:3060] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.407896 17644 raft_consensus.cc:515] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:14.410784 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d0c8416cdc43289eceaddcbd00a20e" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:06:14.411448 16914 raft_consensus.cc:3055] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:14.411379 17644 leader_election.cc:290] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 3 election: Requested vote from peers 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
I20260709 13:06:14.411979 16914 raft_consensus.cc:740] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:06:14.411667 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d0c8416cdc43289eceaddcbd00a20e" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:06:14.413057 16764 raft_consensus.cc:3060] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.412992 16914 consensus_queue.cc:260] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:14.414472 16914 raft_consensus.cc:3060] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.420228 16764 raft_consensus.cc:2468] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 3.
I20260709 13:06:14.422061 17485 leader_election.cc:304] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:06:14.422087 16914 raft_consensus.cc:2468] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 3.
I20260709 13:06:14.423947 17775 raft_consensus.cc:2804] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:14.424494 17775 raft_consensus.cc:697] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [term 3 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:06:14.425570 17775 consensus_queue.cc:237] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:14.442147 17756 raft_consensus.cc:993] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b: : Instructing follower 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:14.442589 17756 raft_consensus.cc:1081] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 2 LEADER]: Signalling peer 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:14.444124 17644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "661f1f2dcacb42bca7e3b25195dbdfe1"
dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:06:14.444710 17644 raft_consensus.cc:493] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:14.445019 17644 raft_consensus.cc:3060] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.447005 16588 catalog_manager.cc:5697] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 2 to 3, leader changed from 7197bc10b2304fccb972da2da7749e3b (127.8.4.68) to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 3 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:14.450484 17644 raft_consensus.cc:515] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:14.454859 16833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661f1f2dcacb42bca7e3b25195dbdfe1" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:06:14.455237 16907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661f1f2dcacb42bca7e3b25195dbdfe1" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:06:14.455572 16833 raft_consensus.cc:3060] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.455893 16907 raft_consensus.cc:3055] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:14.456218 16907 raft_consensus.cc:740] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:06:14.457113 16907 consensus_queue.cc:260] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:14.458346 16907 raft_consensus.cc:3060] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.467984 16907 raft_consensus.cc:2468] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 3.
I20260709 13:06:14.468891 17644 leader_election.cc:290] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 3 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:06:14.469496 16833 raft_consensus.cc:2468] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 3.
I20260709 13:06:14.469347 17485 leader_election.cc:304] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:06:14.471424 17775 raft_consensus.cc:2804] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:14.472076 17775 raft_consensus.cc:697] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [term 3 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:06:14.474076 17775 consensus_queue.cc:237] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:14.484797 16588 catalog_manager.cc:5697] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 2 to 3, leader changed from 7197bc10b2304fccb972da2da7749e3b (127.8.4.68) to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 3 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.509541 17760 raft_consensus.cc:993] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b: : Instructing follower 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:14.510087 17760 raft_consensus.cc:1081] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Signalling peer 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:14.511726 17644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73a0ed4bc207489699e41033ec224d3a"
dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:06:14.512279 17644 raft_consensus.cc:493] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:14.512594 17644 raft_consensus.cc:3060] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.518453 17644 raft_consensus.cc:515] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:14.520483 17644 leader_election.cc:290] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:06:14.520982 16831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a0ed4bc207489699e41033ec224d3a" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:06:14.521680 16831 raft_consensus.cc:3060] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.521587 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a0ed4bc207489699e41033ec224d3a" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:06:14.522317 16914 raft_consensus.cc:3055] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:14.522620 16914 raft_consensus.cc:740] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:06:14.523005 17760 raft_consensus.cc:993] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b: : Instructing follower 622433288cac4964aea9ea5a24ba77fd to start an election
I20260709 13:06:14.523494 17756 raft_consensus.cc:1081] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Signalling peer 622433288cac4964aea9ea5a24ba77fd to start an election
I20260709 13:06:14.523375 16914 consensus_queue.cc:260] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:14.525102 16914 raft_consensus.cc:3060] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.525530 16833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e863dd66af3949e78a0e9882520673fb"
dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
 from {username='slave'} at 127.0.0.1:39574
I20260709 13:06:14.526158 16833 raft_consensus.cc:493] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:14.526535 16833 raft_consensus.cc:3060] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.529307 16831 raft_consensus.cc:2468] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 2.
I20260709 13:06:14.530846 17486 leader_election.cc:304] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd; no voters: 
I20260709 13:06:14.531670 17775 raft_consensus.cc:2804] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:14.532156 17775 raft_consensus.cc:697] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [term 2 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:06:14.532785 16914 raft_consensus.cc:2468] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 2.
I20260709 13:06:14.532874 16833 raft_consensus.cc:515] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:06:14.533063 17775 consensus_queue.cc:237] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:14.535915 16833 leader_election.cc:290] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:06:14.536142 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e863dd66af3949e78a0e9882520673fb" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:06:14.536836 16764 raft_consensus.cc:3060] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.544543 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e863dd66af3949e78a0e9882520673fb" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:06:14.547071 16764 raft_consensus.cc:2468] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 2.
I20260709 13:06:14.547700 16914 raft_consensus.cc:3055] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:14.548086 16914 raft_consensus.cc:740] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:06:14.548828 16802 leader_election.cc:304] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:06:14.548918 16914 consensus_queue.cc:260] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:06:14.550236 17802 raft_consensus.cc:2804] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:14.550616 16914 raft_consensus.cc:3060] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.550693 17802 raft_consensus.cc:697] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Becoming Leader. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:06:14.551605 17802 consensus_queue.cc:237] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:06:14.558764 16588 catalog_manager.cc:5697] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 1 to 2, leader changed from 7197bc10b2304fccb972da2da7749e3b (127.8.4.68) to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 2 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.559593 16914 raft_consensus.cc:2468] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 2.
I20260709 13:06:14.565388 16586 catalog_manager.cc:5697] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd reported cstate change: term changed from 1 to 2, leader changed from 7197bc10b2304fccb972da2da7749e3b (127.8.4.68) to 622433288cac4964aea9ea5a24ba77fd (127.8.4.67). New cstate: current_term: 2 leader_uuid: "622433288cac4964aea9ea5a24ba77fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:14.699904 16833 raft_consensus.cc:1275] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:14.701407 17797 consensus_queue.cc:1048] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:14.714291 16914 raft_consensus.cc:1275] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:14.715655 17797 consensus_queue.cc:1048] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:14.823382 16761 raft_consensus.cc:1275] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [term 3 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:14.824750 17774 consensus_queue.cc:1048] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.834457 16907 raft_consensus.cc:1275] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:14.836285 17819 consensus_queue.cc:1048] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.902451 16833 raft_consensus.cc:1275] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:14.903839 17819 consensus_queue.cc:1048] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.917138 16907 raft_consensus.cc:1275] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:14.921182 17775 consensus_queue.cc:1048] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.922518 16833 raft_consensus.cc:1275] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:14.924073 17819 consensus_queue.cc:1048] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:14.932417 16761 raft_consensus.cc:1275] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 3 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:14.934440 17819 consensus_queue.cc:1048] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:14.957456 16907 raft_consensus.cc:1275] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:14.959645 16831 raft_consensus.cc:1275] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:14.962631 17774 consensus_queue.cc:1048] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:14.963564 17820 consensus_queue.cc:1048] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:15.087452 16764 raft_consensus.cc:1275] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Refusing update from remote peer 622433288cac4964aea9ea5a24ba77fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:15.088863 17803 consensus_queue.cc:1048] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.104780 16914 raft_consensus.cc:1275] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Refusing update from remote peer 622433288cac4964aea9ea5a24ba77fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:15.107515 17802 consensus_queue.cc:1048] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.117630  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:15.170370  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:15.218838 16764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b49036bff00949ec88900c3537cf5edc"
dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
mode: GRACEFUL
new_leader_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:46380
I20260709 13:06:15.219425 16764 raft_consensus.cc:606] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 2 LEADER]: Received request to transfer leadership to TS 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:06:15.222388 16833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d281c9020d454b23a8bd21ccfadfa93c"
dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
mode: GRACEFUL
new_leader_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:55706
I20260709 13:06:15.222985 16833 raft_consensus.cc:606] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Received request to transfer leadership to TS 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:06:15.225888 16764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e848db4f370a472f9baa6f3d547cb966"
dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
mode: GRACEFUL
new_leader_uuid: "7197bc10b2304fccb972da2da7749e3b"
 from {username='slave'} at 127.0.0.1:46380
I20260709 13:06:15.226493 16764 raft_consensus.cc:606] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Received request to transfer leadership to TS 7197bc10b2304fccb972da2da7749e3b
I20260709 13:06:15.229296 16764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1e9d9f32bec4123a2f10e3a20f1067b"
dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
mode: GRACEFUL
new_leader_uuid: "622433288cac4964aea9ea5a24ba77fd"
 from {username='slave'} at 127.0.0.1:46380
I20260709 13:06:15.230067 16764 raft_consensus.cc:606] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Received request to transfer leadership to TS 622433288cac4964aea9ea5a24ba77fd
I20260709 13:06:15.231575  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:06:15.233132  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:15.267326 17815 raft_consensus.cc:993] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011: : Instructing follower 622433288cac4964aea9ea5a24ba77fd to start an election
I20260709 13:06:15.267995 17757 raft_consensus.cc:1081] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Signalling peer 622433288cac4964aea9ea5a24ba77fd to start an election
I20260709 13:06:15.269614 16833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1e9d9f32bec4123a2f10e3a20f1067b"
dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 13:06:15.270160 16833 raft_consensus.cc:493] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:15.270494 16833 raft_consensus.cc:3060] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.278982 16833 raft_consensus.cc:515] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:06:15.281329 16833 leader_election.cc:290] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:06:15.282373 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e9d9f32bec4123a2f10e3a20f1067b" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:06:15.282418 16764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e9d9f32bec4123a2f10e3a20f1067b" candidate_uuid: "622433288cac4964aea9ea5a24ba77fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:06:15.283154 16914 raft_consensus.cc:3060] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.283187 16764 raft_consensus.cc:3055] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:15.283911 16764 raft_consensus.cc:740] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:06:15.284757 16764 consensus_queue.cc:260] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:06:15.286062 16764 raft_consensus.cc:3060] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.291251 16914 raft_consensus.cc:2468] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 2.
I20260709 13:06:15.293689 16764 raft_consensus.cc:2468] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622433288cac4964aea9ea5a24ba77fd in term 2.
I20260709 13:06:15.293740 16802 leader_election.cc:304] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:06:15.295552 17802 raft_consensus.cc:2804] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:15.296070 17802 raft_consensus.cc:697] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Becoming Leader. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:06:15.296981 17802 consensus_queue.cc:237] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:06:15.312525 16585 catalog_manager.cc:5697] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd reported cstate change: term changed from 1 to 2, leader changed from d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66) to 622433288cac4964aea9ea5a24ba77fd (127.8.4.67). New cstate: current_term: 2 leader_uuid: "622433288cac4964aea9ea5a24ba77fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:15.592743 17802 raft_consensus.cc:993] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd: : Instructing follower 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:15.666560 17803 raft_consensus.cc:1081] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Signalling peer 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:15.667687 17815 raft_consensus.cc:993] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011: : Instructing follower 7197bc10b2304fccb972da2da7749e3b to start an election
I20260709 13:06:15.668695 17815 raft_consensus.cc:1081] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Signalling peer 7197bc10b2304fccb972da2da7749e3b to start an election
I20260709 13:06:15.690194 16914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e848db4f370a472f9baa6f3d547cb966"
dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
 from {username='slave'} at 127.0.0.1:41114
I20260709 13:06:15.691349 16914 raft_consensus.cc:493] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:15.692024 16914 raft_consensus.cc:3060] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:15.759114 16804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37355, user_credentials={real_user=slave}} blocked reactor thread for 49234.4us
I20260709 13:06:15.794217 17649 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d281c9020d454b23a8bd21ccfadfa93c"
dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:41638
I20260709 13:06:15.799736 17649 raft_consensus.cc:493] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:15.802323 17649 raft_consensus.cc:3060] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.802853 16909 raft_consensus.cc:1275] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Refusing update from remote peer 622433288cac4964aea9ea5a24ba77fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:15.803995 16879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37355, user_credentials={real_user=slave}} blocked reactor thread for 67122.4us
I20260709 13:06:15.805335 17823 consensus_queue.cc:1048] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:15.816013 16914 raft_consensus.cc:515] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:06:15.847105 16764 raft_consensus.cc:1275] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Refusing update from remote peer 622433288cac4964aea9ea5a24ba77fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:15.852001 17849 consensus_queue.cc:1048] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:15.859839 16914 leader_election.cc:290] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:06:15.881351 16839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848db4f370a472f9baa6f3d547cb966" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:06:15.894162 16839 raft_consensus.cc:3060] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.891355 17649 raft_consensus.cc:515] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
W20260709 13:06:15.920775 16877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:33887, user_credentials={real_user=slave}} blocked reactor thread for 118556us
I20260709 13:06:15.940280 16762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e848db4f370a472f9baa6f3d547cb966" candidate_uuid: "7197bc10b2304fccb972da2da7749e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:06:15.941843 16762 raft_consensus.cc:3055] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:15.942242 16762 raft_consensus.cc:740] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:06:15.943547 16762 consensus_queue.cc:260] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:06:15.951002 16762 raft_consensus.cc:3060] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.931648 16839 raft_consensus.cc:2468] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 2.
I20260709 13:06:15.956404 16830 raft_consensus.cc:1240] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Rejecting Update request from peer d0ea3afb898b4eb5b21faeb676627011 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:15.960311 16730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37355, user_credentials={real_user=slave}} blocked reactor thread for 178766us
I20260709 13:06:15.965641 17855 raft_consensus.cc:993] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011: : Instructing follower 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:15.966472 17843 raft_consensus.cc:1081] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 2 LEADER]: Signalling peer 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:15.969736 17649 leader_election.cc:290] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 3 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:06:15.972965 16908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d281c9020d454b23a8bd21ccfadfa93c" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:06:15.973975 16908 raft_consensus.cc:3060] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.977190 17648 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b49036bff00949ec88900c3537cf5edc"
dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:41644
I20260709 13:06:15.978055 17648 raft_consensus.cc:493] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:15.978456 17648 raft_consensus.cc:3060] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.984429 16830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d281c9020d454b23a8bd21ccfadfa93c" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:06:15.985500 16830 raft_consensus.cc:3055] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:15.986097 16830 raft_consensus.cc:740] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:06:15.987373 16830 consensus_queue.cc:260] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:15.989442 16830 raft_consensus.cc:3060] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.022961 16878 leader_election.cc:304] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622433288cac4964aea9ea5a24ba77fd, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:06:16.024257 17842 raft_consensus.cc:2804] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:16.024803 17842 raft_consensus.cc:697] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b [term 2 LEADER]: Becoming Leader. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:06:16.026230 17842 consensus_queue.cc:237] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } }
I20260709 13:06:16.036269 16830 raft_consensus.cc:2468] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 3.
I20260709 13:06:16.038899 17648 raft_consensus.cc:515] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:16.051947 16908 raft_consensus.cc:2468] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 3.
I20260709 13:06:16.052582 17648 leader_election.cc:290] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 3 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:06:16.054782 16833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49036bff00949ec88900c3537cf5edc" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:06:16.058080 16833 raft_consensus.cc:3060] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.065462 17485 leader_election.cc:304] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 7197bc10b2304fccb972da2da7749e3b; no voters: 
I20260709 13:06:16.068779 17775 raft_consensus.cc:2804] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:16.072690 16762 raft_consensus.cc:2468] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7197bc10b2304fccb972da2da7749e3b in term 2.
I20260709 13:06:16.074728 17775 raft_consensus.cc:697] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 3 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:06:16.075963 17775 consensus_queue.cc:237] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:16.084923 16763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49036bff00949ec88900c3537cf5edc" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:06:16.085770 16763 raft_consensus.cc:3055] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:16.086220 16763 raft_consensus.cc:740] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d0ea3afb898b4eb5b21faeb676627011, State: Running, Role: LEADER
I20260709 13:06:16.087419 16763 consensus_queue.cc:260] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:16.089102 16763 raft_consensus.cc:3060] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.106564 16763 raft_consensus.cc:2468] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 3.
I20260709 13:06:16.106703 16833 raft_consensus.cc:2468] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 3.
W20260709 13:06:16.109302 16879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.65:37355, user_credentials={real_user=slave}} blocked reactor thread for 81118.6us
I20260709 13:06:16.112505 17486 leader_election.cc:304] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd; no voters: 
I20260709 13:06:16.113704 17775 raft_consensus.cc:2804] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:16.114303 17775 raft_consensus.cc:697] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [term 3 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:06:16.115609 17775 consensus_queue.cc:237] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:16.118469 16585 catalog_manager.cc:5697] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 2 to 3, leader changed from 622433288cac4964aea9ea5a24ba77fd (127.8.4.67) to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 3 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:16.148530 16586 catalog_manager.cc:5697] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b reported cstate change: term changed from 1 to 2, leader changed from d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66) to 7197bc10b2304fccb972da2da7749e3b (127.8.4.68). New cstate: current_term: 2 leader_uuid: "7197bc10b2304fccb972da2da7749e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:16.205709 16587 catalog_manager.cc:5697] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 2 to 3, leader changed from d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66) to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 3 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:16.234372  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:16.296922  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:16.349947 16908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "061a5313535a475ea9385383b611b52d"
dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
mode: GRACEFUL
new_leader_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:47518
I20260709 13:06:16.350698 16908 raft_consensus.cc:606] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 2 LEADER]: Received request to transfer leadership to TS 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:06:16.355294 16830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "772bb23805934270899495ae7c8cbb07"
dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
mode: GRACEFUL
new_leader_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:55706
I20260709 13:06:16.355938 16830 raft_consensus.cc:606] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Received request to transfer leadership to TS 1cbe303821774e4d936ea3d54875dcb8
I20260709 13:06:16.359946  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:16.362280  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:16.367700 17850 raft_consensus.cc:993] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd: : Instructing follower 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:16.368358 17849 raft_consensus.cc:1081] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Signalling peer 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:16.370026 17640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "772bb23805934270899495ae7c8cbb07"
dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:41638
I20260709 13:06:16.370639 17640 raft_consensus.cc:493] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:16.370986 17640 raft_consensus.cc:3060] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.380838 17640 raft_consensus.cc:515] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:16.383992 16763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772bb23805934270899495ae7c8cbb07" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d0ea3afb898b4eb5b21faeb676627011"
I20260709 13:06:16.384244 17640 leader_election.cc:290] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 3 election: Requested vote from peers d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887), 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929)
I20260709 13:06:16.384349 16833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772bb23805934270899495ae7c8cbb07" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:06:16.384814 16763 raft_consensus.cc:3060] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.385203 16833 raft_consensus.cc:3055] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:16.385588 16833 raft_consensus.cc:740] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 622433288cac4964aea9ea5a24ba77fd, State: Running, Role: LEADER
I20260709 13:06:16.387130 16833 consensus_queue.cc:260] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:16.388514 16833 raft_consensus.cc:3060] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.391152 16763 raft_consensus.cc:2468] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 3.
I20260709 13:06:16.392660 17485 leader_election.cc:304] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011; no voters: 
I20260709 13:06:16.393644 17775 raft_consensus.cc:2804] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:16.394351 17775 raft_consensus.cc:697] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 3 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:06:16.395644 17775 consensus_queue.cc:237] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } }
I20260709 13:06:16.399500 16833 raft_consensus.cc:2468] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 3.
I20260709 13:06:16.406401 16587 catalog_manager.cc:5697] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 2 to 3, leader changed from 622433288cac4964aea9ea5a24ba77fd (127.8.4.67) to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 3 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:16.503944 17842 raft_consensus.cc:993] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b: : Instructing follower 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:16.504546 17852 raft_consensus.cc:1081] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 2 LEADER]: Signalling peer 1cbe303821774e4d936ea3d54875dcb8 to start an election
I20260709 13:06:16.506376 17640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "061a5313535a475ea9385383b611b52d"
dest_uuid: "1cbe303821774e4d936ea3d54875dcb8"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:06:16.507750 17640 raft_consensus.cc:493] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:16.508158 17640 raft_consensus.cc:3060] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.514348 17640 raft_consensus.cc:515] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:16.517307 16833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061a5313535a475ea9385383b611b52d" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "622433288cac4964aea9ea5a24ba77fd"
I20260709 13:06:16.517419 17640 leader_election.cc:290] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 3 election: Requested vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 7197bc10b2304fccb972da2da7749e3b (127.8.4.68:45033)
I20260709 13:06:16.517740 16908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061a5313535a475ea9385383b611b52d" candidate_uuid: "1cbe303821774e4d936ea3d54875dcb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7197bc10b2304fccb972da2da7749e3b"
I20260709 13:06:16.517922 16833 raft_consensus.cc:3060] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.518383 16908 raft_consensus.cc:3055] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:16.518741 16908 raft_consensus.cc:740] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7197bc10b2304fccb972da2da7749e3b, State: Running, Role: LEADER
I20260709 13:06:16.519568 16908 consensus_queue.cc:260] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:16.520918 16908 raft_consensus.cc:3060] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.523422 16763 raft_consensus.cc:1275] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 3 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:16.525939 17775 consensus_queue.cc:1048] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:16.527221 16833 raft_consensus.cc:2468] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 3.
I20260709 13:06:16.530303 17486 leader_election.cc:304] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd; no voters: 
I20260709 13:06:16.531184 17775 raft_consensus.cc:2804] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:16.532348 17775 raft_consensus.cc:697] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 3 LEADER]: Becoming Leader. State: Replica: 1cbe303821774e4d936ea3d54875dcb8, State: Running, Role: LEADER
I20260709 13:06:16.531118 16908 raft_consensus.cc:2468] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cbe303821774e4d936ea3d54875dcb8 in term 3.
I20260709 13:06:16.535400 17775 consensus_queue.cc:237] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:16.542910 16833 raft_consensus.cc:1275] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Refusing update from remote peer 7197bc10b2304fccb972da2da7749e3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:16.550877 17842 consensus_queue.cc:1048] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:16.560765 16839 raft_consensus.cc:1275] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:16.562553 17874 consensus_queue.cc:1048] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:16.556226 16587 catalog_manager.cc:5697] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 reported cstate change: term changed from 2 to 3, leader changed from 7197bc10b2304fccb972da2da7749e3b (127.8.4.68) to 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65). New cstate: current_term: 3 leader_uuid: "1cbe303821774e4d936ea3d54875dcb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:16.573734 16830 raft_consensus.cc:1275] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:16.575538 17874 consensus_queue.cc:1048] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:16.623940 16763 raft_consensus.cc:1275] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Refusing update from remote peer 7197bc10b2304fccb972da2da7749e3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:16.626461 17853 consensus_queue.cc:1048] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:16.639063 16907 raft_consensus.cc:1275] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:16.640980 17819 consensus_queue.cc:1048] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:16.817663 16763 raft_consensus.cc:1275] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [term 3 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:16.819341 17774 consensus_queue.cc:1048] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:16.832984 16830 raft_consensus.cc:1275] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:16.834635 17819 consensus_queue.cc:1048] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:16.919770 16830 raft_consensus.cc:1275] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:16.922541 17774 consensus_queue.cc:1048] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:16.935904 16907 raft_consensus.cc:1275] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Refusing update from remote peer 1cbe303821774e4d936ea3d54875dcb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:16.937695 17775 consensus_queue.cc:1048] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.363582  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:17.413165  8209 tablet_server.cc:179] TabletServer@127.8.4.65:37355 shutting down...
W20260709 13:06:17.459398 16730 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 326 similar messages]
W20260709 13:06:17.463761 16730 consensus_peers.cc:597] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.468669  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:17.470045  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.471426  8209 raft_consensus.cc:2243] T bf3d4f25ea4e4b14b6dd55a052daf82c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.472079  8209 raft_consensus.cc:2272] T bf3d4f25ea4e4b14b6dd55a052daf82c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.476013  8209 tablet_replica.cc:333] stopping tablet replica
W20260709 13:06:17.482440 16879 consensus_peers.cc:597] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.483392  8209 raft_consensus.cc:2243] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.484170  8209 raft_consensus.cc:2272] T b7e982a881834665b4845c226db01020 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.488082  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.489183  8209 raft_consensus.cc:2243] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.489907  8209 raft_consensus.cc:2272] T 0f6a383a050745a791b07441a3b93828 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.493312  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.494342  8209 raft_consensus.cc:2243] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.494977  8209 raft_consensus.cc:2272] T c80dc47d27a749eab1ffa183f231f036 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.498222  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.499058  8209 raft_consensus.cc:2243] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.499553  8209 raft_consensus.cc:2272] T d965337ae0df4ca7aba0e4f9549a8ca9 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.501960  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.502874  8209 raft_consensus.cc:2243] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.503381  8209 raft_consensus.cc:2272] T 4e93c7f885494add9735d842339e740a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.505590  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.506217  8209 raft_consensus.cc:2243] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:17.507138  8209 raft_consensus.cc:2272] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.509625  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.510363  8209 raft_consensus.cc:2243] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.510839  8209 raft_consensus.cc:2272] T 9b51d554de084a5594e8c14973873edc P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.513614  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.514330  8209 raft_consensus.cc:2243] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.514940  8209 raft_consensus.cc:2272] T 2369d92de77f42e7be750810912daeef P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.517896  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.518532  8209 raft_consensus.cc:2243] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.518975  8209 raft_consensus.cc:2272] T 4723ff8bcfab41bfad7b411c81cd0386 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.521395  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.522055  8209 raft_consensus.cc:2243] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.522526  8209 raft_consensus.cc:2272] T 4f0d93c13e344f40b065cabcbc63d751 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.525835  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.526659  8209 raft_consensus.cc:2243] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.527189  8209 raft_consensus.cc:2272] T 6ce874d8c223464585bd12c973d333b6 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:17.527891 16730 consensus_peers.cc:597] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.530269  8209 tablet_replica.cc:333] stopping tablet replica
W20260709 13:06:17.530303 16730 consensus_peers.cc:597] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.531131  8209 raft_consensus.cc:2243] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:17.532015  8209 raft_consensus.cc:2272] T 061a5313535a475ea9385383b611b52d P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.535305  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.536180  8209 raft_consensus.cc:2243] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:17.537358  8209 raft_consensus.cc:2272] T 2500d1c1df2649d99c7a5e1146e771d9 P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.540337  8209 tablet_replica.cc:333] stopping tablet replica
W20260709 13:06:17.540896 16804 consensus_peers.cc:597] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.541263  8209 raft_consensus.cc:2243] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.541855  8209 raft_consensus.cc:2272] T f2eb3c14d44647a7a2a6e4a88d64df71 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.546459  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.547438  8209 raft_consensus.cc:2243] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.548117  8209 raft_consensus.cc:2272] T fff8e33f0af546a8a976e5547b1b437e P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:17.549389 16730 consensus_peers.cc:597] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:17.550295 16730 consensus_peers.cc:597] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.551932  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.553253  8209 raft_consensus.cc:2243] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:17.554360  8209 raft_consensus.cc:2272] T 8b89e067aed8497a9c9c70577ac56c77 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.557680  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.558399  8209 raft_consensus.cc:2243] T 16b4be927a834597b7190497210b9169 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.558880  8209 raft_consensus.cc:2272] T 16b4be927a834597b7190497210b9169 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.561261  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.561923  8209 raft_consensus.cc:2243] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.562374  8209 raft_consensus.cc:2272] T e2f17f39ebb642ac9ff48f3820305d1a P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.564873  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.565732  8209 raft_consensus.cc:2243] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:17.566630  8209 raft_consensus.cc:2272] T 0f906a9d133f4a90b55f8dd4ba7d917a P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.569795  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.570698  8209 raft_consensus.cc:2243] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.571221  8209 raft_consensus.cc:2272] T 0d72e7ee195341ab8a8d3865c5013ac8 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.573287  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.573839  8209 raft_consensus.cc:2243] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.574214  8209 raft_consensus.cc:2272] T e79d615b8ac14c149720027be9d4dee2 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.576342  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.576900  8209 raft_consensus.cc:2243] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.577404  8209 raft_consensus.cc:2272] T a6c91dff9e8c4ab78bacda0d282beacf P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.579443  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.579993  8209 raft_consensus.cc:2243] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.580338  8209 raft_consensus.cc:2272] T aab71409c1cf4356817b8f83a1686482 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.582778  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.583441  8209 raft_consensus.cc:2243] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.584164  8209 raft_consensus.cc:2272] T 7e97f3430b8a49e2a9476402b7d46203 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.587018  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.587623  8209 raft_consensus.cc:2243] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:06:17.587893 16804 consensus_peers.cc:597] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.588073  8209 raft_consensus.cc:2272] T 82e52334c3ab4394b0a09b0a460e34d4 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.591053  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.591742  8209 raft_consensus.cc:2243] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:17.592700  8209 raft_consensus.cc:2272] T 73a0ed4bc207489699e41033ec224d3a P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.596203  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.597057  8209 raft_consensus.cc:2243] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:17.598111  8209 raft_consensus.cc:2272] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.601248  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.602123  8209 raft_consensus.cc:2243] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.602770  8209 raft_consensus.cc:2272] T af9f8110756a49c082a81e072eed60b3 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:17.603874 16879 consensus_peers.cc:597] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.605980  8209 tablet_replica.cc:333] stopping tablet replica
W20260709 13:06:17.606676 16879 consensus_peers.cc:597] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.606935  8209 raft_consensus.cc:2243] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:06:17.608150 17874 consensus_queue.cc:1175] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "622433288cac4964aea9ea5a24ba77fd" responder_term: 3 status { last_received { term: 3 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 3 index: 3 } }
I20260709 13:06:17.608914  8209 raft_consensus.cc:2272] T d281c9020d454b23a8bd21ccfadfa93c P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.611837  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.612597  8209 raft_consensus.cc:2243] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.613131  8209 raft_consensus.cc:2272] T 95d82e412df245e1a4f614cc8c60539c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.616185  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.616814  8209 raft_consensus.cc:2243] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:17.617805  8209 raft_consensus.cc:2272] T b49036bff00949ec88900c3537cf5edc P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.621070  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.621974  8209 raft_consensus.cc:2243] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.622467  8209 raft_consensus.cc:2272] T 9bc00a2c7a04450a9c9ce82457ab573c P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:17.624756 16804 consensus_peers.cc:597] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.625411  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.626096  8209 raft_consensus.cc:2243] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:17.626910  8209 raft_consensus.cc:2272] T 1e348c32749d48f68c70dc32267e38c0 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.629294  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.630004  8209 raft_consensus.cc:2243] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.630514  8209 raft_consensus.cc:2272] T 2088afc1f50443139a328a7e3bb10212 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.633102  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.633761  8209 raft_consensus.cc:2243] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:17.634881  8209 raft_consensus.cc:2272] T fa6e4009e1d445a1b055538cf3006287 P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:17.637036 16804 consensus_peers.cc:597] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.637580  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.638263  8209 raft_consensus.cc:2243] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.638689  8209 raft_consensus.cc:2272] T 82e662a1c0204e5bab9a5b5e50b81561 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.641248  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.642010  8209 raft_consensus.cc:2243] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.642546  8209 raft_consensus.cc:2272] T 3526ae05dd1141aaaaa2aaea2391b108 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:17.644259 16730 consensus_peers.cc:597] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.646646  8209 tablet_replica.cc:333] stopping tablet replica
W20260709 13:06:17.647151 16730 consensus_peers.cc:597] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.647393  8209 raft_consensus.cc:2243] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.648047  8209 raft_consensus.cc:2272] T e3aa4f2f9c5f43b383113ff0d0ad296d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:17.648538 16730 consensus_peers.cc:597] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.651225  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.651912  8209 raft_consensus.cc:2243] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.652470  8209 raft_consensus.cc:2272] T 2f610e2abe7b467facd521257722760d P 1cbe303821774e4d936ea3d54875dcb8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.656059  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.656921  8209 raft_consensus.cc:2243] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:17.657884  8209 raft_consensus.cc:2272] T 772bb23805934270899495ae7c8cbb07 P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.660883  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.661785  8209 raft_consensus.cc:2243] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.662218  8209 raft_consensus.cc:2272] T 5f7a4cb12b194107a5bba9336ed37819 P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.664310  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.664839  8209 raft_consensus.cc:2243] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:17.665844  8209 raft_consensus.cc:2272] T 30d0c8416cdc43289eceaddcbd00a20e P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.668192  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.668942  8209 raft_consensus.cc:2243] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:17.670297  8209 raft_consensus.cc:2272] T 7ac2a62af17746bcba9f94b6a1053f28 P 1cbe303821774e4d936ea3d54875dcb8 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:17.672129 16879 consensus_peers.cc:597] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.673406  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:17.674140  8209 raft_consensus.cc:2243] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.674611  8209 raft_consensus.cc:2272] T 47e91185676f4335a4100a6d3fa40c8d P 1cbe303821774e4d936ea3d54875dcb8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:17.696209 16804 consensus_peers.cc:597] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:17.704550 16879 consensus_peers.cc:597] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:17.728730 16730 consensus_peers.cc:597] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:17.731667 16879 consensus_peers.cc:597] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:17.734513 16804 consensus_peers.cc:597] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:17.741770 16879 consensus_peers.cc:597] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.761307  8209 tablet_server.cc:196] TabletServer@127.8.4.65:37355 shutdown complete.
W20260709 13:06:17.769210 16804 consensus_peers.cc:597] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:17.776451 16730 consensus_peers.cc:597] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:17.795238 16730 consensus_peers.cc:597] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:17.819886 16730 consensus_peers.cc:597] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:17.860040 16879 consensus_peers.cc:597] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.861500  8209 tablet_server.cc:179] TabletServer@127.8.4.66:0 shutting down...
W20260709 13:06:17.872977 16802 consensus_peers.cc:597] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd -> Peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Couldn't send request to peer d0ea3afb898b4eb5b21faeb676627011. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:17.873589 16802 consensus_peers.cc:597] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd -> Peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Couldn't send request to peer d0ea3afb898b4eb5b21faeb676627011. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:17.895387 16877 consensus_peers.cc:597] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b -> Peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Couldn't send request to peer d0ea3afb898b4eb5b21faeb676627011. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:17.902122 16879 consensus_peers.cc:597] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:17.905916 16730 consensus_peers.cc:597] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:17.926515 16877 consensus_peers.cc:597] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b -> Peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Couldn't send request to peer d0ea3afb898b4eb5b21faeb676627011. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:17.927539 16802 consensus_peers.cc:597] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd -> Peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Couldn't send request to peer d0ea3afb898b4eb5b21faeb676627011. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:17.928809 16730 consensus_peers.cc:597] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:17.939751 16804 consensus_peers.cc:597] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd -> Peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Couldn't send request to peer 1cbe303821774e4d936ea3d54875dcb8. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.943711  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:17.945111  8209 tablet_replica.cc:333] T 5f7a4cb12b194107a5bba9336ed37819 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
W20260709 13:06:17.945273 16877 consensus_peers.cc:597] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b -> Peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Couldn't send request to peer d0ea3afb898b4eb5b21faeb676627011. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.946238  8209 raft_consensus.cc:2243] T 5f7a4cb12b194107a5bba9336ed37819 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.947063  8209 raft_consensus.cc:2272] T 5f7a4cb12b194107a5bba9336ed37819 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:17.949199 16877 consensus_peers.cc:597] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b -> Peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Couldn't send request to peer d0ea3afb898b4eb5b21faeb676627011. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.950505  8209 tablet_replica.cc:333] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:17.951985  8209 raft_consensus.cc:2243] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.952663  8209 raft_consensus.cc:2272] T e863dd66af3949e78a0e9882520673fb P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.956221  8209 tablet_replica.cc:333] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:17.957171  8209 raft_consensus.cc:2243] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.957722  8209 raft_consensus.cc:2272] T b49036bff00949ec88900c3537cf5edc P d0ea3afb898b4eb5b21faeb676627011 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.960881  8209 tablet_replica.cc:333] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:17.961722  8209 raft_consensus.cc:2243] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:17.962672  8209 raft_consensus.cc:2272] T bf3d4f25ea4e4b14b6dd55a052daf82c P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.965639  8209 tablet_replica.cc:333] T 1ceff4a1d9cf4d75994e64ebab75c551 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:17.966539  8209 raft_consensus.cc:2243] T 1ceff4a1d9cf4d75994e64ebab75c551 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.967147  8209 raft_consensus.cc:2272] T 1ceff4a1d9cf4d75994e64ebab75c551 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.970480  8209 tablet_replica.cc:333] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:17.971463  8209 raft_consensus.cc:2243] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.972265  8209 raft_consensus.cc:2272] T 83f0df42f20d4d9398c8d4b5b3cba4ea P d0ea3afb898b4eb5b21faeb676627011 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.975332  8209 tablet_replica.cc:333] T 7013ecc82f234c109dc955f8dca102b2 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:17.976219  8209 raft_consensus.cc:2243] T 7013ecc82f234c109dc955f8dca102b2 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.976855  8209 raft_consensus.cc:2272] T 7013ecc82f234c109dc955f8dca102b2 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.980031  8209 tablet_replica.cc:333] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:17.981060  8209 raft_consensus.cc:2243] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.981712  8209 raft_consensus.cc:2272] T 772bb23805934270899495ae7c8cbb07 P d0ea3afb898b4eb5b21faeb676627011 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:17.982395 16877 consensus_peers.cc:597] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b -> Peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Couldn't send request to peer d0ea3afb898b4eb5b21faeb676627011. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.984619  8209 tablet_replica.cc:333] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:17.985513  8209 raft_consensus.cc:2243] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:17.986441  8209 raft_consensus.cc:2272] T 2f610e2abe7b467facd521257722760d P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.989213  8209 tablet_replica.cc:333] T f2eb3c14d44647a7a2a6e4a88d64df71 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:17.989840  8209 raft_consensus.cc:2243] T f2eb3c14d44647a7a2a6e4a88d64df71 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.990341  8209 raft_consensus.cc:2272] T f2eb3c14d44647a7a2a6e4a88d64df71 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.992949  8209 tablet_replica.cc:333] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:17.993896  8209 raft_consensus.cc:2243] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.994525  8209 raft_consensus.cc:2272] T 30d0c8416cdc43289eceaddcbd00a20e P d0ea3afb898b4eb5b21faeb676627011 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.997044  8209 tablet_replica.cc:333] T 9de37f630dc142a28db71d81fa427ab4 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:17.997700  8209 raft_consensus.cc:2243] T 9de37f630dc142a28db71d81fa427ab4 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.998173  8209 raft_consensus.cc:2272] T 9de37f630dc142a28db71d81fa427ab4 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.000653  8209 tablet_replica.cc:333] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.001339  8209 raft_consensus.cc:2243] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.001848  8209 raft_consensus.cc:2272] T e848db4f370a472f9baa6f3d547cb966 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.004127  8209 tablet_replica.cc:333] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.005198  8209 raft_consensus.cc:2243] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.006282  8209 raft_consensus.cc:2272] T 4723ff8bcfab41bfad7b411c81cd0386 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:18.007802 16802 consensus_peers.cc:597] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd -> Peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Couldn't send request to peer d0ea3afb898b4eb5b21faeb676627011. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.008692  8209 tablet_replica.cc:333] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.009389  8209 raft_consensus.cc:2243] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.010293  8209 raft_consensus.cc:2272] T 37a024bf1cd844419249b9636dd94c69 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.012369  8209 tablet_replica.cc:333] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.012924  8209 raft_consensus.cc:2243] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.013690  8209 raft_consensus.cc:2272] T fa6e4009e1d445a1b055538cf3006287 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.016884  8209 tablet_replica.cc:333] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.017752  8209 raft_consensus.cc:2243] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.018781  8209 raft_consensus.cc:2272] T 82e662a1c0204e5bab9a5b5e50b81561 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.021474  8209 tablet_replica.cc:333] T e5445951d8c04b35838db7ef8df62694 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.022070  8209 raft_consensus.cc:2243] T e5445951d8c04b35838db7ef8df62694 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.022576  8209 raft_consensus.cc:2272] T e5445951d8c04b35838db7ef8df62694 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.024803  8209 tablet_replica.cc:333] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.025516  8209 raft_consensus.cc:2243] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.026328  8209 raft_consensus.cc:2272] T 82e52334c3ab4394b0a09b0a460e34d4 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.028352  8209 tablet_replica.cc:333] T 13d7f28a321a46919d282b9709ab84cb P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.029110  8209 raft_consensus.cc:2243] T 13d7f28a321a46919d282b9709ab84cb P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.029721  8209 raft_consensus.cc:2272] T 13d7f28a321a46919d282b9709ab84cb P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:18.031955 16802 consensus_peers.cc:597] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd -> Peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Couldn't send request to peer d0ea3afb898b4eb5b21faeb676627011. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.032167  8209 tablet_replica.cc:333] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.032892  8209 raft_consensus.cc:2243] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.033457  8209 raft_consensus.cc:2272] T a6c91dff9e8c4ab78bacda0d282beacf P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.035880  8209 tablet_replica.cc:333] T 2369d92de77f42e7be750810912daeef P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.036608  8209 raft_consensus.cc:2243] T 2369d92de77f42e7be750810912daeef P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.037308  8209 raft_consensus.cc:2272] T 2369d92de77f42e7be750810912daeef P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.039990  8209 tablet_replica.cc:333] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.040809  8209 raft_consensus.cc:2243] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.041301  8209 raft_consensus.cc:2272] T f1e9d9f32bec4123a2f10e3a20f1067b P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.043429  8209 tablet_replica.cc:333] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.044060  8209 raft_consensus.cc:2243] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.044965  8209 raft_consensus.cc:2272] T 9b51d554de084a5594e8c14973873edc P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.047574  8209 tablet_replica.cc:333] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.048174  8209 raft_consensus.cc:2243] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.048648  8209 raft_consensus.cc:2272] T fff8e33f0af546a8a976e5547b1b437e P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.051188  8209 tablet_replica.cc:333] T a8d411124ca242a3b8b4fbb5b0a90b66 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.051936  8209 raft_consensus.cc:2243] T a8d411124ca242a3b8b4fbb5b0a90b66 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.052469  8209 raft_consensus.cc:2272] T a8d411124ca242a3b8b4fbb5b0a90b66 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.055413  8209 tablet_replica.cc:333] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.056221  8209 raft_consensus.cc:2243] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.056819  8209 raft_consensus.cc:2272] T 8b89e067aed8497a9c9c70577ac56c77 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.060060  8209 tablet_replica.cc:333] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.060882  8209 raft_consensus.cc:2243] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.061439  8209 raft_consensus.cc:2272] T 2500d1c1df2649d99c7a5e1146e771d9 P d0ea3afb898b4eb5b21faeb676627011 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.064077  8209 tablet_replica.cc:333] T 6ce874d8c223464585bd12c973d333b6 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.064855  8209 raft_consensus.cc:2243] T 6ce874d8c223464585bd12c973d333b6 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.065492  8209 raft_consensus.cc:2272] T 6ce874d8c223464585bd12c973d333b6 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.067986  8209 tablet_replica.cc:333] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.068712  8209 raft_consensus.cc:2243] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.069825  8209 raft_consensus.cc:2272] T 4f0d93c13e344f40b065cabcbc63d751 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.072319  8209 tablet_replica.cc:333] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.073202  8209 raft_consensus.cc:2243] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.074107  8209 raft_consensus.cc:2272] T 4e93c7f885494add9735d842339e740a P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:18.076606 16802 consensus_peers.cc:597] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd -> Peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Couldn't send request to peer d0ea3afb898b4eb5b21faeb676627011. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.077138  8209 tablet_replica.cc:333] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.078092  8209 raft_consensus.cc:2243] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.079107  8209 raft_consensus.cc:2272] T d965337ae0df4ca7aba0e4f9549a8ca9 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.081631  8209 tablet_replica.cc:333] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.082226  8209 raft_consensus.cc:2243] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.083119  8209 raft_consensus.cc:2272] T c80dc47d27a749eab1ffa183f231f036 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.085444  8209 tablet_replica.cc:333] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.086094  8209 raft_consensus.cc:2243] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.086935  8209 raft_consensus.cc:2272] T 0f6a383a050745a791b07441a3b93828 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.088959  8209 tablet_replica.cc:333] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.089591  8209 raft_consensus.cc:2243] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.090041  8209 raft_consensus.cc:2272] T ce42d5cbca2144e8a54bab8a8cf31763 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.092018  8209 tablet_replica.cc:333] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.092604  8209 raft_consensus.cc:2243] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.093103  8209 raft_consensus.cc:2272] T e2f17f39ebb642ac9ff48f3820305d1a P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.095614  8209 tablet_replica.cc:333] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.096485  8209 raft_consensus.cc:2243] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.097518  8209 raft_consensus.cc:2272] T 16b4be927a834597b7190497210b9169 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.100399  8209 tablet_replica.cc:333] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.101301  8209 raft_consensus.cc:2243] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.101900  8209 raft_consensus.cc:2272] T c522eefb992a4533ad3a9f3ba6634bc8 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:18.103055 16877 consensus_peers.cc:597] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b -> Peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Couldn't send request to peer d0ea3afb898b4eb5b21faeb676627011. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.104656  8209 tablet_replica.cc:333] T 3526ae05dd1141aaaaa2aaea2391b108 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.105726  8209 raft_consensus.cc:2243] T 3526ae05dd1141aaaaa2aaea2391b108 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.106405  8209 raft_consensus.cc:2272] T 3526ae05dd1141aaaaa2aaea2391b108 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.108821  8209 tablet_replica.cc:333] T 9bc00a2c7a04450a9c9ce82457ab573c P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.109501  8209 raft_consensus.cc:2243] T 9bc00a2c7a04450a9c9ce82457ab573c P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.109948  8209 raft_consensus.cc:2272] T 9bc00a2c7a04450a9c9ce82457ab573c P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.112005  8209 tablet_replica.cc:333] T 3c96e991f59b4bc298a3819b579eaa15 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.112566  8209 raft_consensus.cc:2243] T 3c96e991f59b4bc298a3819b579eaa15 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.113049  8209 raft_consensus.cc:2272] T 3c96e991f59b4bc298a3819b579eaa15 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.115296  8209 tablet_replica.cc:333] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.115805  8209 raft_consensus.cc:2243] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.116627  8209 raft_consensus.cc:2272] T b7e982a881834665b4845c226db01020 P d0ea3afb898b4eb5b21faeb676627011 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.118714  8209 tablet_replica.cc:333] T d51df8e7709946bbb3f3d5ec1c541307 P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.119235  8209 raft_consensus.cc:2243] T d51df8e7709946bbb3f3d5ec1c541307 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.119668  8209 raft_consensus.cc:2272] T d51df8e7709946bbb3f3d5ec1c541307 P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.121656  8209 tablet_replica.cc:333] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011: stopping tablet replica
I20260709 13:06:18.122289  8209 raft_consensus.cc:2243] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.123503  8209 raft_consensus.cc:2272] T 47e91185676f4335a4100a6d3fa40c8d P d0ea3afb898b4eb5b21faeb676627011 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:18.146660 16802 consensus_peers.cc:597] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd -> Peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Couldn't send request to peer d0ea3afb898b4eb5b21faeb676627011. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:18.182130 16877 consensus_peers.cc:597] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b -> Peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Couldn't send request to peer d0ea3afb898b4eb5b21faeb676627011. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:18.182318 16802 consensus_peers.cc:597] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd -> Peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Couldn't send request to peer d0ea3afb898b4eb5b21faeb676627011. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:18.208498 16802 consensus_peers.cc:597] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd -> Peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Couldn't send request to peer d0ea3afb898b4eb5b21faeb676627011. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:33887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.211233  8209 tablet_server.cc:196] TabletServer@127.8.4.66:0 shutdown complete.
W20260709 13:06:18.218551 16877 consensus_peers.cc:597] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b -> Peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Couldn't send request to peer d0ea3afb898b4eb5b21faeb676627011. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:33887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:18.226722 16877 consensus_peers.cc:597] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b -> Peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Couldn't send request to peer d0ea3afb898b4eb5b21faeb676627011. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:33887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:18.259045 16877 consensus_peers.cc:597] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b -> Peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Couldn't send request to peer d0ea3afb898b4eb5b21faeb676627011. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:33887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:18.264264 16802 consensus_peers.cc:597] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd -> Peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Couldn't send request to peer d0ea3afb898b4eb5b21faeb676627011. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:33887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.307773  8209 tablet_server.cc:179] TabletServer@127.8.4.67:0 shutting down...
W20260709 13:06:18.321579 16878 consensus_peers.cc:597] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b -> Peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Couldn't send request to peer 622433288cac4964aea9ea5a24ba77fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:18.345281 16878 consensus_peers.cc:597] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b -> Peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Couldn't send request to peer 622433288cac4964aea9ea5a24ba77fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:18.361970 16877 consensus_peers.cc:597] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b -> Peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Couldn't send request to peer d0ea3afb898b4eb5b21faeb676627011. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:33887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:18.393821 16878 consensus_peers.cc:597] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b -> Peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Couldn't send request to peer 622433288cac4964aea9ea5a24ba77fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.394129  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:18.397122  8209 tablet_replica.cc:333] T c522eefb992a4533ad3a9f3ba6634bc8 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.398589  8209 raft_consensus.cc:2243] T c522eefb992a4533ad3a9f3ba6634bc8 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.399236  8209 raft_consensus.cc:2272] T c522eefb992a4533ad3a9f3ba6634bc8 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:18.402269 16802 consensus_peers.cc:597] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd -> Peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Couldn't send request to peer d0ea3afb898b4eb5b21faeb676627011. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:33887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.402464  8209 tablet_replica.cc:333] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.404126  8209 raft_consensus.cc:2243] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:06:18.404295 16878 consensus_peers.cc:597] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b -> Peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Couldn't send request to peer 622433288cac4964aea9ea5a24ba77fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.404855  8209 raft_consensus.cc:2272] T 7ac2a62af17746bcba9f94b6a1053f28 P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.407476  8209 tablet_replica.cc:333] T bf3d4f25ea4e4b14b6dd55a052daf82c P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.408360  8209 raft_consensus.cc:2243] T bf3d4f25ea4e4b14b6dd55a052daf82c P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.408951  8209 raft_consensus.cc:2272] T bf3d4f25ea4e4b14b6dd55a052daf82c P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.411494  8209 tablet_replica.cc:333] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.412199  8209 raft_consensus.cc:2243] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.412791  8209 raft_consensus.cc:2272] T 0f906a9d133f4a90b55f8dd4ba7d917a P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.415228  8209 tablet_replica.cc:333] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.415846  8209 raft_consensus.cc:2243] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.416679  8209 raft_consensus.cc:2272] T e3aa4f2f9c5f43b383113ff0d0ad296d P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.419052  8209 tablet_replica.cc:333] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.419822  8209 raft_consensus.cc:2243] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.420296  8209 raft_consensus.cc:2272] T 772bb23805934270899495ae7c8cbb07 P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.422425  8209 tablet_replica.cc:333] T e79d615b8ac14c149720027be9d4dee2 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.423074  8209 raft_consensus.cc:2243] T e79d615b8ac14c149720027be9d4dee2 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.423527  8209 raft_consensus.cc:2272] T e79d615b8ac14c149720027be9d4dee2 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.425976  8209 tablet_replica.cc:333] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.426631  8209 raft_consensus.cc:2243] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.427726  8209 raft_consensus.cc:2272] T 7013ecc82f234c109dc955f8dca102b2 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.431053  8209 tablet_replica.cc:333] T 3c96e991f59b4bc298a3819b579eaa15 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.431599  8209 raft_consensus.cc:2243] T 3c96e991f59b4bc298a3819b579eaa15 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.432053  8209 raft_consensus.cc:2272] T 3c96e991f59b4bc298a3819b579eaa15 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.434216  8209 tablet_replica.cc:333] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.434947  8209 raft_consensus.cc:2243] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.435986  8209 raft_consensus.cc:2272] T f2eb3c14d44647a7a2a6e4a88d64df71 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.438582  8209 tablet_replica.cc:333] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.439378  8209 raft_consensus.cc:2243] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.439967  8209 raft_consensus.cc:2272] T 83f0df42f20d4d9398c8d4b5b3cba4ea P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.442824  8209 tablet_replica.cc:333] T af9f8110756a49c082a81e072eed60b3 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.443636  8209 raft_consensus.cc:2243] T af9f8110756a49c082a81e072eed60b3 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.444186  8209 raft_consensus.cc:2272] T af9f8110756a49c082a81e072eed60b3 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.447045  8209 tablet_replica.cc:333] T 2088afc1f50443139a328a7e3bb10212 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.447841  8209 raft_consensus.cc:2243] T 2088afc1f50443139a328a7e3bb10212 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:06:18.448218 16878 consensus_peers.cc:597] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b -> Peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Couldn't send request to peer 622433288cac4964aea9ea5a24ba77fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.448397  8209 raft_consensus.cc:2272] T 2088afc1f50443139a328a7e3bb10212 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.451639  8209 tablet_replica.cc:333] T 4723ff8bcfab41bfad7b411c81cd0386 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.452579  8209 raft_consensus.cc:2243] T 4723ff8bcfab41bfad7b411c81cd0386 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:06:18.453179 16878 consensus_peers.cc:597] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b -> Peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Couldn't send request to peer 622433288cac4964aea9ea5a24ba77fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.453269  8209 raft_consensus.cc:2272] T 4723ff8bcfab41bfad7b411c81cd0386 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.455687  8209 tablet_replica.cc:333] T 9de37f630dc142a28db71d81fa427ab4 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.456410  8209 raft_consensus.cc:2243] T 9de37f630dc142a28db71d81fa427ab4 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.457101  8209 raft_consensus.cc:2272] T 9de37f630dc142a28db71d81fa427ab4 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.459792  8209 tablet_replica.cc:333] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.460655  8209 raft_consensus.cc:2243] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.461259  8209 raft_consensus.cc:2272] T e848db4f370a472f9baa6f3d547cb966 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.464107  8209 tablet_replica.cc:333] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.464928  8209 raft_consensus.cc:2243] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.465533  8209 raft_consensus.cc:2272] T 37a024bf1cd844419249b9636dd94c69 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.470302  8209 tablet_replica.cc:333] T 82e662a1c0204e5bab9a5b5e50b81561 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.471002  8209 raft_consensus.cc:2243] T 82e662a1c0204e5bab9a5b5e50b81561 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.471508  8209 raft_consensus.cc:2272] T 82e662a1c0204e5bab9a5b5e50b81561 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.473640  8209 tablet_replica.cc:333] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.474236  8209 raft_consensus.cc:2243] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.475036  8209 raft_consensus.cc:2272] T 0d72e7ee195341ab8a8d3865c5013ac8 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.477185  8209 tablet_replica.cc:333] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.477790  8209 raft_consensus.cc:2243] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.478590  8209 raft_consensus.cc:2272] T 7e97f3430b8a49e2a9476402b7d46203 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.480540  8209 tablet_replica.cc:333] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.481241  8209 raft_consensus.cc:2243] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.482054  8209 raft_consensus.cc:2272] T aab71409c1cf4356817b8f83a1686482 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.484120  8209 tablet_replica.cc:333] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.484690  8209 raft_consensus.cc:2243] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.487151  8209 raft_consensus.cc:2272] T fff8e33f0af546a8a976e5547b1b437e P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.489863  8209 tablet_replica.cc:333] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
W20260709 13:06:18.489959 16878 consensus_peers.cc:597] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b -> Peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Couldn't send request to peer 622433288cac4964aea9ea5a24ba77fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.490538  8209 raft_consensus.cc:2243] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.491420  8209 raft_consensus.cc:2272] T a8d411124ca242a3b8b4fbb5b0a90b66 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.493762  8209 tablet_replica.cc:333] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.494385  8209 raft_consensus.cc:2243] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.494939  8209 raft_consensus.cc:2272] T 8b89e067aed8497a9c9c70577ac56c77 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.496951  8209 tablet_replica.cc:333] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.497596  8209 raft_consensus.cc:2243] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.498418  8209 raft_consensus.cc:2272] T e5445951d8c04b35838db7ef8df62694 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.500401  8209 tablet_replica.cc:333] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.500974  8209 raft_consensus.cc:2243] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.501849  8209 raft_consensus.cc:2272] T 2369d92de77f42e7be750810912daeef P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.503940  8209 tablet_replica.cc:333] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.504550  8209 raft_consensus.cc:2243] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.505431  8209 raft_consensus.cc:2272] T f1e9d9f32bec4123a2f10e3a20f1067b P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.507548  8209 tablet_replica.cc:333] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.508479  8209 raft_consensus.cc:2243] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.509883  8209 raft_consensus.cc:2272] T 13d7f28a321a46919d282b9709ab84cb P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.512722  8209 tablet_replica.cc:333] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.513397  8209 raft_consensus.cc:2243] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.514256  8209 raft_consensus.cc:2272] T 9bc00a2c7a04450a9c9ce82457ab573c P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.517510  8209 tablet_replica.cc:333] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.518122  8209 raft_consensus.cc:2243] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.518610  8209 raft_consensus.cc:2272] T 1e348c32749d48f68c70dc32267e38c0 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.521359  8209 tablet_replica.cc:333] T 1ceff4a1d9cf4d75994e64ebab75c551 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.522168  8209 raft_consensus.cc:2243] T 1ceff4a1d9cf4d75994e64ebab75c551 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.522640  8209 raft_consensus.cc:2272] T 1ceff4a1d9cf4d75994e64ebab75c551 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.525846  8209 tablet_replica.cc:333] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.526562  8209 raft_consensus.cc:2243] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.527103  8209 raft_consensus.cc:2272] T 061a5313535a475ea9385383b611b52d P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.529600  8209 tablet_replica.cc:333] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.530251  8209 raft_consensus.cc:2243] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.530875  8209 raft_consensus.cc:2272] T b49036bff00949ec88900c3537cf5edc P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.533181  8209 tablet_replica.cc:333] T 95d82e412df245e1a4f614cc8c60539c P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.533703  8209 raft_consensus.cc:2243] T 95d82e412df245e1a4f614cc8c60539c P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.534190  8209 raft_consensus.cc:2272] T 95d82e412df245e1a4f614cc8c60539c P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.536569  8209 tablet_replica.cc:333] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.537142  8209 raft_consensus.cc:2243] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.537520  8209 raft_consensus.cc:2272] T d281c9020d454b23a8bd21ccfadfa93c P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.539386  8209 tablet_replica.cc:333] T 4f0d93c13e344f40b065cabcbc63d751 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.540107  8209 raft_consensus.cc:2243] T 4f0d93c13e344f40b065cabcbc63d751 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.540592  8209 raft_consensus.cc:2272] T 4f0d93c13e344f40b065cabcbc63d751 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.543097  8209 tablet_replica.cc:333] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.544046  8209 raft_consensus.cc:2243] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.544978  8209 raft_consensus.cc:2272] T e863dd66af3949e78a0e9882520673fb P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.547701  8209 tablet_replica.cc:333] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.548334  8209 raft_consensus.cc:2243] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.548883  8209 raft_consensus.cc:2272] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.551235  8209 tablet_replica.cc:333] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.551882  8209 raft_consensus.cc:2243] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.552348  8209 raft_consensus.cc:2272] T 2500d1c1df2649d99c7a5e1146e771d9 P 622433288cac4964aea9ea5a24ba77fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.555490  8209 tablet_replica.cc:333] T d51df8e7709946bbb3f3d5ec1c541307 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.556075  8209 raft_consensus.cc:2243] T d51df8e7709946bbb3f3d5ec1c541307 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.556542  8209 raft_consensus.cc:2272] T d51df8e7709946bbb3f3d5ec1c541307 P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.558727  8209 tablet_replica.cc:333] T 47e91185676f4335a4100a6d3fa40c8d P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.559259  8209 raft_consensus.cc:2243] T 47e91185676f4335a4100a6d3fa40c8d P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.559715  8209 raft_consensus.cc:2272] T 47e91185676f4335a4100a6d3fa40c8d P 622433288cac4964aea9ea5a24ba77fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.562017  8209 tablet_replica.cc:333] T 0f6a383a050745a791b07441a3b93828 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.562691  8209 raft_consensus.cc:2243] T 0f6a383a050745a791b07441a3b93828 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.563270  8209 raft_consensus.cc:2272] T 0f6a383a050745a791b07441a3b93828 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.565639  8209 tablet_replica.cc:333] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.566325  8209 raft_consensus.cc:2243] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:06:18.566859 16878 consensus_peers.cc:597] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b -> Peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Couldn't send request to peer 622433288cac4964aea9ea5a24ba77fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.567369  8209 raft_consensus.cc:2272] T ce42d5cbca2144e8a54bab8a8cf31763 P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.569834  8209 tablet_replica.cc:333] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd: stopping tablet replica
I20260709 13:06:18.570412  8209 raft_consensus.cc:2243] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.571077  8209 raft_consensus.cc:2272] T 73a0ed4bc207489699e41033ec224d3a P 622433288cac4964aea9ea5a24ba77fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.656275  8209 tablet_server.cc:196] TabletServer@127.8.4.67:0 shutdown complete.
W20260709 13:06:18.683540 16878 consensus_peers.cc:597] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b -> Peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Couldn't send request to peer 622433288cac4964aea9ea5a24ba77fd. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.67:39929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.709647 17853 raft_consensus.cc:493] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:06:18.710419 17853 raft_consensus.cc:515] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:18.713817 17853 leader_election.cc:290] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
W20260709 13:06:18.719987 16879 leader_election.cc:336] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
W20260709 13:06:18.724622 16878 leader_election.cc:336] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Network error: Client connection negotiation failed: client connection to 127.8.4.67:39929: connect: Connection refused (error 111)
I20260709 13:06:18.725113 16878 leader_election.cc:304] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd
I20260709 13:06:18.725926 17853 raft_consensus.cc:2749] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:18.728089 17890 raft_consensus.cc:493] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:06:18.728782 17890 raft_consensus.cc:515] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:18.734079 17890 leader_election.cc:290] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
W20260709 13:06:18.745572 16879 leader_election.cc:336] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
W20260709 13:06:18.747164 16878 leader_election.cc:336] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Network error: Client connection negotiation failed: client connection to 127.8.4.67:39929: connect: Connection refused (error 111)
I20260709 13:06:18.747694 16878 leader_election.cc:304] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd
I20260709 13:06:18.748375 17890 raft_consensus.cc:2749] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:18.754057  8209 tablet_server.cc:179] TabletServer@127.8.4.68:0 shutting down...
I20260709 13:06:18.771211 17853 raft_consensus.cc:493] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:06:18.772053 17853 raft_consensus.cc:515] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:18.774760 17853 leader_election.cc:290] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
W20260709 13:06:18.780963 16878 leader_election.cc:336] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Network error: Client connection negotiation failed: client connection to 127.8.4.67:39929: connect: Connection refused (error 111)
W20260709 13:06:18.781788 16879 leader_election.cc:336] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:06:18.782276 16879 leader_election.cc:304] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd
I20260709 13:06:18.784233 17853 raft_consensus.cc:2749] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:18.796471 17890 raft_consensus.cc:493] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:06:18.797078 17890 raft_consensus.cc:515] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } } peers { permanent_uuid: "d0ea3afb898b4eb5b21faeb676627011" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 33887 } }
I20260709 13:06:18.799288 17890 leader_election.cc:290] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355), d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887)
W20260709 13:06:18.804543 16879 leader_election.cc:336] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
W20260709 13:06:18.805404 16877 leader_election.cc:336] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d0ea3afb898b4eb5b21faeb676627011 (127.8.4.66:33887): Network error: Client connection negotiation failed: client connection to 127.8.4.66:33887: connect: Connection refused (error 111)
I20260709 13:06:18.805815 16877 leader_election.cc:304] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8, d0ea3afb898b4eb5b21faeb676627011
I20260709 13:06:18.806767 17890 raft_consensus.cc:2749] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:18.807379 16878 consensus_peers.cc:597] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b -> Peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Couldn't send request to peer 622433288cac4964aea9ea5a24ba77fd. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.67:39929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.815071  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:18.816043  8209 tablet_replica.cc:333] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.816872  8209 raft_consensus.cc:2243] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.817759  8209 raft_consensus.cc:2272] T 7ac2a62af17746bcba9f94b6a1053f28 P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.820586  8209 tablet_replica.cc:333] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.821347  8209 raft_consensus.cc:2243] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.822213  8209 raft_consensus.cc:2272] T 5f7a4cb12b194107a5bba9336ed37819 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.824549  8209 tablet_replica.cc:333] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.825348  8209 raft_consensus.cc:2243] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.826143  8209 raft_consensus.cc:2272] T 6ce874d8c223464585bd12c973d333b6 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.828316  8209 tablet_replica.cc:333] T 7013ecc82f234c109dc955f8dca102b2 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.828934  8209 raft_consensus.cc:2243] T 7013ecc82f234c109dc955f8dca102b2 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.829470  8209 raft_consensus.cc:2272] T 7013ecc82f234c109dc955f8dca102b2 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.831583  8209 tablet_replica.cc:333] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.832201  8209 raft_consensus.cc:2243] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.832647  8209 raft_consensus.cc:2272] T 30d0c8416cdc43289eceaddcbd00a20e P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.834808  8209 tablet_replica.cc:333] T e3aa4f2f9c5f43b383113ff0d0ad296d P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.835512  8209 raft_consensus.cc:2243] T e3aa4f2f9c5f43b383113ff0d0ad296d P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.836056  8209 raft_consensus.cc:2272] T e3aa4f2f9c5f43b383113ff0d0ad296d P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.838887  8209 tablet_replica.cc:333] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.839892  8209 raft_consensus.cc:2243] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.840540  8209 raft_consensus.cc:2272] T 2f610e2abe7b467facd521257722760d P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.843528  8209 tablet_replica.cc:333] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.844213  8209 raft_consensus.cc:2243] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.845103  8209 raft_consensus.cc:2272] T 9de37f630dc142a28db71d81fa427ab4 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.847327  8209 tablet_replica.cc:333] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.847913  8209 raft_consensus.cc:2243] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.848690  8209 raft_consensus.cc:2272] T e848db4f370a472f9baa6f3d547cb966 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.850841  8209 tablet_replica.cc:333] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.851380  8209 raft_consensus.cc:2243] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.852165  8209 raft_consensus.cc:2272] T af9f8110756a49c082a81e072eed60b3 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.854271  8209 tablet_replica.cc:333] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.854916  8209 raft_consensus.cc:2243] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.855830  8209 raft_consensus.cc:2272] T 2088afc1f50443139a328a7e3bb10212 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.858600  8209 tablet_replica.cc:333] T 37a024bf1cd844419249b9636dd94c69 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.859419  8209 raft_consensus.cc:2243] T 37a024bf1cd844419249b9636dd94c69 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.859983  8209 raft_consensus.cc:2272] T 37a024bf1cd844419249b9636dd94c69 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.862326  8209 tablet_replica.cc:333] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.862864  8209 raft_consensus.cc:2243] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.863273  8209 raft_consensus.cc:2272] T fa6e4009e1d445a1b055538cf3006287 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.865516  8209 tablet_replica.cc:333] T 7e97f3430b8a49e2a9476402b7d46203 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.866091  8209 raft_consensus.cc:2243] T 7e97f3430b8a49e2a9476402b7d46203 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.866493  8209 raft_consensus.cc:2272] T 7e97f3430b8a49e2a9476402b7d46203 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.868460  8209 tablet_replica.cc:333] T 82e52334c3ab4394b0a09b0a460e34d4 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.869114  8209 raft_consensus.cc:2243] T 82e52334c3ab4394b0a09b0a460e34d4 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.869515  8209 raft_consensus.cc:2272] T 82e52334c3ab4394b0a09b0a460e34d4 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.871372  8209 tablet_replica.cc:333] T aab71409c1cf4356817b8f83a1686482 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.871904  8209 raft_consensus.cc:2243] T aab71409c1cf4356817b8f83a1686482 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.872283  8209 raft_consensus.cc:2272] T aab71409c1cf4356817b8f83a1686482 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.874191  8209 tablet_replica.cc:333] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.874696  8209 raft_consensus.cc:2243] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.875460  8209 raft_consensus.cc:2272] T e79d615b8ac14c149720027be9d4dee2 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.877581  8209 tablet_replica.cc:333] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.878087  8209 raft_consensus.cc:2243] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.878798  8209 raft_consensus.cc:2272] T a6c91dff9e8c4ab78bacda0d282beacf P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.880697  8209 tablet_replica.cc:333] T 0d72e7ee195341ab8a8d3865c5013ac8 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.881286  8209 raft_consensus.cc:2243] T 0d72e7ee195341ab8a8d3865c5013ac8 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.881672  8209 raft_consensus.cc:2272] T 0d72e7ee195341ab8a8d3865c5013ac8 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.883749  8209 tablet_replica.cc:333] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.884235  8209 raft_consensus.cc:2243] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.884620  8209 raft_consensus.cc:2272] T 13d7f28a321a46919d282b9709ab84cb P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.886694  8209 tablet_replica.cc:333] T e5445951d8c04b35838db7ef8df62694 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.887287  8209 raft_consensus.cc:2243] T e5445951d8c04b35838db7ef8df62694 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.887751  8209 raft_consensus.cc:2272] T e5445951d8c04b35838db7ef8df62694 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.890167  8209 tablet_replica.cc:333] T c80dc47d27a749eab1ffa183f231f036 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.890697  8209 raft_consensus.cc:2243] T c80dc47d27a749eab1ffa183f231f036 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.891060  8209 raft_consensus.cc:2272] T c80dc47d27a749eab1ffa183f231f036 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.892935  8209 tablet_replica.cc:333] T ce42d5cbca2144e8a54bab8a8cf31763 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.893492  8209 raft_consensus.cc:2243] T ce42d5cbca2144e8a54bab8a8cf31763 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.893872  8209 raft_consensus.cc:2272] T ce42d5cbca2144e8a54bab8a8cf31763 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.895926  8209 tablet_replica.cc:333] T 9b51d554de084a5594e8c14973873edc P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.896468  8209 raft_consensus.cc:2243] T 9b51d554de084a5594e8c14973873edc P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.896898  8209 raft_consensus.cc:2272] T 9b51d554de084a5594e8c14973873edc P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.898145 17890 raft_consensus.cc:493] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1cbe303821774e4d936ea3d54875dcb8)
I20260709 13:06:18.898667 17890 raft_consensus.cc:515] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "622433288cac4964aea9ea5a24ba77fd" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 39929 } } peers { permanent_uuid: "7197bc10b2304fccb972da2da7749e3b" member_type: VOTER last_known_addr { host: "127.8.4.68" port: 45033 } } peers { permanent_uuid: "1cbe303821774e4d936ea3d54875dcb8" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 37355 } }
I20260709 13:06:18.899497  8209 tablet_replica.cc:333] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.900182  8209 raft_consensus.cc:2243] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.900656  8209 raft_consensus.cc:2272] T f1e9d9f32bec4123a2f10e3a20f1067b P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.900785 17890 leader_election.cc:290] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929), 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355)
I20260709 13:06:18.903694  8209 tablet_replica.cc:333] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.904590  8209 raft_consensus.cc:2243] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:06:18.905118 16878 leader_election.cc:336] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 622433288cac4964aea9ea5a24ba77fd (127.8.4.67:39929): Network error: Client connection negotiation failed: client connection to 127.8.4.67:39929: connect: Connection refused (error 111)
I20260709 13:06:18.905157  8209 raft_consensus.cc:2272] T 1e348c32749d48f68c70dc32267e38c0 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:18.905853 16879 leader_election.cc:336] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1cbe303821774e4d936ea3d54875dcb8 (127.8.4.65:37355): Network error: Client connection negotiation failed: client connection to 127.8.4.65:37355: connect: Connection refused (error 111)
I20260709 13:06:18.906255 16879 leader_election.cc:304] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7197bc10b2304fccb972da2da7749e3b; no voters: 1cbe303821774e4d936ea3d54875dcb8, 622433288cac4964aea9ea5a24ba77fd
I20260709 13:06:18.907001 17890 raft_consensus.cc:2749] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:18.908320  8209 tablet_replica.cc:333] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.909227  8209 raft_consensus.cc:2243] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.910133  8209 raft_consensus.cc:2272] T 95d82e412df245e1a4f614cc8c60539c P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.912187  8209 tablet_replica.cc:333] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.912761  8209 raft_consensus.cc:2243] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.913326  8209 raft_consensus.cc:2272] T d281c9020d454b23a8bd21ccfadfa93c P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.915242  8209 tablet_replica.cc:333] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.915781  8209 raft_consensus.cc:2243] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.916577  8209 raft_consensus.cc:2272] T 1ceff4a1d9cf4d75994e64ebab75c551 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.918766  8209 tablet_replica.cc:333] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.919345  8209 raft_consensus.cc:2243] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.919765  8209 raft_consensus.cc:2272] T 061a5313535a475ea9385383b611b52d P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.921717  8209 tablet_replica.cc:333] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.922398  8209 raft_consensus.cc:2243] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.923380  8209 raft_consensus.cc:2272] T c522eefb992a4533ad3a9f3ba6634bc8 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.926234  8209 tablet_replica.cc:333] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.926756  8209 raft_consensus.cc:2243] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.927457  8209 raft_consensus.cc:2272] T 3526ae05dd1141aaaaa2aaea2391b108 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.929509  8209 tablet_replica.cc:333] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.930346  8209 raft_consensus.cc:2243] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.930815  8209 raft_consensus.cc:2272] T e863dd66af3949e78a0e9882520673fb P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.932799  8209 tablet_replica.cc:333] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.933404  8209 raft_consensus.cc:2243] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.933805  8209 raft_consensus.cc:2272] T 661f1f2dcacb42bca7e3b25195dbdfe1 P 7197bc10b2304fccb972da2da7749e3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.935616  8209 tablet_replica.cc:333] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.936098  8209 raft_consensus.cc:2243] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.936455  8209 raft_consensus.cc:2272] T a8d411124ca242a3b8b4fbb5b0a90b66 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.938541  8209 tablet_replica.cc:333] T 4e93c7f885494add9735d842339e740a P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.939042  8209 raft_consensus.cc:2243] T 4e93c7f885494add9735d842339e740a P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.939432  8209 raft_consensus.cc:2272] T 4e93c7f885494add9735d842339e740a P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.941444  8209 tablet_replica.cc:333] T d965337ae0df4ca7aba0e4f9549a8ca9 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.941942  8209 raft_consensus.cc:2243] T d965337ae0df4ca7aba0e4f9549a8ca9 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.942319  8209 raft_consensus.cc:2272] T d965337ae0df4ca7aba0e4f9549a8ca9 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.944154  8209 tablet_replica.cc:333] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.944643  8209 raft_consensus.cc:2243] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.945441  8209 raft_consensus.cc:2272] T d51df8e7709946bbb3f3d5ec1c541307 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.947364  8209 tablet_replica.cc:333] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.947847  8209 raft_consensus.cc:2243] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.948304  8209 raft_consensus.cc:2272] T 0f906a9d133f4a90b55f8dd4ba7d917a P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.950285  8209 tablet_replica.cc:333] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.950793  8209 raft_consensus.cc:2243] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.951505  8209 raft_consensus.cc:2272] T e2f17f39ebb642ac9ff48f3820305d1a P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.953524  8209 tablet_replica.cc:333] T 16b4be927a834597b7190497210b9169 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.954061  8209 raft_consensus.cc:2243] T 16b4be927a834597b7190497210b9169 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.954470  8209 raft_consensus.cc:2272] T 16b4be927a834597b7190497210b9169 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.956657  8209 tablet_replica.cc:333] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.957195  8209 raft_consensus.cc:2243] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.957697  8209 raft_consensus.cc:2272] T 73a0ed4bc207489699e41033ec224d3a P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.959609  8209 tablet_replica.cc:333] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.960112  8209 raft_consensus.cc:2243] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:18.960884  8209 raft_consensus.cc:2272] T 3c96e991f59b4bc298a3819b579eaa15 P 7197bc10b2304fccb972da2da7749e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.962805  8209 tablet_replica.cc:333] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b: stopping tablet replica
I20260709 13:06:18.963296  8209 raft_consensus.cc:2243] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.963723  8209 raft_consensus.cc:2272] T b7e982a881834665b4845c226db01020 P 7197bc10b2304fccb972da2da7749e3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:19.038192  8209 tablet_server.cc:196] TabletServer@127.8.4.68:0 shutdown complete.
I20260709 13:06:19.106701  8209 master.cc:562] Master@127.8.4.126:37545 shutting down...
I20260709 13:06:19.140419  8209 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:19.141258  8209 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:19.141773  8209 tablet_replica.cc:333] T 00000000000000000000000000000000 P 717ac9db426249d99b79ed1678194d86: stopping tablet replica
I20260709 13:06:19.166384  8209 master.cc:584] Master@127.8.4.126:37545 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (34775 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:06:19.267580  8209 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.4.126:43659
I20260709 13:06:19.269711  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:19.281541 17901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:19.281721 17900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:19.282888 17903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:19.284693  8209 server_base.cc:1061] running on GCE node
I20260709 13:06:19.286577  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:19.286820  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:19.287048  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602379287032 us; error 0 us; skew 500 ppm
I20260709 13:06:19.287669  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:19.290706  8209 webserver.cc:533] Webserver started at http://127.8.4.126:45295/ using document root <none> and password file <none>
I20260709 13:06:19.291270  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:19.291436  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:19.291782  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:19.293479  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/master-0-root/instance:
uuid: "1a35567847a74562b712368db60a985b"
format_stamp: "Formatted at 2026-07-09 13:06:19 on dist-test-slave-008w"
I20260709 13:06:19.299002  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:06:19.303596 17908 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:19.304909  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:06:19.305590  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/master-0-root
uuid: "1a35567847a74562b712368db60a985b"
format_stamp: "Formatted at 2026-07-09 13:06:19 on dist-test-slave-008w"
I20260709 13:06:19.306201  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:19.320510  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:19.321910  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:19.366101  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.126:43659
I20260709 13:06:19.366294 17959 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.126:43659 every 8 connection(s)
I20260709 13:06:19.370297 17960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:19.383932 17960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b: Bootstrap starting.
I20260709 13:06:19.389181 17960 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:19.393949 17960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b: No bootstrap required, opened a new log
I20260709 13:06:19.396302 17960 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a35567847a74562b712368db60a985b" member_type: VOTER }
I20260709 13:06:19.396701 17960 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:19.396994 17960 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a35567847a74562b712368db60a985b, State: Initialized, Role: FOLLOWER
I20260709 13:06:19.397645 17960 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a35567847a74562b712368db60a985b" member_type: VOTER }
I20260709 13:06:19.398134 17960 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:06:19.398370 17960 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:06:19.398685 17960 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:19.403651 17960 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a35567847a74562b712368db60a985b" member_type: VOTER }
I20260709 13:06:19.404362 17960 leader_election.cc:304] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1a35567847a74562b712368db60a985b; no voters: 
I20260709 13:06:19.405776 17960 leader_election.cc:290] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:06:19.406272 17963 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:19.407706 17963 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b [term 1 LEADER]: Becoming Leader. State: Replica: 1a35567847a74562b712368db60a985b, State: Running, Role: LEADER
I20260709 13:06:19.408506 17963 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a35567847a74562b712368db60a985b" member_type: VOTER }
I20260709 13:06:19.409089 17960 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:06:19.414394 17965 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a35567847a74562b712368db60a985b. Latest consensus state: current_term: 1 leader_uuid: "1a35567847a74562b712368db60a985b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a35567847a74562b712368db60a985b" member_type: VOTER } }
I20260709 13:06:19.415515 17965 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:19.414386 17964 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1a35567847a74562b712368db60a985b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a35567847a74562b712368db60a985b" member_type: VOTER } }
I20260709 13:06:19.422180 17971 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:06:19.422700 17964 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:19.428167 17971 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:06:19.433548  8209 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:06:19.439968 17971 catalog_manager.cc:1383] Generated new cluster ID: 75723e3feb2644a3b630ffd188600c8a
I20260709 13:06:19.440316 17971 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:06:19.467686 17971 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:06:19.469097 17971 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:06:19.488138 17971 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b: Generated new TSK 0
I20260709 13:06:19.488813 17971 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:06:19.501365  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:19.507869 17981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:19.508904 17982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:19.513099  8209 server_base.cc:1061] running on GCE node
W20260709 13:06:19.513118 17984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:19.514662  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:19.514863  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:19.514991  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602379514980 us; error 0 us; skew 500 ppm
I20260709 13:06:19.515465  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:19.517905  8209 webserver.cc:533] Webserver started at http://127.8.4.65:44999/ using document root <none> and password file <none>
I20260709 13:06:19.518391  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:19.518545  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:19.518764  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:19.519796  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/ts-0-root/instance:
uuid: "c4af78329ca642e1961b052895824194"
format_stamp: "Formatted at 2026-07-09 13:06:19 on dist-test-slave-008w"
I20260709 13:06:19.524503  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:06:19.528668 17989 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:19.529774  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:06:19.530081  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/ts-0-root
uuid: "c4af78329ca642e1961b052895824194"
format_stamp: "Formatted at 2026-07-09 13:06:19 on dist-test-slave-008w"
I20260709 13:06:19.530402  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:19.549343  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:19.550814  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:19.552624  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:19.555305  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:19.555500  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:19.555785  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:19.555958  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:19.604151  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.65:45469
I20260709 13:06:19.604287 18051 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.65:45469 every 8 connection(s)
I20260709 13:06:19.609755  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:19.617906 18056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:19.618461 18057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:19.620676  8209 server_base.cc:1061] running on GCE node
W20260709 13:06:19.621788 18059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:19.623347  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:19.623634  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:19.623862  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602379623821 us; error 0 us; skew 500 ppm
I20260709 13:06:19.624598  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:19.625108 18052 heartbeater.cc:344] Connected to a master server at 127.8.4.126:43659
I20260709 13:06:19.625578 18052 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:19.626361 18052 heartbeater.cc:507] Master 127.8.4.126:43659 requested a full tablet report, sending...
I20260709 13:06:19.627815  8209 webserver.cc:533] Webserver started at http://127.8.4.66:33225/ using document root <none> and password file <none>
I20260709 13:06:19.628512  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:19.628767  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:19.628849 17925 ts_manager.cc:194] Registered new tserver with Master: c4af78329ca642e1961b052895824194 (127.8.4.65:45469)
I20260709 13:06:19.629173  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:19.630863  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/ts-1-root/instance:
uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
format_stamp: "Formatted at 2026-07-09 13:06:19 on dist-test-slave-008w"
I20260709 13:06:19.631523 17925 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56278
I20260709 13:06:19.636826  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.005s
I20260709 13:06:19.640745 18064 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:19.641671  8209 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:06:19.642009  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/ts-1-root
uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
format_stamp: "Formatted at 2026-07-09 13:06:19 on dist-test-slave-008w"
I20260709 13:06:19.642298  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:19.659365  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:19.660620  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:19.662209  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:19.664563  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:19.664801  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:19.665123  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:19.665298  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:19.709637  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.66:42357
I20260709 13:06:19.709795 18126 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.66:42357 every 8 connection(s)
I20260709 13:06:19.715324  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:19.724375 18130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:19.726454 18131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:19.730496 18133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:19.731595  8209 server_base.cc:1061] running on GCE node
I20260709 13:06:19.731686 18127 heartbeater.cc:344] Connected to a master server at 127.8.4.126:43659
I20260709 13:06:19.732292 18127 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:19.732842  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:06:19.733114 18127 heartbeater.cc:507] Master 127.8.4.126:43659 requested a full tablet report, sending...
W20260709 13:06:19.733213  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:19.733636  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602379733616 us; error 0 us; skew 500 ppm
I20260709 13:06:19.734263  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:19.735387 17925 ts_manager.cc:194] Registered new tserver with Master: 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357)
I20260709 13:06:19.736856 17925 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56280
I20260709 13:06:19.737331  8209 webserver.cc:533] Webserver started at http://127.8.4.67:37493/ using document root <none> and password file <none>
I20260709 13:06:19.737984  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:19.738262  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:19.738571  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:19.739769  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/ts-2-root/instance:
uuid: "49f27fe3f4404664b26a8f607f466ba6"
format_stamp: "Formatted at 2026-07-09 13:06:19 on dist-test-slave-008w"
I20260709 13:06:19.744861  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:06:19.748597 18138 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:19.749686  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:06:19.750109  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/ts-2-root
uuid: "49f27fe3f4404664b26a8f607f466ba6"
format_stamp: "Formatted at 2026-07-09 13:06:19 on dist-test-slave-008w"
I20260709 13:06:19.750447  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:19.764425  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:19.765753  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:19.767364  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:19.769809  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:19.770056  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:19.770308  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:19.770499  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:19.814910  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.67:44527
I20260709 13:06:19.814998 18200 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.67:44527 every 8 connection(s)
I20260709 13:06:19.831125 18201 heartbeater.cc:344] Connected to a master server at 127.8.4.126:43659
I20260709 13:06:19.831709 18201 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:19.832530 18201 heartbeater.cc:507] Master 127.8.4.126:43659 requested a full tablet report, sending...
I20260709 13:06:19.834733 17925 ts_manager.cc:194] Registered new tserver with Master: 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:19.834887  8209 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01661984s
I20260709 13:06:19.836642 17925 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56282
I20260709 13:06:19.864753 17925 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56296:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:19.867853 17925 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:19.940223 18166 tablet_service.cc:1511] Processing CreateTablet for tablet b6c5f89a38464e3a8f50e6de3fd70c02 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:06:19.941855 18166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c5f89a38464e3a8f50e6de3fd70c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:19.946043 18092 tablet_service.cc:1511] Processing CreateTablet for tablet b6c5f89a38464e3a8f50e6de3fd70c02 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:06:19.947506 18092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c5f89a38464e3a8f50e6de3fd70c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:19.955207 18017 tablet_service.cc:1511] Processing CreateTablet for tablet b6c5f89a38464e3a8f50e6de3fd70c02 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:06:19.956358 18016 tablet_service.cc:1511] Processing CreateTablet for tablet 537f32a9788e4706b31db79d783e4e33 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:06:19.957046 18091 tablet_service.cc:1511] Processing CreateTablet for tablet 537f32a9788e4706b31db79d783e4e33 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:06:19.956823 18017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c5f89a38464e3a8f50e6de3fd70c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:19.958468 18091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 537f32a9788e4706b31db79d783e4e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:19.960800 18016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 537f32a9788e4706b31db79d783e4e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:19.969521 18165 tablet_service.cc:1511] Processing CreateTablet for tablet 537f32a9788e4706b31db79d783e4e33 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:06:19.971248 18165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 537f32a9788e4706b31db79d783e4e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:19.975035 18090 tablet_service.cc:1511] Processing CreateTablet for tablet b4ee1113d207411694eacec667ae8bc1 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:06:19.977177 18015 tablet_service.cc:1511] Processing CreateTablet for tablet b4ee1113d207411694eacec667ae8bc1 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:06:19.978722 18015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ee1113d207411694eacec667ae8bc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:19.977200 18090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ee1113d207411694eacec667ae8bc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:19.978675 18215 tablet_bootstrap.cc:492] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8: Bootstrap starting.
I20260709 13:06:19.984568 18164 tablet_service.cc:1511] Processing CreateTablet for tablet b4ee1113d207411694eacec667ae8bc1 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:06:19.986172 18164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ee1113d207411694eacec667ae8bc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:19.991007 18215 tablet_bootstrap.cc:654] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.002149 18216 tablet_bootstrap.cc:492] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194: Bootstrap starting.
I20260709 13:06:20.013233 18215 tablet_bootstrap.cc:492] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8: No bootstrap required, opened a new log
I20260709 13:06:20.018741 18215 ts_tablet_manager.cc:1403] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.008s
I20260709 13:06:20.019707 18017 tablet_service.cc:1511] Processing CreateTablet for tablet 2b9641807c104f04b44fd7e50509b3a7 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:06:20.021158 18017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b9641807c104f04b44fd7e50509b3a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.021592 18091 tablet_service.cc:1511] Processing CreateTablet for tablet 2b9641807c104f04b44fd7e50509b3a7 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:06:20.022009 18215 raft_consensus.cc:359] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } }
I20260709 13:06:20.022816 18215 raft_consensus.cc:385] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.022985 18091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b9641807c104f04b44fd7e50509b3a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.023134 18215 raft_consensus.cc:740] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.024307 18215 consensus_queue.cc:260] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } }
I20260709 13:06:20.025782 18216 tablet_bootstrap.cc:654] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.035038 18015 tablet_service.cc:1511] Processing CreateTablet for tablet 77b05b18753e4424b93fafb956a63eeb (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:06:20.035508 18164 tablet_service.cc:1511] Processing CreateTablet for tablet 2b9641807c104f04b44fd7e50509b3a7 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:06:20.037097 18015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b05b18753e4424b93fafb956a63eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.037446 18164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b9641807c104f04b44fd7e50509b3a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.042678 18090 tablet_service.cc:1511] Processing CreateTablet for tablet 77b05b18753e4424b93fafb956a63eeb (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:06:20.044450 18090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b05b18753e4424b93fafb956a63eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.056583 18127 heartbeater.cc:499] Master 127.8.4.126:43659 was elected leader, sending a full tablet report...
I20260709 13:06:20.059914 18163 tablet_service.cc:1511] Processing CreateTablet for tablet 77b05b18753e4424b93fafb956a63eeb (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:06:20.061677 18163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b05b18753e4424b93fafb956a63eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.066740 18016 tablet_service.cc:1511] Processing CreateTablet for tablet 2430275956ef476e9dedff8b6b31ddef (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:06:20.070056 18016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2430275956ef476e9dedff8b6b31ddef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.070386 18218 tablet_bootstrap.cc:492] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6: Bootstrap starting.
I20260709 13:06:20.076934 18215 ts_tablet_manager.cc:1434] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8: Time spent starting tablet: real 0.058s	user 0.015s	sys 0.000s
I20260709 13:06:20.077350 18218 tablet_bootstrap.cc:654] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.079691 18215 tablet_bootstrap.cc:492] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8: Bootstrap starting.
I20260709 13:06:20.097323 18216 tablet_bootstrap.cc:492] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194: No bootstrap required, opened a new log
I20260709 13:06:20.096959 18090 tablet_service.cc:1511] Processing CreateTablet for tablet 2430275956ef476e9dedff8b6b31ddef (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:06:20.097870 18216 ts_tablet_manager.cc:1403] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194: Time spent bootstrapping tablet: real 0.096s	user 0.022s	sys 0.021s
I20260709 13:06:20.098393 18090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2430275956ef476e9dedff8b6b31ddef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.102103 18216 raft_consensus.cc:359] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } }
I20260709 13:06:20.103102 18216 raft_consensus.cc:385] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.103503 18216 raft_consensus.cc:740] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4af78329ca642e1961b052895824194, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.103672 18091 tablet_service.cc:1511] Processing CreateTablet for tablet 7d6f1422dbe6496db73bb5d12a4e60e9 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:06:20.105273 18091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d6f1422dbe6496db73bb5d12a4e60e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.104691 18216 consensus_queue.cc:260] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } }
I20260709 13:06:20.103559 18215 tablet_bootstrap.cc:654] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.108103 18017 tablet_service.cc:1511] Processing CreateTablet for tablet 7d6f1422dbe6496db73bb5d12a4e60e9 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:06:20.109616 18017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d6f1422dbe6496db73bb5d12a4e60e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.110463 18163 tablet_service.cc:1511] Processing CreateTablet for tablet 7d6f1422dbe6496db73bb5d12a4e60e9 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:06:20.112090 18163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d6f1422dbe6496db73bb5d12a4e60e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.114786 18164 tablet_service.cc:1511] Processing CreateTablet for tablet 2430275956ef476e9dedff8b6b31ddef (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:06:20.116323 18164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2430275956ef476e9dedff8b6b31ddef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.121178 18016 tablet_service.cc:1511] Processing CreateTablet for tablet b5f6d2429ec54e0f9f38b92bb4048fe1 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:06:20.122602 18016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5f6d2429ec54e0f9f38b92bb4048fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.129482 18092 tablet_service.cc:1511] Processing CreateTablet for tablet b5f6d2429ec54e0f9f38b92bb4048fe1 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:06:20.131007 18092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5f6d2429ec54e0f9f38b92bb4048fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.148506 18052 heartbeater.cc:499] Master 127.8.4.126:43659 was elected leader, sending a full tablet report...
I20260709 13:06:20.155957 18216 ts_tablet_manager.cc:1434] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.012s
I20260709 13:06:20.157265 18216 tablet_bootstrap.cc:492] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194: Bootstrap starting.
I20260709 13:06:20.163542 18218 tablet_bootstrap.cc:492] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6: No bootstrap required, opened a new log
I20260709 13:06:20.164207 18218 ts_tablet_manager.cc:1403] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6: Time spent bootstrapping tablet: real 0.094s	user 0.017s	sys 0.011s
I20260709 13:06:20.164587 18166 tablet_service.cc:1511] Processing CreateTablet for tablet b5f6d2429ec54e0f9f38b92bb4048fe1 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:06:20.166355 18166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5f6d2429ec54e0f9f38b92bb4048fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.168095 18218 raft_consensus.cc:359] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } }
I20260709 13:06:20.169044 18218 raft_consensus.cc:385] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.169256 18215 tablet_bootstrap.cc:492] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8: No bootstrap required, opened a new log
I20260709 13:06:20.169377 18218 raft_consensus.cc:740] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.170138 18215 ts_tablet_manager.cc:1403] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8: Time spent bootstrapping tablet: real 0.091s	user 0.013s	sys 0.007s
I20260709 13:06:20.170670 18218 consensus_queue.cc:260] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } }
I20260709 13:06:20.175494 18017 tablet_service.cc:1511] Processing CreateTablet for tablet cd8d451d800544b68665799cc3e58a76 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:06:20.177075 18017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd8d451d800544b68665799cc3e58a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.185971 18215 raft_consensus.cc:359] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.186933 18215 raft_consensus.cc:385] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.187284 18215 raft_consensus.cc:740] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.188112 18215 consensus_queue.cc:260] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.190428 18215 ts_tablet_manager.cc:1434] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.002s
I20260709 13:06:20.194649 18016 tablet_service.cc:1511] Processing CreateTablet for tablet b924daab328e432691b232291b6d5f92 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:06:20.196173 18016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b924daab328e432691b232291b6d5f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.198472 18089 tablet_service.cc:1511] Processing CreateTablet for tablet cd8d451d800544b68665799cc3e58a76 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:06:20.200039 18089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd8d451d800544b68665799cc3e58a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.200700 18216 tablet_bootstrap.cc:654] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.202353 18165 tablet_service.cc:1511] Processing CreateTablet for tablet cd8d451d800544b68665799cc3e58a76 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:06:20.203759 18165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd8d451d800544b68665799cc3e58a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.207297 18088 tablet_service.cc:1511] Processing CreateTablet for tablet b924daab328e432691b232291b6d5f92 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:06:20.212635 18164 tablet_service.cc:1511] Processing CreateTablet for tablet b924daab328e432691b232291b6d5f92 (DEFAULT_TABLE table=test-workload [id=296c5251c46d4a5188f626cd0b7d1ca8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
W20260709 13:06:20.214813 18128 tablet.cc:2406] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:06:20.215839 18164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b924daab328e432691b232291b6d5f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.216176 18216 tablet_bootstrap.cc:492] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194: No bootstrap required, opened a new log
I20260709 13:06:20.217410 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b924daab328e432691b232291b6d5f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.216727 18216 ts_tablet_manager.cc:1403] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.003s
I20260709 13:06:20.230607 18215 tablet_bootstrap.cc:492] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8: Bootstrap starting.
I20260709 13:06:20.231438 18201 heartbeater.cc:499] Master 127.8.4.126:43659 was elected leader, sending a full tablet report...
I20260709 13:06:20.237738 18215 tablet_bootstrap.cc:654] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.243057 18216 raft_consensus.cc:359] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.243935 18216 raft_consensus.cc:385] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.244242 18216 raft_consensus.cc:740] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4af78329ca642e1961b052895824194, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.245055 18216 consensus_queue.cc:260] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.246160 18218 ts_tablet_manager.cc:1434] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6: Time spent starting tablet: real 0.082s	user 0.021s	sys 0.008s
I20260709 13:06:20.253913 18218 tablet_bootstrap.cc:492] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6: Bootstrap starting.
I20260709 13:06:20.259259 18215 tablet_bootstrap.cc:492] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8: No bootstrap required, opened a new log
I20260709 13:06:20.259968 18215 ts_tablet_manager.cc:1403] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.017s
I20260709 13:06:20.262508 18216 ts_tablet_manager.cc:1434] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.001s
I20260709 13:06:20.262876 18215 raft_consensus.cc:359] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.263640 18216 tablet_bootstrap.cc:492] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194: Bootstrap starting.
I20260709 13:06:20.263715 18215 raft_consensus.cc:385] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.264302 18215 raft_consensus.cc:740] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.265089 18215 consensus_queue.cc:260] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.267386 18215 ts_tablet_manager.cc:1434] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:06:20.267619 18222 raft_consensus.cc:493] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.268141 18222 raft_consensus.cc:515] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.268561 18215 tablet_bootstrap.cc:492] T 2b9641807c104f04b44fd7e50509b3a7 P 43f35dbf581d4cd39f32cc742b03b2e8: Bootstrap starting.
I20260709 13:06:20.271232 18216 tablet_bootstrap.cc:654] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.276254 18215 tablet_bootstrap.cc:654] T 2b9641807c104f04b44fd7e50509b3a7 P 43f35dbf581d4cd39f32cc742b03b2e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.281309 18222 leader_election.cc:290] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:20.288923 18219 raft_consensus.cc:493] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.289827 18219 raft_consensus.cc:515] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.293469 18218 tablet_bootstrap.cc:654] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.298892 18219 leader_election.cc:290] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:20.306902 18218 tablet_bootstrap.cc:492] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6: No bootstrap required, opened a new log
I20260709 13:06:20.307796 18218 ts_tablet_manager.cc:1403] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.005s
I20260709 13:06:20.312453 18218 raft_consensus.cc:359] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.313547 18218 raft_consensus.cc:385] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.313939 18218 raft_consensus.cc:740] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.315131 18218 consensus_queue.cc:260] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.329874 18218 ts_tablet_manager.cc:1434] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.004s
I20260709 13:06:20.333719 18218 tablet_bootstrap.cc:492] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6: Bootstrap starting.
I20260709 13:06:20.344005 18218 tablet_bootstrap.cc:654] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.368069 18218 tablet_bootstrap.cc:492] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6: No bootstrap required, opened a new log
I20260709 13:06:20.368909 18218 ts_tablet_manager.cc:1403] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.006s
I20260709 13:06:20.373518 18218 raft_consensus.cc:359] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.374715 18218 raft_consensus.cc:385] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.375190 18218 raft_consensus.cc:740] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.376562 18218 consensus_queue.cc:260] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.382822 18219 raft_consensus.cc:493] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.383711 18219 raft_consensus.cc:515] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.387161 18219 leader_election.cc:290] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:20.390666 18218 ts_tablet_manager.cc:1434] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:06:20.402844 18218 tablet_bootstrap.cc:492] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6: Bootstrap starting.
I20260709 13:06:20.404069 18219 raft_consensus.cc:493] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.404969 18219 raft_consensus.cc:515] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } }
I20260709 13:06:20.407884 18219 leader_election.cc:290] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527), c4af78329ca642e1961b052895824194 (127.8.4.65:45469)
I20260709 13:06:20.413617 18218 tablet_bootstrap.cc:654] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.425030 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ee1113d207411694eacec667ae8bc1" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4af78329ca642e1961b052895824194" is_pre_election: true
I20260709 13:06:20.425879 18027 raft_consensus.cc:2468] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 0.
I20260709 13:06:20.426308 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ee1113d207411694eacec667ae8bc1" candidate_uuid: "c4af78329ca642e1961b052895824194" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" is_pre_election: true
I20260709 13:06:20.427117 18102 raft_consensus.cc:2468] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4af78329ca642e1961b052895824194 in term 0.
I20260709 13:06:20.427177 18222 raft_consensus.cc:493] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.427778 18222 raft_consensus.cc:515] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } }
I20260709 13:06:20.425789 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f32a9788e4706b31db79d783e4e33" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4af78329ca642e1961b052895824194" is_pre_election: true
W20260709 13:06:20.429037 17973 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:20.430361 18222 leader_election.cc:290] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527), 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357)
I20260709 13:06:20.430516 17990 leader_election.cc:304] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:20.430577 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ee1113d207411694eacec667ae8bc1" candidate_uuid: "c4af78329ca642e1961b052895824194" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6" is_pre_election: true
I20260709 13:06:20.431532 18176 raft_consensus.cc:2468] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4af78329ca642e1961b052895824194 in term 0.
I20260709 13:06:20.431623 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c5f89a38464e3a8f50e6de3fd70c02" candidate_uuid: "c4af78329ca642e1961b052895824194" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6" is_pre_election: true
I20260709 13:06:20.432169 18222 raft_consensus.cc:2804] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:20.432366 18175 raft_consensus.cc:2468] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4af78329ca642e1961b052895824194 in term 0.
I20260709 13:06:20.432704 18215 tablet_bootstrap.cc:492] T 2b9641807c104f04b44fd7e50509b3a7 P 43f35dbf581d4cd39f32cc742b03b2e8: No bootstrap required, opened a new log
I20260709 13:06:20.432739 18222 raft_consensus.cc:493] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.433306 18215 ts_tablet_manager.cc:1403] T 2b9641807c104f04b44fd7e50509b3a7 P 43f35dbf581d4cd39f32cc742b03b2e8: Time spent bootstrapping tablet: real 0.165s	user 0.075s	sys 0.078s
I20260709 13:06:20.433513 18222 raft_consensus.cc:3060] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.434716 17993 leader_election.cc:304] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49f27fe3f4404664b26a8f607f466ba6, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:20.436038 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c5f89a38464e3a8f50e6de3fd70c02" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4af78329ca642e1961b052895824194" is_pre_election: true
I20260709 13:06:20.435998 18215 raft_consensus.cc:359] T 2b9641807c104f04b44fd7e50509b3a7 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.437175 18027 raft_consensus.cc:2468] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 0.
I20260709 13:06:20.437342 18215 raft_consensus.cc:385] T 2b9641807c104f04b44fd7e50509b3a7 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.437670 18215 raft_consensus.cc:740] T 2b9641807c104f04b44fd7e50509b3a7 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.438122 18068 leader_election.cc:304] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:20.438488 18215 consensus_queue.cc:260] T 2b9641807c104f04b44fd7e50509b3a7 P 43f35dbf581d4cd39f32cc742b03b2e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
W20260709 13:06:20.439167 18068 leader_election.cc:343] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.440240 18219 raft_consensus.cc:2804] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:20.440618 18219 raft_consensus.cc:493] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.440730 18216 tablet_bootstrap.cc:492] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194: No bootstrap required, opened a new log
I20260709 13:06:20.444953 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c5f89a38464e3a8f50e6de3fd70c02" candidate_uuid: "c4af78329ca642e1961b052895824194" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" is_pre_election: true
I20260709 13:06:20.446254 18102 raft_consensus.cc:2468] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4af78329ca642e1961b052895824194 in term 0.
I20260709 13:06:20.446247 18216 ts_tablet_manager.cc:1403] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194: Time spent bootstrapping tablet: real 0.183s	user 0.049s	sys 0.108s
I20260709 13:06:20.441066 18219 raft_consensus.cc:3060] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.446302 18236 raft_consensus.cc:2804] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:20.447625 18236 raft_consensus.cc:493] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.448045 18236 raft_consensus.cc:3060] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.451210 18216 raft_consensus.cc:359] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.452543 18216 raft_consensus.cc:385] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.453114 18216 raft_consensus.cc:740] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4af78329ca642e1961b052895824194, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.454720 18068 leader_election.cc:304] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:20.454761 18216 consensus_queue.cc:260] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.457888 18222 raft_consensus.cc:515] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.458738 18236 raft_consensus.cc:515] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } }
I20260709 13:06:20.461647 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c5f89a38464e3a8f50e6de3fd70c02" candidate_uuid: "c4af78329ca642e1961b052895824194" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
I20260709 13:06:20.462229 18175 raft_consensus.cc:3060] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.463436 18219 raft_consensus.cc:515] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.466603 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ee1113d207411694eacec667ae8bc1" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6" is_pre_election: true
I20260709 13:06:20.467324 18176 raft_consensus.cc:2468] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 0.
I20260709 13:06:20.470903 18175 raft_consensus.cc:2468] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4af78329ca642e1961b052895824194 in term 1.
I20260709 13:06:20.466113 18216 ts_tablet_manager.cc:1434] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 13:06:20.472798 17993 leader_election.cc:304] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49f27fe3f4404664b26a8f607f466ba6, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:20.475704 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f32a9788e4706b31db79d783e4e33" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6" is_pre_election: true
I20260709 13:06:20.490979 18242 raft_consensus.cc:493] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.491428 18176 raft_consensus.cc:2468] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 0.
I20260709 13:06:20.491582 18242 raft_consensus.cc:515] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.484061 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c5f89a38464e3a8f50e6de3fd70c02" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6" is_pre_election: true
I20260709 13:06:20.494381 18175 raft_consensus.cc:2393] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43f35dbf581d4cd39f32cc742b03b2e8 in current term 1: Already voted for candidate c4af78329ca642e1961b052895824194 in this term.
I20260709 13:06:20.495747 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f32a9788e4706b31db79d783e4e33" candidate_uuid: "c4af78329ca642e1961b052895824194" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6" is_pre_election: true
I20260709 13:06:20.495747 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ee1113d207411694eacec667ae8bc1" candidate_uuid: "c4af78329ca642e1961b052895824194" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
I20260709 13:06:20.496518 18175 raft_consensus.cc:2468] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4af78329ca642e1961b052895824194 in term 0.
I20260709 13:06:20.496702 18102 raft_consensus.cc:2393] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c4af78329ca642e1961b052895824194 in current term 1: Already voted for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in this term.
I20260709 13:06:20.497045 18240 raft_consensus.cc:2804] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:20.498215 18242 leader_election.cc:290] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:20.497741 18236 leader_election.cc:290] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [CANDIDATE]: Term 1 election: Requested vote from peers 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527), 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357)
I20260709 13:06:20.488664 18216 tablet_bootstrap.cc:492] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194: Bootstrap starting.
I20260709 13:06:20.499564 17993 leader_election.cc:304] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49f27fe3f4404664b26a8f607f466ba6, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:20.500150 18240 raft_consensus.cc:697] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [term 1 LEADER]: Becoming Leader. State: Replica: c4af78329ca642e1961b052895824194, State: Running, Role: LEADER
I20260709 13:06:20.506042 18240 consensus_queue.cc:237] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } }
I20260709 13:06:20.499570 18068 leader_election.cc:304] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, 49f27fe3f4404664b26a8f607f466ba6; no voters: c4af78329ca642e1961b052895824194
I20260709 13:06:20.501413 18218 tablet_bootstrap.cc:492] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6: No bootstrap required, opened a new log
I20260709 13:06:20.512852 18218 ts_tablet_manager.cc:1403] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6: Time spent bootstrapping tablet: real 0.110s	user 0.015s	sys 0.004s
I20260709 13:06:20.515930 18218 raft_consensus.cc:359] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.516889 18218 raft_consensus.cc:385] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.517333 18218 raft_consensus.cc:740] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.518633 18218 consensus_queue.cc:260] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.509359 18241 raft_consensus.cc:2804] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:20.521219 18241 raft_consensus.cc:493] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.521569 18241 raft_consensus.cc:3060] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.522737 18216 tablet_bootstrap.cc:654] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.528369 18239 raft_consensus.cc:2804] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:20.528931 18239 raft_consensus.cc:493] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.529301 18239 raft_consensus.cc:3060] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.525238 18218 ts_tablet_manager.cc:1434] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:06:20.540688 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ee1113d207411694eacec667ae8bc1" candidate_uuid: "c4af78329ca642e1961b052895824194" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
I20260709 13:06:20.541535 18175 raft_consensus.cc:3060] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.544184 18239 raft_consensus.cc:515] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } }
I20260709 13:06:20.538455 18222 leader_election.cc:290] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [CANDIDATE]: Term 1 election: Requested vote from peers 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:20.550531 18218 tablet_bootstrap.cc:492] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6: Bootstrap starting.
I20260709 13:06:20.550982 18245 raft_consensus.cc:2804] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:20.551172 18219 leader_election.cc:290] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 election: Requested vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:20.557504 18175 raft_consensus.cc:2468] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4af78329ca642e1961b052895824194 in term 1.
I20260709 13:06:20.551647 18245 raft_consensus.cc:493] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.559398 18245 raft_consensus.cc:3060] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.554944 18239 leader_election.cc:290] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 election: Requested vote from peers 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527), c4af78329ca642e1961b052895824194 (127.8.4.65:45469)
I20260709 13:06:20.559358 17993 leader_election.cc:304] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49f27fe3f4404664b26a8f607f466ba6, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:20.560865 18222 raft_consensus.cc:2804] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:20.561138 18216 tablet_bootstrap.cc:492] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194: No bootstrap required, opened a new log
I20260709 13:06:20.561714 18222 raft_consensus.cc:697] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 1 LEADER]: Becoming Leader. State: Replica: c4af78329ca642e1961b052895824194, State: Running, Role: LEADER
W20260709 13:06:20.549840 18068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:44527, user_credentials={real_user=slave}} blocked reactor thread for 51069.7us
I20260709 13:06:20.559536 18215 ts_tablet_manager.cc:1434] T 2b9641807c104f04b44fd7e50509b3a7 P 43f35dbf581d4cd39f32cc742b03b2e8: Time spent starting tablet: real 0.126s	user 0.042s	sys 0.068s
I20260709 13:06:20.562731 18222 consensus_queue.cc:237] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.563869 18215 tablet_bootstrap.cc:492] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8: Bootstrap starting.
I20260709 13:06:20.561808 18216 ts_tablet_manager.cc:1403] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.012s
I20260709 13:06:20.564903 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c5f89a38464e3a8f50e6de3fd70c02" candidate_uuid: "c4af78329ca642e1961b052895824194" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
I20260709 13:06:20.565277 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f32a9788e4706b31db79d783e4e33" candidate_uuid: "c4af78329ca642e1961b052895824194" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" is_pre_election: true
I20260709 13:06:20.566007 18101 raft_consensus.cc:2393] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c4af78329ca642e1961b052895824194 in current term 1: Already voted for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in this term.
I20260709 13:06:20.547089 18241 raft_consensus.cc:515] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.568074 18216 raft_consensus.cc:359] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.568938 18216 raft_consensus.cc:385] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.569265 18216 raft_consensus.cc:740] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4af78329ca642e1961b052895824194, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.557389 17924 catalog_manager.cc:5697] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 reported cstate change: term changed from 0 to 1, leader changed from <none> to c4af78329ca642e1961b052895824194 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "c4af78329ca642e1961b052895824194" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:20.571647 18216 consensus_queue.cc:260] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.573477 18215 tablet_bootstrap.cc:654] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.575652 18216 ts_tablet_manager.cc:1434] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:06:20.576895 18216 tablet_bootstrap.cc:492] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194: Bootstrap starting.
I20260709 13:06:20.579212 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f32a9788e4706b31db79d783e4e33" candidate_uuid: "c4af78329ca642e1961b052895824194" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
I20260709 13:06:20.581518 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ee1113d207411694eacec667ae8bc1" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4af78329ca642e1961b052895824194"
I20260709 13:06:20.594676 18215 tablet_bootstrap.cc:492] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8: No bootstrap required, opened a new log
I20260709 13:06:20.583304 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ee1113d207411694eacec667ae8bc1" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
I20260709 13:06:20.584654 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c5f89a38464e3a8f50e6de3fd70c02" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
I20260709 13:06:20.598958 18215 ts_tablet_manager.cc:1403] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.015s
I20260709 13:06:20.599261 18176 raft_consensus.cc:2393] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 43f35dbf581d4cd39f32cc742b03b2e8 in current term 1: Already voted for candidate c4af78329ca642e1961b052895824194 in this term.
I20260709 13:06:20.599727 18175 raft_consensus.cc:3060] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.581647 18241 leader_election.cc:290] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [CANDIDATE]: Term 1 election: Requested vote from peers 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:20.589439 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f32a9788e4706b31db79d783e4e33" candidate_uuid: "c4af78329ca642e1961b052895824194" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
I20260709 13:06:20.586665 18245 raft_consensus.cc:515] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.586290 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c5f89a38464e3a8f50e6de3fd70c02" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4af78329ca642e1961b052895824194"
I20260709 13:06:20.602061 18102 raft_consensus.cc:2393] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4af78329ca642e1961b052895824194 in current term 1: Already voted for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in this term.
I20260709 13:06:20.599261 18174 raft_consensus.cc:2393] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 43f35dbf581d4cd39f32cc742b03b2e8 in current term 1: Already voted for candidate c4af78329ca642e1961b052895824194 in this term.
I20260709 13:06:20.602632 18215 raft_consensus.cc:359] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.603426 18215 raft_consensus.cc:385] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.603562 18245 leader_election.cc:290] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 election: Requested vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:20.603788 18215 raft_consensus.cc:740] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.604641 18215 consensus_queue.cc:260] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.605396 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f32a9788e4706b31db79d783e4e33" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4af78329ca642e1961b052895824194"
I20260709 13:06:20.605592 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f32a9788e4706b31db79d783e4e33" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
I20260709 13:06:20.606361 18026 raft_consensus.cc:2393] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 43f35dbf581d4cd39f32cc742b03b2e8 in current term 1: Already voted for candidate c4af78329ca642e1961b052895824194 in this term.
I20260709 13:06:20.608017 18068 leader_election.cc:304] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8; no voters: 49f27fe3f4404664b26a8f607f466ba6, c4af78329ca642e1961b052895824194
I20260709 13:06:20.608598 18215 ts_tablet_manager.cc:1434] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:06:20.609779 18215 tablet_bootstrap.cc:492] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8: Bootstrap starting.
I20260709 13:06:20.609514 18068 leader_election.cc:304] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8; no voters: 49f27fe3f4404664b26a8f607f466ba6, c4af78329ca642e1961b052895824194
I20260709 13:06:20.610044 18237 raft_consensus.cc:2749] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:20.610481 18239 raft_consensus.cc:2749] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:20.611776 18068 leader_election.cc:304] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8; no voters: 49f27fe3f4404664b26a8f607f466ba6, c4af78329ca642e1961b052895824194
I20260709 13:06:20.597254 18218 tablet_bootstrap.cc:654] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.597196 18216 tablet_bootstrap.cc:654] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.617244 18239 raft_consensus.cc:2749] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:20.618026 18215 tablet_bootstrap.cc:654] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.619920 18175 raft_consensus.cc:2468] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4af78329ca642e1961b052895824194 in term 1.
I20260709 13:06:20.624783 18239 raft_consensus.cc:493] T 2b9641807c104f04b44fd7e50509b3a7 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.630854 18241 raft_consensus.cc:493] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.634414 18239 raft_consensus.cc:515] T 2b9641807c104f04b44fd7e50509b3a7 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.634557 18241 raft_consensus.cc:515] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.637557 18241 leader_election.cc:290] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:20.637785 18239 leader_election.cc:290] T 2b9641807c104f04b44fd7e50509b3a7 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:20.629881 17924 catalog_manager.cc:5697] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 reported cstate change: term changed from 0 to 1, leader changed from <none> to c4af78329ca642e1961b052895824194 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "c4af78329ca642e1961b052895824194" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:20.638821 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9641807c104f04b44fd7e50509b3a7" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4af78329ca642e1961b052895824194" is_pre_election: true
I20260709 13:06:20.641824 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b05b18753e4424b93fafb956a63eeb" candidate_uuid: "c4af78329ca642e1961b052895824194" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" is_pre_election: true
I20260709 13:06:20.642062 17993 leader_election.cc:304] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49f27fe3f4404664b26a8f607f466ba6, c4af78329ca642e1961b052895824194; no voters: 43f35dbf581d4cd39f32cc742b03b2e8
I20260709 13:06:20.642565 18102 raft_consensus.cc:2468] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4af78329ca642e1961b052895824194 in term 0.
I20260709 13:06:20.643430 18241 raft_consensus.cc:2804] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:20.643735 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9641807c104f04b44fd7e50509b3a7" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6" is_pre_election: true
I20260709 13:06:20.644116 18241 raft_consensus.cc:697] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 1 LEADER]: Becoming Leader. State: Replica: c4af78329ca642e1961b052895824194, State: Running, Role: LEADER
I20260709 13:06:20.645140 18241 consensus_queue.cc:237] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
W20260709 13:06:20.645821 18068 leader_election.cc:343] T 2b9641807c104f04b44fd7e50509b3a7 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:20.646643 18068 leader_election.cc:343] T 2b9641807c104f04b44fd7e50509b3a7 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.647097 18068 leader_election.cc:304] T 2b9641807c104f04b44fd7e50509b3a7 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8; no voters: 49f27fe3f4404664b26a8f607f466ba6, c4af78329ca642e1961b052895824194
I20260709 13:06:20.648579 17990 leader_election.cc:304] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:20.649151 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b05b18753e4424b93fafb956a63eeb" candidate_uuid: "c4af78329ca642e1961b052895824194" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6" is_pre_election: true
I20260709 13:06:20.649641 18222 raft_consensus.cc:2804] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:20.650108 18222 raft_consensus.cc:493] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.649853 18175 raft_consensus.cc:2468] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4af78329ca642e1961b052895824194 in term 0.
I20260709 13:06:20.650511 18222 raft_consensus.cc:3060] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.654986 18216 tablet_bootstrap.cc:492] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194: No bootstrap required, opened a new log
I20260709 13:06:20.657958 18218 tablet_bootstrap.cc:492] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6: No bootstrap required, opened a new log
I20260709 13:06:20.659276 18239 raft_consensus.cc:2749] T 2b9641807c104f04b44fd7e50509b3a7 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:20.669291 18216 ts_tablet_manager.cc:1403] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.016s
I20260709 13:06:20.670702 18218 ts_tablet_manager.cc:1403] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6: Time spent bootstrapping tablet: real 0.121s	user 0.014s	sys 0.013s
I20260709 13:06:20.675519 18218 raft_consensus.cc:359] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.667631 18222 raft_consensus.cc:515] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.676878 18218 raft_consensus.cc:385] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.677306 18218 raft_consensus.cc:740] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.678117 18216 raft_consensus.cc:359] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.679225 18216 raft_consensus.cc:385] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.679520 18216 raft_consensus.cc:740] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4af78329ca642e1961b052895824194, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.678416 18222 leader_election.cc:290] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [CANDIDATE]: Term 1 election: Requested vote from peers 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:20.678344 18218 consensus_queue.cc:260] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.680374 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b05b18753e4424b93fafb956a63eeb" candidate_uuid: "c4af78329ca642e1961b052895824194" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
I20260709 13:06:20.680330 18216 consensus_queue.cc:260] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.680922 18215 tablet_bootstrap.cc:492] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8: No bootstrap required, opened a new log
I20260709 13:06:20.681136 18175 raft_consensus.cc:3060] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.681754 18215 ts_tablet_manager.cc:1403] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8: Time spent bootstrapping tablet: real 0.072s	user 0.033s	sys 0.035s
I20260709 13:06:20.682781 18216 ts_tablet_manager.cc:1434] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:06:20.684080 18216 tablet_bootstrap.cc:492] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194: Bootstrap starting.
I20260709 13:06:20.684868 18215 raft_consensus.cc:359] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.685690 18215 raft_consensus.cc:385] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.685992 18215 raft_consensus.cc:740] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.686605 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b05b18753e4424b93fafb956a63eeb" candidate_uuid: "c4af78329ca642e1961b052895824194" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
I20260709 13:06:20.686754 18215 consensus_queue.cc:260] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.687274 18102 raft_consensus.cc:3060] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.690414 18218 ts_tablet_manager.cc:1434] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:06:20.679733 17924 catalog_manager.cc:5697] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 reported cstate change: term changed from 0 to 1, leader changed from <none> to c4af78329ca642e1961b052895824194 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "c4af78329ca642e1961b052895824194" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:20.691264 18216 tablet_bootstrap.cc:654] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.695192 18102 raft_consensus.cc:2468] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4af78329ca642e1961b052895824194 in term 1.
I20260709 13:06:20.697201 17990 leader_election.cc:304] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:20.697722 18215 ts_tablet_manager.cc:1434] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:06:20.698514 18241 raft_consensus.cc:2804] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:20.698915 18215 tablet_bootstrap.cc:492] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8: Bootstrap starting.
I20260709 13:06:20.699440 18241 raft_consensus.cc:697] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [term 1 LEADER]: Becoming Leader. State: Replica: c4af78329ca642e1961b052895824194, State: Running, Role: LEADER
I20260709 13:06:20.700697 18222 raft_consensus.cc:493] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.701381 18222 raft_consensus.cc:515] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.705396 18215 tablet_bootstrap.cc:654] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.707803 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2430275956ef476e9dedff8b6b31ddef" candidate_uuid: "c4af78329ca642e1961b052895824194" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" is_pre_election: true
W20260709 13:06:20.710539 17990 leader_election.cc:343] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.713837 18222 leader_election.cc:290] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:20.714088 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2430275956ef476e9dedff8b6b31ddef" candidate_uuid: "c4af78329ca642e1961b052895824194" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6" is_pre_election: true
I20260709 13:06:20.714735 18175 raft_consensus.cc:2468] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4af78329ca642e1961b052895824194 in term 1.
I20260709 13:06:20.716005 18241 consensus_queue.cc:237] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
W20260709 13:06:20.716445 17993 leader_election.cc:343] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.717104 17993 leader_election.cc:304] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4af78329ca642e1961b052895824194; no voters: 43f35dbf581d4cd39f32cc742b03b2e8, 49f27fe3f4404664b26a8f607f466ba6
I20260709 13:06:20.719389 18222 raft_consensus.cc:2749] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:20.722847 18215 tablet_bootstrap.cc:492] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8: No bootstrap required, opened a new log
I20260709 13:06:20.723264 18218 tablet_bootstrap.cc:492] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6: Bootstrap starting.
I20260709 13:06:20.723476 18215 ts_tablet_manager.cc:1403] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.004s
I20260709 13:06:20.724913 18216 tablet_bootstrap.cc:492] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194: No bootstrap required, opened a new log
I20260709 13:06:20.725754 18216 ts_tablet_manager.cc:1403] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.014s
I20260709 13:06:20.726634 18215 raft_consensus.cc:359] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.727567 18215 raft_consensus.cc:385] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.727901 18215 raft_consensus.cc:740] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.729049 18215 consensus_queue.cc:260] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.730487 18216 raft_consensus.cc:359] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.731886 18218 tablet_bootstrap.cc:654] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.731954 18216 raft_consensus.cc:385] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.732693 18216 raft_consensus.cc:740] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4af78329ca642e1961b052895824194, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.734042 18216 consensus_queue.cc:260] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.741417 18216 ts_tablet_manager.cc:1434] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.002s
I20260709 13:06:20.743355 18216 tablet_bootstrap.cc:492] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194: Bootstrap starting.
I20260709 13:06:20.744400 18215 ts_tablet_manager.cc:1434] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:06:20.751022 18216 tablet_bootstrap.cc:654] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.752823 18215 tablet_bootstrap.cc:492] T 2430275956ef476e9dedff8b6b31ddef P 43f35dbf581d4cd39f32cc742b03b2e8: Bootstrap starting.
I20260709 13:06:20.752517 17924 catalog_manager.cc:5697] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 reported cstate change: term changed from 0 to 1, leader changed from <none> to c4af78329ca642e1961b052895824194 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "c4af78329ca642e1961b052895824194" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:20.759728 18216 tablet_bootstrap.cc:492] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194: No bootstrap required, opened a new log
I20260709 13:06:20.760344 18216 ts_tablet_manager.cc:1403] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:06:20.760682 18215 tablet_bootstrap.cc:654] T 2430275956ef476e9dedff8b6b31ddef P 43f35dbf581d4cd39f32cc742b03b2e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.764091 18218 tablet_bootstrap.cc:492] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6: No bootstrap required, opened a new log
I20260709 13:06:20.764887 18218 ts_tablet_manager.cc:1403] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.007s
I20260709 13:06:20.769155 18218 raft_consensus.cc:359] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.763652 18216 raft_consensus.cc:359] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.770601 18216 raft_consensus.cc:385] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.770972 18216 raft_consensus.cc:740] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4af78329ca642e1961b052895824194, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.771855 18216 consensus_queue.cc:260] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.773166 18215 tablet_bootstrap.cc:492] T 2430275956ef476e9dedff8b6b31ddef P 43f35dbf581d4cd39f32cc742b03b2e8: No bootstrap required, opened a new log
I20260709 13:06:20.773816 18215 ts_tablet_manager.cc:1403] T 2430275956ef476e9dedff8b6b31ddef P 43f35dbf581d4cd39f32cc742b03b2e8: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.009s
I20260709 13:06:20.774421 18216 ts_tablet_manager.cc:1434] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.003s
I20260709 13:06:20.775645 18216 tablet_bootstrap.cc:492] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194: Bootstrap starting.
I20260709 13:06:20.775756 18218 raft_consensus.cc:385] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.776261 18218 raft_consensus.cc:740] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.777144 18215 raft_consensus.cc:359] T 2430275956ef476e9dedff8b6b31ddef P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.778971 18215 raft_consensus.cc:385] T 2430275956ef476e9dedff8b6b31ddef P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.779412 18215 raft_consensus.cc:740] T 2430275956ef476e9dedff8b6b31ddef P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.780315 18215 consensus_queue.cc:260] T 2430275956ef476e9dedff8b6b31ddef P 43f35dbf581d4cd39f32cc742b03b2e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.782655 18215 ts_tablet_manager.cc:1434] T 2430275956ef476e9dedff8b6b31ddef P 43f35dbf581d4cd39f32cc742b03b2e8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:20.777364 18218 consensus_queue.cc:260] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.784503 18218 ts_tablet_manager.cc:1434] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:06:20.785591 18215 tablet_bootstrap.cc:492] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8: Bootstrap starting.
I20260709 13:06:20.787921 18218 tablet_bootstrap.cc:492] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6: Bootstrap starting.
I20260709 13:06:20.792053 18215 tablet_bootstrap.cc:654] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.796140 18216 tablet_bootstrap.cc:654] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.799809 18218 tablet_bootstrap.cc:654] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.801335 18215 tablet_bootstrap.cc:492] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8: No bootstrap required, opened a new log
I20260709 13:06:20.801863 18215 ts_tablet_manager.cc:1403] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:06:20.804710 18215 raft_consensus.cc:359] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.805888 18215 raft_consensus.cc:385] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.806285 18215 raft_consensus.cc:740] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.807300 18215 consensus_queue.cc:260] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.810097 18215 ts_tablet_manager.cc:1434] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:06:20.811070 18215 tablet_bootstrap.cc:492] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8: Bootstrap starting.
I20260709 13:06:20.810724 18224 raft_consensus.cc:493] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.811728 18224 raft_consensus.cc:515] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.812727 18216 tablet_bootstrap.cc:492] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194: No bootstrap required, opened a new log
I20260709 13:06:20.813335 18216 ts_tablet_manager.cc:1403] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.004s
I20260709 13:06:20.814934 18224 leader_election.cc:290] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357)
I20260709 13:06:20.818822 18215 tablet_bootstrap.cc:654] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.819324 18224 raft_consensus.cc:493] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.819918 18224 raft_consensus.cc:515] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.821666 18218 tablet_bootstrap.cc:492] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6: No bootstrap required, opened a new log
I20260709 13:06:20.822487 18218 ts_tablet_manager.cc:1403] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.004s
I20260709 13:06:20.822659 18224 leader_election.cc:290] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357)
I20260709 13:06:20.825955 18218 raft_consensus.cc:359] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.826918 18218 raft_consensus.cc:385] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.827302 18218 raft_consensus.cc:740] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.828297 18218 consensus_queue.cc:260] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.831147 18218 ts_tablet_manager.cc:1434] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:06:20.832780 18218 tablet_bootstrap.cc:492] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6: Bootstrap starting.
I20260709 13:06:20.828647 18216 raft_consensus.cc:359] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.834970 18216 raft_consensus.cc:385] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.835397 18216 raft_consensus.cc:740] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4af78329ca642e1961b052895824194, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.840955 18218 tablet_bootstrap.cc:654] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.842911 18216 consensus_queue.cc:260] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.849709 18239 raft_consensus.cc:493] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.850358 18239 raft_consensus.cc:515] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.852481 18239 leader_election.cc:290] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:20.857614 18216 ts_tablet_manager.cc:1434] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.002s
I20260709 13:06:20.861987 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6f1422dbe6496db73bb5d12a4e60e9" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4af78329ca642e1961b052895824194" is_pre_election: true
I20260709 13:06:20.863008 18026 raft_consensus.cc:2468] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 0.
I20260709 13:06:20.864746 18068 leader_election.cc:304] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:20.865688 18239 raft_consensus.cc:2804] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:20.866129 18239 raft_consensus.cc:493] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.866472 18239 raft_consensus.cc:3060] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.868394 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6f1422dbe6496db73bb5d12a4e60e9" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6" is_pre_election: true
I20260709 13:06:20.869251 18175 raft_consensus.cc:2468] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 0.
I20260709 13:06:20.871876 18216 tablet_bootstrap.cc:492] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194: Bootstrap starting.
I20260709 13:06:20.879592 18245 raft_consensus.cc:493] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.880208 18245 raft_consensus.cc:515] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.881501 18239 raft_consensus.cc:515] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.882719 18245 leader_election.cc:290] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:20.883677 18239 leader_election.cc:290] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 election: Requested vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:20.883939 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd8d451d800544b68665799cc3e58a76" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4af78329ca642e1961b052895824194" is_pre_election: true
I20260709 13:06:20.883939 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd8d451d800544b68665799cc3e58a76" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6" is_pre_election: true
I20260709 13:06:20.886818 18215 tablet_bootstrap.cc:492] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8: No bootstrap required, opened a new log
I20260709 13:06:20.887437 18215 ts_tablet_manager.cc:1403] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8: Time spent bootstrapping tablet: real 0.077s	user 0.032s	sys 0.007s
I20260709 13:06:20.887171 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2430275956ef476e9dedff8b6b31ddef" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" is_pre_election: true
I20260709 13:06:20.888155 18218 tablet_bootstrap.cc:492] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6: No bootstrap required, opened a new log
I20260709 13:06:20.888145 18102 raft_consensus.cc:2468] T 2430275956ef476e9dedff8b6b31ddef P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 0.
I20260709 13:06:20.888718 18218 ts_tablet_manager.cc:1403] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6: Time spent bootstrapping tablet: real 0.056s	user 0.022s	sys 0.020s
W20260709 13:06:20.890002 18068 leader_election.cc:343] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.890906 18215 raft_consensus.cc:359] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.890702 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9641807c104f04b44fd7e50509b3a7" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" is_pre_election: true
I20260709 13:06:20.891728 18215 raft_consensus.cc:385] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.891454 18218 raft_consensus.cc:359] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.892103 18215 raft_consensus.cc:740] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.892252 18218 raft_consensus.cc:385] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.892751 18218 raft_consensus.cc:740] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.886816 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6f1422dbe6496db73bb5d12a4e60e9" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4af78329ca642e1961b052895824194"
I20260709 13:06:20.893337 18026 raft_consensus.cc:3060] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.893527 18218 consensus_queue.cc:260] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.895615 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2430275956ef476e9dedff8b6b31ddef" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4af78329ca642e1961b052895824194" is_pre_election: true
I20260709 13:06:20.896440 18027 raft_consensus.cc:2468] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 0.
I20260709 13:06:20.895637 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9641807c104f04b44fd7e50509b3a7" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4af78329ca642e1961b052895824194" is_pre_election: true
I20260709 13:06:20.897903 18025 raft_consensus.cc:2468] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 0.
I20260709 13:06:20.898051 18142 leader_election.cc:304] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49f27fe3f4404664b26a8f607f466ba6, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:20.899169 18224 raft_consensus.cc:2804] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:20.899578 18224 raft_consensus.cc:493] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.899328 18142 leader_election.cc:304] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49f27fe3f4404664b26a8f607f466ba6, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:20.899715 18241 consensus_queue.cc:1048] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:20.900029 18224 raft_consensus.cc:3060] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.902673 18269 raft_consensus.cc:2804] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:20.903117 18269 raft_consensus.cc:493] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.903470 18269 raft_consensus.cc:3060] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.904388 18216 tablet_bootstrap.cc:654] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.891970 18102 raft_consensus.cc:2468] T 2b9641807c104f04b44fd7e50509b3a7 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 0.
I20260709 13:06:20.905596 18218 ts_tablet_manager.cc:1434] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:06:20.906869 18218 tablet_bootstrap.cc:492] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6: Bootstrap starting.
I20260709 13:06:20.913218 18218 tablet_bootstrap.cc:654] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:20.913545 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6f1422dbe6496db73bb5d12a4e60e9" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
W20260709 13:06:20.913290 18068 leader_election.cc:343] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:20.913694 18269 raft_consensus.cc:515] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.914278 18174 raft_consensus.cc:3060] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.914525 18068 leader_election.cc:304] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8; no voters: 49f27fe3f4404664b26a8f607f466ba6, c4af78329ca642e1961b052895824194
I20260709 13:06:20.901816 18215 consensus_queue.cc:260] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.921976 18215 ts_tablet_manager.cc:1434] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.001s
I20260709 13:06:20.923709 18224 raft_consensus.cc:515] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.916944 18239 raft_consensus.cc:2749] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:20.912835 18026 raft_consensus.cc:2468] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 1.
I20260709 13:06:20.927076 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9641807c104f04b44fd7e50509b3a7" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4af78329ca642e1961b052895824194"
I20260709 13:06:20.931391 18025 raft_consensus.cc:3060] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.924289 18269 leader_election.cc:290] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 1 election: Requested vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357)
I20260709 13:06:20.942564 18068 leader_election.cc:304] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:20.944057 18239 raft_consensus.cc:2804] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:20.938937 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9641807c104f04b44fd7e50509b3a7" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
I20260709 13:06:20.945492 18102 raft_consensus.cc:3060] T 2b9641807c104f04b44fd7e50509b3a7 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.944573 18239 raft_consensus.cc:697] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 LEADER]: Becoming Leader. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Running, Role: LEADER
I20260709 13:06:20.946792 18239 consensus_queue.cc:237] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.950121 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2430275956ef476e9dedff8b6b31ddef" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4af78329ca642e1961b052895824194"
I20260709 13:06:20.950892 18026 raft_consensus.cc:3060] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.963807 18224 leader_election.cc:290] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 1 election: Requested vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357)
I20260709 13:06:20.965389 18025 raft_consensus.cc:2468] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 1.
I20260709 13:06:20.966989 18102 raft_consensus.cc:2468] T 2b9641807c104f04b44fd7e50509b3a7 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 1.
I20260709 13:06:20.967898 18142 leader_election.cc:304] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49f27fe3f4404664b26a8f607f466ba6, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:20.969571 18174 raft_consensus.cc:2468] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 1.
I20260709 13:06:20.970340 18224 raft_consensus.cc:2804] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:20.978515 18222 consensus_queue.cc:1048] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:20.979441 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2430275956ef476e9dedff8b6b31ddef" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
I20260709 13:06:20.980120 18102 raft_consensus.cc:3060] T 2430275956ef476e9dedff8b6b31ddef P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:20.986372 18216 tablet_bootstrap.cc:492] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194: No bootstrap required, opened a new log
I20260709 13:06:20.987035 18216 ts_tablet_manager.cc:1403] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194: Time spent bootstrapping tablet: real 0.115s	user 0.019s	sys 0.011s
I20260709 13:06:20.989914 18026 raft_consensus.cc:2468] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 1.
I20260709 13:06:20.991354 18142 leader_election.cc:304] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49f27fe3f4404664b26a8f607f466ba6, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:20.991307 17925 catalog_manager.cc:5697] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:20.992493 18269 raft_consensus.cc:2804] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:20.993093 18269 raft_consensus.cc:697] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 [term 1 LEADER]: Becoming Leader. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Running, Role: LEADER
I20260709 13:06:20.992743 18216 raft_consensus.cc:359] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.993920 18216 raft_consensus.cc:385] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:20.994331 18216 raft_consensus.cc:740] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4af78329ca642e1961b052895824194, State: Initialized, Role: FOLLOWER
I20260709 13:06:20.995046 18216 consensus_queue.cc:260] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:20.982231 18224 raft_consensus.cc:697] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 LEADER]: Becoming Leader. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Running, Role: LEADER
I20260709 13:06:20.993990 18269 consensus_queue.cc:237] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:21.005901 18102 raft_consensus.cc:2468] T 2430275956ef476e9dedff8b6b31ddef P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 1.
I20260709 13:06:21.012034 18218 tablet_bootstrap.cc:492] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6: No bootstrap required, opened a new log
I20260709 13:06:21.012570 18218 ts_tablet_manager.cc:1403] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6: Time spent bootstrapping tablet: real 0.106s	user 0.009s	sys 0.005s
I20260709 13:06:21.013319 18216 ts_tablet_manager.cc:1434] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 13:06:21.014467 18216 tablet_bootstrap.cc:492] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194: Bootstrap starting.
I20260709 13:06:21.011549 18224 consensus_queue.cc:237] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:21.018749 18218 raft_consensus.cc:359] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:21.019644 18218 raft_consensus.cc:385] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:21.020004 18218 raft_consensus.cc:740] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Initialized, Role: FOLLOWER
I20260709 13:06:21.021099 18218 consensus_queue.cc:260] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:21.023690 18216 tablet_bootstrap.cc:654] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:21.023346 18218 ts_tablet_manager.cc:1434] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:06:21.025267 18218 tablet_bootstrap.cc:492] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6: Bootstrap starting.
I20260709 13:06:21.030880 18218 tablet_bootstrap.cc:654] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:21.034255 17925 catalog_manager.cc:5697] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67). New cstate: current_term: 1 leader_uuid: "49f27fe3f4404664b26a8f607f466ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:21.041850 18240 consensus_queue.cc:1048] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:21.039113 17925 catalog_manager.cc:5697] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67). New cstate: current_term: 1 leader_uuid: "49f27fe3f4404664b26a8f607f466ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:21.043613 18216 tablet_bootstrap.cc:492] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194: No bootstrap required, opened a new log
I20260709 13:06:21.044440 18216 ts_tablet_manager.cc:1403] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.000s
I20260709 13:06:21.049998 18216 raft_consensus.cc:359] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:21.050400 18218 tablet_bootstrap.cc:492] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6: No bootstrap required, opened a new log
I20260709 13:06:21.050822 18216 raft_consensus.cc:385] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:21.051252 18216 raft_consensus.cc:740] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4af78329ca642e1961b052895824194, State: Initialized, Role: FOLLOWER
I20260709 13:06:21.051481 18218 ts_tablet_manager.cc:1403] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6: Time spent bootstrapping tablet: real 0.026s	user 0.021s	sys 0.003s
I20260709 13:06:21.052397 18216 consensus_queue.cc:260] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:21.055018 18216 ts_tablet_manager.cc:1434] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:06:21.055888 18218 raft_consensus.cc:359] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:21.057878 18218 raft_consensus.cc:385] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:21.058449 18218 raft_consensus.cc:740] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Initialized, Role: FOLLOWER
I20260709 13:06:21.059701 18218 consensus_queue.cc:260] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:21.062425 18218 ts_tablet_manager.cc:1434] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:06:21.068521 18222 consensus_queue.cc:1048] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:21.070192 18239 raft_consensus.cc:493] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.070916 18239 raft_consensus.cc:515] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:21.073338 18239 leader_election.cc:290] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:21.076284 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b924daab328e432691b232291b6d5f92" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6" is_pre_election: true
I20260709 13:06:21.077175 18175 raft_consensus.cc:2468] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 0.
I20260709 13:06:21.078559 18068 leader_election.cc:304] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, 49f27fe3f4404664b26a8f607f466ba6; no voters: 
I20260709 13:06:21.079413 18245 raft_consensus.cc:2804] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:21.079830 18245 raft_consensus.cc:493] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.080233 18245 raft_consensus.cc:3060] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.080356 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b924daab328e432691b232291b6d5f92" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4af78329ca642e1961b052895824194" is_pre_election: true
I20260709 13:06:21.081157 18026 raft_consensus.cc:2468] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 0.
I20260709 13:06:21.085210 18239 raft_consensus.cc:493] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.085852 18239 raft_consensus.cc:515] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:21.088227 18239 leader_election.cc:290] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:21.087973 18245 raft_consensus.cc:515] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:21.090471 18245 leader_election.cc:290] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 election: Requested vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:21.091885 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f6d2429ec54e0f9f38b92bb4048fe1" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4af78329ca642e1961b052895824194" is_pre_election: true
I20260709 13:06:21.092800 18026 raft_consensus.cc:2468] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 0.
I20260709 13:06:21.094285 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f6d2429ec54e0f9f38b92bb4048fe1" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6" is_pre_election: true
I20260709 13:06:21.095099 18175 raft_consensus.cc:2468] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 0.
I20260709 13:06:21.095428 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b924daab328e432691b232291b6d5f92" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4af78329ca642e1961b052895824194"
I20260709 13:06:21.095836 18068 leader_election.cc:304] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:21.096248 18026 raft_consensus.cc:3060] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.096787 18245 raft_consensus.cc:2804] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:21.097292 18245 raft_consensus.cc:493] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.097630 18245 raft_consensus.cc:3060] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.095379 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b924daab328e432691b232291b6d5f92" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
I20260709 13:06:21.102027 18174 raft_consensus.cc:3060] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.103875 18245 raft_consensus.cc:515] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:21.106403 18245 leader_election.cc:290] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 election: Requested vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:21.108137 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f6d2429ec54e0f9f38b92bb4048fe1" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4af78329ca642e1961b052895824194"
I20260709 13:06:21.108906 18025 raft_consensus.cc:3060] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.108991 18174 raft_consensus.cc:2468] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 1.
I20260709 13:06:21.109869 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f6d2429ec54e0f9f38b92bb4048fe1" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
I20260709 13:06:21.110577 18175 raft_consensus.cc:3060] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.111804 18026 raft_consensus.cc:2468] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 1.
I20260709 13:06:21.110539 18068 leader_election.cc:304] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, 49f27fe3f4404664b26a8f607f466ba6; no voters: 
I20260709 13:06:21.114672 18245 raft_consensus.cc:2804] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:21.116145 18245 raft_consensus.cc:697] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 LEADER]: Becoming Leader. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Running, Role: LEADER
I20260709 13:06:21.117295 18243 consensus_queue.cc:1048] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:21.118100 18175 raft_consensus.cc:2468] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 1.
I20260709 13:06:21.118603 18025 raft_consensus.cc:2468] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 1.
I20260709 13:06:21.119412 18245 consensus_queue.cc:237] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:21.120204 18068 leader_election.cc:304] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, 49f27fe3f4404664b26a8f607f466ba6; no voters: 
I20260709 13:06:21.121143 18239 raft_consensus.cc:2804] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:21.121802 18239 raft_consensus.cc:697] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 LEADER]: Becoming Leader. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Running, Role: LEADER
I20260709 13:06:21.123338 18239 consensus_queue.cc:237] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:21.130892 18222 consensus_queue.cc:1048] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:21.134740 18240 consensus_queue.cc:1048] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:21.163978 18222 consensus_queue.cc:1048] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:21.182782 17925 catalog_manager.cc:5697] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:21.198954 17922 catalog_manager.cc:5697] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66). New cstate: current_term: 1 leader_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:21.261305 18224 raft_consensus.cc:493] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.261986 18224 raft_consensus.cc:515] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:21.263866 18224 leader_election.cc:290] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357)
I20260709 13:06:21.264981 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd8d451d800544b68665799cc3e58a76" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4af78329ca642e1961b052895824194" is_pre_election: true
I20260709 13:06:21.265141 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd8d451d800544b68665799cc3e58a76" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" is_pre_election: true
I20260709 13:06:21.265733 18025 raft_consensus.cc:2468] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 0.
I20260709 13:06:21.265892 18102 raft_consensus.cc:2468] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 0.
I20260709 13:06:21.266865 18142 leader_election.cc:304] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49f27fe3f4404664b26a8f607f466ba6, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:21.267627 18224 raft_consensus.cc:2804] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:21.267998 18224 raft_consensus.cc:493] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.268303 18224 raft_consensus.cc:3060] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.275468 18224 raft_consensus.cc:515] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:21.277171 18224 leader_election.cc:290] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 1 election: Requested vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357)
I20260709 13:06:21.278249 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd8d451d800544b68665799cc3e58a76" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
I20260709 13:06:21.278275 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd8d451d800544b68665799cc3e58a76" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4af78329ca642e1961b052895824194"
I20260709 13:06:21.278832 18102 raft_consensus.cc:3060] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.279119 18025 raft_consensus.cc:3060] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:21.284263 18102 raft_consensus.cc:2468] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 1.
I20260709 13:06:21.284832 18025 raft_consensus.cc:2468] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 1.
I20260709 13:06:21.285746 18139 leader_election.cc:304] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, 49f27fe3f4404664b26a8f607f466ba6; no voters: 
I20260709 13:06:21.286741 18224 raft_consensus.cc:2804] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:21.287194 18224 raft_consensus.cc:697] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 LEADER]: Becoming Leader. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Running, Role: LEADER
I20260709 13:06:21.287964 18224 consensus_queue.cc:237] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:21.295522 17922 catalog_manager.cc:5697] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67). New cstate: current_term: 1 leader_uuid: "49f27fe3f4404664b26a8f607f466ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:21.384785  8209 ts_manager.cc:295] Set tserver state for c4af78329ca642e1961b052895824194 to MAINTENANCE_MODE
I20260709 13:06:21.385638  8209 tablet_server.cc:179] TabletServer@127.8.4.65:0 shutting down...
I20260709 13:06:21.412309  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:21.413278  8209 tablet_replica.cc:333] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194: stopping tablet replica
I20260709 13:06:21.414182  8209 raft_consensus.cc:2243] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:21.414791  8209 raft_consensus.cc:2272] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:21.417246  8209 tablet_replica.cc:333] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194: stopping tablet replica
I20260709 13:06:21.417855  8209 raft_consensus.cc:2243] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:21.418275  8209 raft_consensus.cc:2272] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:21.420121  8209 tablet_replica.cc:333] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194: stopping tablet replica
I20260709 13:06:21.420680  8209 raft_consensus.cc:2243] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:21.421275  8209 raft_consensus.cc:2272] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:21.423485  8209 tablet_replica.cc:333] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194: stopping tablet replica
I20260709 13:06:21.424041  8209 raft_consensus.cc:2243] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:21.424898  8209 raft_consensus.cc:2272] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:21.427263  8209 tablet_replica.cc:333] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194: stopping tablet replica
I20260709 13:06:21.427805  8209 raft_consensus.cc:2243] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:21.428226  8209 raft_consensus.cc:2272] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:21.430271  8209 tablet_replica.cc:333] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194: stopping tablet replica
W20260709 13:06:21.430595 17973 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:06:21.430822  8209 raft_consensus.cc:2243] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:21.431758  8209 raft_consensus.cc:2272] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:21.434158  8209 tablet_replica.cc:333] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194: stopping tablet replica
I20260709 13:06:21.434727  8209 raft_consensus.cc:2243] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:21.435561  8209 raft_consensus.cc:2272] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:21.437878  8209 tablet_replica.cc:333] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194: stopping tablet replica
I20260709 13:06:21.438434  8209 raft_consensus.cc:2243] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:21.438827  8209 raft_consensus.cc:2272] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:21.440864  8209 tablet_replica.cc:333] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194: stopping tablet replica
I20260709 13:06:21.441413  8209 raft_consensus.cc:2243] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:21.441797  8209 raft_consensus.cc:2272] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:21.443550  8209 tablet_replica.cc:333] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194: stopping tablet replica
I20260709 13:06:21.444072  8209 raft_consensus.cc:2243] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:21.444914  8209 raft_consensus.cc:2272] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:21.471710 18068 consensus_peers.cc:597] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:21.475275  8209 tablet_server.cc:196] TabletServer@127.8.4.65:0 shutdown complete.
I20260709 13:06:21.519356 18224 consensus_queue.cc:1048] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:06:21.538908 18142 consensus_peers.cc:597] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:21.543908 18245 consensus_queue.cc:1048] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:21.561626 18297 consensus_queue.cc:1048] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:21.570783 18068 consensus_peers.cc:597] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:21.583614 18142 consensus_peers.cc:597] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:21.585354 18245 consensus_queue.cc:1048] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:21.605911 18068 consensus_peers.cc:597] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:21.699961 18245 consensus_queue.cc:1048] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:21.868172 18297 consensus_queue.cc:1048] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:21.873054 18142 consensus_peers.cc:597] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:22.431732 17973 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:06:22.473888 18068 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111) [suppressed 138 similar messages]
I20260709 13:06:22.495738 18297 raft_consensus.cc:493] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c4af78329ca642e1961b052895824194)
I20260709 13:06:22.496342 18297 raft_consensus.cc:515] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } }
I20260709 13:06:22.498279 18297 leader_election.cc:290] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357), c4af78329ca642e1961b052895824194 (127.8.4.65:45469)
I20260709 13:06:22.499523 18239 raft_consensus.cc:493] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c4af78329ca642e1961b052895824194)
I20260709 13:06:22.499419 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c5f89a38464e3a8f50e6de3fd70c02" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" is_pre_election: true
I20260709 13:06:22.500257 18239 raft_consensus.cc:515] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } }
I20260709 13:06:22.501151 18102 raft_consensus.cc:2468] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 1.
I20260709 13:06:22.502342 18239 leader_election.cc:290] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527), c4af78329ca642e1961b052895824194 (127.8.4.65:45469)
W20260709 13:06:22.502619 18142 leader_election.cc:336] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111)
I20260709 13:06:22.503084 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c5f89a38464e3a8f50e6de3fd70c02" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6" is_pre_election: true
I20260709 13:06:22.503695 18175 raft_consensus.cc:2468] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 1.
I20260709 13:06:22.503830 18139 leader_election.cc:304] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, 49f27fe3f4404664b26a8f607f466ba6; no voters: c4af78329ca642e1961b052895824194
I20260709 13:06:22.504714 18297 raft_consensus.cc:2804] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:22.505218 18297 raft_consensus.cc:493] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c4af78329ca642e1961b052895824194)
I20260709 13:06:22.505488 18068 leader_election.cc:304] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, 49f27fe3f4404664b26a8f607f466ba6; no voters: 
I20260709 13:06:22.505766 18297 raft_consensus.cc:3060] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.506415 18239 raft_consensus.cc:2804] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:22.506819 18239 raft_consensus.cc:493] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c4af78329ca642e1961b052895824194)
I20260709 13:06:22.507344 18239 raft_consensus.cc:3060] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:22.508224 18068 leader_election.cc:336] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111)
I20260709 13:06:22.512432 18297 raft_consensus.cc:515] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } }
I20260709 13:06:22.513482 18239 raft_consensus.cc:515] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } }
I20260709 13:06:22.514426 18297 leader_election.cc:290] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 election: Requested vote from peers 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357), c4af78329ca642e1961b052895824194 (127.8.4.65:45469)
I20260709 13:06:22.515535 18239 leader_election.cc:290] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 2 election: Requested vote from peers 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527), c4af78329ca642e1961b052895824194 (127.8.4.65:45469)
I20260709 13:06:22.515468 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c5f89a38464e3a8f50e6de3fd70c02" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
I20260709 13:06:22.516611 18102 raft_consensus.cc:2393] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 49f27fe3f4404664b26a8f607f466ba6 in current term 2: Already voted for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in this term.
I20260709 13:06:22.517318 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c5f89a38464e3a8f50e6de3fd70c02" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
I20260709 13:06:22.518306 18175 raft_consensus.cc:2393] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 43f35dbf581d4cd39f32cc742b03b2e8 in current term 2: Already voted for candidate 49f27fe3f4404664b26a8f607f466ba6 in this term.
W20260709 13:06:22.519182 18142 leader_election.cc:336] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111)
I20260709 13:06:22.519671 18142 leader_election.cc:304] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 49f27fe3f4404664b26a8f607f466ba6; no voters: 43f35dbf581d4cd39f32cc742b03b2e8, c4af78329ca642e1961b052895824194
I20260709 13:06:22.520352 18297 raft_consensus.cc:2749] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:22.521101 18068 leader_election.cc:336] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111)
I20260709 13:06:22.521587 18068 leader_election.cc:304] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8; no voters: 49f27fe3f4404664b26a8f607f466ba6, c4af78329ca642e1961b052895824194
I20260709 13:06:22.522277 18239 raft_consensus.cc:2749] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:22.567842 18297 raft_consensus.cc:493] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c4af78329ca642e1961b052895824194)
I20260709 13:06:22.568522 18297 raft_consensus.cc:515] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:22.570489 18297 leader_election.cc:290] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357)
I20260709 13:06:22.571794 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ee1113d207411694eacec667ae8bc1" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" is_pre_election: true
I20260709 13:06:22.574432 18239 raft_consensus.cc:493] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c4af78329ca642e1961b052895824194)
W20260709 13:06:22.574503 18142 leader_election.cc:336] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111)
I20260709 13:06:22.574923 18239 raft_consensus.cc:515] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:22.575109 18142 leader_election.cc:304] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 49f27fe3f4404664b26a8f607f466ba6; no voters: 43f35dbf581d4cd39f32cc742b03b2e8, c4af78329ca642e1961b052895824194
I20260709 13:06:22.575971 18297 raft_consensus.cc:2749] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:22.576882 18239 leader_election.cc:290] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:22.578626 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ee1113d207411694eacec667ae8bc1" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6" is_pre_election: true
I20260709 13:06:22.579762 18175 raft_consensus.cc:2468] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 1.
I20260709 13:06:22.580899 18068 leader_election.cc:304] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, 49f27fe3f4404664b26a8f607f466ba6; no voters: 
I20260709 13:06:22.581668 18239 raft_consensus.cc:2804] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:22.581862 18068 leader_election.cc:336] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111)
I20260709 13:06:22.582058 18239 raft_consensus.cc:493] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c4af78329ca642e1961b052895824194)
I20260709 13:06:22.582537 18239 raft_consensus.cc:3060] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.587831 18239 raft_consensus.cc:515] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:22.589756 18239 leader_election.cc:290] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 2 election: Requested vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:22.591502 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ee1113d207411694eacec667ae8bc1" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
I20260709 13:06:22.592090 18175 raft_consensus.cc:3060] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:22.593694 18068 leader_election.cc:336] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111)
I20260709 13:06:22.598843 18175 raft_consensus.cc:2468] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 2.
I20260709 13:06:22.600253 18068 leader_election.cc:304] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, 49f27fe3f4404664b26a8f607f466ba6; no voters: c4af78329ca642e1961b052895824194
I20260709 13:06:22.601040 18239 raft_consensus.cc:2804] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:22.601554 18239 raft_consensus.cc:697] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 LEADER]: Becoming Leader. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Running, Role: LEADER
I20260709 13:06:22.602530 18239 consensus_queue.cc:237] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:22.610204 17925 catalog_manager.cc:5697] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 reported cstate change: term changed from 1 to 2, leader changed from c4af78329ca642e1961b052895824194 (127.8.4.65) to 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66). New cstate: current_term: 2 leader_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:22.640698 18297 raft_consensus.cc:493] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c4af78329ca642e1961b052895824194)
I20260709 13:06:22.641397 18297 raft_consensus.cc:515] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:22.643483 18297 leader_election.cc:290] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357)
I20260709 13:06:22.644742 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b05b18753e4424b93fafb956a63eeb" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" is_pre_election: true
I20260709 13:06:22.646566 18239 raft_consensus.cc:493] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c4af78329ca642e1961b052895824194)
I20260709 13:06:22.647063 18239 raft_consensus.cc:515] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
W20260709 13:06:22.647583 18142 leader_election.cc:336] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111)
I20260709 13:06:22.648036 18142 leader_election.cc:304] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 49f27fe3f4404664b26a8f607f466ba6; no voters: 43f35dbf581d4cd39f32cc742b03b2e8, c4af78329ca642e1961b052895824194
I20260709 13:06:22.648682 18297 raft_consensus.cc:2749] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:22.649138 18239 leader_election.cc:290] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:22.650717 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b05b18753e4424b93fafb956a63eeb" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6" is_pre_election: true
I20260709 13:06:22.651460 18175 raft_consensus.cc:2468] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 1.
I20260709 13:06:22.652452 18068 leader_election.cc:304] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, 49f27fe3f4404664b26a8f607f466ba6; no voters: 
I20260709 13:06:22.653165 18239 raft_consensus.cc:2804] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:22.653205 18068 leader_election.cc:336] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111)
I20260709 13:06:22.653515 18239 raft_consensus.cc:493] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c4af78329ca642e1961b052895824194)
I20260709 13:06:22.653898 18239 raft_consensus.cc:3060] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.659554 18239 raft_consensus.cc:515] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:22.661649 18239 leader_election.cc:290] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 2 election: Requested vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:22.663041 18239 raft_consensus.cc:493] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c4af78329ca642e1961b052895824194)
I20260709 13:06:22.663594 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b05b18753e4424b93fafb956a63eeb" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
I20260709 13:06:22.663559 18239 raft_consensus.cc:515] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:22.664378 18175 raft_consensus.cc:3060] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.665863 18239 leader_election.cc:290] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:22.667017 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f32a9788e4706b31db79d783e4e33" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "49f27fe3f4404664b26a8f607f466ba6" is_pre_election: true
W20260709 13:06:22.667318 18068 leader_election.cc:336] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111)
W20260709 13:06:22.670128 18068 leader_election.cc:336] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111)
I20260709 13:06:22.670598 18068 leader_election.cc:304] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8; no voters: 49f27fe3f4404664b26a8f607f466ba6, c4af78329ca642e1961b052895824194
I20260709 13:06:22.671438 18239 raft_consensus.cc:2749] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:22.672919 18175 raft_consensus.cc:2468] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 2.
I20260709 13:06:22.674513 18297 raft_consensus.cc:493] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c4af78329ca642e1961b052895824194)
I20260709 13:06:22.674759 18068 leader_election.cc:304] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, 49f27fe3f4404664b26a8f607f466ba6; no voters: c4af78329ca642e1961b052895824194
I20260709 13:06:22.675117 18297 raft_consensus.cc:515] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:22.675763 18239 raft_consensus.cc:2804] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:22.676281 18239 raft_consensus.cc:697] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 LEADER]: Becoming Leader. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Running, Role: LEADER
I20260709 13:06:22.677116 18239 consensus_queue.cc:237] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:22.677572 18297 leader_election.cc:290] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357)
I20260709 13:06:22.678877 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f32a9788e4706b31db79d783e4e33" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" is_pre_election: true
I20260709 13:06:22.679556 18102 raft_consensus.cc:2468] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 1.
I20260709 13:06:22.680799 18139 leader_election.cc:304] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, 49f27fe3f4404664b26a8f607f466ba6; no voters: 
I20260709 13:06:22.681764 18297 raft_consensus.cc:2804] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:22.682170 18297 raft_consensus.cc:493] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c4af78329ca642e1961b052895824194)
I20260709 13:06:22.682536 18297 raft_consensus.cc:3060] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:22.682861 18142 leader_election.cc:336] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111)
I20260709 13:06:22.685925 17925 catalog_manager.cc:5697] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 reported cstate change: term changed from 1 to 2, leader changed from c4af78329ca642e1961b052895824194 (127.8.4.65) to 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66). New cstate: current_term: 2 leader_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:22.688017 18297 raft_consensus.cc:515] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:22.690343 18297 leader_election.cc:290] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 election: Requested vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357)
I20260709 13:06:22.691140 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f32a9788e4706b31db79d783e4e33" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
I20260709 13:06:22.691759 18102 raft_consensus.cc:3060] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:22.694196 18142 leader_election.cc:336] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111)
I20260709 13:06:22.698581 18102 raft_consensus.cc:2468] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 2.
I20260709 13:06:22.699813 18139 leader_election.cc:304] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, 49f27fe3f4404664b26a8f607f466ba6; no voters: c4af78329ca642e1961b052895824194
I20260709 13:06:22.700534 18297 raft_consensus.cc:2804] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:22.702092 18297 raft_consensus.cc:697] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 LEADER]: Becoming Leader. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Running, Role: LEADER
I20260709 13:06:22.703042 18297 consensus_queue.cc:237] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:22.712499 17925 catalog_manager.cc:5697] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 reported cstate change: term changed from 1 to 2, leader changed from c4af78329ca642e1961b052895824194 (127.8.4.65) to 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67). New cstate: current_term: 2 leader_uuid: "49f27fe3f4404664b26a8f607f466ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.101830 18102 raft_consensus.cc:1275] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Refusing update from remote peer 49f27fe3f4404664b26a8f607f466ba6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:23.103116 18297 consensus_queue.cc:1048] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:23.117424 18142 consensus_peers.cc:597] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:23.159281 18068 consensus_peers.cc:597] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:23.169968 18175 raft_consensus.cc:1275] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Refusing update from remote peer 43f35dbf581d4cd39f32cc742b03b2e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:23.171521 18239 consensus_queue.cc:1048] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:23.224319 18175 raft_consensus.cc:1275] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Refusing update from remote peer 43f35dbf581d4cd39f32cc742b03b2e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:23.225907 18320 consensus_queue.cc:1048] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:23.238020 18068 consensus_peers.cc:597] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:23.432847 17973 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:06:23.838997 18068 consensus_peers.cc:597] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:23.905735 18142 consensus_peers.cc:597] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:23.942581 18068 consensus_peers.cc:597] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:23.959887 18068 consensus_peers.cc:597] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:24.021903 18316 raft_consensus.cc:493] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.022578 18316 raft_consensus.cc:515] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } }
I20260709 13:06:24.024668 18316 leader_election.cc:290] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357), c4af78329ca642e1961b052895824194 (127.8.4.65:45469)
I20260709 13:06:24.025695 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c5f89a38464e3a8f50e6de3fd70c02" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" is_pre_election: true
I20260709 13:06:24.026530 18102 raft_consensus.cc:2468] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 2.
I20260709 13:06:24.028088 18139 leader_election.cc:304] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, 49f27fe3f4404664b26a8f607f466ba6; no voters: 
I20260709 13:06:24.029075 18316 raft_consensus.cc:2804] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:24.029439 18316 raft_consensus.cc:493] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:24.029529 18142 leader_election.cc:336] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111)
I20260709 13:06:24.029752 18316 raft_consensus.cc:3060] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.035282 18316 raft_consensus.cc:515] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } }
I20260709 13:06:24.036993 18316 leader_election.cc:290] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 3 election: Requested vote from peers 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357), c4af78329ca642e1961b052895824194 (127.8.4.65:45469)
I20260709 13:06:24.038096 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c5f89a38464e3a8f50e6de3fd70c02" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
I20260709 13:06:24.038722 18102 raft_consensus.cc:3060] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:24.041544 18142 leader_election.cc:336] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111)
I20260709 13:06:24.045064 18102 raft_consensus.cc:2468] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 3.
I20260709 13:06:24.046607 18139 leader_election.cc:304] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, 49f27fe3f4404664b26a8f607f466ba6; no voters: c4af78329ca642e1961b052895824194
I20260709 13:06:24.047735 18316 raft_consensus.cc:2804] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:24.048645 18316 raft_consensus.cc:697] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 LEADER]: Becoming Leader. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Running, Role: LEADER
I20260709 13:06:24.049531 18316 consensus_queue.cc:237] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } }
W20260709 13:06:24.055521 18142 consensus_peers.cc:597] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:24.059695 17925 catalog_manager.cc:5697] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 reported cstate change: term changed from 1 to 3, leader changed from c4af78329ca642e1961b052895824194 (127.8.4.65) to 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67). New cstate: current_term: 3 leader_uuid: "49f27fe3f4404664b26a8f607f466ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:24.434051 17973 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:06:24.439908 18102 raft_consensus.cc:1275] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 FOLLOWER]: Refusing update from remote peer 49f27fe3f4404664b26a8f607f466ba6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:24.441489 18316 consensus_queue.cc:1048] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:24.456643 18142 consensus_peers.cc:597] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:24.473366 18142 consensus_peers.cc:597] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:25.435287 17973 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:06:25.561930 18068 consensus_peers.cc:597] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:25.660828 18142 consensus_peers.cc:597] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:26.054124 18068 consensus_peers.cc:597] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:26.208122 18068 consensus_peers.cc:597] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:26.276376 18142 consensus_peers.cc:597] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:26.380798 18068 consensus_peers.cc:597] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:26.436913 17973 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:06:26.494869 18142 consensus_peers.cc:597] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:26.495846  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:26.505663 18335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:26.505754 18334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:26.508267 18337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:26.510232  8209 server_base.cc:1061] running on GCE node
I20260709 13:06:26.512599  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:26.512867  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:26.513139  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602386513119 us; error 0 us; skew 500 ppm
I20260709 13:06:26.514307  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:26.518941  8209 webserver.cc:533] Webserver started at http://127.8.4.65:44999/ using document root <none> and password file <none>
I20260709 13:06:26.519647  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:26.519887  8209 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:06:26.524212  8209 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:06:26.528861 18342 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:26.530030  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:06:26.530388  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/ts-0-root
uuid: "c4af78329ca642e1961b052895824194"
format_stamp: "Formatted at 2026-07-09 13:06:19 on dist-test-slave-008w"
I20260709 13:06:26.530848  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602095438975-8209-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:26.554055  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:26.555719  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:26.557618  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:26.562868 18349 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:06:26.565855 18068 consensus_peers.cc:597] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:26.629604  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:06:26.630230  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.069s	user 0.003s	sys 0.000s
I20260709 13:06:26.630870  8209 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:06:26.637712 18349 tablet_bootstrap.cc:492] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194: Bootstrap starting.
I20260709 13:06:26.652920 18349 tablet_bootstrap.cc:492] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:26.653851 18349 tablet_bootstrap.cc:492] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194: Bootstrap complete.
I20260709 13:06:26.654444 18349 ts_tablet_manager.cc:1403] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.005s
I20260709 13:06:26.656898 18349 raft_consensus.cc:359] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:26.657841 18349 raft_consensus.cc:740] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4af78329ca642e1961b052895824194, State: Initialized, Role: FOLLOWER
I20260709 13:06:26.659008 18349 consensus_queue.cc:260] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:26.662279 18349 ts_tablet_manager.cc:1434] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:06:26.663339 18349 tablet_bootstrap.cc:492] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194: Bootstrap starting.
I20260709 13:06:26.677450  8209 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:06:26.677838  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.047s	user 0.044s	sys 0.004s
I20260709 13:06:26.680352 18349 tablet_bootstrap.cc:492] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:26.681644 18349 tablet_bootstrap.cc:492] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194: Bootstrap complete.
I20260709 13:06:26.682343 18349 ts_tablet_manager.cc:1403] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.005s
I20260709 13:06:26.685176 18349 raft_consensus.cc:359] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:26.686138 18349 raft_consensus.cc:740] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4af78329ca642e1961b052895824194, State: Initialized, Role: FOLLOWER
I20260709 13:06:26.687224 18349 consensus_queue.cc:260] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:26.690140 18349 ts_tablet_manager.cc:1434] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:06:26.691318 18349 tablet_bootstrap.cc:492] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194: Bootstrap starting.
I20260709 13:06:26.706164 18349 tablet_bootstrap.cc:492] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:26.707026 18349 tablet_bootstrap.cc:492] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194: Bootstrap complete.
I20260709 13:06:26.707881 18349 ts_tablet_manager.cc:1403] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:06:26.711037 18349 raft_consensus.cc:359] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:26.711737 18349 raft_consensus.cc:740] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4af78329ca642e1961b052895824194, State: Initialized, Role: FOLLOWER
I20260709 13:06:26.712549 18349 consensus_queue.cc:260] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:26.714833 18349 ts_tablet_manager.cc:1434] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:06:26.715698 18349 tablet_bootstrap.cc:492] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194: Bootstrap starting.
I20260709 13:06:26.731632 18349 tablet_bootstrap.cc:492] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:26.732452 18349 tablet_bootstrap.cc:492] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194: Bootstrap complete.
I20260709 13:06:26.733376 18349 ts_tablet_manager.cc:1403] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.008s
I20260709 13:06:26.735982 18349 raft_consensus.cc:359] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:26.736796 18349 raft_consensus.cc:740] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4af78329ca642e1961b052895824194, State: Initialized, Role: FOLLOWER
I20260709 13:06:26.737485 18349 consensus_queue.cc:260] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:26.739761 18349 ts_tablet_manager.cc:1434] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:06:26.740912 18349 tablet_bootstrap.cc:492] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194: Bootstrap starting.
I20260709 13:06:26.753777  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.65:45469
I20260709 13:06:26.753921 18411 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.65:45469 every 8 connection(s)
I20260709 13:06:26.756307 18349 tablet_bootstrap.cc:492] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:26.757414 18349 tablet_bootstrap.cc:492] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194: Bootstrap complete.
I20260709 13:06:26.758087 18349 ts_tablet_manager.cc:1403] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.007s
I20260709 13:06:26.759691  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:26.763423 18349 raft_consensus.cc:359] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } }
I20260709 13:06:26.764648 18349 raft_consensus.cc:740] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4af78329ca642e1961b052895824194, State: Initialized, Role: FOLLOWER
I20260709 13:06:26.767729 18349 consensus_queue.cc:260] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } }
I20260709 13:06:26.770974 18349 ts_tablet_manager.cc:1434] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:06:26.772071 18349 tablet_bootstrap.cc:492] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194: Bootstrap starting.
I20260709 13:06:26.793706 18349 tablet_bootstrap.cc:492] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:26.794638 18349 tablet_bootstrap.cc:492] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194: Bootstrap complete.
I20260709 13:06:26.795567 18349 ts_tablet_manager.cc:1403] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260709 13:06:26.798604 18349 raft_consensus.cc:359] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:26.799419 18349 raft_consensus.cc:740] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4af78329ca642e1961b052895824194, State: Initialized, Role: FOLLOWER
I20260709 13:06:26.800710 18412 heartbeater.cc:344] Connected to a master server at 127.8.4.126:43659
I20260709 13:06:26.800236 18349 consensus_queue.cc:260] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:26.801268 18412 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:26.802435 18412 heartbeater.cc:507] Master 127.8.4.126:43659 requested a full tablet report, sending...
I20260709 13:06:26.803390 18349 ts_tablet_manager.cc:1434] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:26.803504 18175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "537f32a9788e4706b31db79d783e4e33"
dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
mode: GRACEFUL
new_leader_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
 from {username='slave'} at 127.0.0.1:57256
I20260709 13:06:26.804402 18175 raft_consensus.cc:606] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 LEADER]: Received request to transfer leadership to TS 43f35dbf581d4cd39f32cc742b03b2e8
I20260709 13:06:26.804677 18349 tablet_bootstrap.cc:492] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194: Bootstrap starting.
I20260709 13:06:26.813731 17922 ts_manager.cc:194] Re-registered known tserver with Master: c4af78329ca642e1961b052895824194 (127.8.4.65:45469)
I20260709 13:06:26.819499 18349 tablet_bootstrap.cc:492] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:26.820372 18349 tablet_bootstrap.cc:492] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194: Bootstrap complete.
I20260709 13:06:26.821146 18349 ts_tablet_manager.cc:1403] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:06:26.823342 18102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4ee1113d207411694eacec667ae8bc1"
dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
mode: GRACEFUL
new_leader_uuid: "49f27fe3f4404664b26a8f607f466ba6"
 from {username='slave'} at 127.0.0.1:44356
I20260709 13:06:26.823904 18349 raft_consensus.cc:359] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:26.824143 18102 raft_consensus.cc:606] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 LEADER]: Received request to transfer leadership to TS 49f27fe3f4404664b26a8f607f466ba6
I20260709 13:06:26.824474 18349 raft_consensus.cc:740] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4af78329ca642e1961b052895824194, State: Initialized, Role: FOLLOWER
I20260709 13:06:26.825243 18349 consensus_queue.cc:260] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:26.826498  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:26.827090 18349 ts_tablet_manager.cc:1434] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:06:26.827690  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:26.827988 18349 tablet_bootstrap.cc:492] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194: Bootstrap starting.
I20260709 13:06:26.828732  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:26.829280 17922 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59678
I20260709 13:06:26.834403 18412 heartbeater.cc:499] Master 127.8.4.126:43659 was elected leader, sending a full tablet report...
I20260709 13:06:26.843065 18349 tablet_bootstrap.cc:492] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:26.844367 18349 tablet_bootstrap.cc:492] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194: Bootstrap complete.
I20260709 13:06:26.845211 18349 ts_tablet_manager.cc:1403] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:06:26.847826 18349 raft_consensus.cc:359] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:26.848515 18349 raft_consensus.cc:740] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4af78329ca642e1961b052895824194, State: Initialized, Role: FOLLOWER
I20260709 13:06:26.849232 18349 consensus_queue.cc:260] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:26.851444 18349 ts_tablet_manager.cc:1434] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:26.852355 18349 tablet_bootstrap.cc:492] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194: Bootstrap starting.
I20260709 13:06:26.865048 18349 tablet_bootstrap.cc:492] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:26.865984 18349 tablet_bootstrap.cc:492] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194: Bootstrap complete.
I20260709 13:06:26.866684 18349 ts_tablet_manager.cc:1403] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:06:26.868820 18349 raft_consensus.cc:359] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:26.869510 18349 raft_consensus.cc:740] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4af78329ca642e1961b052895824194, State: Initialized, Role: FOLLOWER
I20260709 13:06:26.870250 18349 consensus_queue.cc:260] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:26.872330 18349 ts_tablet_manager.cc:1434] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:26.873111 18349 tablet_bootstrap.cc:492] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194: Bootstrap starting.
I20260709 13:06:26.886951 18349 tablet_bootstrap.cc:492] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:26.887702 18349 tablet_bootstrap.cc:492] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194: Bootstrap complete.
I20260709 13:06:26.888298 18349 ts_tablet_manager.cc:1403] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 13:06:26.890343 18349 raft_consensus.cc:359] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:26.890905 18349 raft_consensus.cc:740] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4af78329ca642e1961b052895824194, State: Initialized, Role: FOLLOWER
I20260709 13:06:26.891574 18349 consensus_queue.cc:260] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:26.893644 18349 ts_tablet_manager.cc:1434] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:06:26.977413 18385 raft_consensus.cc:3060] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.080978 18385 raft_consensus.cc:3060] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.083755 18384 raft_consensus.cc:3060] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.135049 18384 raft_consensus.cc:3060] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.205922 18332 raft_consensus.cc:993] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6: : Instructing follower 43f35dbf581d4cd39f32cc742b03b2e8 to start an election
I20260709 13:06:27.206518 18427 raft_consensus.cc:1081] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 LEADER]: Signalling peer 43f35dbf581d4cd39f32cc742b03b2e8 to start an election
I20260709 13:06:27.208112 18102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "537f32a9788e4706b31db79d783e4e33"
dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
 from {username='slave'} at 127.0.0.1:48178
I20260709 13:06:27.208600 18102 raft_consensus.cc:493] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:27.208945 18102 raft_consensus.cc:3060] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.214855 18102 raft_consensus.cc:515] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:27.216974 18102 leader_election.cc:290] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 3 election: Requested vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:27.218214 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f32a9788e4706b31db79d783e4e33" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c4af78329ca642e1961b052895824194"
I20260709 13:06:27.218331 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f32a9788e4706b31db79d783e4e33" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
I20260709 13:06:27.219127 18384 raft_consensus.cc:3060] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.219343 18175 raft_consensus.cc:3055] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:27.219720 18175 raft_consensus.cc:740] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Running, Role: LEADER
I20260709 13:06:27.220507 18175 consensus_queue.cc:260] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:27.221712 18175 raft_consensus.cc:3060] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.225963 18384 raft_consensus.cc:2468] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 3.
I20260709 13:06:27.227665 18068 leader_election.cc:304] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:27.228515 18239 raft_consensus.cc:2804] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:27.228777 18175 raft_consensus.cc:2468] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 3.
I20260709 13:06:27.229557 18239 raft_consensus.cc:697] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 LEADER]: Becoming Leader. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Running, Role: LEADER
I20260709 13:06:27.230623 18239 consensus_queue.cc:237] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:27.237617 17922 catalog_manager.cc:5697] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 reported cstate change: term changed from 2 to 3, leader changed from 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67) to 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66). New cstate: current_term: 3 leader_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:27.295373 18435 raft_consensus.cc:993] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8: : Instructing follower 49f27fe3f4404664b26a8f607f466ba6 to start an election
I20260709 13:06:27.295908 18239 raft_consensus.cc:1081] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 LEADER]: Signalling peer 49f27fe3f4404664b26a8f607f466ba6 to start an election
I20260709 13:06:27.297590 18175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4ee1113d207411694eacec667ae8bc1"
dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
 from {username='slave'} at 127.0.0.1:47698
I20260709 13:06:27.298097 18175 raft_consensus.cc:493] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:27.298388 18175 raft_consensus.cc:3060] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.305624 18175 raft_consensus.cc:515] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:27.307161 18175 leader_election.cc:290] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 3 election: Requested vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357)
I20260709 13:06:27.308399 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ee1113d207411694eacec667ae8bc1" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c4af78329ca642e1961b052895824194"
I20260709 13:06:27.308583 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ee1113d207411694eacec667ae8bc1" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
I20260709 13:06:27.309305 18384 raft_consensus.cc:3060] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.309465 18102 raft_consensus.cc:3055] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:27.309844 18102 raft_consensus.cc:740] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Running, Role: LEADER
I20260709 13:06:27.310794 18102 consensus_queue.cc:260] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:27.311831 18102 raft_consensus.cc:3060] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.315083 18384 raft_consensus.cc:2468] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 3.
I20260709 13:06:27.316298 18142 leader_election.cc:304] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49f27fe3f4404664b26a8f607f466ba6, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:27.316759 18102 raft_consensus.cc:2468] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 3.
I20260709 13:06:27.317179 18427 raft_consensus.cc:2804] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:27.317752 18427 raft_consensus.cc:697] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 LEADER]: Becoming Leader. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Running, Role: LEADER
I20260709 13:06:27.318989 18427 consensus_queue.cc:237] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:27.327533 17922 catalog_manager.cc:5697] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 reported cstate change: term changed from 2 to 3, leader changed from 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66) to 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67). New cstate: current_term: 3 leader_uuid: "49f27fe3f4404664b26a8f607f466ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:27.438215 17973 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:06:27.779029 18384 raft_consensus.cc:1275] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 3 FOLLOWER]: Refusing update from remote peer 43f35dbf581d4cd39f32cc742b03b2e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:27.780460 18446 consensus_queue.cc:1048] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.789737 18175 raft_consensus.cc:1275] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 FOLLOWER]: Refusing update from remote peer 43f35dbf581d4cd39f32cc742b03b2e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:27.791352 18435 consensus_queue.cc:1048] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.838193  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:27.845633 18102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b924daab328e432691b232291b6d5f92"
dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
mode: GRACEFUL
new_leader_uuid: "49f27fe3f4404664b26a8f607f466ba6"
 from {username='slave'} at 127.0.0.1:44356
I20260709 13:06:27.846148 18102 raft_consensus.cc:606] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 LEADER]: Received request to transfer leadership to TS 49f27fe3f4404664b26a8f607f466ba6
I20260709 13:06:27.848642 18175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd8d451d800544b68665799cc3e58a76"
dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
mode: GRACEFUL
new_leader_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
 from {username='slave'} at 127.0.0.1:57256
I20260709 13:06:27.849166 18175 raft_consensus.cc:606] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 LEADER]: Received request to transfer leadership to TS 43f35dbf581d4cd39f32cc742b03b2e8
I20260709 13:06:27.850348  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:27.850852  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:27.851459  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:27.889554 18384 raft_consensus.cc:1275] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 3 FOLLOWER]: Refusing update from remote peer 49f27fe3f4404664b26a8f607f466ba6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:27.890846 18332 consensus_queue.cc:1048] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.899452 18102 raft_consensus.cc:1275] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 FOLLOWER]: Refusing update from remote peer 49f27fe3f4404664b26a8f607f466ba6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:27.901327 18450 consensus_queue.cc:1048] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:27.946306 18332 raft_consensus.cc:993] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6: : Instructing follower 43f35dbf581d4cd39f32cc742b03b2e8 to start an election
I20260709 13:06:27.946832 18450 raft_consensus.cc:1081] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 LEADER]: Signalling peer 43f35dbf581d4cd39f32cc742b03b2e8 to start an election
I20260709 13:06:27.948453 18102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd8d451d800544b68665799cc3e58a76"
dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
 from {username='slave'} at 127.0.0.1:48178
I20260709 13:06:27.948943 18102 raft_consensus.cc:493] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:27.949275 18102 raft_consensus.cc:3060] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.955073 18102 raft_consensus.cc:515] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:27.956640 18102 leader_election.cc:290] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 2 election: Requested vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:27.957681 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd8d451d800544b68665799cc3e58a76" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4af78329ca642e1961b052895824194"
I20260709 13:06:27.958047 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd8d451d800544b68665799cc3e58a76" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
I20260709 13:06:27.958388 18384 raft_consensus.cc:3060] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.958762 18175 raft_consensus.cc:3055] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:27.959045 18175 raft_consensus.cc:740] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Running, Role: LEADER
I20260709 13:06:27.959731 18175 consensus_queue.cc:260] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:27.960690 18175 raft_consensus.cc:3060] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.964951 18384 raft_consensus.cc:2468] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 2.
I20260709 13:06:27.966316 18068 leader_election.cc:304] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:27.966775 18175 raft_consensus.cc:2468] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 2.
I20260709 13:06:27.967202 18435 raft_consensus.cc:2804] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:27.967784 18435 raft_consensus.cc:697] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 LEADER]: Becoming Leader. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Running, Role: LEADER
I20260709 13:06:27.968684 18435 consensus_queue.cc:237] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:27.976070 17922 catalog_manager.cc:5697] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 reported cstate change: term changed from 1 to 2, leader changed from 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67) to 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66). New cstate: current_term: 2 leader_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.335119 18239 raft_consensus.cc:993] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8: : Instructing follower 49f27fe3f4404664b26a8f607f466ba6 to start an election
I20260709 13:06:28.335638 18239 raft_consensus.cc:1081] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 LEADER]: Signalling peer 49f27fe3f4404664b26a8f607f466ba6 to start an election
I20260709 13:06:28.337996 18176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b924daab328e432691b232291b6d5f92"
dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
 from {username='slave'} at 127.0.0.1:47698
I20260709 13:06:28.338816 18176 raft_consensus.cc:493] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:28.339361 18176 raft_consensus.cc:3060] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.348698 18176 raft_consensus.cc:515] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:28.351794 18176 leader_election.cc:290] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 election: Requested vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357)
I20260709 13:06:28.357367 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b924daab328e432691b232291b6d5f92" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4af78329ca642e1961b052895824194"
I20260709 13:06:28.358137 18385 raft_consensus.cc:3060] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.362546 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b924daab328e432691b232291b6d5f92" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
I20260709 13:06:28.363178 18102 raft_consensus.cc:3055] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:28.363474 18102 raft_consensus.cc:740] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Running, Role: LEADER
I20260709 13:06:28.364264 18102 consensus_queue.cc:260] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:28.365674 18102 raft_consensus.cc:3060] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.367681 18385 raft_consensus.cc:2468] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 2.
I20260709 13:06:28.374577 18142 leader_election.cc:304] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49f27fe3f4404664b26a8f607f466ba6, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:28.375779 18444 raft_consensus.cc:2804] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:28.376302 18444 raft_consensus.cc:697] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 LEADER]: Becoming Leader. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Running, Role: LEADER
I20260709 13:06:28.377355 18444 consensus_queue.cc:237] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:28.391925 18102 raft_consensus.cc:2468] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 2.
I20260709 13:06:28.397686 17922 catalog_manager.cc:5697] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 reported cstate change: term changed from 1 to 2, leader changed from 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66) to 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67). New cstate: current_term: 2 leader_uuid: "49f27fe3f4404664b26a8f607f466ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:28.429193 18385 raft_consensus.cc:1275] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194 [term 2 FOLLOWER]: Refusing update from remote peer 43f35dbf581d4cd39f32cc742b03b2e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:28.430586 18239 consensus_queue.cc:1048] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:28.439359 17973 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:06:28.443576 18175 raft_consensus.cc:1275] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Refusing update from remote peer 43f35dbf581d4cd39f32cc742b03b2e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:28.445991 18239 consensus_queue.cc:1048] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:28.839498 18385 raft_consensus.cc:1275] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194 [term 2 FOLLOWER]: Refusing update from remote peer 49f27fe3f4404664b26a8f607f466ba6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:28.841158 18457 consensus_queue.cc:1048] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:28.854869 18101 raft_consensus.cc:1275] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Refusing update from remote peer 49f27fe3f4404664b26a8f607f466ba6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:28.858266 18427 consensus_queue.cc:1048] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:29.069624  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:29.077545 18101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5f6d2429ec54e0f9f38b92bb4048fe1"
dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
mode: GRACEFUL
new_leader_uuid: "49f27fe3f4404664b26a8f607f466ba6"
 from {username='slave'} at 127.0.0.1:44356
I20260709 13:06:29.078145 18101 raft_consensus.cc:606] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 LEADER]: Received request to transfer leadership to TS 49f27fe3f4404664b26a8f607f466ba6
I20260709 13:06:29.081226 18175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b924daab328e432691b232291b6d5f92"
dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
mode: GRACEFUL
new_leader_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
 from {username='slave'} at 127.0.0.1:57256
I20260709 13:06:29.081748 18175 raft_consensus.cc:606] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 LEADER]: Received request to transfer leadership to TS 43f35dbf581d4cd39f32cc742b03b2e8
I20260709 13:06:29.082988  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:29.083489  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:29.084192  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:29.261469 18427 raft_consensus.cc:993] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6: : Instructing follower 43f35dbf581d4cd39f32cc742b03b2e8 to start an election
I20260709 13:06:29.262171 18457 raft_consensus.cc:1081] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 LEADER]: Signalling peer 43f35dbf581d4cd39f32cc742b03b2e8 to start an election
I20260709 13:06:29.263857 18101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b924daab328e432691b232291b6d5f92"
dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
 from {username='slave'} at 127.0.0.1:48178
I20260709 13:06:29.264381 18101 raft_consensus.cc:493] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:29.264708 18101 raft_consensus.cc:3060] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:29.271202 18101 raft_consensus.cc:515] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:29.273118 18101 leader_election.cc:290] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 3 election: Requested vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:29.274269 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b924daab328e432691b232291b6d5f92" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
I20260709 13:06:29.274204 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b924daab328e432691b232291b6d5f92" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c4af78329ca642e1961b052895824194"
I20260709 13:06:29.275158 18175 raft_consensus.cc:3055] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:29.275236 18385 raft_consensus.cc:3060] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:29.275656 18175 raft_consensus.cc:740] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Running, Role: LEADER
I20260709 13:06:29.276674 18175 consensus_queue.cc:260] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:29.277998 18175 raft_consensus.cc:3060] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:29.280049 18446 raft_consensus.cc:993] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8: : Instructing follower 49f27fe3f4404664b26a8f607f466ba6 to start an election
I20260709 13:06:29.280748 18446 raft_consensus.cc:1081] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 LEADER]: Signalling peer 49f27fe3f4404664b26a8f607f466ba6 to start an election
I20260709 13:06:29.282490 18176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5f6d2429ec54e0f9f38b92bb4048fe1"
dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
 from {username='slave'} at 127.0.0.1:47698
I20260709 13:06:29.283078 18176 raft_consensus.cc:493] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:29.283458 18176 raft_consensus.cc:3060] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:29.283985 18385 raft_consensus.cc:2468] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 3.
I20260709 13:06:29.285305 18068 leader_election.cc:304] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:29.285651 18175 raft_consensus.cc:2468] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 3.
I20260709 13:06:29.286181 18446 raft_consensus.cc:2804] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:29.286829 18446 raft_consensus.cc:697] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 LEADER]: Becoming Leader. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Running, Role: LEADER
I20260709 13:06:29.287840 18446 consensus_queue.cc:237] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:29.291927 18176 raft_consensus.cc:515] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:29.294140 18176 leader_election.cc:290] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 election: Requested vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357)
I20260709 13:06:29.294875 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f6d2429ec54e0f9f38b92bb4048fe1" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4af78329ca642e1961b052895824194"
I20260709 13:06:29.295477 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f6d2429ec54e0f9f38b92bb4048fe1" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
I20260709 13:06:29.295843 18385 raft_consensus.cc:3060] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:29.296368 18101 raft_consensus.cc:3055] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:29.296850 18101 raft_consensus.cc:740] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Running, Role: LEADER
I20260709 13:06:29.296792 17922 catalog_manager.cc:5697] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 reported cstate change: term changed from 2 to 3, leader changed from 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67) to 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66). New cstate: current_term: 3 leader_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:29.298236 18101 consensus_queue.cc:260] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:29.299817 18101 raft_consensus.cc:3060] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:29.305012 18385 raft_consensus.cc:2468] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 2.
I20260709 13:06:29.306463 18142 leader_election.cc:304] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49f27fe3f4404664b26a8f607f466ba6, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:29.307447 18457 raft_consensus.cc:2804] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:29.307967 18457 raft_consensus.cc:697] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 LEADER]: Becoming Leader. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Running, Role: LEADER
I20260709 13:06:29.308879 18101 raft_consensus.cc:2468] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 2.
I20260709 13:06:29.308951 18457 consensus_queue.cc:237] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:29.316861 17922 catalog_manager.cc:5697] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 reported cstate change: term changed from 1 to 2, leader changed from 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66) to 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67). New cstate: current_term: 2 leader_uuid: "49f27fe3f4404664b26a8f607f466ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:29.371801 18407 debug-util.cc:398] Leaking SignalData structure 0x7b0800255b80 after lost signal to thread 8212
W20260709 13:06:29.373325 18407 debug-util.cc:398] Leaking SignalData structure 0x7b08000fcb40 after lost signal to thread 17959
W20260709 13:06:29.374735 18407 debug-util.cc:398] Leaking SignalData structure 0x7b0800247600 after lost signal to thread 18126
W20260709 13:06:29.376137 18407 debug-util.cc:398] Leaking SignalData structure 0x7b0800058ac0 after lost signal to thread 18200
W20260709 13:06:29.377516 18407 debug-util.cc:398] Leaking SignalData structure 0x7b08000c9500 after lost signal to thread 18411
W20260709 13:06:29.440590 17973 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:06:29.809767 18101 raft_consensus.cc:1275] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Refusing update from remote peer 49f27fe3f4404664b26a8f607f466ba6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:29.811313 18457 consensus_queue.cc:1048] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:29.828171 18385 raft_consensus.cc:1275] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194 [term 2 FOLLOWER]: Refusing update from remote peer 49f27fe3f4404664b26a8f607f466ba6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:29.829789 18427 consensus_queue.cc:1048] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:29.868641 18385 raft_consensus.cc:1275] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194 [term 3 FOLLOWER]: Refusing update from remote peer 43f35dbf581d4cd39f32cc742b03b2e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:29.868908 18176 raft_consensus.cc:1275] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 FOLLOWER]: Refusing update from remote peer 43f35dbf581d4cd39f32cc742b03b2e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:29.870332 18465 consensus_queue.cc:1048] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:29.871102 18446 consensus_queue.cc:1048] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:30.091344  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:30.103223 18101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d6f1422dbe6496db73bb5d12a4e60e9"
dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
mode: GRACEFUL
new_leader_uuid: "49f27fe3f4404664b26a8f607f466ba6"
 from {username='slave'} at 127.0.0.1:44356
I20260709 13:06:30.104076 18101 raft_consensus.cc:606] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 LEADER]: Received request to transfer leadership to TS 49f27fe3f4404664b26a8f607f466ba6
I20260709 13:06:30.107745 18176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5f6d2429ec54e0f9f38b92bb4048fe1"
dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
mode: GRACEFUL
new_leader_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
 from {username='slave'} at 127.0.0.1:57256
I20260709 13:06:30.108402 18176 raft_consensus.cc:606] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 LEADER]: Received request to transfer leadership to TS 43f35dbf581d4cd39f32cc742b03b2e8
I20260709 13:06:30.109987  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:30.110720  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:30.111485  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:30.268046 18427 raft_consensus.cc:993] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6: : Instructing follower 43f35dbf581d4cd39f32cc742b03b2e8 to start an election
I20260709 13:06:30.268877 18457 raft_consensus.cc:1081] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 LEADER]: Signalling peer 43f35dbf581d4cd39f32cc742b03b2e8 to start an election
I20260709 13:06:30.270735 18101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5f6d2429ec54e0f9f38b92bb4048fe1"
dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
 from {username='slave'} at 127.0.0.1:48178
I20260709 13:06:30.271404 18101 raft_consensus.cc:493] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:30.271819 18101 raft_consensus.cc:3060] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:30.277803 18101 raft_consensus.cc:515] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:30.279796 18101 leader_election.cc:290] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 3 election: Requested vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:30.280722 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f6d2429ec54e0f9f38b92bb4048fe1" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c4af78329ca642e1961b052895824194"
I20260709 13:06:30.281607 18385 raft_consensus.cc:3060] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:30.283444 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f6d2429ec54e0f9f38b92bb4048fe1" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
I20260709 13:06:30.284231 18176 raft_consensus.cc:3055] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:30.284677 18176 raft_consensus.cc:740] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Running, Role: LEADER
I20260709 13:06:30.285655 18176 consensus_queue.cc:260] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:30.286795 18176 raft_consensus.cc:3060] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:30.290858 18385 raft_consensus.cc:2468] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 3.
I20260709 13:06:30.292610 18068 leader_election.cc:304] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:30.292945 18176 raft_consensus.cc:2468] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 3.
I20260709 13:06:30.293606 18465 raft_consensus.cc:2804] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:30.294157 18465 raft_consensus.cc:697] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 LEADER]: Becoming Leader. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Running, Role: LEADER
I20260709 13:06:30.295482 18465 consensus_queue.cc:237] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:30.303049 17925 catalog_manager.cc:5697] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 reported cstate change: term changed from 2 to 3, leader changed from 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67) to 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66). New cstate: current_term: 3 leader_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.313764 18465 raft_consensus.cc:993] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8: : Instructing follower 49f27fe3f4404664b26a8f607f466ba6 to start an election
I20260709 13:06:30.314337 18479 raft_consensus.cc:1081] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 LEADER]: Signalling peer 49f27fe3f4404664b26a8f607f466ba6 to start an election
I20260709 13:06:30.316319 18176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d6f1422dbe6496db73bb5d12a4e60e9"
dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
 from {username='slave'} at 127.0.0.1:47698
I20260709 13:06:30.316932 18176 raft_consensus.cc:493] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:30.317358 18176 raft_consensus.cc:3060] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.323668 18176 raft_consensus.cc:515] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:30.326570 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6f1422dbe6496db73bb5d12a4e60e9" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
I20260709 13:06:30.326020 18176 leader_election.cc:290] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 election: Requested vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357)
I20260709 13:06:30.326606 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6f1422dbe6496db73bb5d12a4e60e9" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4af78329ca642e1961b052895824194"
I20260709 13:06:30.327257 18101 raft_consensus.cc:3055] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:30.327675 18385 raft_consensus.cc:3060] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.327703 18101 raft_consensus.cc:740] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Running, Role: LEADER
I20260709 13:06:30.329054 18101 consensus_queue.cc:260] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:30.330171 18101 raft_consensus.cc:3060] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.335827 18101 raft_consensus.cc:2468] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 2.
I20260709 13:06:30.337181 18139 leader_election.cc:304] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, 49f27fe3f4404664b26a8f607f466ba6; no voters: 
I20260709 13:06:30.337224 18385 raft_consensus.cc:2468] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 2.
I20260709 13:06:30.337997 18457 raft_consensus.cc:2804] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:30.338496 18457 raft_consensus.cc:697] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 LEADER]: Becoming Leader. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Running, Role: LEADER
I20260709 13:06:30.339540 18457 consensus_queue.cc:237] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:30.349435 17925 catalog_manager.cc:5697] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6 reported cstate change: term changed from 1 to 2, leader changed from 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66) to 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67). New cstate: current_term: 2 leader_uuid: "49f27fe3f4404664b26a8f607f466ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:30.441702 17973 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:06:30.688372 18176 raft_consensus.cc:1275] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 FOLLOWER]: Refusing update from remote peer 43f35dbf581d4cd39f32cc742b03b2e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:30.690078 18479 consensus_queue.cc:1048] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:30.704996 18385 raft_consensus.cc:1275] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194 [term 3 FOLLOWER]: Refusing update from remote peer 43f35dbf581d4cd39f32cc742b03b2e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:30.707266 18479 consensus_queue.cc:1048] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:30.791687 18101 raft_consensus.cc:1275] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Refusing update from remote peer 49f27fe3f4404664b26a8f607f466ba6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:30.793349 18457 consensus_queue.cc:1048] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:30.806155 18385 raft_consensus.cc:1275] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194 [term 2 FOLLOWER]: Refusing update from remote peer 49f27fe3f4404664b26a8f607f466ba6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:30.808264 18489 consensus_queue.cc:1048] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:31.123355  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:31.131181 18101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "537f32a9788e4706b31db79d783e4e33"
dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
mode: GRACEFUL
new_leader_uuid: "49f27fe3f4404664b26a8f607f466ba6"
 from {username='slave'} at 127.0.0.1:44356
I20260709 13:06:31.131752 18101 raft_consensus.cc:606] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 LEADER]: Received request to transfer leadership to TS 49f27fe3f4404664b26a8f607f466ba6
I20260709 13:06:31.134538 18176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4ee1113d207411694eacec667ae8bc1"
dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
mode: GRACEFUL
new_leader_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
 from {username='slave'} at 127.0.0.1:57256
I20260709 13:06:31.135070 18176 raft_consensus.cc:606] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 LEADER]: Received request to transfer leadership to TS 43f35dbf581d4cd39f32cc742b03b2e8
I20260709 13:06:31.136437  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:31.137066  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:31.137775  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:31.141256 18465 raft_consensus.cc:993] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8: : Instructing follower 49f27fe3f4404664b26a8f607f466ba6 to start an election
I20260709 13:06:31.141862 18479 raft_consensus.cc:1081] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 LEADER]: Signalling peer 49f27fe3f4404664b26a8f607f466ba6 to start an election
I20260709 13:06:31.143766 18176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "537f32a9788e4706b31db79d783e4e33"
dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
 from {username='slave'} at 127.0.0.1:47698
I20260709 13:06:31.144512 18176 raft_consensus.cc:493] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:31.144976 18176 raft_consensus.cc:3060] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.154884 18176 raft_consensus.cc:515] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:31.157368 18176 leader_election.cc:290] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 4 election: Requested vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66:42357)
I20260709 13:06:31.158594 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f32a9788e4706b31db79d783e4e33" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
I20260709 13:06:31.158633 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537f32a9788e4706b31db79d783e4e33" candidate_uuid: "49f27fe3f4404664b26a8f607f466ba6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c4af78329ca642e1961b052895824194"
I20260709 13:06:31.159408 18101 raft_consensus.cc:3055] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:31.159566 18384 raft_consensus.cc:3060] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.159821 18101 raft_consensus.cc:740] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Running, Role: LEADER
I20260709 13:06:31.160797 18101 consensus_queue.cc:260] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:31.162277 18101 raft_consensus.cc:3060] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.166455 18384 raft_consensus.cc:2468] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 4.
I20260709 13:06:31.168448 18142 leader_election.cc:304] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49f27fe3f4404664b26a8f607f466ba6, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:31.169345 18489 raft_consensus.cc:2804] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:31.169871 18489 raft_consensus.cc:697] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 4 LEADER]: Becoming Leader. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Running, Role: LEADER
I20260709 13:06:31.170812 18489 consensus_queue.cc:237] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:31.175308 18101 raft_consensus.cc:2468] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49f27fe3f4404664b26a8f607f466ba6 in term 4.
I20260709 13:06:31.180058 17924 catalog_manager.cc:5697] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 reported cstate change: term changed from 3 to 4, leader changed from 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66) to 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67). New cstate: current_term: 4 leader_uuid: "49f27fe3f4404664b26a8f607f466ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:31.442915 17973 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:06:31.618716 18384 raft_consensus.cc:1275] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 4 FOLLOWER]: Refusing update from remote peer 49f27fe3f4404664b26a8f607f466ba6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:31.620394 18489 consensus_queue.cc:1048] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:31.632817 18101 raft_consensus.cc:1275] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 4 FOLLOWER]: Refusing update from remote peer 49f27fe3f4404664b26a8f607f466ba6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:31.635011 18427 consensus_queue.cc:1048] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:31.705106 18489 raft_consensus.cc:993] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6: : Instructing follower 43f35dbf581d4cd39f32cc742b03b2e8 to start an election
I20260709 13:06:31.705740 18427 raft_consensus.cc:1081] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 LEADER]: Signalling peer 43f35dbf581d4cd39f32cc742b03b2e8 to start an election
I20260709 13:06:31.708148 18101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4ee1113d207411694eacec667ae8bc1"
dest_uuid: "43f35dbf581d4cd39f32cc742b03b2e8"
 from {username='slave'} at 127.0.0.1:48178
I20260709 13:06:31.708882 18101 raft_consensus.cc:493] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:31.709352 18101 raft_consensus.cc:3060] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.714921 18101 raft_consensus.cc:515] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:31.716995 18101 leader_election.cc:290] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 4 election: Requested vote from peers c4af78329ca642e1961b052895824194 (127.8.4.65:45469), 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67:44527)
I20260709 13:06:31.718034 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ee1113d207411694eacec667ae8bc1" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c4af78329ca642e1961b052895824194"
I20260709 13:06:31.718883 18385 raft_consensus.cc:3060] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.718247 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ee1113d207411694eacec667ae8bc1" candidate_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "49f27fe3f4404664b26a8f607f466ba6"
I20260709 13:06:31.721459 18175 raft_consensus.cc:3055] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:31.721777 18175 raft_consensus.cc:740] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 49f27fe3f4404664b26a8f607f466ba6, State: Running, Role: LEADER
I20260709 13:06:31.722669 18175 consensus_queue.cc:260] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:31.724016 18175 raft_consensus.cc:3060] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.726738 18385 raft_consensus.cc:2468] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 4.
I20260709 13:06:31.728158 18068 leader_election.cc:304] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f35dbf581d4cd39f32cc742b03b2e8, c4af78329ca642e1961b052895824194; no voters: 
I20260709 13:06:31.729036 18479 raft_consensus.cc:2804] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:31.729667 18479 raft_consensus.cc:697] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 4 LEADER]: Becoming Leader. State: Replica: 43f35dbf581d4cd39f32cc742b03b2e8, State: Running, Role: LEADER
I20260709 13:06:31.730809 18175 raft_consensus.cc:2468] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43f35dbf581d4cd39f32cc742b03b2e8 in term 4.
I20260709 13:06:31.730690 18479 consensus_queue.cc:237] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } }
I20260709 13:06:31.739840 17925 catalog_manager.cc:5697] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 reported cstate change: term changed from 3 to 4, leader changed from 49f27fe3f4404664b26a8f607f466ba6 (127.8.4.67) to 43f35dbf581d4cd39f32cc742b03b2e8 (127.8.4.66). New cstate: current_term: 4 leader_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4af78329ca642e1961b052895824194" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43f35dbf581d4cd39f32cc742b03b2e8" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 42357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:32.145704  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:32.184559  8209 tablet_server.cc:179] TabletServer@127.8.4.65:45469 shutting down...
W20260709 13:06:32.189775 18142 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 94 similar messages]
I20260709 13:06:32.190937 18175 raft_consensus.cc:1275] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 4 FOLLOWER]: Refusing update from remote peer 43f35dbf581d4cd39f32cc742b03b2e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:32.193830 18479 consensus_queue.cc:1048] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49f27fe3f4404664b26a8f607f466ba6" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 44527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:06:32.213306 18142 consensus_peers.cc:597] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:32.247008 18068 consensus_peers.cc:597] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:32.255683  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:32.256563  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:32.257488  8209 raft_consensus.cc:2243] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.258026  8209 raft_consensus.cc:2272] T 7d6f1422dbe6496db73bb5d12a4e60e9 P c4af78329ca642e1961b052895824194 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.260733  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:32.261826  8209 raft_consensus.cc:2243] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:06:32.262496 18142 consensus_peers.cc:597] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:32.262517  8209 raft_consensus.cc:2272] T 2430275956ef476e9dedff8b6b31ddef P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.265671  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:32.266335  8209 raft_consensus.cc:2243] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.266819  8209 raft_consensus.cc:2272] T b6c5f89a38464e3a8f50e6de3fd70c02 P c4af78329ca642e1961b052895824194 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.268994  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:32.269670  8209 raft_consensus.cc:2243] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.270107  8209 raft_consensus.cc:2272] T 77b05b18753e4424b93fafb956a63eeb P c4af78329ca642e1961b052895824194 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.272054  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:32.272646  8209 raft_consensus.cc:2243] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.273161  8209 raft_consensus.cc:2272] T b924daab328e432691b232291b6d5f92 P c4af78329ca642e1961b052895824194 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.275103  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:32.275700  8209 raft_consensus.cc:2243] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.276149  8209 raft_consensus.cc:2272] T b5f6d2429ec54e0f9f38b92bb4048fe1 P c4af78329ca642e1961b052895824194 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.278273  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:32.278873  8209 raft_consensus.cc:2243] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.279328  8209 raft_consensus.cc:2272] T b4ee1113d207411694eacec667ae8bc1 P c4af78329ca642e1961b052895824194 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.281327  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:32.281891  8209 raft_consensus.cc:2243] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.282347  8209 raft_consensus.cc:2272] T cd8d451d800544b68665799cc3e58a76 P c4af78329ca642e1961b052895824194 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.284263  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:32.285212  8209 raft_consensus.cc:2243] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.285724  8209 raft_consensus.cc:2272] T 2b9641807c104f04b44fd7e50509b3a7 P c4af78329ca642e1961b052895824194 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.288128  8209 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:32.288753  8209 raft_consensus.cc:2243] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.289295  8209 raft_consensus.cc:2272] T 537f32a9788e4706b31db79d783e4e33 P c4af78329ca642e1961b052895824194 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:32.295518 18068 consensus_peers.cc:597] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:32.444026 17973 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:06:32.446424 18142 consensus_peers.cc:597] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:32.473882 18068 consensus_peers.cc:597] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:32.481132 18142 consensus_peers.cc:597] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:32.515261 18068 consensus_peers.cc:597] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:32.696743 18142 consensus_peers.cc:597] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:32.707777 18068 consensus_peers.cc:597] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 -> Peer c4af78329ca642e1961b052895824194 (127.8.4.65:45469): Couldn't send request to peer c4af78329ca642e1961b052895824194. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:32.827669  8209 tablet_server.cc:196] TabletServer@127.8.4.65:45469 shutdown complete.
I20260709 13:06:32.848628  8209 tablet_server.cc:179] TabletServer@127.8.4.66:0 shutting down...
I20260709 13:06:32.883613  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:32.885042  8209 tablet_replica.cc:333] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8: stopping tablet replica
I20260709 13:06:32.885926  8209 raft_consensus.cc:2243] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:32.886929  8209 raft_consensus.cc:2272] T cd8d451d800544b68665799cc3e58a76 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.889897  8209 tablet_replica.cc:333] T 2b9641807c104f04b44fd7e50509b3a7 P 43f35dbf581d4cd39f32cc742b03b2e8: stopping tablet replica
I20260709 13:06:32.890522  8209 raft_consensus.cc:2243] T 2b9641807c104f04b44fd7e50509b3a7 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.890988  8209 raft_consensus.cc:2272] T 2b9641807c104f04b44fd7e50509b3a7 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.893337  8209 tablet_replica.cc:333] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8: stopping tablet replica
I20260709 13:06:32.893853  8209 raft_consensus.cc:2243] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.894294  8209 raft_consensus.cc:2272] T 537f32a9788e4706b31db79d783e4e33 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.896575  8209 tablet_replica.cc:333] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8: stopping tablet replica
I20260709 13:06:32.897224  8209 raft_consensus.cc:2243] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:32.898103  8209 raft_consensus.cc:2272] T 77b05b18753e4424b93fafb956a63eeb P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.900614  8209 tablet_replica.cc:333] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8: stopping tablet replica
I20260709 13:06:32.901314  8209 raft_consensus.cc:2243] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:32.902112  8209 raft_consensus.cc:2272] T b924daab328e432691b232291b6d5f92 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.904464  8209 tablet_replica.cc:333] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8: stopping tablet replica
I20260709 13:06:32.905149  8209 raft_consensus.cc:2243] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:32.906081  8209 raft_consensus.cc:2272] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.908466  8209 tablet_replica.cc:333] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8: stopping tablet replica
I20260709 13:06:32.909034  8209 raft_consensus.cc:2243] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:32.909889  8209 raft_consensus.cc:2272] T b4ee1113d207411694eacec667ae8bc1 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.913317  8209 tablet_replica.cc:333] T 2430275956ef476e9dedff8b6b31ddef P 43f35dbf581d4cd39f32cc742b03b2e8: stopping tablet replica
I20260709 13:06:32.913910  8209 raft_consensus.cc:2243] T 2430275956ef476e9dedff8b6b31ddef P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.914391  8209 raft_consensus.cc:2272] T 2430275956ef476e9dedff8b6b31ddef P 43f35dbf581d4cd39f32cc742b03b2e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.916724  8209 tablet_replica.cc:333] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8: stopping tablet replica
I20260709 13:06:32.917374  8209 raft_consensus.cc:2243] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.917810  8209 raft_consensus.cc:2272] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.919966  8209 tablet_replica.cc:333] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8: stopping tablet replica
I20260709 13:06:32.920435  8209 raft_consensus.cc:2243] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.920931  8209 raft_consensus.cc:2272] T b6c5f89a38464e3a8f50e6de3fd70c02 P 43f35dbf581d4cd39f32cc742b03b2e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.956736  8209 tablet_server.cc:196] TabletServer@127.8.4.66:0 shutdown complete.
I20260709 13:06:32.981313  8209 tablet_server.cc:179] TabletServer@127.8.4.67:0 shutting down...
I20260709 13:06:33.010825  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:33.011608  8209 tablet_replica.cc:333] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6: stopping tablet replica
I20260709 13:06:33.012427  8209 raft_consensus.cc:2243] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.012907  8209 raft_consensus.cc:2272] T cd8d451d800544b68665799cc3e58a76 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.015125  8209 tablet_replica.cc:333] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6: stopping tablet replica
I20260709 13:06:33.015710  8209 raft_consensus.cc:2243] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:33.016541  8209 raft_consensus.cc:2272] T 2b9641807c104f04b44fd7e50509b3a7 P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.018949  8209 tablet_replica.cc:333] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6: stopping tablet replica
I20260709 13:06:33.019521  8209 raft_consensus.cc:2243] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:33.020323  8209 raft_consensus.cc:2272] T 537f32a9788e4706b31db79d783e4e33 P 49f27fe3f4404664b26a8f607f466ba6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.022629  8209 tablet_replica.cc:333] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6: stopping tablet replica
I20260709 13:06:33.023262  8209 raft_consensus.cc:2243] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.023727  8209 raft_consensus.cc:2272] T 77b05b18753e4424b93fafb956a63eeb P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.025972  8209 tablet_replica.cc:333] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6: stopping tablet replica
I20260709 13:06:33.026544  8209 raft_consensus.cc:2243] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.026980  8209 raft_consensus.cc:2272] T b924daab328e432691b232291b6d5f92 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.029217  8209 tablet_replica.cc:333] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6: stopping tablet replica
I20260709 13:06:33.029776  8209 raft_consensus.cc:2243] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.030231  8209 raft_consensus.cc:2272] T b5f6d2429ec54e0f9f38b92bb4048fe1 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.032331  8209 tablet_replica.cc:333] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6: stopping tablet replica
I20260709 13:06:33.032871  8209 raft_consensus.cc:2243] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.033387  8209 raft_consensus.cc:2272] T b4ee1113d207411694eacec667ae8bc1 P 49f27fe3f4404664b26a8f607f466ba6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.036233  8209 tablet_replica.cc:333] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6: stopping tablet replica
I20260709 13:06:33.036792  8209 raft_consensus.cc:2243] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:33.037706  8209 raft_consensus.cc:2272] T 7d6f1422dbe6496db73bb5d12a4e60e9 P 49f27fe3f4404664b26a8f607f466ba6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.040366  8209 tablet_replica.cc:333] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6: stopping tablet replica
I20260709 13:06:33.040918  8209 raft_consensus.cc:2243] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:33.041800  8209 raft_consensus.cc:2272] T 2430275956ef476e9dedff8b6b31ddef P 49f27fe3f4404664b26a8f607f466ba6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.044158  8209 tablet_replica.cc:333] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6: stopping tablet replica
I20260709 13:06:33.044739  8209 raft_consensus.cc:2243] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:33.045682  8209 raft_consensus.cc:2272] T b6c5f89a38464e3a8f50e6de3fd70c02 P 49f27fe3f4404664b26a8f607f466ba6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.070693  8209 tablet_server.cc:196] TabletServer@127.8.4.67:0 shutdown complete.
I20260709 13:06:33.098047  8209 master.cc:562] Master@127.8.4.126:43659 shutting down...
I20260709 13:06:33.122480  8209 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:33.123085  8209 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.123359  8209 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1a35567847a74562b712368db60a985b: stopping tablet replica
I20260709 13:06:33.144949  8209 master.cc:584] Master@127.8.4.126:43659 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13925 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:06:33.193338  8209 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.4.126:40303
I20260709 13:06:33.194485  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:33.200606 18521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:33.201068 18522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:33.203306 18524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:33.204054  8209 server_base.cc:1061] running on GCE node
I20260709 13:06:33.205255  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:33.205443  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:33.205616  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602393205600 us; error 0 us; skew 500 ppm
I20260709 13:06:33.206203  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:33.209227  8209 webserver.cc:533] Webserver started at http://127.8.4.126:37749/ using document root <none> and password file <none>
I20260709 13:06:33.209789  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:33.209977  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:33.210281  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:33.211423  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602095438975-8209-0/minicluster-data/master-0-root/instance:
uuid: "88463b68d68540a093f22be7a210b66b"
format_stamp: "Formatted at 2026-07-09 13:06:33 on dist-test-slave-008w"
I20260709 13:06:33.216332  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:06:33.220561 18529 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:33.221457  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:06:33.221802  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602095438975-8209-0/minicluster-data/master-0-root
uuid: "88463b68d68540a093f22be7a210b66b"
format_stamp: "Formatted at 2026-07-09 13:06:33 on dist-test-slave-008w"
I20260709 13:06:33.222065  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602095438975-8209-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602095438975-8209-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602095438975-8209-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:33.244144  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:33.245426  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:33.287806  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.126:40303
I20260709 13:06:33.287917 18580 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.126:40303 every 8 connection(s)
I20260709 13:06:33.292102 18581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:33.304454 18581 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b: Bootstrap starting.
I20260709 13:06:33.309574 18581 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:33.314168 18581 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b: No bootstrap required, opened a new log
I20260709 13:06:33.316480 18581 raft_consensus.cc:359] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88463b68d68540a093f22be7a210b66b" member_type: VOTER }
I20260709 13:06:33.316885 18581 raft_consensus.cc:385] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:33.317186 18581 raft_consensus.cc:740] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88463b68d68540a093f22be7a210b66b, State: Initialized, Role: FOLLOWER
I20260709 13:06:33.317793 18581 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88463b68d68540a093f22be7a210b66b" member_type: VOTER }
I20260709 13:06:33.318328 18581 raft_consensus.cc:399] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:06:33.318569 18581 raft_consensus.cc:493] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:06:33.318850 18581 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:33.327039 18581 raft_consensus.cc:515] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88463b68d68540a093f22be7a210b66b" member_type: VOTER }
I20260709 13:06:33.327690 18581 leader_election.cc:304] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88463b68d68540a093f22be7a210b66b; no voters: 
I20260709 13:06:33.328965 18581 leader_election.cc:290] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:06:33.329382 18584 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:33.330914 18584 raft_consensus.cc:697] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b [term 1 LEADER]: Becoming Leader. State: Replica: 88463b68d68540a093f22be7a210b66b, State: Running, Role: LEADER
I20260709 13:06:33.331696 18584 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88463b68d68540a093f22be7a210b66b" member_type: VOTER }
I20260709 13:06:33.332409 18581 sys_catalog.cc:565] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:06:33.336562 18585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "88463b68d68540a093f22be7a210b66b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88463b68d68540a093f22be7a210b66b" member_type: VOTER } }
I20260709 13:06:33.337208 18586 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88463b68d68540a093f22be7a210b66b. Latest consensus state: current_term: 1 leader_uuid: "88463b68d68540a093f22be7a210b66b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88463b68d68540a093f22be7a210b66b" member_type: VOTER } }
I20260709 13:06:33.337734 18585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:33.338158 18586 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:33.340761 18591 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:06:33.347466 18591 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:06:33.350972  8209 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:06:33.358844 18591 catalog_manager.cc:1383] Generated new cluster ID: 32adaef934ad4549b2645a441366cb5d
I20260709 13:06:33.359259 18591 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:06:33.391533 18591 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:06:33.392959 18591 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:06:33.410778 18591 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b: Generated new TSK 0
I20260709 13:06:33.411428 18591 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:06:33.418594  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:33.425464 18602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:33.426407 18603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:33.428900 18605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:33.430745  8209 server_base.cc:1061] running on GCE node
I20260709 13:06:33.434453  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:33.434808  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:33.434998  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602393434979 us; error 0 us; skew 500 ppm
I20260709 13:06:33.435639  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:33.438437  8209 webserver.cc:533] Webserver started at http://127.8.4.65:34023/ using document root <none> and password file <none>
I20260709 13:06:33.438970  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:33.439182  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:33.439445  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:33.440531  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602095438975-8209-0/minicluster-data/ts-0-root/instance:
uuid: "4a44f405300f4861aa0811f98bee968a"
format_stamp: "Formatted at 2026-07-09 13:06:33 on dist-test-slave-008w"
I20260709 13:06:33.445619  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:06:33.449752 18610 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:33.450670  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:06:33.450948  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602095438975-8209-0/minicluster-data/ts-0-root
uuid: "4a44f405300f4861aa0811f98bee968a"
format_stamp: "Formatted at 2026-07-09 13:06:33 on dist-test-slave-008w"
I20260709 13:06:33.451216  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602095438975-8209-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602095438975-8209-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602095438975-8209-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:33.461874  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:33.463317  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:33.465157  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:33.467631  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:33.467833  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:33.468140  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:33.468358  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:33.522210  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.65:36957
I20260709 13:06:33.522307 18672 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.65:36957 every 8 connection(s)
I20260709 13:06:33.527701  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:33.536479 18677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:33.538625 18678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:33.540306  8209 server_base.cc:1061] running on GCE node
W20260709 13:06:33.542224 18680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:33.543309  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:06:33.543462 18673 heartbeater.cc:344] Connected to a master server at 127.8.4.126:40303
W20260709 13:06:33.543529  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:33.544013  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602393543992 us; error 0 us; skew 500 ppm
I20260709 13:06:33.544026 18673 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:33.544839  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:33.545138 18673 heartbeater.cc:507] Master 127.8.4.126:40303 requested a full tablet report, sending...
I20260709 13:06:33.547989 18546 ts_manager.cc:194] Registered new tserver with Master: 4a44f405300f4861aa0811f98bee968a (127.8.4.65:36957)
I20260709 13:06:33.548004  8209 webserver.cc:533] Webserver started at http://127.8.4.66:37735/ using document root <none> and password file <none>
I20260709 13:06:33.549072  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:33.549347  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:33.549667  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:33.550822 18546 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39278
I20260709 13:06:33.551157  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602095438975-8209-0/minicluster-data/ts-1-root/instance:
uuid: "c7d6db765e304bd887f9ff6203db284d"
format_stamp: "Formatted at 2026-07-09 13:06:33 on dist-test-slave-008w"
I20260709 13:06:33.556370  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:06:33.560197 18685 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:33.561271  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:06:33.561599  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602095438975-8209-0/minicluster-data/ts-1-root
uuid: "c7d6db765e304bd887f9ff6203db284d"
format_stamp: "Formatted at 2026-07-09 13:06:33 on dist-test-slave-008w"
I20260709 13:06:33.561863  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602095438975-8209-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602095438975-8209-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602095438975-8209-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:33.590018  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:33.591490  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:33.593101  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:33.595408  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:33.595602  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:33.595906  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:33.596043  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:33.640769  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.66:46353
I20260709 13:06:33.640875 18747 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.66:46353 every 8 connection(s)
I20260709 13:06:33.647091  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:33.656170 18751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:33.656553 18752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:33.659691 18748 heartbeater.cc:344] Connected to a master server at 127.8.4.126:40303
I20260709 13:06:33.660172 18748 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:33.660583  8209 server_base.cc:1061] running on GCE node
W20260709 13:06:33.660722 18754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:33.661207 18748 heartbeater.cc:507] Master 127.8.4.126:40303 requested a full tablet report, sending...
I20260709 13:06:33.662052  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:33.662403  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:33.662606  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602393662588 us; error 0 us; skew 500 ppm
I20260709 13:06:33.663373  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:33.663847 18546 ts_manager.cc:194] Registered new tserver with Master: c7d6db765e304bd887f9ff6203db284d (127.8.4.66:46353)
I20260709 13:06:33.665695 18546 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39290
I20260709 13:06:33.666465  8209 webserver.cc:533] Webserver started at http://127.8.4.67:41273/ using document root <none> and password file <none>
I20260709 13:06:33.667098  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:33.667366  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:33.667702  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:33.669157  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602095438975-8209-0/minicluster-data/ts-2-root/instance:
uuid: "167d0284e4ed49f4a0860255531076c7"
format_stamp: "Formatted at 2026-07-09 13:06:33 on dist-test-slave-008w"
I20260709 13:06:33.674099  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:06:33.678134 18759 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:33.679112  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:06:33.679556  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602095438975-8209-0/minicluster-data/ts-2-root
uuid: "167d0284e4ed49f4a0860255531076c7"
format_stamp: "Formatted at 2026-07-09 13:06:33 on dist-test-slave-008w"
I20260709 13:06:33.679970  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602095438975-8209-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602095438975-8209-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602095438975-8209-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:33.706434  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:33.707945  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:33.710331  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:33.713327  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:33.713773  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:33.714114  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:33.714316  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:33.761322  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.67:43871
I20260709 13:06:33.761422 18821 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.67:43871 every 8 connection(s)
I20260709 13:06:33.777652 18822 heartbeater.cc:344] Connected to a master server at 127.8.4.126:40303
I20260709 13:06:33.778215 18822 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:33.778980 18822 heartbeater.cc:507] Master 127.8.4.126:40303 requested a full tablet report, sending...
I20260709 13:06:33.781181 18546 ts_manager.cc:194] Registered new tserver with Master: 167d0284e4ed49f4a0860255531076c7 (127.8.4.67:43871)
I20260709 13:06:33.781370  8209 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01674886s
I20260709 13:06:33.782815 18546 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39302
I20260709 13:06:33.810312 18546 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39318:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:33.812661 18546 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:34.096925 18787 tablet_service.cc:1511] Processing CreateTablet for tablet dc7b1a7c632e46ee94329768417eeca3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2d2a4a00380b4950b3bf86ba151169a0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:06:34.098455 18787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc7b1a7c632e46ee94329768417eeca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:34.096925 18786 tablet_service.cc:1511] Processing CreateTablet for tablet 41caf625eaae4efb9ba13414ea164b37 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2d2a4a00380b4950b3bf86ba151169a0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:06:34.100643 18786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41caf625eaae4efb9ba13414ea164b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:34.102962 18713 tablet_service.cc:1511] Processing CreateTablet for tablet dc7b1a7c632e46ee94329768417eeca3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2d2a4a00380b4950b3bf86ba151169a0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:06:34.104460 18713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc7b1a7c632e46ee94329768417eeca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:34.106019 18712 tablet_service.cc:1511] Processing CreateTablet for tablet 41caf625eaae4efb9ba13414ea164b37 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2d2a4a00380b4950b3bf86ba151169a0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:06:34.107328 18712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41caf625eaae4efb9ba13414ea164b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:34.109053 18638 tablet_service.cc:1511] Processing CreateTablet for tablet dc7b1a7c632e46ee94329768417eeca3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2d2a4a00380b4950b3bf86ba151169a0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:06:34.109301 18637 tablet_service.cc:1511] Processing CreateTablet for tablet 41caf625eaae4efb9ba13414ea164b37 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2d2a4a00380b4950b3bf86ba151169a0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:06:34.111034 18638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc7b1a7c632e46ee94329768417eeca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:34.111917 18637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41caf625eaae4efb9ba13414ea164b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:34.151648 18837 tablet_bootstrap.cc:492] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7: Bootstrap starting.
I20260709 13:06:34.158857 18838 tablet_bootstrap.cc:492] T 41caf625eaae4efb9ba13414ea164b37 P c7d6db765e304bd887f9ff6203db284d: Bootstrap starting.
I20260709 13:06:34.160421 18837 tablet_bootstrap.cc:654] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.161227 18839 tablet_bootstrap.cc:492] T 41caf625eaae4efb9ba13414ea164b37 P 4a44f405300f4861aa0811f98bee968a: Bootstrap starting.
I20260709 13:06:34.165326 18837 tablet_bootstrap.cc:492] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7: No bootstrap required, opened a new log
I20260709 13:06:34.165992 18837 ts_tablet_manager.cc:1403] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:06:34.169338 18839 tablet_bootstrap.cc:654] T 41caf625eaae4efb9ba13414ea164b37 P 4a44f405300f4861aa0811f98bee968a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.169411 18838 tablet_bootstrap.cc:654] T 41caf625eaae4efb9ba13414ea164b37 P c7d6db765e304bd887f9ff6203db284d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.169299 18837 raft_consensus.cc:359] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.170248 18837 raft_consensus.cc:385] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.170559 18837 raft_consensus.cc:740] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 167d0284e4ed49f4a0860255531076c7, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.171347 18837 consensus_queue.cc:260] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.179740 18822 heartbeater.cc:499] Master 127.8.4.126:40303 was elected leader, sending a full tablet report...
I20260709 13:06:34.180335 18837 ts_tablet_manager.cc:1434] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.008s
I20260709 13:06:34.180563 18838 tablet_bootstrap.cc:492] T 41caf625eaae4efb9ba13414ea164b37 P c7d6db765e304bd887f9ff6203db284d: No bootstrap required, opened a new log
I20260709 13:06:34.181346 18838 ts_tablet_manager.cc:1403] T 41caf625eaae4efb9ba13414ea164b37 P c7d6db765e304bd887f9ff6203db284d: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.000s
I20260709 13:06:34.182467 18839 tablet_bootstrap.cc:492] T 41caf625eaae4efb9ba13414ea164b37 P 4a44f405300f4861aa0811f98bee968a: No bootstrap required, opened a new log
I20260709 13:06:34.182687 18837 tablet_bootstrap.cc:492] T dc7b1a7c632e46ee94329768417eeca3 P 167d0284e4ed49f4a0860255531076c7: Bootstrap starting.
I20260709 13:06:34.183230 18839 ts_tablet_manager.cc:1403] T 41caf625eaae4efb9ba13414ea164b37 P 4a44f405300f4861aa0811f98bee968a: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.010s
I20260709 13:06:34.187091 18839 raft_consensus.cc:359] T 41caf625eaae4efb9ba13414ea164b37 P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.187995 18839 raft_consensus.cc:385] T 41caf625eaae4efb9ba13414ea164b37 P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.188350 18839 raft_consensus.cc:740] T 41caf625eaae4efb9ba13414ea164b37 P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a44f405300f4861aa0811f98bee968a, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.189339 18837 tablet_bootstrap.cc:654] T dc7b1a7c632e46ee94329768417eeca3 P 167d0284e4ed49f4a0860255531076c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.189249 18839 consensus_queue.cc:260] T 41caf625eaae4efb9ba13414ea164b37 P 4a44f405300f4861aa0811f98bee968a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.192327 18839 ts_tablet_manager.cc:1434] T 41caf625eaae4efb9ba13414ea164b37 P 4a44f405300f4861aa0811f98bee968a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:06:34.192559 18673 heartbeater.cc:499] Master 127.8.4.126:40303 was elected leader, sending a full tablet report...
I20260709 13:06:34.193543 18838 raft_consensus.cc:359] T 41caf625eaae4efb9ba13414ea164b37 P c7d6db765e304bd887f9ff6203db284d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.195765 18838 raft_consensus.cc:385] T 41caf625eaae4efb9ba13414ea164b37 P c7d6db765e304bd887f9ff6203db284d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.196120 18838 raft_consensus.cc:740] T 41caf625eaae4efb9ba13414ea164b37 P c7d6db765e304bd887f9ff6203db284d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7d6db765e304bd887f9ff6203db284d, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.196915 18838 consensus_queue.cc:260] T 41caf625eaae4efb9ba13414ea164b37 P c7d6db765e304bd887f9ff6203db284d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.198400 18837 tablet_bootstrap.cc:492] T dc7b1a7c632e46ee94329768417eeca3 P 167d0284e4ed49f4a0860255531076c7: No bootstrap required, opened a new log
I20260709 13:06:34.199136 18837 ts_tablet_manager.cc:1403] T dc7b1a7c632e46ee94329768417eeca3 P 167d0284e4ed49f4a0860255531076c7: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:06:34.199836 18748 heartbeater.cc:499] Master 127.8.4.126:40303 was elected leader, sending a full tablet report...
I20260709 13:06:34.193696 18839 tablet_bootstrap.cc:492] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a: Bootstrap starting.
I20260709 13:06:34.202102 18838 ts_tablet_manager.cc:1434] T 41caf625eaae4efb9ba13414ea164b37 P c7d6db765e304bd887f9ff6203db284d: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:06:34.203239 18838 tablet_bootstrap.cc:492] T dc7b1a7c632e46ee94329768417eeca3 P c7d6db765e304bd887f9ff6203db284d: Bootstrap starting.
I20260709 13:06:34.202775 18837 raft_consensus.cc:359] T dc7b1a7c632e46ee94329768417eeca3 P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } } peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } }
I20260709 13:06:34.203756 18837 raft_consensus.cc:385] T dc7b1a7c632e46ee94329768417eeca3 P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.204162 18837 raft_consensus.cc:740] T dc7b1a7c632e46ee94329768417eeca3 P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 167d0284e4ed49f4a0860255531076c7, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.205344 18837 consensus_queue.cc:260] T dc7b1a7c632e46ee94329768417eeca3 P 167d0284e4ed49f4a0860255531076c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } } peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } }
I20260709 13:06:34.208555 18837 ts_tablet_manager.cc:1434] T dc7b1a7c632e46ee94329768417eeca3 P 167d0284e4ed49f4a0860255531076c7: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:06:34.209350 18839 tablet_bootstrap.cc:654] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.210508 18838 tablet_bootstrap.cc:654] T dc7b1a7c632e46ee94329768417eeca3 P c7d6db765e304bd887f9ff6203db284d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.221637 18839 tablet_bootstrap.cc:492] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a: No bootstrap required, opened a new log
I20260709 13:06:34.222273 18839 ts_tablet_manager.cc:1403] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.007s
I20260709 13:06:34.224263 18838 tablet_bootstrap.cc:492] T dc7b1a7c632e46ee94329768417eeca3 P c7d6db765e304bd887f9ff6203db284d: No bootstrap required, opened a new log
I20260709 13:06:34.224992 18838 ts_tablet_manager.cc:1403] T dc7b1a7c632e46ee94329768417eeca3 P c7d6db765e304bd887f9ff6203db284d: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.005s
I20260709 13:06:34.224857 18839 raft_consensus.cc:359] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } } peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } }
I20260709 13:06:34.225710 18839 raft_consensus.cc:385] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.225975 18839 raft_consensus.cc:740] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a44f405300f4861aa0811f98bee968a, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.226714 18839 consensus_queue.cc:260] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } } peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } }
I20260709 13:06:34.228682 18839 ts_tablet_manager.cc:1434] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.002s
I20260709 13:06:34.228147 18838 raft_consensus.cc:359] T dc7b1a7c632e46ee94329768417eeca3 P c7d6db765e304bd887f9ff6203db284d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } } peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } }
I20260709 13:06:34.229175 18838 raft_consensus.cc:385] T dc7b1a7c632e46ee94329768417eeca3 P c7d6db765e304bd887f9ff6203db284d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.229507 18838 raft_consensus.cc:740] T dc7b1a7c632e46ee94329768417eeca3 P c7d6db765e304bd887f9ff6203db284d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7d6db765e304bd887f9ff6203db284d, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.230373 18838 consensus_queue.cc:260] T dc7b1a7c632e46ee94329768417eeca3 P c7d6db765e304bd887f9ff6203db284d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } } peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } }
I20260709 13:06:34.232493 18838 ts_tablet_manager.cc:1434] T dc7b1a7c632e46ee94329768417eeca3 P c7d6db765e304bd887f9ff6203db284d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:06:34.253217 18841 raft_consensus.cc:493] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.253888 18841 raft_consensus.cc:515] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.256079 18841 leader_election.cc:290] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a44f405300f4861aa0811f98bee968a (127.8.4.65:36957), c7d6db765e304bd887f9ff6203db284d (127.8.4.66:46353)
I20260709 13:06:34.267825 18648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41caf625eaae4efb9ba13414ea164b37" candidate_uuid: "167d0284e4ed49f4a0860255531076c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a44f405300f4861aa0811f98bee968a" is_pre_election: true
I20260709 13:06:34.268433 18723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41caf625eaae4efb9ba13414ea164b37" candidate_uuid: "167d0284e4ed49f4a0860255531076c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7d6db765e304bd887f9ff6203db284d" is_pre_election: true
I20260709 13:06:34.269359 18648 raft_consensus.cc:2468] T 41caf625eaae4efb9ba13414ea164b37 P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 167d0284e4ed49f4a0860255531076c7 in term 0.
I20260709 13:06:34.269711 18723 raft_consensus.cc:2468] T 41caf625eaae4efb9ba13414ea164b37 P c7d6db765e304bd887f9ff6203db284d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 167d0284e4ed49f4a0860255531076c7 in term 0.
I20260709 13:06:34.271410 18761 leader_election.cc:304] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167d0284e4ed49f4a0860255531076c7, 4a44f405300f4861aa0811f98bee968a; no voters: 
I20260709 13:06:34.273180 18841 raft_consensus.cc:2804] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.273941 18841 raft_consensus.cc:493] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.274359 18841 raft_consensus.cc:3060] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.281332 18841 raft_consensus.cc:515] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.283622 18841 leader_election.cc:290] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 [CANDIDATE]: Term 1 election: Requested vote from peers 4a44f405300f4861aa0811f98bee968a (127.8.4.65:36957), c7d6db765e304bd887f9ff6203db284d (127.8.4.66:46353)
I20260709 13:06:34.284801 18648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41caf625eaae4efb9ba13414ea164b37" candidate_uuid: "167d0284e4ed49f4a0860255531076c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a44f405300f4861aa0811f98bee968a"
I20260709 13:06:34.285063 18723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41caf625eaae4efb9ba13414ea164b37" candidate_uuid: "167d0284e4ed49f4a0860255531076c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7d6db765e304bd887f9ff6203db284d"
I20260709 13:06:34.285812 18648 raft_consensus.cc:3060] T 41caf625eaae4efb9ba13414ea164b37 P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.286042 18723 raft_consensus.cc:3060] T 41caf625eaae4efb9ba13414ea164b37 P c7d6db765e304bd887f9ff6203db284d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.290284 18844 raft_consensus.cc:493] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.290933 18844 raft_consensus.cc:515] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } } peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } }
I20260709 13:06:34.293565 18844 leader_election.cc:290] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 167d0284e4ed49f4a0860255531076c7 (127.8.4.67:43871), c7d6db765e304bd887f9ff6203db284d (127.8.4.66:46353)
I20260709 13:06:34.295063 18648 raft_consensus.cc:2468] T 41caf625eaae4efb9ba13414ea164b37 P 4a44f405300f4861aa0811f98bee968a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 167d0284e4ed49f4a0860255531076c7 in term 1.
I20260709 13:06:34.296626 18761 leader_election.cc:304] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167d0284e4ed49f4a0860255531076c7, 4a44f405300f4861aa0811f98bee968a; no voters: 
I20260709 13:06:34.298007 18841 raft_consensus.cc:2804] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:34.296763 18723 raft_consensus.cc:2468] T 41caf625eaae4efb9ba13414ea164b37 P c7d6db765e304bd887f9ff6203db284d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 167d0284e4ed49f4a0860255531076c7 in term 1.
I20260709 13:06:34.302436 18841 raft_consensus.cc:697] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 [term 1 LEADER]: Becoming Leader. State: Replica: 167d0284e4ed49f4a0860255531076c7, State: Running, Role: LEADER
I20260709 13:06:34.304188 18841 consensus_queue.cc:237] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.308751 18797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7b1a7c632e46ee94329768417eeca3" candidate_uuid: "4a44f405300f4861aa0811f98bee968a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167d0284e4ed49f4a0860255531076c7" is_pre_election: true
I20260709 13:06:34.309568 18797 raft_consensus.cc:2468] T dc7b1a7c632e46ee94329768417eeca3 P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a44f405300f4861aa0811f98bee968a in term 0.
I20260709 13:06:34.310767 18723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7b1a7c632e46ee94329768417eeca3" candidate_uuid: "4a44f405300f4861aa0811f98bee968a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7d6db765e304bd887f9ff6203db284d" is_pre_election: true
I20260709 13:06:34.311080 18614 leader_election.cc:304] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167d0284e4ed49f4a0860255531076c7, 4a44f405300f4861aa0811f98bee968a; no voters: 
I20260709 13:06:34.311851 18723 raft_consensus.cc:2468] T dc7b1a7c632e46ee94329768417eeca3 P c7d6db765e304bd887f9ff6203db284d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a44f405300f4861aa0811f98bee968a in term 0.
I20260709 13:06:34.312521 18844 raft_consensus.cc:2804] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.312994 18844 raft_consensus.cc:493] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.313410 18844 raft_consensus.cc:3060] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.314399 18546 catalog_manager.cc:5697] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 167d0284e4ed49f4a0860255531076c7 (127.8.4.67). New cstate: current_term: 1 leader_uuid: "167d0284e4ed49f4a0860255531076c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.319880 18844 raft_consensus.cc:515] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } } peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } }
I20260709 13:06:34.322959 18844 leader_election.cc:290] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a [CANDIDATE]: Term 1 election: Requested vote from peers 167d0284e4ed49f4a0860255531076c7 (127.8.4.67:43871), c7d6db765e304bd887f9ff6203db284d (127.8.4.66:46353)
I20260709 13:06:34.323418 18723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7b1a7c632e46ee94329768417eeca3" candidate_uuid: "4a44f405300f4861aa0811f98bee968a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7d6db765e304bd887f9ff6203db284d"
I20260709 13:06:34.323750 18797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7b1a7c632e46ee94329768417eeca3" candidate_uuid: "4a44f405300f4861aa0811f98bee968a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167d0284e4ed49f4a0860255531076c7"
I20260709 13:06:34.324080 18723 raft_consensus.cc:3060] T dc7b1a7c632e46ee94329768417eeca3 P c7d6db765e304bd887f9ff6203db284d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.324627 18797 raft_consensus.cc:3060] T dc7b1a7c632e46ee94329768417eeca3 P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.332499 18797 raft_consensus.cc:2468] T dc7b1a7c632e46ee94329768417eeca3 P 167d0284e4ed49f4a0860255531076c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a44f405300f4861aa0811f98bee968a in term 1.
I20260709 13:06:34.332499 18723 raft_consensus.cc:2468] T dc7b1a7c632e46ee94329768417eeca3 P c7d6db765e304bd887f9ff6203db284d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a44f405300f4861aa0811f98bee968a in term 1.
I20260709 13:06:34.334014 18611 leader_election.cc:304] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a44f405300f4861aa0811f98bee968a, c7d6db765e304bd887f9ff6203db284d; no voters: 
I20260709 13:06:34.335052 18844 raft_consensus.cc:2804] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:34.335994 18844 raft_consensus.cc:697] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a [term 1 LEADER]: Becoming Leader. State: Replica: 4a44f405300f4861aa0811f98bee968a, State: Running, Role: LEADER
I20260709 13:06:34.336730 18844 consensus_queue.cc:237] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } } peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } }
W20260709 13:06:34.344996 18594 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:34.344822 18546 catalog_manager.cc:5697] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a44f405300f4861aa0811f98bee968a (127.8.4.65). New cstate: current_term: 1 leader_uuid: "4a44f405300f4861aa0811f98bee968a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.391664 18546 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39332:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:34.393831 18546 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:34.422850 18637 tablet_service.cc:1511] Processing CreateTablet for tablet 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=80055d0e4b1240c4a2a7017d7a67a95d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:06:34.424263 18637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c05e3cd2d8e41dca0cbcb2f9ffa1c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:34.424589 18712 tablet_service.cc:1511] Processing CreateTablet for tablet 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=80055d0e4b1240c4a2a7017d7a67a95d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:06:34.425469 18787 tablet_service.cc:1511] Processing CreateTablet for tablet 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=80055d0e4b1240c4a2a7017d7a67a95d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:06:34.426100 18712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c05e3cd2d8e41dca0cbcb2f9ffa1c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:34.426833 18787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c05e3cd2d8e41dca0cbcb2f9ffa1c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:34.429813 18638 tablet_service.cc:1511] Processing CreateTablet for tablet 3073246b2b354f1b8a108bf8f10c4e1d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=80055d0e4b1240c4a2a7017d7a67a95d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:06:34.429883 18786 tablet_service.cc:1511] Processing CreateTablet for tablet 3073246b2b354f1b8a108bf8f10c4e1d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=80055d0e4b1240c4a2a7017d7a67a95d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:06:34.431486 18638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3073246b2b354f1b8a108bf8f10c4e1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:34.431516 18786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3073246b2b354f1b8a108bf8f10c4e1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:34.439939 18713 tablet_service.cc:1511] Processing CreateTablet for tablet 3073246b2b354f1b8a108bf8f10c4e1d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=80055d0e4b1240c4a2a7017d7a67a95d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:06:34.441485 18713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3073246b2b354f1b8a108bf8f10c4e1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:34.447635 18838 tablet_bootstrap.cc:492] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P c7d6db765e304bd887f9ff6203db284d: Bootstrap starting.
I20260709 13:06:34.454586 18838 tablet_bootstrap.cc:654] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P c7d6db765e304bd887f9ff6203db284d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.455483 18837 tablet_bootstrap.cc:492] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 167d0284e4ed49f4a0860255531076c7: Bootstrap starting.
I20260709 13:06:34.462248 18837 tablet_bootstrap.cc:654] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 167d0284e4ed49f4a0860255531076c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.467955 18838 tablet_bootstrap.cc:492] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P c7d6db765e304bd887f9ff6203db284d: No bootstrap required, opened a new log
I20260709 13:06:34.468184 18839 tablet_bootstrap.cc:492] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a: Bootstrap starting.
I20260709 13:06:34.468531 18838 ts_tablet_manager.cc:1403] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P c7d6db765e304bd887f9ff6203db284d: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.005s
I20260709 13:06:34.472654 18838 raft_consensus.cc:359] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P c7d6db765e304bd887f9ff6203db284d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.474257 18838 raft_consensus.cc:385] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P c7d6db765e304bd887f9ff6203db284d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.474779 18838 raft_consensus.cc:740] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P c7d6db765e304bd887f9ff6203db284d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7d6db765e304bd887f9ff6203db284d, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.475757 18839 tablet_bootstrap.cc:654] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.476065 18838 consensus_queue.cc:260] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P c7d6db765e304bd887f9ff6203db284d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.479794 18838 ts_tablet_manager.cc:1434] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P c7d6db765e304bd887f9ff6203db284d: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:06:34.480930 18838 tablet_bootstrap.cc:492] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d: Bootstrap starting.
I20260709 13:06:34.487244 18837 tablet_bootstrap.cc:492] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 167d0284e4ed49f4a0860255531076c7: No bootstrap required, opened a new log
I20260709 13:06:34.487844 18837 ts_tablet_manager.cc:1403] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 167d0284e4ed49f4a0860255531076c7: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.006s
I20260709 13:06:34.489174 18838 tablet_bootstrap.cc:654] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.491168 18839 tablet_bootstrap.cc:492] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a: No bootstrap required, opened a new log
I20260709 13:06:34.491137 18837 raft_consensus.cc:359] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.491945 18839 ts_tablet_manager.cc:1403] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.005s
I20260709 13:06:34.492110 18837 raft_consensus.cc:385] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.492527 18837 raft_consensus.cc:740] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 167d0284e4ed49f4a0860255531076c7, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.493491 18837 consensus_queue.cc:260] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 167d0284e4ed49f4a0860255531076c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.495339 18838 tablet_bootstrap.cc:492] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d: No bootstrap required, opened a new log
I20260709 13:06:34.495893 18837 ts_tablet_manager.cc:1434] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 167d0284e4ed49f4a0860255531076c7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:34.495339 18839 raft_consensus.cc:359] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.496057 18838 ts_tablet_manager.cc:1403] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:06:34.496379 18839 raft_consensus.cc:385] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.496784 18839 raft_consensus.cc:740] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a44f405300f4861aa0811f98bee968a, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.497119 18837 tablet_bootstrap.cc:492] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7: Bootstrap starting.
I20260709 13:06:34.497991 18839 consensus_queue.cc:260] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.500464 18838 raft_consensus.cc:359] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.501351 18838 raft_consensus.cc:385] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.501904 18838 raft_consensus.cc:740] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7d6db765e304bd887f9ff6203db284d, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.502993 18838 consensus_queue.cc:260] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.505342 18837 tablet_bootstrap.cc:654] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.506690 18838 ts_tablet_manager.cc:1434] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:06:34.509934 18839 ts_tablet_manager.cc:1434] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.003s
I20260709 13:06:34.511689 18839 tablet_bootstrap.cc:492] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a: Bootstrap starting.
I20260709 13:06:34.520005 18839 tablet_bootstrap.cc:654] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:34.524423 18837 tablet_bootstrap.cc:492] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7: No bootstrap required, opened a new log
I20260709 13:06:34.525364 18837 ts_tablet_manager.cc:1403] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.011s
I20260709 13:06:34.526221 18839 tablet_bootstrap.cc:492] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a: No bootstrap required, opened a new log
I20260709 13:06:34.526789 18839 ts_tablet_manager.cc:1403] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:06:34.528364 18837 raft_consensus.cc:359] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.529294 18837 raft_consensus.cc:385] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.529606 18837 raft_consensus.cc:740] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 167d0284e4ed49f4a0860255531076c7, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.529611 18839 raft_consensus.cc:359] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.530471 18839 raft_consensus.cc:385] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:34.530759 18839 raft_consensus.cc:740] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a44f405300f4861aa0811f98bee968a, State: Initialized, Role: FOLLOWER
I20260709 13:06:34.530586 18837 consensus_queue.cc:260] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.531569 18839 consensus_queue.cc:260] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.533890 18839 ts_tablet_manager.cc:1434] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:06:34.534581 18837 ts_tablet_manager.cc:1434] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:06:34.569531 18846 raft_consensus.cc:493] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.570168 18846 raft_consensus.cc:515] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.572459 18846 leader_election.cc:290] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a44f405300f4861aa0811f98bee968a (127.8.4.65:36957), 167d0284e4ed49f4a0860255531076c7 (127.8.4.67:43871)
I20260709 13:06:34.585449 18797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3073246b2b354f1b8a108bf8f10c4e1d" candidate_uuid: "c7d6db765e304bd887f9ff6203db284d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167d0284e4ed49f4a0860255531076c7" is_pre_election: true
I20260709 13:06:34.585675 18841 raft_consensus.cc:493] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.585490 18648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3073246b2b354f1b8a108bf8f10c4e1d" candidate_uuid: "c7d6db765e304bd887f9ff6203db284d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a44f405300f4861aa0811f98bee968a" is_pre_election: true
I20260709 13:06:34.586702 18648 raft_consensus.cc:2468] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7d6db765e304bd887f9ff6203db284d in term 0.
I20260709 13:06:34.586625 18841 raft_consensus.cc:515] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.587795 18797 raft_consensus.cc:2468] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7d6db765e304bd887f9ff6203db284d in term 0.
I20260709 13:06:34.588028 18687 leader_election.cc:304] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a44f405300f4861aa0811f98bee968a, c7d6db765e304bd887f9ff6203db284d; no voters: 
I20260709 13:06:34.589063 18846 raft_consensus.cc:2804] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.589509 18846 raft_consensus.cc:493] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.589848 18846 raft_consensus.cc:3060] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.590052 18648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3073246b2b354f1b8a108bf8f10c4e1d" candidate_uuid: "167d0284e4ed49f4a0860255531076c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a44f405300f4861aa0811f98bee968a" is_pre_election: true
I20260709 13:06:34.590777 18648 raft_consensus.cc:2468] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 167d0284e4ed49f4a0860255531076c7 in term 0.
I20260709 13:06:34.591432 18723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3073246b2b354f1b8a108bf8f10c4e1d" candidate_uuid: "167d0284e4ed49f4a0860255531076c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7d6db765e304bd887f9ff6203db284d" is_pre_election: true
I20260709 13:06:34.589775 18841 leader_election.cc:290] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a44f405300f4861aa0811f98bee968a (127.8.4.65:36957), c7d6db765e304bd887f9ff6203db284d (127.8.4.66:46353)
I20260709 13:06:34.592157 18761 leader_election.cc:304] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167d0284e4ed49f4a0860255531076c7, 4a44f405300f4861aa0811f98bee968a; no voters: 
I20260709 13:06:34.593197 18841 raft_consensus.cc:2804] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.593618 18841 raft_consensus.cc:493] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.594024 18841 raft_consensus.cc:3060] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.597216 18846 raft_consensus.cc:515] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.598356 18723 raft_consensus.cc:2393] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 167d0284e4ed49f4a0860255531076c7 in current term 1: Already voted for candidate c7d6db765e304bd887f9ff6203db284d in this term.
I20260709 13:06:34.600008 18846 leader_election.cc:290] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [CANDIDATE]: Term 1 election: Requested vote from peers 4a44f405300f4861aa0811f98bee968a (127.8.4.65:36957), 167d0284e4ed49f4a0860255531076c7 (127.8.4.67:43871)
I20260709 13:06:34.599838 18841 raft_consensus.cc:515] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.600272 18648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3073246b2b354f1b8a108bf8f10c4e1d" candidate_uuid: "c7d6db765e304bd887f9ff6203db284d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a44f405300f4861aa0811f98bee968a"
I20260709 13:06:34.601095 18648 raft_consensus.cc:3060] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.601487 18797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3073246b2b354f1b8a108bf8f10c4e1d" candidate_uuid: "c7d6db765e304bd887f9ff6203db284d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167d0284e4ed49f4a0860255531076c7"
I20260709 13:06:34.602468 18797 raft_consensus.cc:2393] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c7d6db765e304bd887f9ff6203db284d in current term 1: Already voted for candidate 167d0284e4ed49f4a0860255531076c7 in this term.
I20260709 13:06:34.602720 18841 leader_election.cc:290] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [CANDIDATE]: Term 1 election: Requested vote from peers 4a44f405300f4861aa0811f98bee968a (127.8.4.65:36957), c7d6db765e304bd887f9ff6203db284d (127.8.4.66:46353)
I20260709 13:06:34.602938 18647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3073246b2b354f1b8a108bf8f10c4e1d" candidate_uuid: "167d0284e4ed49f4a0860255531076c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a44f405300f4861aa0811f98bee968a"
I20260709 13:06:34.604760 18723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3073246b2b354f1b8a108bf8f10c4e1d" candidate_uuid: "167d0284e4ed49f4a0860255531076c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7d6db765e304bd887f9ff6203db284d"
I20260709 13:06:34.605444 18723 raft_consensus.cc:2393] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 167d0284e4ed49f4a0860255531076c7 in current term 1: Already voted for candidate c7d6db765e304bd887f9ff6203db284d in this term.
I20260709 13:06:34.606392 18760 leader_election.cc:304] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 167d0284e4ed49f4a0860255531076c7; no voters: 4a44f405300f4861aa0811f98bee968a, c7d6db765e304bd887f9ff6203db284d
I20260709 13:06:34.607090 18841 raft_consensus.cc:2749] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:34.607939 18648 raft_consensus.cc:2468] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7d6db765e304bd887f9ff6203db284d in term 1.
I20260709 13:06:34.608978 18687 leader_election.cc:304] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a44f405300f4861aa0811f98bee968a, c7d6db765e304bd887f9ff6203db284d; no voters: 167d0284e4ed49f4a0860255531076c7
I20260709 13:06:34.610034 18846 raft_consensus.cc:2804] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:34.610925 18846 raft_consensus.cc:697] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 1 LEADER]: Becoming Leader. State: Replica: c7d6db765e304bd887f9ff6203db284d, State: Running, Role: LEADER
I20260709 13:06:34.611770 18846 consensus_queue.cc:237] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.619340 18546 catalog_manager.cc:5697] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d reported cstate change: term changed from 0 to 1, leader changed from <none> to c7d6db765e304bd887f9ff6203db284d (127.8.4.66). New cstate: current_term: 1 leader_uuid: "c7d6db765e304bd887f9ff6203db284d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.701777 18844 raft_consensus.cc:493] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.702360 18844 raft_consensus.cc:515] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.704541 18844 leader_election.cc:290] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7d6db765e304bd887f9ff6203db284d (127.8.4.66:46353), 167d0284e4ed49f4a0860255531076c7 (127.8.4.67:43871)
I20260709 13:06:34.705468 18723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c05e3cd2d8e41dca0cbcb2f9ffa1c34" candidate_uuid: "4a44f405300f4861aa0811f98bee968a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7d6db765e304bd887f9ff6203db284d" is_pre_election: true
I20260709 13:06:34.705690 18797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c05e3cd2d8e41dca0cbcb2f9ffa1c34" candidate_uuid: "4a44f405300f4861aa0811f98bee968a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167d0284e4ed49f4a0860255531076c7" is_pre_election: true
I20260709 13:06:34.706308 18797 raft_consensus.cc:2468] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a44f405300f4861aa0811f98bee968a in term 0.
I20260709 13:06:34.706308 18723 raft_consensus.cc:2468] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P c7d6db765e304bd887f9ff6203db284d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a44f405300f4861aa0811f98bee968a in term 0.
I20260709 13:06:34.707692 18614 leader_election.cc:304] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167d0284e4ed49f4a0860255531076c7, 4a44f405300f4861aa0811f98bee968a; no voters: 
I20260709 13:06:34.708915 18844 raft_consensus.cc:2804] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:34.709470 18844 raft_consensus.cc:493] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.709801 18844 raft_consensus.cc:3060] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.715786 18844 raft_consensus.cc:515] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.717974 18844 leader_election.cc:290] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a [CANDIDATE]: Term 1 election: Requested vote from peers c7d6db765e304bd887f9ff6203db284d (127.8.4.66:46353), 167d0284e4ed49f4a0860255531076c7 (127.8.4.67:43871)
I20260709 13:06:34.718766 18723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c05e3cd2d8e41dca0cbcb2f9ffa1c34" candidate_uuid: "4a44f405300f4861aa0811f98bee968a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7d6db765e304bd887f9ff6203db284d"
I20260709 13:06:34.719163 18797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c05e3cd2d8e41dca0cbcb2f9ffa1c34" candidate_uuid: "4a44f405300f4861aa0811f98bee968a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167d0284e4ed49f4a0860255531076c7"
I20260709 13:06:34.719501 18723 raft_consensus.cc:3060] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P c7d6db765e304bd887f9ff6203db284d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.719801 18797 raft_consensus.cc:3060] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 167d0284e4ed49f4a0860255531076c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:34.726544 18844 consensus_queue.cc:1048] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:34.727523 18797 raft_consensus.cc:2468] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 167d0284e4ed49f4a0860255531076c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a44f405300f4861aa0811f98bee968a in term 1.
I20260709 13:06:34.727523 18723 raft_consensus.cc:2468] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P c7d6db765e304bd887f9ff6203db284d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a44f405300f4861aa0811f98bee968a in term 1.
I20260709 13:06:34.729209 18614 leader_election.cc:304] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167d0284e4ed49f4a0860255531076c7, 4a44f405300f4861aa0811f98bee968a; no voters: 
I20260709 13:06:34.730075 18844 raft_consensus.cc:2804] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:34.730597 18844 raft_consensus.cc:697] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a [term 1 LEADER]: Becoming Leader. State: Replica: 4a44f405300f4861aa0811f98bee968a, State: Running, Role: LEADER
I20260709 13:06:34.731664 18844 consensus_queue.cc:237] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:34.744565 18546 catalog_manager.cc:5697] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a44f405300f4861aa0811f98bee968a (127.8.4.65). New cstate: current_term: 1 leader_uuid: "4a44f405300f4861aa0811f98bee968a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.745754 18844 consensus_queue.cc:1048] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a [LEADER]: Connected to new peer: Peer: permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:34.759598 18841 consensus_queue.cc:1048] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:34.775344 18841 consensus_queue.cc:1048] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:34.808350 18722 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3073246b2b354f1b8a108bf8f10c4e1d"
dest_uuid: "c7d6db765e304bd887f9ff6203db284d"
mode: GRACEFUL
new_leader_uuid: "4a44f405300f4861aa0811f98bee968a"
 from {username='slave'} at 127.0.0.1:40784
I20260709 13:06:34.808979 18722 raft_consensus.cc:606] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 1 LEADER]: Received request to transfer leadership to TS 4a44f405300f4861aa0811f98bee968a
W20260709 13:06:35.021400 18818 debug-util.cc:398] Leaking SignalData structure 0x7b0800194fc0 after lost signal to thread 8212
I20260709 13:06:35.071410 18846 consensus_queue.cc:1048] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [LEADER]: Connected to new peer: Peer: permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:35.086567 18846 consensus_queue.cc:1048] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:35.097965 18883 raft_consensus.cc:993] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d: : Instructing follower 4a44f405300f4861aa0811f98bee968a to start an election
I20260709 13:06:35.098522 18846 raft_consensus.cc:1081] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 1 LEADER]: Signalling peer 4a44f405300f4861aa0811f98bee968a to start an election
I20260709 13:06:35.100850 18648 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3073246b2b354f1b8a108bf8f10c4e1d"
dest_uuid: "4a44f405300f4861aa0811f98bee968a"
 from {username='slave'} at 127.0.0.1:47432
I20260709 13:06:35.101761 18648 raft_consensus.cc:493] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:35.102296 18648 raft_consensus.cc:3060] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.112635 18648 raft_consensus.cc:515] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:35.116158 18722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3073246b2b354f1b8a108bf8f10c4e1d" candidate_uuid: "4a44f405300f4861aa0811f98bee968a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7d6db765e304bd887f9ff6203db284d"
I20260709 13:06:35.116864 18722 raft_consensus.cc:3055] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:35.117276 18722 raft_consensus.cc:740] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7d6db765e304bd887f9ff6203db284d, State: Running, Role: LEADER
I20260709 13:06:35.117028 18648 leader_election.cc:290] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [CANDIDATE]: Term 2 election: Requested vote from peers c7d6db765e304bd887f9ff6203db284d (127.8.4.66:46353), 167d0284e4ed49f4a0860255531076c7 (127.8.4.67:43871)
I20260709 13:06:35.118422 18722 consensus_queue.cc:260] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:35.119820 18722 raft_consensus.cc:3060] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.120692 18797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3073246b2b354f1b8a108bf8f10c4e1d" candidate_uuid: "4a44f405300f4861aa0811f98bee968a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "167d0284e4ed49f4a0860255531076c7"
I20260709 13:06:35.121507 18797 raft_consensus.cc:3060] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.126811 18722 raft_consensus.cc:2468] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a44f405300f4861aa0811f98bee968a in term 2.
I20260709 13:06:35.128173 18611 leader_election.cc:304] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a44f405300f4861aa0811f98bee968a, c7d6db765e304bd887f9ff6203db284d; no voters: 
I20260709 13:06:35.129246 18844 raft_consensus.cc:2804] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:35.129771 18844 raft_consensus.cc:697] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [term 2 LEADER]: Becoming Leader. State: Replica: 4a44f405300f4861aa0811f98bee968a, State: Running, Role: LEADER
I20260709 13:06:35.130677 18844 consensus_queue.cc:237] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:35.131353 18797 raft_consensus.cc:2468] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a44f405300f4861aa0811f98bee968a in term 2.
I20260709 13:06:35.137885 18545 catalog_manager.cc:5697] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a reported cstate change: term changed from 1 to 2, leader changed from c7d6db765e304bd887f9ff6203db284d (127.8.4.66) to 4a44f405300f4861aa0811f98bee968a (127.8.4.65). New cstate: current_term: 2 leader_uuid: "4a44f405300f4861aa0811f98bee968a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.201926 18844 consensus_queue.cc:1048] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:35.215529 18854 consensus_queue.cc:1048] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a [LEADER]: Connected to new peer: Peer: permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:35.298492  8209 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:06:35.300237  8209 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:06:35.300693  8209 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:06:35.317354 18648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3073246b2b354f1b8a108bf8f10c4e1d"
dest_uuid: "4a44f405300f4861aa0811f98bee968a"
mode: GRACEFUL
new_leader_uuid: "c7d6db765e304bd887f9ff6203db284d"
 from {username='slave'} at 127.0.0.1:47436
I20260709 13:06:35.318058 18648 raft_consensus.cc:606] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [term 2 LEADER]: Received request to transfer leadership to TS c7d6db765e304bd887f9ff6203db284d
I20260709 13:06:35.319792  8209 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:06:35.712982 18797 raft_consensus.cc:1275] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [term 2 FOLLOWER]: Refusing update from remote peer 4a44f405300f4861aa0811f98bee968a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:35.717087 18722 raft_consensus.cc:1275] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 2 FOLLOWER]: Refusing update from remote peer 4a44f405300f4861aa0811f98bee968a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:35.718698 18844 consensus_queue.cc:1048] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [LEADER]: Connected to new peer: Peer: permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:06:35.721973 18886 consensus_queue.cc:1048] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:35.782730 18886 raft_consensus.cc:993] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a: : Instructing follower c7d6db765e304bd887f9ff6203db284d to start an election
I20260709 13:06:35.783854 18844 raft_consensus.cc:1081] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [term 2 LEADER]: Signalling peer c7d6db765e304bd887f9ff6203db284d to start an election
I20260709 13:06:35.788986 18723 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3073246b2b354f1b8a108bf8f10c4e1d"
dest_uuid: "c7d6db765e304bd887f9ff6203db284d"
 from {username='slave'} at 127.0.0.1:40778
I20260709 13:06:35.795044 18723 raft_consensus.cc:493] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:35.795850 18723 raft_consensus.cc:3060] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.812588 18723 raft_consensus.cc:515] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:35.828715 18648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3073246b2b354f1b8a108bf8f10c4e1d" candidate_uuid: "c7d6db765e304bd887f9ff6203db284d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a44f405300f4861aa0811f98bee968a"
I20260709 13:06:35.829751 18648 raft_consensus.cc:3055] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:35.830128 18648 raft_consensus.cc:740] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a44f405300f4861aa0811f98bee968a, State: Running, Role: LEADER
I20260709 13:06:35.831355 18648 consensus_queue.cc:260] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:35.832526 18796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3073246b2b354f1b8a108bf8f10c4e1d" candidate_uuid: "c7d6db765e304bd887f9ff6203db284d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "167d0284e4ed49f4a0860255531076c7"
I20260709 13:06:35.832810 18648 raft_consensus.cc:3060] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.833395 18796 raft_consensus.cc:3060] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.841248 18723 leader_election.cc:290] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [CANDIDATE]: Term 3 election: Requested vote from peers 4a44f405300f4861aa0811f98bee968a (127.8.4.65:36957), 167d0284e4ed49f4a0860255531076c7 (127.8.4.67:43871)
I20260709 13:06:35.843080 18648 raft_consensus.cc:2468] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7d6db765e304bd887f9ff6203db284d in term 3.
I20260709 13:06:35.844839 18687 leader_election.cc:304] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a44f405300f4861aa0811f98bee968a, c7d6db765e304bd887f9ff6203db284d; no voters: 
I20260709 13:06:35.845844 18893 raft_consensus.cc:2804] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:35.846515 18796 raft_consensus.cc:2468] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7d6db765e304bd887f9ff6203db284d in term 3.
I20260709 13:06:35.847175 18893 raft_consensus.cc:697] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 3 LEADER]: Becoming Leader. State: Replica: c7d6db765e304bd887f9ff6203db284d, State: Running, Role: LEADER
I20260709 13:06:35.848625 18893 consensus_queue.cc:237] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } }
I20260709 13:06:35.856400 18543 catalog_manager.cc:5697] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d reported cstate change: term changed from 2 to 3, leader changed from 4a44f405300f4861aa0811f98bee968a (127.8.4.65) to c7d6db765e304bd887f9ff6203db284d (127.8.4.66). New cstate: current_term: 3 leader_uuid: "c7d6db765e304bd887f9ff6203db284d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a44f405300f4861aa0811f98bee968a" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 36957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7d6db765e304bd887f9ff6203db284d" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 46353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "167d0284e4ed49f4a0860255531076c7" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 43871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:36.040058  8209 tablet_server.cc:179] TabletServer@127.8.4.65:0 shutting down...
I20260709 13:06:36.078423  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:36.079591  8209 tablet_replica.cc:333] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a: stopping tablet replica
I20260709 13:06:36.080801  8209 raft_consensus.cc:2243] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:36.081482  8209 raft_consensus.cc:2272] T 3073246b2b354f1b8a108bf8f10c4e1d P 4a44f405300f4861aa0811f98bee968a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:36.086445  8209 tablet_replica.cc:333] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a: stopping tablet replica
I20260709 13:06:36.087450  8209 raft_consensus.cc:2243] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:36.089205  8209 raft_consensus.cc:2272] T dc7b1a7c632e46ee94329768417eeca3 P 4a44f405300f4861aa0811f98bee968a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:36.093636  8209 tablet_replica.cc:333] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a: stopping tablet replica
I20260709 13:06:36.094452  8209 raft_consensus.cc:2243] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:36.095788  8209 raft_consensus.cc:2272] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 4a44f405300f4861aa0811f98bee968a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:36.100936  8209 tablet_replica.cc:333] T 41caf625eaae4efb9ba13414ea164b37 P 4a44f405300f4861aa0811f98bee968a: stopping tablet replica
I20260709 13:06:36.101783  8209 raft_consensus.cc:2243] T 41caf625eaae4efb9ba13414ea164b37 P 4a44f405300f4861aa0811f98bee968a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:36.102532  8209 raft_consensus.cc:2272] T 41caf625eaae4efb9ba13414ea164b37 P 4a44f405300f4861aa0811f98bee968a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:36.127012  8209 tablet_server.cc:196] TabletServer@127.8.4.65:0 shutdown complete.
I20260709 13:06:36.154343  8209 tablet_server.cc:179] TabletServer@127.8.4.66:0 shutting down...
W20260709 13:06:36.190789 18760 consensus_peers.cc:597] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 -> Peer c7d6db765e304bd887f9ff6203db284d (127.8.4.66:46353): Couldn't send request to peer c7d6db765e304bd887f9ff6203db284d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:36.194357  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:36.195473  8209 tablet_replica.cc:333] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d: stopping tablet replica
I20260709 13:06:36.196586  8209 raft_consensus.cc:2243] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:36.197575  8209 pending_rounds.cc:70] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d: Trying to abort 1 pending ops.
I20260709 13:06:36.197860  8209 pending_rounds.cc:77] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305635413404241920 op_type: NO_OP noop_request { }
I20260709 13:06:36.198272  8209 raft_consensus.cc:2889] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:06:36.198670  8209 raft_consensus.cc:2272] T 3073246b2b354f1b8a108bf8f10c4e1d P c7d6db765e304bd887f9ff6203db284d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:36.203410  8209 tablet_replica.cc:333] T dc7b1a7c632e46ee94329768417eeca3 P c7d6db765e304bd887f9ff6203db284d: stopping tablet replica
I20260709 13:06:36.204425  8209 raft_consensus.cc:2243] T dc7b1a7c632e46ee94329768417eeca3 P c7d6db765e304bd887f9ff6203db284d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:36.205188  8209 raft_consensus.cc:2272] T dc7b1a7c632e46ee94329768417eeca3 P c7d6db765e304bd887f9ff6203db284d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:36.209121  8209 tablet_replica.cc:333] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P c7d6db765e304bd887f9ff6203db284d: stopping tablet replica
I20260709 13:06:36.209925  8209 raft_consensus.cc:2243] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P c7d6db765e304bd887f9ff6203db284d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:36.210668  8209 raft_consensus.cc:2272] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P c7d6db765e304bd887f9ff6203db284d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:36.215535  8209 tablet_replica.cc:333] T 41caf625eaae4efb9ba13414ea164b37 P c7d6db765e304bd887f9ff6203db284d: stopping tablet replica
I20260709 13:06:36.216355  8209 raft_consensus.cc:2243] T 41caf625eaae4efb9ba13414ea164b37 P c7d6db765e304bd887f9ff6203db284d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:36.217131  8209 raft_consensus.cc:2272] T 41caf625eaae4efb9ba13414ea164b37 P c7d6db765e304bd887f9ff6203db284d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:36.231027 18761 consensus_peers.cc:597] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 -> Peer 4a44f405300f4861aa0811f98bee968a (127.8.4.65:36957): Couldn't send request to peer 4a44f405300f4861aa0811f98bee968a. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:36957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:36.252038  8209 tablet_server.cc:196] TabletServer@127.8.4.66:0 shutdown complete.
I20260709 13:06:36.287056  8209 tablet_server.cc:179] TabletServer@127.8.4.67:0 shutting down...
I20260709 13:06:36.327400  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:36.328460  8209 tablet_replica.cc:333] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7: stopping tablet replica
I20260709 13:06:36.329401  8209 raft_consensus.cc:2243] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:36.329975  8209 raft_consensus.cc:2272] T 3073246b2b354f1b8a108bf8f10c4e1d P 167d0284e4ed49f4a0860255531076c7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:36.333549  8209 tablet_replica.cc:333] T dc7b1a7c632e46ee94329768417eeca3 P 167d0284e4ed49f4a0860255531076c7: stopping tablet replica
I20260709 13:06:36.334367  8209 raft_consensus.cc:2243] T dc7b1a7c632e46ee94329768417eeca3 P 167d0284e4ed49f4a0860255531076c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:36.335024  8209 raft_consensus.cc:2272] T dc7b1a7c632e46ee94329768417eeca3 P 167d0284e4ed49f4a0860255531076c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:36.337889  8209 tablet_replica.cc:333] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 167d0284e4ed49f4a0860255531076c7: stopping tablet replica
I20260709 13:06:36.338550  8209 raft_consensus.cc:2243] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 167d0284e4ed49f4a0860255531076c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:36.339188  8209 raft_consensus.cc:2272] T 6c05e3cd2d8e41dca0cbcb2f9ffa1c34 P 167d0284e4ed49f4a0860255531076c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:36.342319  8209 tablet_replica.cc:333] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7: stopping tablet replica
I20260709 13:06:36.342888  8209 raft_consensus.cc:2243] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:36.344238  8209 raft_consensus.cc:2272] T 41caf625eaae4efb9ba13414ea164b37 P 167d0284e4ed49f4a0860255531076c7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:37.360968  8209 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 18818)
W20260709 13:06:38.361485  8209 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 18818)
I20260709 13:06:38.527545  8209 tablet_server.cc:196] TabletServer@127.8.4.67:0 shutdown complete.
I20260709 13:06:38.548996  8209 master.cc:562] Master@127.8.4.126:40303 shutting down...
I20260709 13:06:38.574610  8209 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:38.575273  8209 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:38.575620  8209 tablet_replica.cc:333] T 00000000000000000000000000000000 P 88463b68d68540a093f22be7a210b66b: stopping tablet replica
I20260709 13:06:38.597272  8209 master.cc:584] Master@127.8.4.126:40303 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (5447 ms)
[----------] 6 tests from LeaderRebalancerTest (303023 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:06:38.641259  8209 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.4.126:33837
I20260709 13:06:38.642483  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:38.648214 18903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:38.650024 18904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:38.650496 18906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:38.650647  8209 server_base.cc:1061] running on GCE node
I20260709 13:06:38.651759  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:38.651948  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:38.652066  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602398652055 us; error 0 us; skew 500 ppm
I20260709 13:06:38.652513  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:38.655148  8209 webserver.cc:533] Webserver started at http://127.8.4.126:44053/ using document root <none> and password file <none>
I20260709 13:06:38.655694  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:38.655855  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:38.656104  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:38.657370  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602095438975-8209-0/minicluster-data/master-0-root/instance:
uuid: "84787e84284744819b29a77db70cb0c7"
format_stamp: "Formatted at 2026-07-09 13:06:38 on dist-test-slave-008w"
I20260709 13:06:38.662127  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:06:38.666145 18911 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:38.667052  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:06:38.667425  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602095438975-8209-0/minicluster-data/master-0-root
uuid: "84787e84284744819b29a77db70cb0c7"
format_stamp: "Formatted at 2026-07-09 13:06:38 on dist-test-slave-008w"
I20260709 13:06:38.667878  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602095438975-8209-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602095438975-8209-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602095438975-8209-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:38.683921  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:38.685302  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:38.729492  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.126:33837
I20260709 13:06:38.729763 18962 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.126:33837 every 8 connection(s)
I20260709 13:06:38.733687 18963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:38.747246 18963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7: Bootstrap starting.
I20260709 13:06:38.753438 18963 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:38.758620 18963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7: No bootstrap required, opened a new log
I20260709 13:06:38.761307 18963 raft_consensus.cc:359] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84787e84284744819b29a77db70cb0c7" member_type: VOTER }
I20260709 13:06:38.761770 18963 raft_consensus.cc:385] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:38.761966 18963 raft_consensus.cc:740] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84787e84284744819b29a77db70cb0c7, State: Initialized, Role: FOLLOWER
I20260709 13:06:38.762653 18963 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84787e84284744819b29a77db70cb0c7" member_type: VOTER }
I20260709 13:06:38.763147 18963 raft_consensus.cc:399] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:06:38.763355 18963 raft_consensus.cc:493] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:06:38.763592 18963 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:38.769781 18963 raft_consensus.cc:515] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84787e84284744819b29a77db70cb0c7" member_type: VOTER }
I20260709 13:06:38.770565 18963 leader_election.cc:304] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 84787e84284744819b29a77db70cb0c7; no voters: 
I20260709 13:06:38.771898 18963 leader_election.cc:290] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:06:38.772436 18966 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:38.774549 18966 raft_consensus.cc:697] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7 [term 1 LEADER]: Becoming Leader. State: Replica: 84787e84284744819b29a77db70cb0c7, State: Running, Role: LEADER
I20260709 13:06:38.775385 18966 consensus_queue.cc:237] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84787e84284744819b29a77db70cb0c7" member_type: VOTER }
I20260709 13:06:38.775732 18963 sys_catalog.cc:565] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:06:38.780145 18967 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "84787e84284744819b29a77db70cb0c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84787e84284744819b29a77db70cb0c7" member_type: VOTER } }
I20260709 13:06:38.780987 18967 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:38.780876 18968 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84787e84284744819b29a77db70cb0c7. Latest consensus state: current_term: 1 leader_uuid: "84787e84284744819b29a77db70cb0c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84787e84284744819b29a77db70cb0c7" member_type: VOTER } }
I20260709 13:06:38.781612 18968 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:38.783540 18972 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:06:38.788919 18972 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:06:38.795331  8209 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:06:38.799535 18972 catalog_manager.cc:1383] Generated new cluster ID: 5655518f1cfa491ebd0b2cc9a2b21ef0
I20260709 13:06:38.799862 18972 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:06:38.829352 18972 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:06:38.830793 18972 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:06:38.852810 18972 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7: Generated new TSK 0
I20260709 13:06:38.853498 18972 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:06:38.863159  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:38.870290 18984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:38.870896 18985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:38.872546 18987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:38.873459  8209 server_base.cc:1061] running on GCE node
I20260709 13:06:38.874434  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:38.874626  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:38.874750  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602398874739 us; error 0 us; skew 500 ppm
I20260709 13:06:38.875262  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:38.877833  8209 webserver.cc:533] Webserver started at http://127.8.4.65:40133/ using document root <none> and password file <none>
I20260709 13:06:38.878284  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:38.878434  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:38.878645  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:38.879842  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602095438975-8209-0/minicluster-data/ts-0-root/instance:
uuid: "829e1719f453473c934e820685b7f6b7"
format_stamp: "Formatted at 2026-07-09 13:06:38 on dist-test-slave-008w"
I20260709 13:06:38.884518  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:06:38.888660 18992 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:38.889681  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:06:38.890038  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602095438975-8209-0/minicluster-data/ts-0-root
uuid: "829e1719f453473c934e820685b7f6b7"
format_stamp: "Formatted at 2026-07-09 13:06:38 on dist-test-slave-008w"
I20260709 13:06:38.890376  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602095438975-8209-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602095438975-8209-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602095438975-8209-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:38.914839  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:38.916365  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:38.918051  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:38.920588  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:38.920841  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:38.921134  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:38.921334  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:38.969080  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.65:45529
I20260709 13:06:38.969172 19054 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.65:45529 every 8 connection(s)
I20260709 13:06:38.975044  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:38.983189 19059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:38.987696 19060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:38.992893  8209 server_base.cc:1061] running on GCE node
W20260709 13:06:38.992997 19062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:38.994436  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:38.994817  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:38.995069  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602398994995 us; error 0 us; skew 500 ppm
I20260709 13:06:38.995851  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:38.999234 19055 heartbeater.cc:344] Connected to a master server at 127.8.4.126:33837
I20260709 13:06:38.999442  8209 webserver.cc:533] Webserver started at http://127.8.4.66:36805/ using document root <none> and password file <none>
I20260709 13:06:38.999689 19055 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:39.000154  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:39.000434  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:39.000640 19055 heartbeater.cc:507] Master 127.8.4.126:33837 requested a full tablet report, sending...
I20260709 13:06:39.000794  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:39.002593  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602095438975-8209-0/minicluster-data/ts-1-root/instance:
uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
format_stamp: "Formatted at 2026-07-09 13:06:38 on dist-test-slave-008w"
I20260709 13:06:39.003386 18928 ts_manager.cc:194] Registered new tserver with Master: 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529)
I20260709 13:06:39.006166 18928 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35728
I20260709 13:06:39.008144  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:06:39.013916 19067 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:39.014762  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:06:39.015111  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602095438975-8209-0/minicluster-data/ts-1-root
uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
format_stamp: "Formatted at 2026-07-09 13:06:38 on dist-test-slave-008w"
I20260709 13:06:39.015390  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602095438975-8209-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602095438975-8209-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602095438975-8209-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:39.035432  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:39.036754  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:39.038424  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:39.041277  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:39.041563  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:39.041858  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:39.042065  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:39.089176  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.66:36305
I20260709 13:06:39.089236 19129 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.66:36305 every 8 connection(s)
I20260709 13:06:39.095112  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:39.102905 19133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:39.104890 19134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:39.108560 19136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:39.108821 19130 heartbeater.cc:344] Connected to a master server at 127.8.4.126:33837
I20260709 13:06:39.109441 19130 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:39.110180  8209 server_base.cc:1061] running on GCE node
I20260709 13:06:39.110590 19130 heartbeater.cc:507] Master 127.8.4.126:33837 requested a full tablet report, sending...
I20260709 13:06:39.111265  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:39.111697  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:39.111922  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602399111908 us; error 0 us; skew 500 ppm
I20260709 13:06:39.112613  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:39.112725 18928 ts_manager.cc:194] Registered new tserver with Master: e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305)
I20260709 13:06:39.114585 18928 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35736
I20260709 13:06:39.115629  8209 webserver.cc:533] Webserver started at http://127.8.4.67:36497/ using document root <none> and password file <none>
I20260709 13:06:39.116294  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:39.116523  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:39.116900  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:39.118240  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602095438975-8209-0/minicluster-data/ts-2-root/instance:
uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
format_stamp: "Formatted at 2026-07-09 13:06:39 on dist-test-slave-008w"
I20260709 13:06:39.123154  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:06:39.126859 19141 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:39.127746  8209 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:06:39.128142  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602095438975-8209-0/minicluster-data/ts-2-root
uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
format_stamp: "Formatted at 2026-07-09 13:06:39 on dist-test-slave-008w"
I20260709 13:06:39.128468  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602095438975-8209-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602095438975-8209-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602095438975-8209-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:39.142381  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:39.143679  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:39.145331  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:39.147670  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:39.147912  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:39.148157  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:39.148330  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:39.198067  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.67:35263
I20260709 13:06:39.198184 19203 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.67:35263 every 8 connection(s)
I20260709 13:06:39.214663 19204 heartbeater.cc:344] Connected to a master server at 127.8.4.126:33837
I20260709 13:06:39.215269 19204 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:39.216157 19204 heartbeater.cc:507] Master 127.8.4.126:33837 requested a full tablet report, sending...
I20260709 13:06:39.218832 18928 ts_manager.cc:194] Registered new tserver with Master: b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:39.219275  8209 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017514175s
I20260709 13:06:39.220300 18928 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35740
I20260709 13:06:39.250687 18928 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35750:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:39.253628 18928 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:39.334156 19169 tablet_service.cc:1511] Processing CreateTablet for tablet 295fe2d1af3f488a804237a87ade77d0 (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:39.335943 19169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295fe2d1af3f488a804237a87ade77d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.341981 19168 tablet_service.cc:1511] Processing CreateTablet for tablet fd4e237e4d8346afbeea137b22b32ee8 (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:39.345168 19020 tablet_service.cc:1511] Processing CreateTablet for tablet 295fe2d1af3f488a804237a87ade77d0 (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:39.346925 19020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295fe2d1af3f488a804237a87ade77d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.347813 19015 tablet_service.cc:1511] Processing CreateTablet for tablet 77620febb9004ec1a7f17f8a2806b14c (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:39.349406 19015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77620febb9004ec1a7f17f8a2806b14c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.349068 19016 tablet_service.cc:1511] Processing CreateTablet for tablet 814b87b4c7be484da9237ef57482499e (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:39.350607 19016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814b87b4c7be484da9237ef57482499e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.351759 19014 tablet_service.cc:1511] Processing CreateTablet for tablet c9a84c1bc49d48edbd859279ba140f6e (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:39.353328 19014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a84c1bc49d48edbd859279ba140f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.354267 19017 tablet_service.cc:1511] Processing CreateTablet for tablet b85919020ef941829e15062e26562141 (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:39.355770 19017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85919020ef941829e15062e26562141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.358323 19013 tablet_service.cc:1511] Processing CreateTablet for tablet cca026d92b504d9688f93e9bf0769060 (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:39.358495 19018 tablet_service.cc:1511] Processing CreateTablet for tablet 2156d44a5901495290a7a79e622d0839 (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:39.359967 19013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cca026d92b504d9688f93e9bf0769060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.361238 19019 tablet_service.cc:1511] Processing CreateTablet for tablet fd4e237e4d8346afbeea137b22b32ee8 (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:39.363534 19012 tablet_service.cc:1511] Processing CreateTablet for tablet d09ea15f89c540ea8b5d66e1b68ca09f (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:39.365650 19168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd4e237e4d8346afbeea137b22b32ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.361884 19018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2156d44a5901495290a7a79e622d0839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.368003 19012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09ea15f89c540ea8b5d66e1b68ca09f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.369836 19019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd4e237e4d8346afbeea137b22b32ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.390841 19219 tablet_bootstrap.cc:492] T cca026d92b504d9688f93e9bf0769060 P 829e1719f453473c934e820685b7f6b7: Bootstrap starting.
I20260709 13:06:39.393170 19167 tablet_service.cc:1511] Processing CreateTablet for tablet 2156d44a5901495290a7a79e622d0839 (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:39.395707 19167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2156d44a5901495290a7a79e622d0839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.400815 19219 tablet_bootstrap.cc:654] T cca026d92b504d9688f93e9bf0769060 P 829e1719f453473c934e820685b7f6b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.403302 19166 tablet_service.cc:1511] Processing CreateTablet for tablet b85919020ef941829e15062e26562141 (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:39.405287 19166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85919020ef941829e15062e26562141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.405676 19164 tablet_service.cc:1511] Processing CreateTablet for tablet 77620febb9004ec1a7f17f8a2806b14c (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:39.407130 19164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77620febb9004ec1a7f17f8a2806b14c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.409701 19161 tablet_service.cc:1511] Processing CreateTablet for tablet d09ea15f89c540ea8b5d66e1b68ca09f (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:39.410298 19163 tablet_service.cc:1511] Processing CreateTablet for tablet c9a84c1bc49d48edbd859279ba140f6e (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:39.411646 19161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09ea15f89c540ea8b5d66e1b68ca09f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.413213 19162 tablet_service.cc:1511] Processing CreateTablet for tablet cca026d92b504d9688f93e9bf0769060 (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:39.414901 19162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cca026d92b504d9688f93e9bf0769060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.403410 19165 tablet_service.cc:1511] Processing CreateTablet for tablet 814b87b4c7be484da9237ef57482499e (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:39.418171 19165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814b87b4c7be484da9237ef57482499e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.421485 19163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a84c1bc49d48edbd859279ba140f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.458719 19093 tablet_service.cc:1511] Processing CreateTablet for tablet 2156d44a5901495290a7a79e622d0839 (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:39.458886 19092 tablet_service.cc:1511] Processing CreateTablet for tablet b85919020ef941829e15062e26562141 (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:39.460317 19093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2156d44a5901495290a7a79e622d0839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.462456 19090 tablet_service.cc:1511] Processing CreateTablet for tablet 77620febb9004ec1a7f17f8a2806b14c (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:39.463090 19095 tablet_service.cc:1511] Processing CreateTablet for tablet 295fe2d1af3f488a804237a87ade77d0 (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:39.464164 19090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77620febb9004ec1a7f17f8a2806b14c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.464879 19095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295fe2d1af3f488a804237a87ade77d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.466387 19094 tablet_service.cc:1511] Processing CreateTablet for tablet fd4e237e4d8346afbeea137b22b32ee8 (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:39.468022 19094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd4e237e4d8346afbeea137b22b32ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.468878 19092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85919020ef941829e15062e26562141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.471604 19089 tablet_service.cc:1511] Processing CreateTablet for tablet c9a84c1bc49d48edbd859279ba140f6e (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:39.460632 19091 tablet_service.cc:1511] Processing CreateTablet for tablet 814b87b4c7be484da9237ef57482499e (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:39.474372 19089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a84c1bc49d48edbd859279ba140f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.477490 19091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814b87b4c7be484da9237ef57482499e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.483013 19088 tablet_service.cc:1511] Processing CreateTablet for tablet cca026d92b504d9688f93e9bf0769060 (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:39.484673 19088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cca026d92b504d9688f93e9bf0769060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.486979 19087 tablet_service.cc:1511] Processing CreateTablet for tablet d09ea15f89c540ea8b5d66e1b68ca09f (DEFAULT_TABLE table=test-workload [id=f482d8f67b5340d1a5169812f28b5261]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:39.491974 19087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09ea15f89c540ea8b5d66e1b68ca09f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:39.519233 19220 tablet_bootstrap.cc:492] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Bootstrap starting.
I20260709 13:06:39.539033 19219 tablet_bootstrap.cc:492] T cca026d92b504d9688f93e9bf0769060 P 829e1719f453473c934e820685b7f6b7: No bootstrap required, opened a new log
I20260709 13:06:39.539743 19219 ts_tablet_manager.cc:1403] T cca026d92b504d9688f93e9bf0769060 P 829e1719f453473c934e820685b7f6b7: Time spent bootstrapping tablet: real 0.151s	user 0.022s	sys 0.026s
I20260709 13:06:39.543217 19219 raft_consensus.cc:359] T cca026d92b504d9688f93e9bf0769060 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.544003 19219 raft_consensus.cc:385] T cca026d92b504d9688f93e9bf0769060 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.544317 19219 raft_consensus.cc:740] T cca026d92b504d9688f93e9bf0769060 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.545567 19219 consensus_queue.cc:260] T cca026d92b504d9688f93e9bf0769060 P 829e1719f453473c934e820685b7f6b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.554574 19220 tablet_bootstrap.cc:654] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.571754 19055 heartbeater.cc:499] Master 127.8.4.126:33837 was elected leader, sending a full tablet report...
I20260709 13:06:39.578475 19219 ts_tablet_manager.cc:1434] T cca026d92b504d9688f93e9bf0769060 P 829e1719f453473c934e820685b7f6b7: Time spent starting tablet: real 0.038s	user 0.015s	sys 0.003s
I20260709 13:06:39.579381 19219 tablet_bootstrap.cc:492] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7: Bootstrap starting.
I20260709 13:06:39.586968 19219 tablet_bootstrap.cc:654] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.588411 19222 tablet_bootstrap.cc:492] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a: Bootstrap starting.
I20260709 13:06:39.595204 19223 raft_consensus.cc:493] T cca026d92b504d9688f93e9bf0769060 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.596072 19223 raft_consensus.cc:515] T cca026d92b504d9688f93e9bf0769060 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.604985 19223 leader_election.cc:290] T cca026d92b504d9688f93e9bf0769060 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:39.612798 19222 tablet_bootstrap.cc:654] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.625504 19219 tablet_bootstrap.cc:492] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7: No bootstrap required, opened a new log
I20260709 13:06:39.626258 19219 ts_tablet_manager.cc:1403] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7: Time spent bootstrapping tablet: real 0.047s	user 0.032s	sys 0.007s
I20260709 13:06:39.628602 19222 tablet_bootstrap.cc:492] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a: No bootstrap required, opened a new log
I20260709 13:06:39.628980 19220 tablet_bootstrap.cc:492] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: No bootstrap required, opened a new log
I20260709 13:06:39.629267 19222 ts_tablet_manager.cc:1403] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.003s
I20260709 13:06:39.629552 19220 ts_tablet_manager.cc:1403] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent bootstrapping tablet: real 0.111s	user 0.033s	sys 0.013s
I20260709 13:06:39.629535 19219 raft_consensus.cc:359] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } }
I20260709 13:06:39.630694 19219 raft_consensus.cc:385] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.631027 19219 raft_consensus.cc:740] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.631953 19219 consensus_queue.cc:260] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } }
I20260709 13:06:39.633445 19220 raft_consensus.cc:359] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.634271 19219 ts_tablet_manager.cc:1434] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:06:39.634334 19220 raft_consensus.cc:385] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.635728 19219 tablet_bootstrap.cc:492] T 814b87b4c7be484da9237ef57482499e P 829e1719f453473c934e820685b7f6b7: Bootstrap starting.
I20260709 13:06:39.635223 19222 raft_consensus.cc:359] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.635839 19220 raft_consensus.cc:740] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.636227 19222 raft_consensus.cc:385] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.636595 19222 raft_consensus.cc:740] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.636960 19220 consensus_queue.cc:260] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.637444 19222 consensus_queue.cc:260] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.643662 19219 tablet_bootstrap.cc:654] T 814b87b4c7be484da9237ef57482499e P 829e1719f453473c934e820685b7f6b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.643754 19179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca026d92b504d9688f93e9bf0769060" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" is_pre_election: true
W20260709 13:06:39.645965 18996 leader_election.cc:343] T cca026d92b504d9688f93e9bf0769060 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:39.651398 19204 heartbeater.cc:499] Master 127.8.4.126:33837 was elected leader, sending a full tablet report...
I20260709 13:06:39.665313 19105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca026d92b504d9688f93e9bf0769060" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" is_pre_election: true
W20260709 13:06:39.668284 18995 leader_election.cc:343] T cca026d92b504d9688f93e9bf0769060 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:39.669140 18995 leader_election.cc:304] T cca026d92b504d9688f93e9bf0769060 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 829e1719f453473c934e820685b7f6b7; no voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4, e39ee95ba5824b7ca83380fc4f0c596a
I20260709 13:06:39.670917 19223 raft_consensus.cc:2749] T cca026d92b504d9688f93e9bf0769060 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:39.671206 19220 ts_tablet_manager.cc:1434] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent starting tablet: real 0.041s	user 0.011s	sys 0.000s
I20260709 13:06:39.674146 19220 tablet_bootstrap.cc:492] T b85919020ef941829e15062e26562141 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Bootstrap starting.
I20260709 13:06:39.685278 19220 tablet_bootstrap.cc:654] T b85919020ef941829e15062e26562141 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.689532 19130 heartbeater.cc:499] Master 127.8.4.126:33837 was elected leader, sending a full tablet report...
I20260709 13:06:39.690235 19222 ts_tablet_manager.cc:1434] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a: Time spent starting tablet: real 0.061s	user 0.025s	sys 0.033s
I20260709 13:06:39.692016 19222 tablet_bootstrap.cc:492] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a: Bootstrap starting.
I20260709 13:06:39.699126 19220 tablet_bootstrap.cc:492] T b85919020ef941829e15062e26562141 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: No bootstrap required, opened a new log
I20260709 13:06:39.699276 19219 tablet_bootstrap.cc:492] T 814b87b4c7be484da9237ef57482499e P 829e1719f453473c934e820685b7f6b7: No bootstrap required, opened a new log
I20260709 13:06:39.699858 19219 ts_tablet_manager.cc:1403] T 814b87b4c7be484da9237ef57482499e P 829e1719f453473c934e820685b7f6b7: Time spent bootstrapping tablet: real 0.064s	user 0.020s	sys 0.036s
I20260709 13:06:39.699858 19220 ts_tablet_manager.cc:1403] T b85919020ef941829e15062e26562141 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.012s
I20260709 13:06:39.703754 19222 tablet_bootstrap.cc:654] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.703383 19220 raft_consensus.cc:359] T b85919020ef941829e15062e26562141 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.703565 19219 raft_consensus.cc:359] T 814b87b4c7be484da9237ef57482499e P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.704430 19220 raft_consensus.cc:385] T b85919020ef941829e15062e26562141 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.704457 19219 raft_consensus.cc:385] T 814b87b4c7be484da9237ef57482499e P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.705054 19220 raft_consensus.cc:740] T b85919020ef941829e15062e26562141 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.705087 19219 raft_consensus.cc:740] T 814b87b4c7be484da9237ef57482499e P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.706212 19220 consensus_queue.cc:260] T b85919020ef941829e15062e26562141 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.706212 19219 consensus_queue.cc:260] T 814b87b4c7be484da9237ef57482499e P 829e1719f453473c934e820685b7f6b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.709168 19220 ts_tablet_manager.cc:1434] T b85919020ef941829e15062e26562141 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:06:39.710412 19220 tablet_bootstrap.cc:492] T 77620febb9004ec1a7f17f8a2806b14c P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Bootstrap starting.
I20260709 13:06:39.714001 19219 ts_tablet_manager.cc:1434] T 814b87b4c7be484da9237ef57482499e P 829e1719f453473c934e820685b7f6b7: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.005s
I20260709 13:06:39.715360 19219 tablet_bootstrap.cc:492] T 77620febb9004ec1a7f17f8a2806b14c P 829e1719f453473c934e820685b7f6b7: Bootstrap starting.
I20260709 13:06:39.717365 19220 tablet_bootstrap.cc:654] T 77620febb9004ec1a7f17f8a2806b14c P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.721338 19222 tablet_bootstrap.cc:492] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a: No bootstrap required, opened a new log
I20260709 13:06:39.722020 19222 ts_tablet_manager.cc:1403] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.013s
I20260709 13:06:39.723464 19219 tablet_bootstrap.cc:654] T 77620febb9004ec1a7f17f8a2806b14c P 829e1719f453473c934e820685b7f6b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.725605 19222 raft_consensus.cc:359] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.726598 19222 raft_consensus.cc:385] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.726962 19222 raft_consensus.cc:740] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.727982 19222 consensus_queue.cc:260] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.730866 19222 ts_tablet_manager.cc:1434] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:39.731962 19222 tablet_bootstrap.cc:492] T 2156d44a5901495290a7a79e622d0839 P e39ee95ba5824b7ca83380fc4f0c596a: Bootstrap starting.
I20260709 13:06:39.739418 19222 tablet_bootstrap.cc:654] T 2156d44a5901495290a7a79e622d0839 P e39ee95ba5824b7ca83380fc4f0c596a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.743850 19220 tablet_bootstrap.cc:492] T 77620febb9004ec1a7f17f8a2806b14c P b2ef83e29a8e4e8694c3c7c2dd06f9d4: No bootstrap required, opened a new log
I20260709 13:06:39.743927 19219 tablet_bootstrap.cc:492] T 77620febb9004ec1a7f17f8a2806b14c P 829e1719f453473c934e820685b7f6b7: No bootstrap required, opened a new log
I20260709 13:06:39.745041 19220 ts_tablet_manager.cc:1403] T 77620febb9004ec1a7f17f8a2806b14c P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.021s
I20260709 13:06:39.745481 19219 ts_tablet_manager.cc:1403] T 77620febb9004ec1a7f17f8a2806b14c P 829e1719f453473c934e820685b7f6b7: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.016s
I20260709 13:06:39.749171 19222 tablet_bootstrap.cc:492] T 2156d44a5901495290a7a79e622d0839 P e39ee95ba5824b7ca83380fc4f0c596a: No bootstrap required, opened a new log
I20260709 13:06:39.748921 19220 raft_consensus.cc:359] T 77620febb9004ec1a7f17f8a2806b14c P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.749795 19222 ts_tablet_manager.cc:1403] T 2156d44a5901495290a7a79e622d0839 P e39ee95ba5824b7ca83380fc4f0c596a: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.005s
I20260709 13:06:39.749377 19219 raft_consensus.cc:359] T 77620febb9004ec1a7f17f8a2806b14c P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.750121 19220 raft_consensus.cc:385] T 77620febb9004ec1a7f17f8a2806b14c P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.750268 19219 raft_consensus.cc:385] T 77620febb9004ec1a7f17f8a2806b14c P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.750722 19220 raft_consensus.cc:740] T 77620febb9004ec1a7f17f8a2806b14c P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.750742 19219 raft_consensus.cc:740] T 77620febb9004ec1a7f17f8a2806b14c P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.751933 19220 consensus_queue.cc:260] T 77620febb9004ec1a7f17f8a2806b14c P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.752581 19219 consensus_queue.cc:260] T 77620febb9004ec1a7f17f8a2806b14c P 829e1719f453473c934e820685b7f6b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.753291 19222 raft_consensus.cc:359] T 2156d44a5901495290a7a79e622d0839 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.754150 19222 raft_consensus.cc:385] T 2156d44a5901495290a7a79e622d0839 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.754451 19222 raft_consensus.cc:740] T 2156d44a5901495290a7a79e622d0839 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.754551 19220 ts_tablet_manager.cc:1434] T 77620febb9004ec1a7f17f8a2806b14c P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:06:39.754976 19219 ts_tablet_manager.cc:1434] T 77620febb9004ec1a7f17f8a2806b14c P 829e1719f453473c934e820685b7f6b7: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:06:39.755879 19220 tablet_bootstrap.cc:492] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Bootstrap starting.
I20260709 13:06:39.756143 19219 tablet_bootstrap.cc:492] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7: Bootstrap starting.
I20260709 13:06:39.755352 19222 consensus_queue.cc:260] T 2156d44a5901495290a7a79e622d0839 P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.761374 19222 ts_tablet_manager.cc:1434] T 2156d44a5901495290a7a79e622d0839 P e39ee95ba5824b7ca83380fc4f0c596a: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 13:06:39.762786 19222 tablet_bootstrap.cc:492] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a: Bootstrap starting.
I20260709 13:06:39.763195 19219 tablet_bootstrap.cc:654] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.763976 19220 tablet_bootstrap.cc:654] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.772310 19222 tablet_bootstrap.cc:654] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:39.789918 18976 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:39.798171 19230 raft_consensus.cc:493] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.798851 19230 raft_consensus.cc:515] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.799218 19220 tablet_bootstrap.cc:492] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: No bootstrap required, opened a new log
I20260709 13:06:39.799386 19222 tablet_bootstrap.cc:492] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a: No bootstrap required, opened a new log
I20260709 13:06:39.800133 19220 ts_tablet_manager.cc:1403] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.021s
I20260709 13:06:39.800268 19222 ts_tablet_manager.cc:1403] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.021s
I20260709 13:06:39.800292 19219 tablet_bootstrap.cc:492] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7: No bootstrap required, opened a new log
I20260709 13:06:39.801882 19219 ts_tablet_manager.cc:1403] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.021s
I20260709 13:06:39.804237 19230 leader_election.cc:290] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:39.805269 19222 raft_consensus.cc:359] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.806296 19222 raft_consensus.cc:385] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.806648 19222 raft_consensus.cc:740] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.807215 19219 raft_consensus.cc:359] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.807780 19222 consensus_queue.cc:260] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.808542 19219 raft_consensus.cc:385] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.809154 19219 raft_consensus.cc:740] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.810763 19222 ts_tablet_manager.cc:1434] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:06:39.810144 19219 consensus_queue.cc:260] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.811868 19222 tablet_bootstrap.cc:492] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a: Bootstrap starting.
I20260709 13:06:39.813674 19219 ts_tablet_manager.cc:1434] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 13:06:39.813865 19220 raft_consensus.cc:359] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } }
I20260709 13:06:39.814841 19220 raft_consensus.cc:385] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.815187 19220 raft_consensus.cc:740] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.815449 19219 tablet_bootstrap.cc:492] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7: Bootstrap starting.
I20260709 13:06:39.816000 19220 consensus_queue.cc:260] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } }
I20260709 13:06:39.818506 19220 ts_tablet_manager.cc:1434] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 13:06:39.820039 19220 tablet_bootstrap.cc:492] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Bootstrap starting.
I20260709 13:06:39.824704 19219 tablet_bootstrap.cc:654] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.834681 19220 tablet_bootstrap.cc:654] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.837435 19030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85919020ef941829e15062e26562141" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7" is_pre_election: true
I20260709 13:06:39.838198 19219 tablet_bootstrap.cc:492] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7: No bootstrap required, opened a new log
I20260709 13:06:39.838769 19219 ts_tablet_manager.cc:1403] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.009s
W20260709 13:06:39.839481 19070 leader_election.cc:343] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:39.844309 19219 raft_consensus.cc:359] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.845175 19219 raft_consensus.cc:385] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.845477 19219 raft_consensus.cc:740] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.846268 19219 consensus_queue.cc:260] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.847086 19223 raft_consensus.cc:493] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.847862 19223 raft_consensus.cc:515] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.849032 19222 tablet_bootstrap.cc:654] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.849328 19230 raft_consensus.cc:493] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.849820 19230 raft_consensus.cc:515] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.852103 19230 leader_election.cc:290] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:39.853216 19105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2156d44a5901495290a7a79e622d0839" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" is_pre_election: true
I20260709 13:06:39.853627 19179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85919020ef941829e15062e26562141" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" is_pre_election: true
I20260709 13:06:39.854174 19105 raft_consensus.cc:2468] T 2156d44a5901495290a7a79e622d0839 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 829e1719f453473c934e820685b7f6b7 in term 0.
I20260709 13:06:39.854628 19179 raft_consensus.cc:2468] T b85919020ef941829e15062e26562141 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 0.
I20260709 13:06:39.857358 19030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77620febb9004ec1a7f17f8a2806b14c" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7" is_pre_election: true
I20260709 13:06:39.858351 19030 raft_consensus.cc:2468] T 77620febb9004ec1a7f17f8a2806b14c P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 0.
I20260709 13:06:39.860387 19070 leader_election.cc:304] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:39.861189 18995 leader_election.cc:304] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:39.862854 19245 raft_consensus.cc:2804] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:39.862948 19071 leader_election.cc:304] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 829e1719f453473c934e820685b7f6b7
I20260709 13:06:39.863409 19245 raft_consensus.cc:493] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.863803 19245 raft_consensus.cc:3060] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:39.864153 19179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77620febb9004ec1a7f17f8a2806b14c" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" is_pre_election: true
I20260709 13:06:39.865044 19179 raft_consensus.cc:2468] T 77620febb9004ec1a7f17f8a2806b14c P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 0.
I20260709 13:06:39.852703 19230 raft_consensus.cc:493] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.867311 19230 raft_consensus.cc:515] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.870324 19247 raft_consensus.cc:2804] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:39.870887 19247 raft_consensus.cc:493] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.871281 19247 raft_consensus.cc:3060] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:39.871683 19030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b87b4c7be484da9237ef57482499e" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7" is_pre_election: true
I20260709 13:06:39.872675 19030 raft_consensus.cc:2468] T 814b87b4c7be484da9237ef57482499e P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 0.
I20260709 13:06:39.874667 19070 leader_election.cc:304] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:39.876873 19179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2156d44a5901495290a7a79e622d0839" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" is_pre_election: true
I20260709 13:06:39.877379 19230 leader_election.cc:290] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:39.878415 19248 raft_consensus.cc:2804] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:06:39.878756 18996 leader_election.cc:343] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:39.878948 19248 raft_consensus.cc:493] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.880044 19223 leader_election.cc:290] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:39.880242 19248 raft_consensus.cc:3060] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:39.883296 19220 tablet_bootstrap.cc:492] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4: No bootstrap required, opened a new log
I20260709 13:06:39.883960 19220 ts_tablet_manager.cc:1403] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent bootstrapping tablet: real 0.064s	user 0.030s	sys 0.005s
I20260709 13:06:39.879292 19249 raft_consensus.cc:2804] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:39.885596 19249 raft_consensus.cc:493] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.885848 19222 tablet_bootstrap.cc:492] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a: No bootstrap required, opened a new log
I20260709 13:06:39.887070 19222 ts_tablet_manager.cc:1403] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a: Time spent bootstrapping tablet: real 0.075s	user 0.019s	sys 0.004s
I20260709 13:06:39.889523 19179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b87b4c7be484da9237ef57482499e" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" is_pre_election: true
W20260709 13:06:39.891614 19071 leader_election.cc:343] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:39.886111 19249 raft_consensus.cc:3060] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:39.892554 19222 raft_consensus.cc:359] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.893795 19222 raft_consensus.cc:385] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.894150 19222 raft_consensus.cc:740] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.895016 19219 ts_tablet_manager.cc:1434] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7: Time spent starting tablet: real 0.056s	user 0.027s	sys 0.012s
I20260709 13:06:39.895743 19220 raft_consensus.cc:359] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.896373 19219 tablet_bootstrap.cc:492] T c9a84c1bc49d48edbd859279ba140f6e P 829e1719f453473c934e820685b7f6b7: Bootstrap starting.
I20260709 13:06:39.896585 19220 raft_consensus.cc:385] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.896924 19220 raft_consensus.cc:740] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.898813 19245 raft_consensus.cc:515] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.901530 19245 leader_election.cc:290] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Requested vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:39.902455 19220 consensus_queue.cc:260] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.904584 19219 tablet_bootstrap.cc:654] T c9a84c1bc49d48edbd859279ba140f6e P 829e1719f453473c934e820685b7f6b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.905356 19220 ts_tablet_manager.cc:1434] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent starting tablet: real 0.021s	user 0.011s	sys 0.000s
I20260709 13:06:39.895046 19222 consensus_queue.cc:260] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.906386 19030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77620febb9004ec1a7f17f8a2806b14c" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7"
I20260709 13:06:39.907641 19222 ts_tablet_manager.cc:1434] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.004s
I20260709 13:06:39.908794 19222 tablet_bootstrap.cc:492] T fd4e237e4d8346afbeea137b22b32ee8 P e39ee95ba5824b7ca83380fc4f0c596a: Bootstrap starting.
I20260709 13:06:39.908670 19247 raft_consensus.cc:515] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.910616 19248 raft_consensus.cc:515] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.911231 19030 raft_consensus.cc:3060] T 77620febb9004ec1a7f17f8a2806b14c P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:39.912613 19249 raft_consensus.cc:515] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.914340 19029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b87b4c7be484da9237ef57482499e" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7"
I20260709 13:06:39.915149 19029 raft_consensus.cc:3060] T 814b87b4c7be484da9237ef57482499e P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:39.916714 19028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85919020ef941829e15062e26562141" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7"
W20260709 13:06:39.919061 19070 leader_election.cc:343] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:39.920310 19249 leader_election.cc:290] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Requested vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:39.922709 19222 tablet_bootstrap.cc:654] T fd4e237e4d8346afbeea137b22b32ee8 P e39ee95ba5824b7ca83380fc4f0c596a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.922906 19179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2156d44a5901495290a7a79e622d0839" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
I20260709 13:06:39.924085 19178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77620febb9004ec1a7f17f8a2806b14c" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
I20260709 13:06:39.924888 19178 raft_consensus.cc:3060] T 77620febb9004ec1a7f17f8a2806b14c P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:39.924952 18996 leader_election.cc:343] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:39.925624 19248 leader_election.cc:290] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Requested vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:39.925716 19247 leader_election.cc:290] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 election: Requested vote from peers e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:39.927013 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85919020ef941829e15062e26562141" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
I20260709 13:06:39.927551 19029 raft_consensus.cc:2468] T 814b87b4c7be484da9237ef57482499e P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 1.
I20260709 13:06:39.927886 19177 raft_consensus.cc:3060] T b85919020ef941829e15062e26562141 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:39.929427 19070 leader_election.cc:304] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:39.930698 19248 raft_consensus.cc:2804] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:39.931306 19248 raft_consensus.cc:697] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Becoming Leader. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Running, Role: LEADER
I20260709 13:06:39.932385 19248 consensus_queue.cc:237] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.933781 19105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2156d44a5901495290a7a79e622d0839" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
I20260709 13:06:39.934617 19105 raft_consensus.cc:3060] T 2156d44a5901495290a7a79e622d0839 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:39.941262 19179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b87b4c7be484da9237ef57482499e" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
W20260709 13:06:39.946332 19071 leader_election.cc:343] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:39.946830 19219 tablet_bootstrap.cc:492] T c9a84c1bc49d48edbd859279ba140f6e P 829e1719f453473c934e820685b7f6b7: No bootstrap required, opened a new log
I20260709 13:06:39.941378 19247 raft_consensus.cc:493] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.947403 19219 ts_tablet_manager.cc:1403] T c9a84c1bc49d48edbd859279ba140f6e P 829e1719f453473c934e820685b7f6b7: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.007s
I20260709 13:06:39.947554 19247 raft_consensus.cc:515] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } }
I20260709 13:06:39.950174 19229 raft_consensus.cc:493] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.950727 19229 raft_consensus.cc:515] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.906615 19220 tablet_bootstrap.cc:492] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Bootstrap starting.
I20260709 13:06:39.959003 19229 leader_election.cc:290] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305)
I20260709 13:06:39.964051 19104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295fe2d1af3f488a804237a87ade77d0" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" is_pre_election: true
I20260709 13:06:39.964401 19179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295fe2d1af3f488a804237a87ade77d0" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" is_pre_election: true
I20260709 13:06:39.965444 19179 raft_consensus.cc:2468] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 829e1719f453473c934e820685b7f6b7 in term 0.
W20260709 13:06:39.966503 18995 leader_election.cc:343] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:39.967726 18996 leader_election.cc:304] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, b2ef83e29a8e4e8694c3c7c2dd06f9d4; no voters: e39ee95ba5824b7ca83380fc4f0c596a
I20260709 13:06:39.968288 19222 tablet_bootstrap.cc:492] T fd4e237e4d8346afbeea137b22b32ee8 P e39ee95ba5824b7ca83380fc4f0c596a: No bootstrap required, opened a new log
I20260709 13:06:39.969249 19247 leader_election.cc:290] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263), e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305)
I20260709 13:06:39.969213 19244 raft_consensus.cc:2804] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:39.970139 19244 raft_consensus.cc:493] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.970613 19244 raft_consensus.cc:3060] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:39.971956 19222 ts_tablet_manager.cc:1403] T fd4e237e4d8346afbeea137b22b32ee8 P e39ee95ba5824b7ca83380fc4f0c596a: Time spent bootstrapping tablet: real 0.063s	user 0.026s	sys 0.014s
I20260709 13:06:39.975863 19222 raft_consensus.cc:359] T fd4e237e4d8346afbeea137b22b32ee8 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.976672 19222 raft_consensus.cc:385] T fd4e237e4d8346afbeea137b22b32ee8 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:39.976985 19222 raft_consensus.cc:740] T fd4e237e4d8346afbeea137b22b32ee8 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Initialized, Role: FOLLOWER
I20260709 13:06:39.977836 19222 consensus_queue.cc:260] T fd4e237e4d8346afbeea137b22b32ee8 P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.978891 19177 raft_consensus.cc:2468] T b85919020ef941829e15062e26562141 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 1.
I20260709 13:06:39.980316 19071 leader_election.cc:304] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 829e1719f453473c934e820685b7f6b7
I20260709 13:06:39.981524 19222 ts_tablet_manager.cc:1434] T fd4e237e4d8346afbeea137b22b32ee8 P e39ee95ba5824b7ca83380fc4f0c596a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:06:39.982772 19222 tablet_bootstrap.cc:492] T 295fe2d1af3f488a804237a87ade77d0 P e39ee95ba5824b7ca83380fc4f0c596a: Bootstrap starting.
I20260709 13:06:39.982018 18928 catalog_manager.cc:5697] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a reported cstate change: term changed from 0 to 1, leader changed from <none> to e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66). New cstate: current_term: 1 leader_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:39.982939 19105 raft_consensus.cc:2468] T 2156d44a5901495290a7a79e622d0839 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 829e1719f453473c934e820685b7f6b7 in term 1.
I20260709 13:06:39.943606 19030 raft_consensus.cc:2468] T 77620febb9004ec1a7f17f8a2806b14c P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 1.
I20260709 13:06:39.986111 18995 leader_election.cc:304] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, e39ee95ba5824b7ca83380fc4f0c596a; no voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4
I20260709 13:06:39.987004 19070 leader_election.cc:304] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:39.987715 19247 raft_consensus.cc:2804] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:39.988076 19249 raft_consensus.cc:2804] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:39.988390 19247 raft_consensus.cc:697] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 [term 1 LEADER]: Becoming Leader. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Running, Role: LEADER
I20260709 13:06:39.988773 19249 raft_consensus.cc:697] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Becoming Leader. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Running, Role: LEADER
I20260709 13:06:39.989532 19247 consensus_queue.cc:237] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.989923 19249 consensus_queue.cc:237] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.980465 19244 raft_consensus.cc:515] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } }
I20260709 13:06:39.996938 19222 tablet_bootstrap.cc:654] T 295fe2d1af3f488a804237a87ade77d0 P e39ee95ba5824b7ca83380fc4f0c596a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:39.984930 19248 raft_consensus.cc:2804] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:40.007791 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295fe2d1af3f488a804237a87ade77d0" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
I20260709 13:06:40.005540 19248 raft_consensus.cc:697] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Becoming Leader. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Running, Role: LEADER
I20260709 13:06:40.010838 19177 raft_consensus.cc:3060] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:40.011935 19248 consensus_queue.cc:237] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:39.999361 19178 raft_consensus.cc:2468] T 77620febb9004ec1a7f17f8a2806b14c P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 1.
I20260709 13:06:40.025092 19222 tablet_bootstrap.cc:492] T 295fe2d1af3f488a804237a87ade77d0 P e39ee95ba5824b7ca83380fc4f0c596a: No bootstrap required, opened a new log
I20260709 13:06:40.026036 19222 ts_tablet_manager.cc:1403] T 295fe2d1af3f488a804237a87ade77d0 P e39ee95ba5824b7ca83380fc4f0c596a: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.000s
I20260709 13:06:39.995033 19219 raft_consensus.cc:359] T c9a84c1bc49d48edbd859279ba140f6e P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.018782 19229 raft_consensus.cc:493] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.031513 19229 raft_consensus.cc:515] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.032028 19105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295fe2d1af3f488a804237a87ade77d0" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
I20260709 13:06:40.034005 19229 leader_election.cc:290] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305)
I20260709 13:06:40.034121 19222 raft_consensus.cc:359] T 295fe2d1af3f488a804237a87ade77d0 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } }
W20260709 13:06:40.034865 18995 leader_election.cc:343] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:40.035295 19222 raft_consensus.cc:385] T 295fe2d1af3f488a804237a87ade77d0 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:40.029417 19244 leader_election.cc:290] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 election: Requested vote from peers b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263), e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305)
I20260709 13:06:40.035799 19222 raft_consensus.cc:740] T 295fe2d1af3f488a804237a87ade77d0 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Initialized, Role: FOLLOWER
I20260709 13:06:40.038415 19030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a84c1bc49d48edbd859279ba140f6e" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7" is_pre_election: true
I20260709 13:06:40.036976 19222 consensus_queue.cc:260] T 295fe2d1af3f488a804237a87ade77d0 P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } }
I20260709 13:06:40.045167 19222 ts_tablet_manager.cc:1434] T 295fe2d1af3f488a804237a87ade77d0 P e39ee95ba5824b7ca83380fc4f0c596a: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.002s
I20260709 13:06:40.046087 19220 tablet_bootstrap.cc:654] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:40.046782 19222 tablet_bootstrap.cc:492] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a: Bootstrap starting.
I20260709 13:06:40.030102 19219 raft_consensus.cc:385] T c9a84c1bc49d48edbd859279ba140f6e P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:40.041319 19029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd4e237e4d8346afbeea137b22b32ee8" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7" is_pre_election: true
I20260709 13:06:40.050055 19219 raft_consensus.cc:740] T c9a84c1bc49d48edbd859279ba140f6e P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Initialized, Role: FOLLOWER
I20260709 13:06:40.051242 19029 raft_consensus.cc:2468] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 0.
I20260709 13:06:40.052035 19219 consensus_queue.cc:260] T c9a84c1bc49d48edbd859279ba140f6e P 829e1719f453473c934e820685b7f6b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.053768 19030 raft_consensus.cc:2468] T c9a84c1bc49d48edbd859279ba140f6e P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 0.
I20260709 13:06:40.061023 19144 leader_election.cc:304] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, b2ef83e29a8e4e8694c3c7c2dd06f9d4; no voters: 
I20260709 13:06:40.061841 18925 catalog_manager.cc:5697] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 829e1719f453473c934e820685b7f6b7 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "829e1719f453473c934e820685b7f6b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:40.063858 19229 raft_consensus.cc:2804] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:40.064507 19229 raft_consensus.cc:493] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.064795 19177 raft_consensus.cc:2468] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 829e1719f453473c934e820685b7f6b7 in term 1.
I20260709 13:06:40.064977 19229 raft_consensus.cc:3060] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:40.066541 18996 leader_election.cc:304] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, b2ef83e29a8e4e8694c3c7c2dd06f9d4; no voters: e39ee95ba5824b7ca83380fc4f0c596a
I20260709 13:06:40.069211 19105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a84c1bc49d48edbd859279ba140f6e" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" is_pre_election: true
I20260709 13:06:40.071550 19104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd4e237e4d8346afbeea137b22b32ee8" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" is_pre_election: true
I20260709 13:06:40.072739 19104 raft_consensus.cc:2468] T fd4e237e4d8346afbeea137b22b32ee8 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 0.
I20260709 13:06:40.071187 19244 raft_consensus.cc:2804] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:06:40.074465 19144 leader_election.cc:343] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:40.075027 19244 raft_consensus.cc:697] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [term 1 LEADER]: Becoming Leader. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Running, Role: LEADER
I20260709 13:06:40.077105 19144 leader_election.cc:304] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, b2ef83e29a8e4e8694c3c7c2dd06f9d4; no voters: e39ee95ba5824b7ca83380fc4f0c596a
I20260709 13:06:40.083041 19263 raft_consensus.cc:2804] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:40.083420 19263 raft_consensus.cc:493] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.083709 19263 raft_consensus.cc:3060] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:40.076000 19244 consensus_queue.cc:237] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } }
I20260709 13:06:40.086447 19219 ts_tablet_manager.cc:1434] T c9a84c1bc49d48edbd859279ba140f6e P 829e1719f453473c934e820685b7f6b7: Time spent starting tablet: real 0.139s	user 0.016s	sys 0.000s
I20260709 13:06:40.087702 19219 tablet_bootstrap.cc:492] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7: Bootstrap starting.
I20260709 13:06:40.088112 19222 tablet_bootstrap.cc:654] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:40.095485 19220 tablet_bootstrap.cc:492] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4: No bootstrap required, opened a new log
I20260709 13:06:40.096212 19220 ts_tablet_manager.cc:1403] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent bootstrapping tablet: real 0.190s	user 0.010s	sys 0.007s
I20260709 13:06:40.099532 19220 raft_consensus.cc:359] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.099778 19229 raft_consensus.cc:515] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.100497 19220 raft_consensus.cc:385] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:40.101392 19220 raft_consensus.cc:740] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Initialized, Role: FOLLOWER
I20260709 13:06:40.106720 19220 consensus_queue.cc:260] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.108199 19219 tablet_bootstrap.cc:654] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:40.109309 19263 raft_consensus.cc:515] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.111292 19229 leader_election.cc:290] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 election: Requested vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305)
I20260709 13:06:40.111585 19263 leader_election.cc:290] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 election: Requested vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305)
I20260709 13:06:40.113785 19030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd4e237e4d8346afbeea137b22b32ee8" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7"
I20260709 13:06:40.114084 19105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd4e237e4d8346afbeea137b22b32ee8" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
I20260709 13:06:40.114549 19030 raft_consensus.cc:3060] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:40.114655 19105 raft_consensus.cc:3060] T fd4e237e4d8346afbeea137b22b32ee8 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:40.119335 19104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a84c1bc49d48edbd859279ba140f6e" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
W20260709 13:06:40.122668 19144 leader_election.cc:343] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:40.124919 19029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a84c1bc49d48edbd859279ba140f6e" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7"
I20260709 13:06:40.128822 19029 raft_consensus.cc:3060] T c9a84c1bc49d48edbd859279ba140f6e P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:40.129086 19248 raft_consensus.cc:493] T 295fe2d1af3f488a804237a87ade77d0 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.129701 19248 raft_consensus.cc:515] T 295fe2d1af3f488a804237a87ade77d0 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } }
I20260709 13:06:40.132347 19220 ts_tablet_manager.cc:1434] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent starting tablet: real 0.036s	user 0.013s	sys 0.002s
I20260709 13:06:40.132862 19248 leader_election.cc:290] T 295fe2d1af3f488a804237a87ade77d0 P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263), 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529)
I20260709 13:06:40.133554 19220 tablet_bootstrap.cc:492] T 814b87b4c7be484da9237ef57482499e P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Bootstrap starting.
I20260709 13:06:40.134271 19028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295fe2d1af3f488a804237a87ade77d0" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7" is_pre_election: true
I20260709 13:06:40.136665 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295fe2d1af3f488a804237a87ade77d0" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" is_pre_election: true
I20260709 13:06:40.136889 19030 raft_consensus.cc:2468] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 1.
I20260709 13:06:40.137629 19177 raft_consensus.cc:2393] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e39ee95ba5824b7ca83380fc4f0c596a in current term 1: Already voted for candidate 829e1719f453473c934e820685b7f6b7 in this term.
I20260709 13:06:40.138360 19144 leader_election.cc:304] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, b2ef83e29a8e4e8694c3c7c2dd06f9d4; no voters: 
I20260709 13:06:40.137990 18925 catalog_manager.cc:5697] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 829e1719f453473c934e820685b7f6b7 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "829e1719f453473c934e820685b7f6b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:40.139554 19267 raft_consensus.cc:2804] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:40.139707 19071 leader_election.cc:304] T 295fe2d1af3f488a804237a87ade77d0 P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e39ee95ba5824b7ca83380fc4f0c596a; no voters: 829e1719f453473c934e820685b7f6b7, b2ef83e29a8e4e8694c3c7c2dd06f9d4
I20260709 13:06:40.140141 19267 raft_consensus.cc:697] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 LEADER]: Becoming Leader. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Running, Role: LEADER
I20260709 13:06:40.141144 19220 tablet_bootstrap.cc:654] T 814b87b4c7be484da9237ef57482499e P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:40.144347 19248 raft_consensus.cc:3060] T 295fe2d1af3f488a804237a87ade77d0 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:40.141144 19267 consensus_queue.cc:237] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.147500 19222 tablet_bootstrap.cc:492] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a: No bootstrap required, opened a new log
I20260709 13:06:40.148066 19222 ts_tablet_manager.cc:1403] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a: Time spent bootstrapping tablet: real 0.102s	user 0.010s	sys 0.011s
I20260709 13:06:40.154454 19105 raft_consensus.cc:2468] T fd4e237e4d8346afbeea137b22b32ee8 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 1.
I20260709 13:06:40.155943 19222 raft_consensus.cc:359] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.156720 19222 raft_consensus.cc:385] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:40.157027 19222 raft_consensus.cc:740] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Initialized, Role: FOLLOWER
I20260709 13:06:40.157827 19248 raft_consensus.cc:2749] T 295fe2d1af3f488a804237a87ade77d0 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:40.157794 19222 consensus_queue.cc:260] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.159801 19222 ts_tablet_manager.cc:1434] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:06:40.160650 19222 tablet_bootstrap.cc:492] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a: Bootstrap starting.
I20260709 13:06:40.162698 19029 raft_consensus.cc:2468] T c9a84c1bc49d48edbd859279ba140f6e P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 1.
I20260709 13:06:40.164090 19144 leader_election.cc:304] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, b2ef83e29a8e4e8694c3c7c2dd06f9d4; no voters: e39ee95ba5824b7ca83380fc4f0c596a
I20260709 13:06:40.164958 19229 raft_consensus.cc:2804] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:40.165050 19220 tablet_bootstrap.cc:492] T 814b87b4c7be484da9237ef57482499e P b2ef83e29a8e4e8694c3c7c2dd06f9d4: No bootstrap required, opened a new log
I20260709 13:06:40.165627 19229 raft_consensus.cc:697] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 LEADER]: Becoming Leader. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Running, Role: LEADER
I20260709 13:06:40.166019 19220 ts_tablet_manager.cc:1403] T 814b87b4c7be484da9237ef57482499e P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.016s
I20260709 13:06:40.165100 18928 catalog_manager.cc:5697] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a reported cstate change: term changed from 0 to 1, leader changed from <none> to e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66). New cstate: current_term: 1 leader_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:40.166512 19229 consensus_queue.cc:237] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.169380 19220 raft_consensus.cc:359] T 814b87b4c7be484da9237ef57482499e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.170338 19220 raft_consensus.cc:385] T 814b87b4c7be484da9237ef57482499e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:40.167160 19248 raft_consensus.cc:493] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.170713 19220 raft_consensus.cc:740] T 814b87b4c7be484da9237ef57482499e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Initialized, Role: FOLLOWER
I20260709 13:06:40.171038 19248 raft_consensus.cc:515] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.172050 19220 consensus_queue.cc:260] T 814b87b4c7be484da9237ef57482499e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.167239 18928 catalog_manager.cc:5697] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a reported cstate change: term changed from 0 to 1, leader changed from <none> to e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66). New cstate: current_term: 1 leader_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:40.173753 19248 leader_election.cc:290] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:40.174554 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ea15f89c540ea8b5d66e1b68ca09f" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" is_pre_election: true
I20260709 13:06:40.175268 19177 raft_consensus.cc:2468] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 0.
I20260709 13:06:40.176980 19071 leader_election.cc:304] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:40.178171 19029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ea15f89c540ea8b5d66e1b68ca09f" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7" is_pre_election: true
I20260709 13:06:40.178516 19222 tablet_bootstrap.cc:654] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:40.179280 19219 tablet_bootstrap.cc:492] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7: No bootstrap required, opened a new log
I20260709 13:06:40.179759 19219 ts_tablet_manager.cc:1403] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7: Time spent bootstrapping tablet: real 0.092s	user 0.016s	sys 0.002s
W20260709 13:06:40.180178 19070 leader_election.cc:343] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:40.181531 19248 raft_consensus.cc:2804] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:40.182351 19248 raft_consensus.cc:493] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.182931 19248 raft_consensus.cc:3060] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:40.183645 19220 ts_tablet_manager.cc:1434] T 814b87b4c7be484da9237ef57482499e P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent starting tablet: real 0.017s	user 0.000s	sys 0.007s
I20260709 13:06:40.184024 19219 raft_consensus.cc:359] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.184837 19219 raft_consensus.cc:385] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:40.185065 19220 tablet_bootstrap.cc:492] T cca026d92b504d9688f93e9bf0769060 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Bootstrap starting.
I20260709 13:06:40.185149 19219 raft_consensus.cc:740] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Initialized, Role: FOLLOWER
I20260709 13:06:40.188971 19219 consensus_queue.cc:260] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.190280 18925 catalog_manager.cc:5697] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67). New cstate: current_term: 1 leader_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:40.193990 19248 raft_consensus.cc:515] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.195999 19220 tablet_bootstrap.cc:654] T cca026d92b504d9688f93e9bf0769060 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:40.200868 19029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ea15f89c540ea8b5d66e1b68ca09f" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7"
I20260709 13:06:40.201396 19219 ts_tablet_manager.cc:1434] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.003s
W20260709 13:06:40.202771 19070 leader_election.cc:343] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:40.203498 19222 tablet_bootstrap.cc:492] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a: No bootstrap required, opened a new log
I20260709 13:06:40.204101 19222 ts_tablet_manager.cc:1403] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.000s
I20260709 13:06:40.205956 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ea15f89c540ea8b5d66e1b68ca09f" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
I20260709 13:06:40.206902 19177 raft_consensus.cc:3060] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:40.211042 19220 tablet_bootstrap.cc:492] T cca026d92b504d9688f93e9bf0769060 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: No bootstrap required, opened a new log
I20260709 13:06:40.211663 19220 ts_tablet_manager.cc:1403] T cca026d92b504d9688f93e9bf0769060 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.000s
I20260709 13:06:40.213531 18925 catalog_manager.cc:5697] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67). New cstate: current_term: 1 leader_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:40.215197 19219 tablet_bootstrap.cc:492] T d09ea15f89c540ea8b5d66e1b68ca09f P 829e1719f453473c934e820685b7f6b7: Bootstrap starting.
I20260709 13:06:40.214939 19220 raft_consensus.cc:359] T cca026d92b504d9688f93e9bf0769060 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.215615 19248 leader_election.cc:290] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Requested vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:40.215857 19220 raft_consensus.cc:385] T cca026d92b504d9688f93e9bf0769060 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:40.216238 19222 raft_consensus.cc:359] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.217631 19222 raft_consensus.cc:385] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:40.217694 19220 raft_consensus.cc:740] T cca026d92b504d9688f93e9bf0769060 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Initialized, Role: FOLLOWER
I20260709 13:06:40.218334 19222 raft_consensus.cc:740] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Initialized, Role: FOLLOWER
I20260709 13:06:40.218920 19220 consensus_queue.cc:260] T cca026d92b504d9688f93e9bf0769060 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.219333 19222 consensus_queue.cc:260] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.221845 19219 tablet_bootstrap.cc:654] T d09ea15f89c540ea8b5d66e1b68ca09f P 829e1719f453473c934e820685b7f6b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:40.221966 19220 ts_tablet_manager.cc:1434] T cca026d92b504d9688f93e9bf0769060 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:06:40.223131 19220 tablet_bootstrap.cc:492] T 2156d44a5901495290a7a79e622d0839 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Bootstrap starting.
I20260709 13:06:40.225346 19222 ts_tablet_manager.cc:1434] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.003s
I20260709 13:06:40.217397 19177 raft_consensus.cc:2468] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 1.
I20260709 13:06:40.227752 19071 leader_election.cc:304] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 829e1719f453473c934e820685b7f6b7
I20260709 13:06:40.228828 19248 raft_consensus.cc:2804] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:40.229365 19248 raft_consensus.cc:697] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Becoming Leader. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Running, Role: LEADER
I20260709 13:06:40.230297 19248 consensus_queue.cc:237] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.237681 19220 tablet_bootstrap.cc:654] T 2156d44a5901495290a7a79e622d0839 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:40.243059 19220 tablet_bootstrap.cc:492] T 2156d44a5901495290a7a79e622d0839 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: No bootstrap required, opened a new log
I20260709 13:06:40.243301 19219 tablet_bootstrap.cc:492] T d09ea15f89c540ea8b5d66e1b68ca09f P 829e1719f453473c934e820685b7f6b7: No bootstrap required, opened a new log
I20260709 13:06:40.243597 19220 ts_tablet_manager.cc:1403] T 2156d44a5901495290a7a79e622d0839 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:06:40.244012 19219 ts_tablet_manager.cc:1403] T d09ea15f89c540ea8b5d66e1b68ca09f P 829e1719f453473c934e820685b7f6b7: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.003s
I20260709 13:06:40.243300 18927 catalog_manager.cc:5697] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a reported cstate change: term changed from 0 to 1, leader changed from <none> to e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66). New cstate: current_term: 1 leader_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:40.246744 19220 raft_consensus.cc:359] T 2156d44a5901495290a7a79e622d0839 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.246948 19219 raft_consensus.cc:359] T d09ea15f89c540ea8b5d66e1b68ca09f P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.247509 19220 raft_consensus.cc:385] T 2156d44a5901495290a7a79e622d0839 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:40.247617 19219 raft_consensus.cc:385] T d09ea15f89c540ea8b5d66e1b68ca09f P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:40.247857 19220 raft_consensus.cc:740] T 2156d44a5901495290a7a79e622d0839 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Initialized, Role: FOLLOWER
I20260709 13:06:40.247947 19219 raft_consensus.cc:740] T d09ea15f89c540ea8b5d66e1b68ca09f P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Initialized, Role: FOLLOWER
I20260709 13:06:40.248757 19220 consensus_queue.cc:260] T 2156d44a5901495290a7a79e622d0839 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.248819 19219 consensus_queue.cc:260] T d09ea15f89c540ea8b5d66e1b68ca09f P 829e1719f453473c934e820685b7f6b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.251024 19220 ts_tablet_manager.cc:1434] T 2156d44a5901495290a7a79e622d0839 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:40.251338 19219 ts_tablet_manager.cc:1434] T d09ea15f89c540ea8b5d66e1b68ca09f P 829e1719f453473c934e820685b7f6b7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:40.280398 19248 raft_consensus.cc:493] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.281054 19248 raft_consensus.cc:515] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.283015 19248 leader_election.cc:290] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:40.283955 19029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca026d92b504d9688f93e9bf0769060" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7" is_pre_election: true
I20260709 13:06:40.284070 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca026d92b504d9688f93e9bf0769060" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" is_pre_election: true
I20260709 13:06:40.284614 19029 raft_consensus.cc:2468] T cca026d92b504d9688f93e9bf0769060 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 0.
I20260709 13:06:40.284739 19177 raft_consensus.cc:2468] T cca026d92b504d9688f93e9bf0769060 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 0.
I20260709 13:06:40.285835 19070 leader_election.cc:304] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:40.286671 19248 raft_consensus.cc:2804] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:40.287021 19248 raft_consensus.cc:493] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.287323 19248 raft_consensus.cc:3060] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:40.293032 19248 raft_consensus.cc:515] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.294698 19248 leader_election.cc:290] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Requested vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:40.295773 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca026d92b504d9688f93e9bf0769060" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
I20260709 13:06:40.295815 19029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca026d92b504d9688f93e9bf0769060" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7"
I20260709 13:06:40.296360 19177 raft_consensus.cc:3060] T cca026d92b504d9688f93e9bf0769060 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:40.296697 19029 raft_consensus.cc:3060] T cca026d92b504d9688f93e9bf0769060 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:40.302435 19177 raft_consensus.cc:2468] T cca026d92b504d9688f93e9bf0769060 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 1.
I20260709 13:06:40.302438 19029 raft_consensus.cc:2468] T cca026d92b504d9688f93e9bf0769060 P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 1.
I20260709 13:06:40.304103 19070 leader_election.cc:304] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:40.304906 19248 raft_consensus.cc:2804] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:40.305510 19248 raft_consensus.cc:697] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Becoming Leader. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Running, Role: LEADER
I20260709 13:06:40.306376 19248 consensus_queue.cc:237] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.314759 18928 catalog_manager.cc:5697] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a reported cstate change: term changed from 0 to 1, leader changed from <none> to e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66). New cstate: current_term: 1 leader_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:40.430716 19229 raft_consensus.cc:493] T 2156d44a5901495290a7a79e622d0839 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.431308 19229 raft_consensus.cc:515] T 2156d44a5901495290a7a79e622d0839 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.433537 19229 leader_election.cc:290] T 2156d44a5901495290a7a79e622d0839 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305)
I20260709 13:06:40.434300 19029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2156d44a5901495290a7a79e622d0839" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7" is_pre_election: true
I20260709 13:06:40.434675 19105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2156d44a5901495290a7a79e622d0839" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" is_pre_election: true
I20260709 13:06:40.435633 19105 raft_consensus.cc:2393] T 2156d44a5901495290a7a79e622d0839 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in current term 1: Already voted for candidate 829e1719f453473c934e820685b7f6b7 in this term.
I20260709 13:06:40.435767 19248 consensus_queue.cc:1048] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:40.436640 19144 leader_election.cc:304] T 2156d44a5901495290a7a79e622d0839 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4; no voters: 829e1719f453473c934e820685b7f6b7, e39ee95ba5824b7ca83380fc4f0c596a
I20260709 13:06:40.437466 19229 raft_consensus.cc:3060] T 2156d44a5901495290a7a79e622d0839 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:40.444305 19229 raft_consensus.cc:2749] T 2156d44a5901495290a7a79e622d0839 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:40.448957 19248 consensus_queue.cc:1048] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:40.472764 19029 raft_consensus.cc:3060] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:40.480242 19248 consensus_queue.cc:1048] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:40.483305 19244 consensus_queue.cc:1048] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:40.484167 19177 raft_consensus.cc:3060] T 814b87b4c7be484da9237ef57482499e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:40.499348 19244 consensus_queue.cc:1048] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:40.500986 19249 consensus_queue.cc:1048] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:40.511624 19245 consensus_queue.cc:1048] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:40.547683 19245 consensus_queue.cc:1048] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:40.552266 19179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd4e237e4d8346afbeea137b22b32ee8"
dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
mode: GRACEFUL
new_leader_uuid: "829e1719f453473c934e820685b7f6b7"
 from {username='slave'} at 127.0.0.1:59968
I20260709 13:06:40.553244 19179 raft_consensus.cc:606] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 LEADER]: Received request to transfer leadership to TS 829e1719f453473c934e820685b7f6b7
I20260709 13:06:40.560086 19245 raft_consensus.cc:493] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.560667 19245 raft_consensus.cc:515] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.563133 19245 leader_election.cc:290] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:40.564335 19179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a84c1bc49d48edbd859279ba140f6e" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" is_pre_election: true
I20260709 13:06:40.565583 19029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a84c1bc49d48edbd859279ba140f6e" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7" is_pre_election: true
I20260709 13:06:40.566607 19029 raft_consensus.cc:2393] T c9a84c1bc49d48edbd859279ba140f6e P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e39ee95ba5824b7ca83380fc4f0c596a in current term 1: Already voted for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in this term.
I20260709 13:06:40.567948 19071 leader_election.cc:304] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e39ee95ba5824b7ca83380fc4f0c596a; no voters: 829e1719f453473c934e820685b7f6b7, b2ef83e29a8e4e8694c3c7c2dd06f9d4
I20260709 13:06:40.568861 19245 raft_consensus.cc:3060] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:40.575587 19245 raft_consensus.cc:2749] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:40.576043 19105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b85919020ef941829e15062e26562141"
dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
mode: GRACEFUL
new_leader_uuid: "829e1719f453473c934e820685b7f6b7"
 from {username='slave'} at 127.0.0.1:57548
I20260709 13:06:40.576588 19105 raft_consensus.cc:606] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Received request to transfer leadership to TS 829e1719f453473c934e820685b7f6b7
I20260709 13:06:40.588349 19179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9a84c1bc49d48edbd859279ba140f6e"
dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
mode: GRACEFUL
new_leader_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
 from {username='slave'} at 127.0.0.1:59968
I20260709 13:06:40.589057 19179 raft_consensus.cc:606] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 LEADER]: Received request to transfer leadership to TS e39ee95ba5824b7ca83380fc4f0c596a
I20260709 13:06:40.597654 19105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d09ea15f89c540ea8b5d66e1b68ca09f"
dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
mode: GRACEFUL
new_leader_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
 from {username='slave'} at 127.0.0.1:57548
I20260709 13:06:40.598191 19105 raft_consensus.cc:606] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Received request to transfer leadership to TS b2ef83e29a8e4e8694c3c7c2dd06f9d4
I20260709 13:06:40.629065 19229 consensus_queue.cc:1048] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:40.640553 19263 consensus_queue.cc:1048] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:40.649935 19267 raft_consensus.cc:993] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4: : Instructing follower e39ee95ba5824b7ca83380fc4f0c596a to start an election
I20260709 13:06:40.650503 19263 raft_consensus.cc:1081] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 LEADER]: Signalling peer e39ee95ba5824b7ca83380fc4f0c596a to start an election
I20260709 13:06:40.652503 19105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9a84c1bc49d48edbd859279ba140f6e"
dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
 from {username='slave'} at 127.0.0.1:57544
I20260709 13:06:40.653314 19105 raft_consensus.cc:493] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:40.653780 19105 raft_consensus.cc:3060] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.654943 19245 consensus_queue.cc:1048] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:40.656757 19286 consensus_queue.cc:1048] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:40.665791 19292 raft_consensus.cc:993] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a: : Instructing follower b2ef83e29a8e4e8694c3c7c2dd06f9d4 to start an election
I20260709 13:06:40.666316 19292 raft_consensus.cc:1081] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Signalling peer b2ef83e29a8e4e8694c3c7c2dd06f9d4 to start an election
I20260709 13:06:40.666342 19105 raft_consensus.cc:515] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.670687 19179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d09ea15f89c540ea8b5d66e1b68ca09f"
dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
 from {username='slave'} at 127.0.0.1:59958
I20260709 13:06:40.671561 19179 raft_consensus.cc:493] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:40.671334 19263 consensus_queue.cc:1048] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:40.672093 19179 raft_consensus.cc:3060] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.672581 19029 raft_consensus.cc:3060] T d09ea15f89c540ea8b5d66e1b68ca09f P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:40.681476 19179 raft_consensus.cc:515] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.682243 19286 consensus_queue.cc:1048] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:40.684725 19030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ea15f89c540ea8b5d66e1b68ca09f" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "829e1719f453473c934e820685b7f6b7"
I20260709 13:06:40.685357 19030 raft_consensus.cc:3060] T d09ea15f89c540ea8b5d66e1b68ca09f P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.685606 19292 consensus_queue.cc:1048] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:40.687227 19028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a84c1bc49d48edbd859279ba140f6e" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "829e1719f453473c934e820685b7f6b7"
I20260709 13:06:40.687948 19028 raft_consensus.cc:3060] T c9a84c1bc49d48edbd859279ba140f6e P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.694144 19179 leader_election.cc:290] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 2 election: Requested vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305)
I20260709 13:06:40.695209 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ea15f89c540ea8b5d66e1b68ca09f" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
I20260709 13:06:40.696044 19102 raft_consensus.cc:3055] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.696390 19102 raft_consensus.cc:740] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Running, Role: LEADER
I20260709 13:06:40.697036 19030 raft_consensus.cc:2468] T d09ea15f89c540ea8b5d66e1b68ca09f P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 2.
I20260709 13:06:40.697322 19102 consensus_queue.cc:260] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.698263 19027 raft_consensus.cc:1240] T d09ea15f89c540ea8b5d66e1b68ca09f P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Rejecting Update request from peer e39ee95ba5824b7ca83380fc4f0c596a for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:06:40.698786 19028 raft_consensus.cc:2468] T c9a84c1bc49d48edbd859279ba140f6e P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 2.
I20260709 13:06:40.698805 19102 raft_consensus.cc:3060] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.706327 19070 leader_election.cc:304] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:40.707495 19292 raft_consensus.cc:2804] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:40.708060 19292 raft_consensus.cc:697] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [term 2 LEADER]: Becoming Leader. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Running, Role: LEADER
I20260709 13:06:40.708971 19292 consensus_queue.cc:237] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.701155 19105 leader_election.cc:290] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 2 election: Requested vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:40.703749 19144 leader_election.cc:304] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, b2ef83e29a8e4e8694c3c7c2dd06f9d4; no voters: 
I20260709 13:06:40.724268 18928 catalog_manager.cc:5697] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a reported cstate change: term changed from 1 to 2, leader changed from b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67) to e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66). New cstate: current_term: 2 leader_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:40.725421 19263 raft_consensus.cc:2804] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:40.726032 19263 raft_consensus.cc:697] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 LEADER]: Becoming Leader. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Running, Role: LEADER
I20260709 13:06:40.726915 19263 consensus_queue.cc:237] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.730170 19102 raft_consensus.cc:2468] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 2.
I20260709 13:06:40.701843 19179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a84c1bc49d48edbd859279ba140f6e" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
I20260709 13:06:40.731760 19179 raft_consensus.cc:3055] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.732059 19179 raft_consensus.cc:740] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Running, Role: LEADER
I20260709 13:06:40.732875 19179 consensus_queue.cc:260] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.734236 19179 raft_consensus.cc:3060] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.740551 19263 consensus_queue.cc:1048] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:40.742029 19179 raft_consensus.cc:2468] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 2.
I20260709 13:06:40.747438 18928 catalog_manager.cc:5697] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 reported cstate change: term changed from 1 to 2, leader changed from e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66) to b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67). New cstate: current_term: 2 leader_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:40.759189 19263 raft_consensus.cc:993] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: : Instructing follower 829e1719f453473c934e820685b7f6b7 to start an election
I20260709 13:06:40.759814 19267 raft_consensus.cc:1081] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 LEADER]: Signalling peer 829e1719f453473c934e820685b7f6b7 to start an election
I20260709 13:06:40.761554 19028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd4e237e4d8346afbeea137b22b32ee8"
dest_uuid: "829e1719f453473c934e820685b7f6b7"
 from {username='slave'} at 127.0.0.1:53896
I20260709 13:06:40.762262 19028 raft_consensus.cc:493] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:40.762750 19028 raft_consensus.cc:3060] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.770778 19028 raft_consensus.cc:515] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.772578 19028 leader_election.cc:290] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 2 election: Requested vote from peers e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:40.773571 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd4e237e4d8346afbeea137b22b32ee8" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
I20260709 13:06:40.773795 19179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd4e237e4d8346afbeea137b22b32ee8" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
I20260709 13:06:40.774284 19102 raft_consensus.cc:3060] T fd4e237e4d8346afbeea137b22b32ee8 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.774341 19179 raft_consensus.cc:3055] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.774837 19179 raft_consensus.cc:740] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Running, Role: LEADER
I20260709 13:06:40.775765 19179 consensus_queue.cc:260] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.777172 19179 raft_consensus.cc:3060] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.782415 19102 raft_consensus.cc:2468] T fd4e237e4d8346afbeea137b22b32ee8 P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 829e1719f453473c934e820685b7f6b7 in term 2.
I20260709 13:06:40.783771 18995 leader_election.cc:304] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:40.784657 19244 raft_consensus.cc:2804] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:40.784808 19179 raft_consensus.cc:2468] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 829e1719f453473c934e820685b7f6b7 in term 2.
I20260709 13:06:40.785202 19244 raft_consensus.cc:697] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7 [term 2 LEADER]: Becoming Leader. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Running, Role: LEADER
I20260709 13:06:40.786219 19244 consensus_queue.cc:237] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.788599 19292 consensus_queue.cc:1048] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:40.794437 18925 catalog_manager.cc:5697] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7 reported cstate change: term changed from 1 to 2, leader changed from b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67) to 829e1719f453473c934e820685b7f6b7 (127.8.4.65). New cstate: current_term: 2 leader_uuid: "829e1719f453473c934e820685b7f6b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:40.803437 19248 consensus_queue.cc:1048] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:40.952983 19248 raft_consensus.cc:993] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a: : Instructing follower 829e1719f453473c934e820685b7f6b7 to start an election
I20260709 13:06:40.953591 19292 raft_consensus.cc:1081] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Signalling peer 829e1719f453473c934e820685b7f6b7 to start an election
I20260709 13:06:40.955367 19028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b85919020ef941829e15062e26562141"
dest_uuid: "829e1719f453473c934e820685b7f6b7"
 from {username='slave'} at 127.0.0.1:53880
I20260709 13:06:40.955941 19028 raft_consensus.cc:493] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:40.956207 19028 raft_consensus.cc:3060] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.961391 19028 raft_consensus.cc:515] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.963137 19028 leader_election.cc:290] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 2 election: Requested vote from peers e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:40.964164 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85919020ef941829e15062e26562141" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
I20260709 13:06:40.964475 19179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85919020ef941829e15062e26562141" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
I20260709 13:06:40.964900 19102 raft_consensus.cc:3055] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.965081 19179 raft_consensus.cc:3060] T b85919020ef941829e15062e26562141 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.965320 19102 raft_consensus.cc:740] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Running, Role: LEADER
I20260709 13:06:40.966229 19102 consensus_queue.cc:260] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.967505 19102 raft_consensus.cc:3060] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.972930 19179 raft_consensus.cc:2468] T b85919020ef941829e15062e26562141 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 829e1719f453473c934e820685b7f6b7 in term 2.
I20260709 13:06:40.974512 18996 leader_election.cc:304] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, b2ef83e29a8e4e8694c3c7c2dd06f9d4; no voters: 
I20260709 13:06:40.974987 19102 raft_consensus.cc:2468] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 829e1719f453473c934e820685b7f6b7 in term 2.
I20260709 13:06:40.975589 19244 raft_consensus.cc:2804] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:40.976173 19244 raft_consensus.cc:697] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7 [term 2 LEADER]: Becoming Leader. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Running, Role: LEADER
I20260709 13:06:40.977164 19244 consensus_queue.cc:237] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:40.983956 18926 catalog_manager.cc:5697] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7 reported cstate change: term changed from 1 to 2, leader changed from e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66) to 829e1719f453473c934e820685b7f6b7 (127.8.4.65). New cstate: current_term: 2 leader_uuid: "829e1719f453473c934e820685b7f6b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:41.099458 19028 raft_consensus.cc:1275] T c9a84c1bc49d48edbd859279ba140f6e P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Refusing update from remote peer e39ee95ba5824b7ca83380fc4f0c596a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:41.099457 19179 raft_consensus.cc:1275] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Refusing update from remote peer e39ee95ba5824b7ca83380fc4f0c596a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:41.101643 19248 consensus_queue.cc:1048] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:41.102396 19292 consensus_queue.cc:1048] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:41.156212 19028 raft_consensus.cc:1275] T d09ea15f89c540ea8b5d66e1b68ca09f P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Refusing update from remote peer b2ef83e29a8e4e8694c3c7c2dd06f9d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:41.157714 19267 consensus_queue.cc:1048] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:41.172806 19102 raft_consensus.cc:1275] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Refusing update from remote peer b2ef83e29a8e4e8694c3c7c2dd06f9d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:41.174456 19267 consensus_queue.cc:1048] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:41.187090 19102 raft_consensus.cc:1275] T fd4e237e4d8346afbeea137b22b32ee8 P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Refusing update from remote peer 829e1719f453473c934e820685b7f6b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:41.188716 19244 consensus_queue.cc:1048] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:41.198632 19179 raft_consensus.cc:1275] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Refusing update from remote peer 829e1719f453473c934e820685b7f6b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:41.200515 19286 consensus_queue.cc:1048] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:41.452865 19179 raft_consensus.cc:1275] T b85919020ef941829e15062e26562141 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Refusing update from remote peer 829e1719f453473c934e820685b7f6b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:41.453394 19102 raft_consensus.cc:1275] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Refusing update from remote peer 829e1719f453473c934e820685b7f6b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:41.454428 19301 consensus_queue.cc:1048] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:41.455246 19286 consensus_queue.cc:1048] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:43.627322 18926 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42044:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:43.630432 18926 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:43.687433 19015 tablet_service.cc:1511] Processing CreateTablet for tablet 9a228e7541a54198823a7f8cb28c7d36 (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:43.689164 19015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a228e7541a54198823a7f8cb28c7d36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.688791 19089 tablet_service.cc:1511] Processing CreateTablet for tablet 9a228e7541a54198823a7f8cb28c7d36 (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:43.690706 19089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a228e7541a54198823a7f8cb28c7d36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.691299 19167 tablet_service.cc:1511] Processing CreateTablet for tablet 9a228e7541a54198823a7f8cb28c7d36 (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:43.692327 19012 tablet_service.cc:1511] Processing CreateTablet for tablet 7ddf0309e4884e2eb558def45c86820a (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:43.694103 19012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ddf0309e4884e2eb558def45c86820a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.695379 19095 tablet_service.cc:1511] Processing CreateTablet for tablet 7ddf0309e4884e2eb558def45c86820a (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:43.700301 19017 tablet_service.cc:1511] Processing CreateTablet for tablet ad4586d1988846818c9198992321459a (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:43.702047 19017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad4586d1988846818c9198992321459a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.706670 19169 tablet_service.cc:1511] Processing CreateTablet for tablet 7ddf0309e4884e2eb558def45c86820a (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:43.706970 19163 tablet_service.cc:1511] Processing CreateTablet for tablet ad4586d1988846818c9198992321459a (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:43.711126 19087 tablet_service.cc:1511] Processing CreateTablet for tablet ad4586d1988846818c9198992321459a (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:43.711817 19162 tablet_service.cc:1511] Processing CreateTablet for tablet a01279662936472b899ddf84c1b6b655 (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:43.692878 19167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a228e7541a54198823a7f8cb28c7d36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.712878 19092 tablet_service.cc:1511] Processing CreateTablet for tablet a01279662936472b899ddf84c1b6b655 (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:43.715055 19014 tablet_service.cc:1511] Processing CreateTablet for tablet a01279662936472b899ddf84c1b6b655 (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:43.716405 19014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a01279662936472b899ddf84c1b6b655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.717415 19163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad4586d1988846818c9198992321459a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.718509 19162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a01279662936472b899ddf84c1b6b655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.719430 19165 tablet_service.cc:1511] Processing CreateTablet for tablet d3e827f740ed46f8a41dd34ba382bf83 (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:43.720940 19165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3e827f740ed46f8a41dd34ba382bf83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.726166 19018 tablet_service.cc:1511] Processing CreateTablet for tablet 5a73a5950c304c079b67013e79cff93a (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:43.727818 19018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a73a5950c304c079b67013e79cff93a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.726166 19161 tablet_service.cc:1511] Processing CreateTablet for tablet 5a73a5950c304c079b67013e79cff93a (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:43.730500 19161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a73a5950c304c079b67013e79cff93a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.737355 19168 tablet_service.cc:1511] Processing CreateTablet for tablet 5b506e6c7e944a398bfd174c5057182b (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:43.724656 19019 tablet_service.cc:1511] Processing CreateTablet for tablet d3e827f740ed46f8a41dd34ba382bf83 (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:43.738929 19168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b506e6c7e944a398bfd174c5057182b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.739672 19019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3e827f740ed46f8a41dd34ba382bf83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.720844 19095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ddf0309e4884e2eb558def45c86820a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.742786 19094 tablet_service.cc:1511] Processing CreateTablet for tablet d3e827f740ed46f8a41dd34ba382bf83 (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:43.743348 19088 tablet_service.cc:1511] Processing CreateTablet for tablet 5a73a5950c304c079b67013e79cff93a (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:43.744249 19094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3e827f740ed46f8a41dd34ba382bf83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.745265 19088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a73a5950c304c079b67013e79cff93a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.747144 19087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad4586d1988846818c9198992321459a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.749431 19092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a01279662936472b899ddf84c1b6b655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.754200 19164 tablet_service.cc:1511] Processing CreateTablet for tablet 4a583aaa89c04259a6d38100fe448cdf (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:43.755784 19164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a583aaa89c04259a6d38100fe448cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.759536 19166 tablet_service.cc:1511] Processing CreateTablet for tablet b33ab6d6087449ffba8dd9a00abee03f (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:43.761029 19166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33ab6d6087449ffba8dd9a00abee03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.769861 19169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ddf0309e4884e2eb558def45c86820a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.775977 19016 tablet_service.cc:1511] Processing CreateTablet for tablet 5b506e6c7e944a398bfd174c5057182b (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:43.777459 19016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b506e6c7e944a398bfd174c5057182b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.777112 19093 tablet_service.cc:1511] Processing CreateTablet for tablet 4a583aaa89c04259a6d38100fe448cdf (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:43.778633 19093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a583aaa89c04259a6d38100fe448cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.782164 19090 tablet_service.cc:1511] Processing CreateTablet for tablet 5b506e6c7e944a398bfd174c5057182b (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:43.783653 19090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b506e6c7e944a398bfd174c5057182b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.787868 19020 tablet_service.cc:1511] Processing CreateTablet for tablet 4a583aaa89c04259a6d38100fe448cdf (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:43.789479 19020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a583aaa89c04259a6d38100fe448cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.807421 19013 tablet_service.cc:1511] Processing CreateTablet for tablet b33ab6d6087449ffba8dd9a00abee03f (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:43.808316 19091 tablet_service.cc:1511] Processing CreateTablet for tablet b33ab6d6087449ffba8dd9a00abee03f (DEFAULT_TABLE table=soft_deleted_table [id=c333547ee1a545159253509a98be7c12]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:43.808954 19013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33ab6d6087449ffba8dd9a00abee03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:43.809924 19091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33ab6d6087449ffba8dd9a00abee03f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:43.847121 18976 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:43.903782 19323 tablet_bootstrap.cc:492] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Bootstrap starting.
I20260709 13:06:43.911314 19323 tablet_bootstrap.cc:654] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.917977 19324 tablet_bootstrap.cc:492] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a: Bootstrap starting.
I20260709 13:06:43.921123 19322 tablet_bootstrap.cc:492] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7: Bootstrap starting.
I20260709 13:06:43.932823 19322 tablet_bootstrap.cc:654] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.943300 19324 tablet_bootstrap.cc:654] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.949519 19323 tablet_bootstrap.cc:492] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4: No bootstrap required, opened a new log
I20260709 13:06:43.950193 19323 ts_tablet_manager.cc:1403] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.004s
I20260709 13:06:43.953516 19323 raft_consensus.cc:359] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:43.954283 19323 raft_consensus.cc:385] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.954578 19323 raft_consensus.cc:740] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.955344 19323 consensus_queue.cc:260] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:43.958478 19323 ts_tablet_manager.cc:1434] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:43.958859 19322 tablet_bootstrap.cc:492] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7: No bootstrap required, opened a new log
I20260709 13:06:43.959527 19322 ts_tablet_manager.cc:1403] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.009s
I20260709 13:06:43.960057 19323 tablet_bootstrap.cc:492] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Bootstrap starting.
I20260709 13:06:43.963155 19322 raft_consensus.cc:359] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:43.964229 19322 raft_consensus.cc:385] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.964624 19322 raft_consensus.cc:740] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.964900 19324 tablet_bootstrap.cc:492] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a: No bootstrap required, opened a new log
I20260709 13:06:43.965735 19324 ts_tablet_manager.cc:1403] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.000s
I20260709 13:06:43.965652 19322 consensus_queue.cc:260] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:43.969799 19324 raft_consensus.cc:359] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:43.970685 19324 raft_consensus.cc:385] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:43.971050 19324 raft_consensus.cc:740] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Initialized, Role: FOLLOWER
I20260709 13:06:43.973440 19322 ts_tablet_manager.cc:1434] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 13:06:43.973112 19324 consensus_queue.cc:260] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:43.974824 19322 tablet_bootstrap.cc:492] T b33ab6d6087449ffba8dd9a00abee03f P 829e1719f453473c934e820685b7f6b7: Bootstrap starting.
I20260709 13:06:43.975905 19324 ts_tablet_manager.cc:1434] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:06:43.978425 19323 tablet_bootstrap.cc:654] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.977314 19324 tablet_bootstrap.cc:492] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a: Bootstrap starting.
I20260709 13:06:43.983374 19322 tablet_bootstrap.cc:654] T b33ab6d6087449ffba8dd9a00abee03f P 829e1719f453473c934e820685b7f6b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:43.990823 19324 tablet_bootstrap.cc:654] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.002977 19323 tablet_bootstrap.cc:492] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4: No bootstrap required, opened a new log
I20260709 13:06:44.003448 19323 ts_tablet_manager.cc:1403] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.009s
I20260709 13:06:44.006830 19323 raft_consensus.cc:359] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.007620 19323 raft_consensus.cc:385] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.007764 19322 tablet_bootstrap.cc:492] T b33ab6d6087449ffba8dd9a00abee03f P 829e1719f453473c934e820685b7f6b7: No bootstrap required, opened a new log
I20260709 13:06:44.007987 19323 raft_consensus.cc:740] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.007794 19324 tablet_bootstrap.cc:492] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a: No bootstrap required, opened a new log
I20260709 13:06:44.009266 19324 ts_tablet_manager.cc:1403] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.007s
I20260709 13:06:44.008833 19323 consensus_queue.cc:260] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.012315 19324 raft_consensus.cc:359] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.013082 19324 raft_consensus.cc:385] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.013393 19324 raft_consensus.cc:740] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.014143 19324 consensus_queue.cc:260] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.016631 19324 ts_tablet_manager.cc:1434] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:06:44.008497 19322 ts_tablet_manager.cc:1403] T b33ab6d6087449ffba8dd9a00abee03f P 829e1719f453473c934e820685b7f6b7: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.005s
I20260709 13:06:44.020274 19322 raft_consensus.cc:359] T b33ab6d6087449ffba8dd9a00abee03f P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.021104 19322 raft_consensus.cc:385] T b33ab6d6087449ffba8dd9a00abee03f P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.021418 19322 raft_consensus.cc:740] T b33ab6d6087449ffba8dd9a00abee03f P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.022327 19322 consensus_queue.cc:260] T b33ab6d6087449ffba8dd9a00abee03f P 829e1719f453473c934e820685b7f6b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.023097 19323 ts_tablet_manager.cc:1434] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 13:06:44.024222 19323 tablet_bootstrap.cc:492] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Bootstrap starting.
I20260709 13:06:44.024700 19322 ts_tablet_manager.cc:1434] T b33ab6d6087449ffba8dd9a00abee03f P 829e1719f453473c934e820685b7f6b7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:06:44.026170 19322 tablet_bootstrap.cc:492] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7: Bootstrap starting.
I20260709 13:06:44.029578 19324 tablet_bootstrap.cc:492] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a: Bootstrap starting.
I20260709 13:06:44.033097 19322 tablet_bootstrap.cc:654] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.037300 19323 tablet_bootstrap.cc:654] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.043007 19322 tablet_bootstrap.cc:492] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7: No bootstrap required, opened a new log
I20260709 13:06:44.043624 19322 ts_tablet_manager.cc:1403] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:06:44.044932 19324 tablet_bootstrap.cc:654] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.047389 19322 raft_consensus.cc:359] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.048880 19322 raft_consensus.cc:385] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.049384 19322 raft_consensus.cc:740] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.050472 19322 consensus_queue.cc:260] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.054194 19322 ts_tablet_manager.cc:1434] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.004s
I20260709 13:06:44.055809 19322 tablet_bootstrap.cc:492] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7: Bootstrap starting.
I20260709 13:06:44.059136 19324 tablet_bootstrap.cc:492] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a: No bootstrap required, opened a new log
I20260709 13:06:44.059829 19324 ts_tablet_manager.cc:1403] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.012s
I20260709 13:06:44.063634 19324 raft_consensus.cc:359] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.064410 19324 raft_consensus.cc:385] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.064803 19324 raft_consensus.cc:740] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.065054 19322 tablet_bootstrap.cc:654] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.065680 19324 consensus_queue.cc:260] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.068575 19324 ts_tablet_manager.cc:1434] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:06:44.071897 19322 tablet_bootstrap.cc:492] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7: No bootstrap required, opened a new log
I20260709 13:06:44.072010 19324 tablet_bootstrap.cc:492] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a: Bootstrap starting.
I20260709 13:06:44.072578 19322 ts_tablet_manager.cc:1403] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.003s
I20260709 13:06:44.074747 19323 tablet_bootstrap.cc:492] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4: No bootstrap required, opened a new log
I20260709 13:06:44.075349 19323 ts_tablet_manager.cc:1403] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.018s
I20260709 13:06:44.075886 19322 raft_consensus.cc:359] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.076709 19322 raft_consensus.cc:385] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.076992 19322 raft_consensus.cc:740] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.077786 19322 consensus_queue.cc:260] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.078594 19323 raft_consensus.cc:359] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.079397 19323 raft_consensus.cc:385] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.079512 19324 tablet_bootstrap.cc:654] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.079774 19323 raft_consensus.cc:740] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.080237 19322 ts_tablet_manager.cc:1434] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:44.080825 19323 consensus_queue.cc:260] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.083444 19322 tablet_bootstrap.cc:492] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7: Bootstrap starting.
I20260709 13:06:44.086745 19323 ts_tablet_manager.cc:1434] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:06:44.087958 19323 tablet_bootstrap.cc:492] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Bootstrap starting.
I20260709 13:06:44.095038 19323 tablet_bootstrap.cc:654] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.096900 19308 raft_consensus.cc:493] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.097558 19308 raft_consensus.cc:515] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.101655 19308 leader_election.cc:290] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305)
I20260709 13:06:44.101558 19028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4586d1988846818c9198992321459a" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7" is_pre_election: true
I20260709 13:06:44.102308 19103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4586d1988846818c9198992321459a" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" is_pre_election: true
W20260709 13:06:44.104019 19144 leader_election.cc:343] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:44.105039 19144 leader_election.cc:343] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.105613 19144 leader_election.cc:304] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4; no voters: 829e1719f453473c934e820685b7f6b7, e39ee95ba5824b7ca83380fc4f0c596a
I20260709 13:06:44.106531 19308 raft_consensus.cc:2749] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:44.105173 19322 tablet_bootstrap.cc:654] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.110299 19323 tablet_bootstrap.cc:492] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4: No bootstrap required, opened a new log
I20260709 13:06:44.110855 19323 ts_tablet_manager.cc:1403] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 13:06:44.113719 19323 raft_consensus.cc:359] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.116664 19323 raft_consensus.cc:385] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.117112 19323 raft_consensus.cc:740] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.118518 19323 consensus_queue.cc:260] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.129988 19323 ts_tablet_manager.cc:1434] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.003s
I20260709 13:06:44.131824 19323 tablet_bootstrap.cc:492] T d3e827f740ed46f8a41dd34ba382bf83 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Bootstrap starting.
I20260709 13:06:44.141391 19323 tablet_bootstrap.cc:654] T d3e827f740ed46f8a41dd34ba382bf83 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.146181 19322 tablet_bootstrap.cc:492] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7: No bootstrap required, opened a new log
I20260709 13:06:44.146834 19322 ts_tablet_manager.cc:1403] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7: Time spent bootstrapping tablet: real 0.064s	user 0.004s	sys 0.033s
I20260709 13:06:44.149904 19322 raft_consensus.cc:359] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.150662 19322 raft_consensus.cc:385] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.150979 19322 raft_consensus.cc:740] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.151777 19322 consensus_queue.cc:260] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.154289 19323 tablet_bootstrap.cc:492] T d3e827f740ed46f8a41dd34ba382bf83 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: No bootstrap required, opened a new log
I20260709 13:06:44.154587 19322 ts_tablet_manager.cc:1434] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:06:44.154943 19323 ts_tablet_manager.cc:1403] T d3e827f740ed46f8a41dd34ba382bf83 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.009s
I20260709 13:06:44.155828 19322 tablet_bootstrap.cc:492] T 5a73a5950c304c079b67013e79cff93a P 829e1719f453473c934e820685b7f6b7: Bootstrap starting.
I20260709 13:06:44.156921 19324 tablet_bootstrap.cc:492] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a: No bootstrap required, opened a new log
I20260709 13:06:44.158311 19323 raft_consensus.cc:359] T d3e827f740ed46f8a41dd34ba382bf83 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.158906 19324 ts_tablet_manager.cc:1403] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a: Time spent bootstrapping tablet: real 0.087s	user 0.019s	sys 0.037s
I20260709 13:06:44.159123 19323 raft_consensus.cc:385] T d3e827f740ed46f8a41dd34ba382bf83 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.159482 19323 raft_consensus.cc:740] T d3e827f740ed46f8a41dd34ba382bf83 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.160334 19323 consensus_queue.cc:260] T d3e827f740ed46f8a41dd34ba382bf83 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.163071 19323 ts_tablet_manager.cc:1434] T d3e827f740ed46f8a41dd34ba382bf83 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:06:44.162632 19324 raft_consensus.cc:359] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.163574 19324 raft_consensus.cc:385] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.163978 19324 raft_consensus.cc:740] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.164233 19323 tablet_bootstrap.cc:492] T 7ddf0309e4884e2eb558def45c86820a P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Bootstrap starting.
I20260709 13:06:44.164858 19324 consensus_queue.cc:260] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.167042 19324 ts_tablet_manager.cc:1434] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:44.168202 19324 tablet_bootstrap.cc:492] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a: Bootstrap starting.
I20260709 13:06:44.174782 19322 tablet_bootstrap.cc:654] T 5a73a5950c304c079b67013e79cff93a P 829e1719f453473c934e820685b7f6b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.175325 19323 tablet_bootstrap.cc:654] T 7ddf0309e4884e2eb558def45c86820a P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.176635 19324 tablet_bootstrap.cc:654] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.186844 19338 raft_consensus.cc:493] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.187455 19338 raft_consensus.cc:515] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.187753 19301 raft_consensus.cc:493] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.188479 19301 raft_consensus.cc:515] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.189719 19338 leader_election.cc:290] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305)
I20260709 13:06:44.191731 19028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ab6d6087449ffba8dd9a00abee03f" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7" is_pre_election: true
I20260709 13:06:44.192756 19028 raft_consensus.cc:2468] T b33ab6d6087449ffba8dd9a00abee03f P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 0.
I20260709 13:06:44.194159 19334 raft_consensus.cc:493] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.195397 19103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ab6d6087449ffba8dd9a00abee03f" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" is_pre_election: true
I20260709 13:06:44.196341 19323 tablet_bootstrap.cc:492] T 7ddf0309e4884e2eb558def45c86820a P b2ef83e29a8e4e8694c3c7c2dd06f9d4: No bootstrap required, opened a new log
I20260709 13:06:44.197081 19323 ts_tablet_manager.cc:1403] T 7ddf0309e4884e2eb558def45c86820a P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.003s
I20260709 13:06:44.194706 19334 raft_consensus.cc:515] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.199436 19334 leader_election.cc:290] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:44.200163 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a228e7541a54198823a7f8cb28c7d36" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" is_pre_election: true
I20260709 13:06:44.203059 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01279662936472b899ddf84c1b6b655" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" is_pre_election: true
W20260709 13:06:44.201443 19144 leader_election.cc:343] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.204627 19324 tablet_bootstrap.cc:492] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a: No bootstrap required, opened a new log
W20260709 13:06:44.204815 18995 leader_election.cc:343] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.205590 19324 ts_tablet_manager.cc:1403] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.008s
I20260709 13:06:44.210314 19311 raft_consensus.cc:493] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.200737 19323 raft_consensus.cc:359] T 7ddf0309e4884e2eb558def45c86820a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.211388 19323 raft_consensus.cc:385] T 7ddf0309e4884e2eb558def45c86820a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.211074 19324 raft_consensus.cc:359] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.211743 19323 raft_consensus.cc:740] T 7ddf0309e4884e2eb558def45c86820a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.211498 19179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a228e7541a54198823a7f8cb28c7d36" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" is_pre_election: true
I20260709 13:06:44.212263 19324 raft_consensus.cc:385] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.212880 19178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01279662936472b899ddf84c1b6b655" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" is_pre_election: true
I20260709 13:06:44.212756 19323 consensus_queue.cc:260] T 7ddf0309e4884e2eb558def45c86820a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
W20260709 13:06:44.213750 18996 leader_election.cc:343] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.212801 19324 raft_consensus.cc:740] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.214751 18996 leader_election.cc:304] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 829e1719f453473c934e820685b7f6b7; no voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4, e39ee95ba5824b7ca83380fc4f0c596a
I20260709 13:06:44.215968 19334 raft_consensus.cc:2749] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:44.216212 19323 ts_tablet_manager.cc:1434] T 7ddf0309e4884e2eb558def45c86820a P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:06:44.210974 19311 raft_consensus.cc:515] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.215700 19324 consensus_queue.cc:260] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.217846 19323 tablet_bootstrap.cc:492] T 4a583aaa89c04259a6d38100fe448cdf P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Bootstrap starting.
I20260709 13:06:44.219727 19311 leader_election.cc:290] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:44.220124 19324 ts_tablet_manager.cc:1434] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.002s
I20260709 13:06:44.221457 19324 tablet_bootstrap.cc:492] T a01279662936472b899ddf84c1b6b655 P e39ee95ba5824b7ca83380fc4f0c596a: Bootstrap starting.
I20260709 13:06:44.222254 19028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddf0309e4884e2eb558def45c86820a" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7" is_pre_election: true
W20260709 13:06:44.224416 19070 leader_election.cc:343] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.225703 19323 tablet_bootstrap.cc:654] T 4a583aaa89c04259a6d38100fe448cdf P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.229187 19324 tablet_bootstrap.cc:654] T a01279662936472b899ddf84c1b6b655 P e39ee95ba5824b7ca83380fc4f0c596a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.229532 19179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddf0309e4884e2eb558def45c86820a" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" is_pre_election: true
I20260709 13:06:44.230625 19179 raft_consensus.cc:2468] T 7ddf0309e4884e2eb558def45c86820a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 0.
I20260709 13:06:44.232322 19071 leader_election.cc:304] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 829e1719f453473c934e820685b7f6b7
I20260709 13:06:44.233664 19301 leader_election.cc:290] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:44.204878 19144 leader_election.cc:304] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, b2ef83e29a8e4e8694c3c7c2dd06f9d4; no voters: e39ee95ba5824b7ca83380fc4f0c596a
W20260709 13:06:44.216282 18996 leader_election.cc:343] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.236090 19338 raft_consensus.cc:2804] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:44.236454 19338 raft_consensus.cc:493] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.236824 19338 raft_consensus.cc:3060] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.238013 19308 raft_consensus.cc:493] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.238744 19308 raft_consensus.cc:515] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
W20260709 13:06:44.241219 18995 leader_election.cc:343] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.241607 19308 leader_election.cc:290] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305)
I20260709 13:06:44.244350 18995 leader_election.cc:304] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 829e1719f453473c934e820685b7f6b7; no voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4, e39ee95ba5824b7ca83380fc4f0c596a
I20260709 13:06:44.246440 19334 raft_consensus.cc:493] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.267799 19334 raft_consensus.cc:515] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.270936 19334 leader_election.cc:290] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:44.247354 19028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b506e6c7e944a398bfd174c5057182b" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7" is_pre_election: true
I20260709 13:06:44.249679 19323 tablet_bootstrap.cc:492] T 4a583aaa89c04259a6d38100fe448cdf P b2ef83e29a8e4e8694c3c7c2dd06f9d4: No bootstrap required, opened a new log
I20260709 13:06:44.272810 19323 ts_tablet_manager.cc:1403] T 4a583aaa89c04259a6d38100fe448cdf P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent bootstrapping tablet: real 0.055s	user 0.021s	sys 0.011s
I20260709 13:06:44.272261 19028 raft_consensus.cc:2468] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 0.
I20260709 13:06:44.278007 19323 raft_consensus.cc:359] T 4a583aaa89c04259a6d38100fe448cdf P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.279076 19323 raft_consensus.cc:385] T 4a583aaa89c04259a6d38100fe448cdf P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.279448 19323 raft_consensus.cc:740] T 4a583aaa89c04259a6d38100fe448cdf P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.280495 19323 consensus_queue.cc:260] T 4a583aaa89c04259a6d38100fe448cdf P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.283154 19323 ts_tablet_manager.cc:1434] T 4a583aaa89c04259a6d38100fe448cdf P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:06:44.284544 19323 tablet_bootstrap.cc:492] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Bootstrap starting.
I20260709 13:06:44.249536 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b506e6c7e944a398bfd174c5057182b" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" is_pre_election: true
I20260709 13:06:44.259531 19338 raft_consensus.cc:515] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.287254 19102 raft_consensus.cc:2468] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 0.
I20260709 13:06:44.288619 19338 leader_election.cc:290] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 election: Requested vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305)
I20260709 13:06:44.266656 19311 raft_consensus.cc:2804] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:44.289238 19341 raft_consensus.cc:493] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.289585 19311 raft_consensus.cc:493] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.290192 19311 raft_consensus.cc:3060] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.290009 19341 raft_consensus.cc:515] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.294488 19341 leader_election.cc:290] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:44.301220 19311 raft_consensus.cc:515] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.301235 19323 tablet_bootstrap.cc:654] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.302955 19028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e827f740ed46f8a41dd34ba382bf83" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7" is_pre_election: true
I20260709 13:06:44.304381 19311 leader_election.cc:290] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Requested vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
W20260709 13:06:44.305727 19070 leader_election.cc:343] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.311074 19028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddf0309e4884e2eb558def45c86820a" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7"
W20260709 13:06:44.313025 19070 leader_election.cc:343] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.314117 19179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e827f740ed46f8a41dd34ba382bf83" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" is_pre_election: true
I20260709 13:06:44.314863 19179 raft_consensus.cc:2468] T d3e827f740ed46f8a41dd34ba382bf83 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 0.
I20260709 13:06:44.315099 19323 tablet_bootstrap.cc:492] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: No bootstrap required, opened a new log
I20260709 13:06:44.315837 19323 ts_tablet_manager.cc:1403] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.011s
I20260709 13:06:44.317354 19178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddf0309e4884e2eb558def45c86820a" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
I20260709 13:06:44.318053 19178 raft_consensus.cc:3060] T 7ddf0309e4884e2eb558def45c86820a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.318904 19323 raft_consensus.cc:359] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.319783 19323 raft_consensus.cc:385] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.320216 19323 raft_consensus.cc:740] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.320997 19323 consensus_queue.cc:260] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.322739 19323 ts_tablet_manager.cc:1434] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:44.323807 19323 tablet_bootstrap.cc:492] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Bootstrap starting.
I20260709 13:06:44.326418 19178 raft_consensus.cc:2468] T 7ddf0309e4884e2eb558def45c86820a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 1.
I20260709 13:06:44.327853 19341 raft_consensus.cc:493] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.328449 19341 raft_consensus.cc:515] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.329905 19323 tablet_bootstrap.cc:654] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.330557 19334 raft_consensus.cc:493] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.331103 19334 raft_consensus.cc:515] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.333781 19341 leader_election.cc:290] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:44.338364 19334 leader_election.cc:290] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
W20260709 13:06:44.343662 18995 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.66:36305, user_credentials={real_user=slave}} blocked reactor thread for 114349us
I20260709 13:06:44.346210 19334 raft_consensus.cc:2749] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:44.355592 18996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35263, user_credentials={real_user=slave}} blocked reactor thread for 89696.2us
I20260709 13:06:44.358186 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b506e6c7e944a398bfd174c5057182b" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" is_pre_election: true
I20260709 13:06:44.359084 19177 raft_consensus.cc:2468] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 829e1719f453473c934e820685b7f6b7 in term 0.
I20260709 13:06:44.362576 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a583aaa89c04259a6d38100fe448cdf" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" is_pre_election: true
I20260709 13:06:44.363515 19177 raft_consensus.cc:2468] T 4a583aaa89c04259a6d38100fe448cdf P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 829e1719f453473c934e820685b7f6b7 in term 0.
I20260709 13:06:44.363672 18996 leader_election.cc:304] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, b2ef83e29a8e4e8694c3c7c2dd06f9d4; no voters: 
I20260709 13:06:44.366590 19071 leader_election.cc:304] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 829e1719f453473c934e820685b7f6b7
I20260709 13:06:44.368877 19311 raft_consensus.cc:2804] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:44.369480 19311 raft_consensus.cc:493] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.369966 19311 raft_consensus.cc:3060] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.383791 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ab6d6087449ffba8dd9a00abee03f" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
I20260709 13:06:44.389566 19028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a73a5950c304c079b67013e79cff93a" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7" is_pre_election: true
W20260709 13:06:44.391794 19070 leader_election.cc:343] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:44.395035 19144 leader_election.cc:304] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:44.396472 19338 raft_consensus.cc:2804] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:44.397071 19338 raft_consensus.cc:493] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.397563 19338 raft_consensus.cc:3060] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.410285 19071 leader_election.cc:304] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 829e1719f453473c934e820685b7f6b7
I20260709 13:06:44.413296 19341 raft_consensus.cc:2804] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:06:44.418426 18996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.4.67:35263, user_credentials={real_user=slave}} blocked reactor thread for 54847.6us
I20260709 13:06:44.419703 18996 leader_election.cc:304] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, b2ef83e29a8e4e8694c3c7c2dd06f9d4; no voters: 
I20260709 13:06:44.420912 19301 raft_consensus.cc:2804] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:44.421533 19301 raft_consensus.cc:493] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.421983 19301 raft_consensus.cc:3060] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.429339 19347 raft_consensus.cc:2804] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:44.430014 19347 raft_consensus.cc:493] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.430450 19347 raft_consensus.cc:3060] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.442667 19028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ab6d6087449ffba8dd9a00abee03f" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7"
I20260709 13:06:44.443758 19028 raft_consensus.cc:3060] T b33ab6d6087449ffba8dd9a00abee03f P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.452580 19311 raft_consensus.cc:515] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.456912 19030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e827f740ed46f8a41dd34ba382bf83" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7"
W20260709 13:06:44.459853 19070 leader_election.cc:343] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:44.449225 19144 leader_election.cc:343] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:44.476619 19071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35263, user_credentials={real_user=slave}} blocked reactor thread for 64201.6us
I20260709 13:06:44.479067 19178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a73a5950c304c079b67013e79cff93a" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" is_pre_election: true
I20260709 13:06:44.480086 19178 raft_consensus.cc:2468] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 0.
I20260709 13:06:44.486444 19338 raft_consensus.cc:515] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.507050 19351 raft_consensus.cc:493] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.507670 19351 raft_consensus.cc:515] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.508024 19341 raft_consensus.cc:697] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Becoming Leader. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Running, Role: LEADER
I20260709 13:06:44.509035 19341 consensus_queue.cc:237] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.510012 19351 leader_election.cc:290] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:44.511844 19030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a583aaa89c04259a6d38100fe448cdf" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7" is_pre_election: true
I20260709 13:06:44.514186 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b506e6c7e944a398bfd174c5057182b" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" is_pre_election: true
I20260709 13:06:44.515127 19102 raft_consensus.cc:2468] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 829e1719f453473c934e820685b7f6b7 in term 0.
I20260709 13:06:44.517488 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a583aaa89c04259a6d38100fe448cdf" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" is_pre_election: true
I20260709 13:06:44.518400 19102 raft_consensus.cc:2468] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 829e1719f453473c934e820685b7f6b7 in term 0.
I20260709 13:06:44.533632 19178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a583aaa89c04259a6d38100fe448cdf" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" is_pre_election: true
I20260709 13:06:44.534797 19178 raft_consensus.cc:2468] T 4a583aaa89c04259a6d38100fe448cdf P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 0.
I20260709 13:06:44.540094 19311 leader_election.cc:290] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Requested vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:44.543391 19027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b506e6c7e944a398bfd174c5057182b" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7"
I20260709 13:06:44.524683 19347 raft_consensus.cc:515] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.547775 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b506e6c7e944a398bfd174c5057182b" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
I20260709 13:06:44.549633 19102 raft_consensus.cc:3060] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.551227 19030 raft_consensus.cc:2393] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e39ee95ba5824b7ca83380fc4f0c596a in current term 1: Already voted for candidate 829e1719f453473c934e820685b7f6b7 in this term.
I20260709 13:06:44.554482 19178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a583aaa89c04259a6d38100fe448cdf" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
I20260709 13:06:44.555116 19071 leader_election.cc:304] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 829e1719f453473c934e820685b7f6b7
I20260709 13:06:44.555289 19178 raft_consensus.cc:3060] T 4a583aaa89c04259a6d38100fe448cdf P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.555774 19301 raft_consensus.cc:515] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.556493 19071 leader_election.cc:304] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:44.557132 19027 raft_consensus.cc:2393] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in current term 1: Already voted for candidate 829e1719f453473c934e820685b7f6b7 in this term.
I20260709 13:06:44.557705 19351 raft_consensus.cc:2804] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:44.558109 19351 raft_consensus.cc:493] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.558468 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e827f740ed46f8a41dd34ba382bf83" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
I20260709 13:06:44.559183 19177 raft_consensus.cc:3060] T d3e827f740ed46f8a41dd34ba382bf83 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.560290 19323 tablet_bootstrap.cc:492] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: No bootstrap required, opened a new log
I20260709 13:06:44.558444 19351 raft_consensus.cc:3060] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.560851 19323 ts_tablet_manager.cc:1403] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent bootstrapping tablet: real 0.237s	user 0.089s	sys 0.112s
I20260709 13:06:44.563390 19324 tablet_bootstrap.cc:492] T a01279662936472b899ddf84c1b6b655 P e39ee95ba5824b7ca83380fc4f0c596a: No bootstrap required, opened a new log
I20260709 13:06:44.564234 19324 ts_tablet_manager.cc:1403] T a01279662936472b899ddf84c1b6b655 P e39ee95ba5824b7ca83380fc4f0c596a: Time spent bootstrapping tablet: real 0.343s	user 0.111s	sys 0.144s
I20260709 13:06:44.564451 19323 raft_consensus.cc:359] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.564064 19341 raft_consensus.cc:2804] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:44.565270 19323 raft_consensus.cc:385] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.565620 19341 raft_consensus.cc:493] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.566004 19323 raft_consensus.cc:740] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.549288 19338 leader_election.cc:290] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 election: Requested vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305)
I20260709 13:06:44.567328 19323 consensus_queue.cc:260] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.565209 19028 raft_consensus.cc:2468] T b33ab6d6087449ffba8dd9a00abee03f P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 1.
I20260709 13:06:44.567351 19347 leader_election.cc:290] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 election: Requested vote from peers e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:44.569988 19323 ts_tablet_manager.cc:1434] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:06:44.574770 19144 leader_election.cc:304] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, b2ef83e29a8e4e8694c3c7c2dd06f9d4; no voters: e39ee95ba5824b7ca83380fc4f0c596a
I20260709 13:06:44.576344 19179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b506e6c7e944a398bfd174c5057182b" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
I20260709 13:06:44.577270 19338 raft_consensus.cc:2804] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:44.577399 19179 raft_consensus.cc:2393] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 829e1719f453473c934e820685b7f6b7 in current term 1: Already voted for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in this term.
I20260709 13:06:44.570958 19301 leader_election.cc:290] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 election: Requested vote from peers e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:44.577865 19338 raft_consensus.cc:697] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 LEADER]: Becoming Leader. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Running, Role: LEADER
I20260709 13:06:44.578845 19338 consensus_queue.cc:237] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.577885 19102 raft_consensus.cc:2468] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 1.
I20260709 13:06:44.585368 19144 leader_election.cc:304] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:44.588307 19308 raft_consensus.cc:2804] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:44.592676 19177 raft_consensus.cc:2468] T d3e827f740ed46f8a41dd34ba382bf83 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 1.
I20260709 13:06:44.571748 19341 raft_consensus.cc:3060] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.603799 19322 tablet_bootstrap.cc:492] T 5a73a5950c304c079b67013e79cff93a P 829e1719f453473c934e820685b7f6b7: No bootstrap required, opened a new log
I20260709 13:06:44.604787 18925 catalog_manager.cc:5697] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a reported cstate change: term changed from 0 to 1, leader changed from <none> to e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66). New cstate: current_term: 1 leader_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:44.607335 19308 raft_consensus.cc:697] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 LEADER]: Becoming Leader. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Running, Role: LEADER
I20260709 13:06:44.610052 19324 raft_consensus.cc:359] T a01279662936472b899ddf84c1b6b655 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.611131 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a583aaa89c04259a6d38100fe448cdf" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
I20260709 13:06:44.612510 19103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b506e6c7e944a398bfd174c5057182b" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
I20260709 13:06:44.615350 19322 ts_tablet_manager.cc:1403] T 5a73a5950c304c079b67013e79cff93a P 829e1719f453473c934e820685b7f6b7: Time spent bootstrapping tablet: real 0.460s	user 0.120s	sys 0.240s
I20260709 13:06:44.615891 19103 raft_consensus.cc:2393] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 829e1719f453473c934e820685b7f6b7 in current term 1: Already voted for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in this term.
I20260709 13:06:44.617426 19308 consensus_queue.cc:237] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.622504 19178 raft_consensus.cc:2468] T 4a583aaa89c04259a6d38100fe448cdf P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 829e1719f453473c934e820685b7f6b7 in term 1.
I20260709 13:06:44.623919 18996 leader_election.cc:304] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, b2ef83e29a8e4e8694c3c7c2dd06f9d4; no voters: 
I20260709 13:06:44.625025 19301 raft_consensus.cc:2804] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:44.624928 19324 raft_consensus.cc:385] T a01279662936472b899ddf84c1b6b655 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.625887 19324 raft_consensus.cc:740] T a01279662936472b899ddf84c1b6b655 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.625890 19301 raft_consensus.cc:697] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [term 1 LEADER]: Becoming Leader. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Running, Role: LEADER
I20260709 13:06:44.612439 19351 raft_consensus.cc:515] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.628378 19324 consensus_queue.cc:260] T a01279662936472b899ddf84c1b6b655 P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.628170 19301 consensus_queue.cc:237] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.631001 19351 leader_election.cc:290] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Requested vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:44.619470 19322 raft_consensus.cc:359] T 5a73a5950c304c079b67013e79cff93a P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.624188 18926 catalog_manager.cc:5697] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67). New cstate: current_term: 1 leader_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.632232 19030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a73a5950c304c079b67013e79cff93a" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7"
I20260709 13:06:44.632391 19322 raft_consensus.cc:385] T 5a73a5950c304c079b67013e79cff93a P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.632902 19322 raft_consensus.cc:740] T 5a73a5950c304c079b67013e79cff93a P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.635205 19324 ts_tablet_manager.cc:1434] T a01279662936472b899ddf84c1b6b655 P e39ee95ba5824b7ca83380fc4f0c596a: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.007s
I20260709 13:06:44.636938 19324 tablet_bootstrap.cc:492] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a: Bootstrap starting.
I20260709 13:06:44.633930 19322 consensus_queue.cc:260] T 5a73a5950c304c079b67013e79cff93a P 829e1719f453473c934e820685b7f6b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.639756 19071 leader_election.cc:304] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 829e1719f453473c934e820685b7f6b7
I20260709 13:06:44.643095 19351 raft_consensus.cc:2804] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:44.640615 19030 raft_consensus.cc:3060] T 5a73a5950c304c079b67013e79cff93a P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.646705 18995 leader_election.cc:304] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 829e1719f453473c934e820685b7f6b7; no voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4, e39ee95ba5824b7ca83380fc4f0c596a
I20260709 13:06:44.648218 19347 raft_consensus.cc:2749] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:44.640077 19341 raft_consensus.cc:515] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.652117 19178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a73a5950c304c079b67013e79cff93a" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
I20260709 13:06:44.653908 19178 raft_consensus.cc:3060] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.655714 19351 raft_consensus.cc:697] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Becoming Leader. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Running, Role: LEADER
I20260709 13:06:44.656613 19324 tablet_bootstrap.cc:654] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.657159 19102 raft_consensus.cc:2393] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 829e1719f453473c934e820685b7f6b7 in current term 1: Already voted for candidate e39ee95ba5824b7ca83380fc4f0c596a in this term.
I20260709 13:06:44.657521 19351 consensus_queue.cc:237] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.661484 19341 leader_election.cc:290] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Requested vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:44.663031 19027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a583aaa89c04259a6d38100fe448cdf" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7"
I20260709 13:06:44.642590 19322 ts_tablet_manager.cc:1434] T 5a73a5950c304c079b67013e79cff93a P 829e1719f453473c934e820685b7f6b7: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 13:06:44.659778 19030 raft_consensus.cc:2468] T 5a73a5950c304c079b67013e79cff93a P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 1.
I20260709 13:06:44.670917 19070 leader_election.cc:304] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:44.671933 19350 raft_consensus.cc:2804] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:44.672421 19350 raft_consensus.cc:697] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Becoming Leader. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Running, Role: LEADER
I20260709 13:06:44.672791 19322 tablet_bootstrap.cc:492] T d3e827f740ed46f8a41dd34ba382bf83 P 829e1719f453473c934e820685b7f6b7: Bootstrap starting.
I20260709 13:06:44.673775 19350 consensus_queue.cc:237] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.692376 19178 raft_consensus.cc:2468] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 1.
I20260709 13:06:44.698220 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a583aaa89c04259a6d38100fe448cdf" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
I20260709 13:06:44.699168 19177 raft_consensus.cc:2393] T 4a583aaa89c04259a6d38100fe448cdf P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e39ee95ba5824b7ca83380fc4f0c596a in current term 1: Already voted for candidate 829e1719f453473c934e820685b7f6b7 in this term.
I20260709 13:06:44.703678 19322 tablet_bootstrap.cc:654] T d3e827f740ed46f8a41dd34ba382bf83 P 829e1719f453473c934e820685b7f6b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.705690 19071 leader_election.cc:304] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e39ee95ba5824b7ca83380fc4f0c596a; no voters: 829e1719f453473c934e820685b7f6b7, b2ef83e29a8e4e8694c3c7c2dd06f9d4
I20260709 13:06:44.706673 19350 raft_consensus.cc:2749] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:44.707434 19324 tablet_bootstrap.cc:492] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a: No bootstrap required, opened a new log
I20260709 13:06:44.708027 19324 ts_tablet_manager.cc:1403] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a: Time spent bootstrapping tablet: real 0.072s	user 0.023s	sys 0.011s
I20260709 13:06:44.718295 19324 raft_consensus.cc:359] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.719446 19322 tablet_bootstrap.cc:492] T d3e827f740ed46f8a41dd34ba382bf83 P 829e1719f453473c934e820685b7f6b7: No bootstrap required, opened a new log
I20260709 13:06:44.719563 19324 raft_consensus.cc:385] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.720577 19322 ts_tablet_manager.cc:1403] T d3e827f740ed46f8a41dd34ba382bf83 P 829e1719f453473c934e820685b7f6b7: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.000s
I20260709 13:06:44.720908 19324 raft_consensus.cc:740] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.722121 19324 consensus_queue.cc:260] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.724133 19324 ts_tablet_manager.cc:1434] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.006s
I20260709 13:06:44.724723 19322 raft_consensus.cc:359] T d3e827f740ed46f8a41dd34ba382bf83 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.725643 19324 tablet_bootstrap.cc:492] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a: Bootstrap starting.
I20260709 13:06:44.725730 19322 raft_consensus.cc:385] T d3e827f740ed46f8a41dd34ba382bf83 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.726420 19322 raft_consensus.cc:740] T d3e827f740ed46f8a41dd34ba382bf83 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.727574 19322 consensus_queue.cc:260] T d3e827f740ed46f8a41dd34ba382bf83 P 829e1719f453473c934e820685b7f6b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.730799 19322 ts_tablet_manager.cc:1434] T d3e827f740ed46f8a41dd34ba382bf83 P 829e1719f453473c934e820685b7f6b7: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:06:44.732030 19322 tablet_bootstrap.cc:492] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7: Bootstrap starting.
I20260709 13:06:44.734079 19324 tablet_bootstrap.cc:654] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.739262 19322 tablet_bootstrap.cc:654] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.744405 18928 catalog_manager.cc:5697] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 829e1719f453473c934e820685b7f6b7 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "829e1719f453473c934e820685b7f6b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:44.755439 19324 tablet_bootstrap.cc:492] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a: No bootstrap required, opened a new log
I20260709 13:06:44.756065 19324 ts_tablet_manager.cc:1403] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a: Time spent bootstrapping tablet: real 0.031s	user 0.027s	sys 0.000s
I20260709 13:06:44.756215 19350 raft_consensus.cc:493] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.756824 19350 raft_consensus.cc:515] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.759361 19350 leader_election.cc:290] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:44.759876 19324 raft_consensus.cc:359] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.760771 19324 raft_consensus.cc:385] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.761166 19324 raft_consensus.cc:740] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.761986 19324 consensus_queue.cc:260] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.763316 19030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a228e7541a54198823a7f8cb28c7d36" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7" is_pre_election: true
I20260709 13:06:44.764191 19030 raft_consensus.cc:2468] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 0.
I20260709 13:06:44.764833 19324 ts_tablet_manager.cc:1434] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:06:44.765383 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a228e7541a54198823a7f8cb28c7d36" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" is_pre_election: true
I20260709 13:06:44.766034 19324 tablet_bootstrap.cc:492] T b33ab6d6087449ffba8dd9a00abee03f P e39ee95ba5824b7ca83380fc4f0c596a: Bootstrap starting.
I20260709 13:06:44.766155 19177 raft_consensus.cc:2468] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 0.
I20260709 13:06:44.765650 18927 catalog_manager.cc:5697] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a reported cstate change: term changed from 0 to 1, leader changed from <none> to e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66). New cstate: current_term: 1 leader_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:44.767926 19071 leader_election.cc:304] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:44.770660 19350 raft_consensus.cc:2804] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:44.771067 19350 raft_consensus.cc:493] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.771454 19350 raft_consensus.cc:3060] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.774912 19324 tablet_bootstrap.cc:654] T b33ab6d6087449ffba8dd9a00abee03f P e39ee95ba5824b7ca83380fc4f0c596a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.775048 19322 tablet_bootstrap.cc:492] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7: No bootstrap required, opened a new log
I20260709 13:06:44.775686 19322 ts_tablet_manager.cc:1403] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.004s
I20260709 13:06:44.779479 19322 raft_consensus.cc:359] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.780712 19322 raft_consensus.cc:385] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.781226 19322 raft_consensus.cc:740] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.781965 18926 catalog_manager.cc:5697] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67). New cstate: current_term: 1 leader_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.782516 19322 consensus_queue.cc:260] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.786029 19322 ts_tablet_manager.cc:1434] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:06:44.787010 19324 tablet_bootstrap.cc:492] T b33ab6d6087449ffba8dd9a00abee03f P e39ee95ba5824b7ca83380fc4f0c596a: No bootstrap required, opened a new log
I20260709 13:06:44.787289 19322 tablet_bootstrap.cc:492] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7: Bootstrap starting.
I20260709 13:06:44.787878 19324 ts_tablet_manager.cc:1403] T b33ab6d6087449ffba8dd9a00abee03f P e39ee95ba5824b7ca83380fc4f0c596a: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.009s
I20260709 13:06:44.793864 19324 raft_consensus.cc:359] T b33ab6d6087449ffba8dd9a00abee03f P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.794751 19324 raft_consensus.cc:385] T b33ab6d6087449ffba8dd9a00abee03f P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.795817 19324 raft_consensus.cc:740] T b33ab6d6087449ffba8dd9a00abee03f P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.767916 18927 catalog_manager.cc:5697] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a reported cstate change: term changed from 0 to 1, leader changed from <none> to e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66). New cstate: current_term: 1 leader_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:44.796751 19324 consensus_queue.cc:260] T b33ab6d6087449ffba8dd9a00abee03f P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.799266 19324 ts_tablet_manager.cc:1434] T b33ab6d6087449ffba8dd9a00abee03f P e39ee95ba5824b7ca83380fc4f0c596a: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:06:44.801486 19322 tablet_bootstrap.cc:654] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:44.801225 19350 raft_consensus.cc:515] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.804885 19030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a228e7541a54198823a7f8cb28c7d36" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7"
I20260709 13:06:44.805514 19030 raft_consensus.cc:3060] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.806951 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a228e7541a54198823a7f8cb28c7d36" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
I20260709 13:06:44.807646 19177 raft_consensus.cc:3060] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.816519 19030 raft_consensus.cc:2468] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 1.
I20260709 13:06:44.817464 19322 tablet_bootstrap.cc:492] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7: No bootstrap required, opened a new log
I20260709 13:06:44.818018 19322 ts_tablet_manager.cc:1403] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.000s
I20260709 13:06:44.817874 19070 leader_election.cc:304] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:44.818897 19350 leader_election.cc:290] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Requested vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:44.818897 19351 raft_consensus.cc:2804] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:44.817214 19177 raft_consensus.cc:2468] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 1.
I20260709 13:06:44.820402 19308 raft_consensus.cc:493] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.821110 19308 raft_consensus.cc:515] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.819790 19351 raft_consensus.cc:697] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Becoming Leader. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Running, Role: LEADER
I20260709 13:06:44.822624 19351 consensus_queue.cc:237] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.823411 19308 leader_election.cc:290] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305)
I20260709 13:06:44.825709 19341 raft_consensus.cc:493] T b33ab6d6087449ffba8dd9a00abee03f P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.826320 19341 raft_consensus.cc:515] T b33ab6d6087449ffba8dd9a00abee03f P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.829437 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01279662936472b899ddf84c1b6b655" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" is_pre_election: true
I20260709 13:06:44.830297 19102 raft_consensus.cc:2468] T a01279662936472b899ddf84c1b6b655 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 0.
I20260709 13:06:44.832654 19027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ab6d6087449ffba8dd9a00abee03f" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7" is_pre_election: true
I20260709 13:06:44.833679 19027 raft_consensus.cc:2393] T b33ab6d6087449ffba8dd9a00abee03f P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e39ee95ba5824b7ca83380fc4f0c596a in current term 1: Already voted for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in this term.
I20260709 13:06:44.821180 19322 raft_consensus.cc:359] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.836391 19178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33ab6d6087449ffba8dd9a00abee03f" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" is_pre_election: true
I20260709 13:06:44.836763 19322 raft_consensus.cc:385] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:44.837273 19322 raft_consensus.cc:740] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Initialized, Role: FOLLOWER
I20260709 13:06:44.826440 19030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01279662936472b899ddf84c1b6b655" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7" is_pre_election: true
I20260709 13:06:44.838548 19030 raft_consensus.cc:2468] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 0.
I20260709 13:06:44.838621 19144 leader_election.cc:304] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:44.840237 19322 consensus_queue.cc:260] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.840783 19071 leader_election.cc:304] T b33ab6d6087449ffba8dd9a00abee03f P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e39ee95ba5824b7ca83380fc4f0c596a; no voters: 829e1719f453473c934e820685b7f6b7, b2ef83e29a8e4e8694c3c7c2dd06f9d4
I20260709 13:06:44.842500 19311 raft_consensus.cc:3060] T b33ab6d6087449ffba8dd9a00abee03f P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.843624 19322 ts_tablet_manager.cc:1434] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:06:44.845589 19308 raft_consensus.cc:2804] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:44.846216 19308 raft_consensus.cc:493] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.846676 19308 raft_consensus.cc:3060] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.828744 19341 leader_election.cc:290] T b33ab6d6087449ffba8dd9a00abee03f P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
W20260709 13:06:44.849313 18976 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:44.851691 19311 raft_consensus.cc:2749] T b33ab6d6087449ffba8dd9a00abee03f P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:44.852737 19311 raft_consensus.cc:493] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.853323 19311 raft_consensus.cc:515] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.864692 19301 raft_consensus.cc:493] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.858983 19308 raft_consensus.cc:515] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.865267 19301 raft_consensus.cc:515] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.867154 19308 leader_election.cc:290] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 election: Requested vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305)
I20260709 13:06:44.867424 19301 leader_election.cc:290] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:44.867836 19311 leader_election.cc:290] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:44.868448 19030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4586d1988846818c9198992321459a" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7" is_pre_election: true
I20260709 13:06:44.869217 19030 raft_consensus.cc:2468] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 0.
I20260709 13:06:44.870731 19070 leader_election.cc:304] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:44.871985 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4586d1988846818c9198992321459a" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" is_pre_election: true
I20260709 13:06:44.872253 19179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4586d1988846818c9198992321459a" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" is_pre_election: true
I20260709 13:06:44.873087 19177 raft_consensus.cc:2468] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 0.
I20260709 13:06:44.874797 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4586d1988846818c9198992321459a" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" is_pre_election: true
I20260709 13:06:44.875618 19102 raft_consensus.cc:2468] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 829e1719f453473c934e820685b7f6b7 in term 0.
I20260709 13:06:44.877156 19301 raft_consensus.cc:493] T d3e827f740ed46f8a41dd34ba382bf83 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.877811 19301 raft_consensus.cc:515] T d3e827f740ed46f8a41dd34ba382bf83 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.879207 19030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01279662936472b899ddf84c1b6b655" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7"
I20260709 13:06:44.879921 19030 raft_consensus.cc:3060] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.881794 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e827f740ed46f8a41dd34ba382bf83" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" is_pre_election: true
I20260709 13:06:44.881498 18927 catalog_manager.cc:5697] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a reported cstate change: term changed from 0 to 1, leader changed from <none> to e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66). New cstate: current_term: 1 leader_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:44.882717 19177 raft_consensus.cc:2393] T d3e827f740ed46f8a41dd34ba382bf83 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 829e1719f453473c934e820685b7f6b7 in current term 1: Already voted for candidate e39ee95ba5824b7ca83380fc4f0c596a in this term.
I20260709 13:06:44.884217 19103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e827f740ed46f8a41dd34ba382bf83" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" is_pre_election: true
I20260709 13:06:44.885393 18995 leader_election.cc:304] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, e39ee95ba5824b7ca83380fc4f0c596a; no voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4
I20260709 13:06:44.886412 19347 raft_consensus.cc:2804] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:44.886808 19347 raft_consensus.cc:493] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.887128 19347 raft_consensus.cc:3060] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.887465 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01279662936472b899ddf84c1b6b655" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
I20260709 13:06:44.888130 19102 raft_consensus.cc:3060] T a01279662936472b899ddf84c1b6b655 P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.890412 18995 leader_election.cc:304] T d3e827f740ed46f8a41dd34ba382bf83 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 829e1719f453473c934e820685b7f6b7; no voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4, e39ee95ba5824b7ca83380fc4f0c596a
I20260709 13:06:44.891386 19334 raft_consensus.cc:3060] T d3e827f740ed46f8a41dd34ba382bf83 P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.892048 19351 raft_consensus.cc:2804] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:44.892539 19351 raft_consensus.cc:493] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.892880 19351 raft_consensus.cc:3060] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.893049 19301 leader_election.cc:290] T d3e827f740ed46f8a41dd34ba382bf83 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:44.895013 19347 raft_consensus.cc:515] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.898298 19105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4586d1988846818c9198992321459a" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
I20260709 13:06:44.898527 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4586d1988846818c9198992321459a" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
I20260709 13:06:44.899260 19177 raft_consensus.cc:3060] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:44.900252 19334 raft_consensus.cc:2749] T d3e827f740ed46f8a41dd34ba382bf83 P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:44.901146 19347 leader_election.cc:290] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 election: Requested vote from peers e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:44.907261 19177 raft_consensus.cc:2468] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 829e1719f453473c934e820685b7f6b7 in term 1.
I20260709 13:06:44.908787 18996 leader_election.cc:304] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, b2ef83e29a8e4e8694c3c7c2dd06f9d4; no voters: 
I20260709 13:06:44.909976 19347 raft_consensus.cc:2804] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:44.911347 19347 raft_consensus.cc:697] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7 [term 1 LEADER]: Becoming Leader. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Running, Role: LEADER
I20260709 13:06:44.912379 19347 consensus_queue.cc:237] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.907261 19102 raft_consensus.cc:2468] T a01279662936472b899ddf84c1b6b655 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 1.
I20260709 13:06:44.914876 19144 leader_election.cc:304] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:44.915313 19351 raft_consensus.cc:515] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.909528 19030 raft_consensus.cc:2468] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 1.
I20260709 13:06:44.916183 19308 raft_consensus.cc:2804] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:44.916950 19308 raft_consensus.cc:697] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 LEADER]: Becoming Leader. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Running, Role: LEADER
I20260709 13:06:44.918370 19308 consensus_queue.cc:237] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:44.924450 18927 catalog_manager.cc:5697] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 829e1719f453473c934e820685b7f6b7 (127.8.4.65). New cstate: current_term: 1 leader_uuid: "829e1719f453473c934e820685b7f6b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:44.930773 19105 raft_consensus.cc:2393] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 829e1719f453473c934e820685b7f6b7 in current term 1: Already voted for candidate e39ee95ba5824b7ca83380fc4f0c596a in this term.
I20260709 13:06:44.936192 19351 leader_election.cc:290] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Requested vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:44.936800 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4586d1988846818c9198992321459a" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
I20260709 13:06:44.937513 19030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4586d1988846818c9198992321459a" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829e1719f453473c934e820685b7f6b7"
I20260709 13:06:44.937855 19177 raft_consensus.cc:2393] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e39ee95ba5824b7ca83380fc4f0c596a in current term 1: Already voted for candidate 829e1719f453473c934e820685b7f6b7 in this term.
I20260709 13:06:44.944972 19071 leader_election.cc:304] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e39ee95ba5824b7ca83380fc4f0c596a; no voters: 829e1719f453473c934e820685b7f6b7, b2ef83e29a8e4e8694c3c7c2dd06f9d4
I20260709 13:06:44.945987 19351 raft_consensus.cc:2749] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:44.947135 18927 catalog_manager.cc:5697] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67). New cstate: current_term: 1 leader_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:45.049453 19308 consensus_queue.cc:1048] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:45.067668 19351 consensus_queue.cc:1048] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:45.068785 19338 consensus_queue.cc:1048] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:45.085332 19030 raft_consensus.cc:3060] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:45.096374 19105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a228e7541a54198823a7f8cb28c7d36"
dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
mode: GRACEFUL
new_leader_uuid: "829e1719f453473c934e820685b7f6b7"
 from {username='slave'} at 127.0.0.1:57548
I20260709 13:06:45.097167 19105 raft_consensus.cc:606] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Received request to transfer leadership to TS 829e1719f453473c934e820685b7f6b7
I20260709 13:06:45.100243 19341 consensus_queue.cc:1048] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:45.103869 19105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ddf0309e4884e2eb558def45c86820a"
dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
mode: GRACEFUL
new_leader_uuid: "829e1719f453473c934e820685b7f6b7"
 from {username='slave'} at 127.0.0.1:57548
I20260709 13:06:45.104485 19105 raft_consensus.cc:606] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Received request to transfer leadership to TS 829e1719f453473c934e820685b7f6b7
I20260709 13:06:45.108971 19350 raft_consensus.cc:993] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a: : Instructing follower 829e1719f453473c934e820685b7f6b7 to start an election
I20260709 13:06:45.109524 19341 raft_consensus.cc:1081] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Signalling peer 829e1719f453473c934e820685b7f6b7 to start an election
I20260709 13:06:45.111209 19030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ddf0309e4884e2eb558def45c86820a"
dest_uuid: "829e1719f453473c934e820685b7f6b7"
 from {username='slave'} at 127.0.0.1:53880
I20260709 13:06:45.113183 19030 raft_consensus.cc:493] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:45.113715 19030 raft_consensus.cc:3060] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.117264 19338 consensus_queue.cc:1048] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:45.119693 19350 consensus_queue.cc:1048] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:45.123016 19350 consensus_queue.cc:1048] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:45.122763 19030 raft_consensus.cc:515] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:45.126448 19178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddf0309e4884e2eb558def45c86820a" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
I20260709 13:06:45.127285 19178 raft_consensus.cc:3060] T 7ddf0309e4884e2eb558def45c86820a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.130400 19105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddf0309e4884e2eb558def45c86820a" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
I20260709 13:06:45.131675 19105 raft_consensus.cc:3055] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:45.132066 19105 raft_consensus.cc:740] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Running, Role: LEADER
I20260709 13:06:45.133100 19105 consensus_queue.cc:260] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:45.134316 19105 raft_consensus.cc:3060] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.135280 19334 consensus_queue.cc:1048] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:45.140868 19178 raft_consensus.cc:2468] T 7ddf0309e4884e2eb558def45c86820a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 829e1719f453473c934e820685b7f6b7 in term 2.
I20260709 13:06:45.141203 19030 leader_election.cc:290] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 2 election: Requested vote from peers e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:45.142465 18996 leader_election.cc:304] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, b2ef83e29a8e4e8694c3c7c2dd06f9d4; no voters: 
I20260709 13:06:45.142841 19179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a01279662936472b899ddf84c1b6b655"
dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
mode: GRACEFUL
new_leader_uuid: "829e1719f453473c934e820685b7f6b7"
 from {username='slave'} at 127.0.0.1:59968
I20260709 13:06:45.143776 19179 raft_consensus.cc:606] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 LEADER]: Received request to transfer leadership to TS 829e1719f453473c934e820685b7f6b7
I20260709 13:06:45.144837 19347 raft_consensus.cc:2804] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:45.145720 19347 raft_consensus.cc:697] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7 [term 2 LEADER]: Becoming Leader. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Running, Role: LEADER
I20260709 13:06:45.146931 19347 consensus_queue.cc:237] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:45.157264 19105 raft_consensus.cc:2468] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 829e1719f453473c934e820685b7f6b7 in term 2.
I20260709 13:06:45.162870 19308 consensus_queue.cc:1048] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:45.169483 19178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b506e6c7e944a398bfd174c5057182b"
dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
mode: GRACEFUL
new_leader_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
 from {username='slave'} at 127.0.0.1:59968
I20260709 13:06:45.170807 19178 raft_consensus.cc:606] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 LEADER]: Received request to transfer leadership to TS e39ee95ba5824b7ca83380fc4f0c596a
I20260709 13:06:45.186793 19308 raft_consensus.cc:993] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4: : Instructing follower e39ee95ba5824b7ca83380fc4f0c596a to start an election
I20260709 13:06:45.187284 19308 raft_consensus.cc:1081] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 LEADER]: Signalling peer e39ee95ba5824b7ca83380fc4f0c596a to start an election
I20260709 13:06:45.189697 19102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b506e6c7e944a398bfd174c5057182b"
dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
 from {username='slave'} at 127.0.0.1:57544
I20260709 13:06:45.193861 19102 raft_consensus.cc:493] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:45.195591 19102 raft_consensus.cc:3060] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.210774 19350 consensus_queue.cc:1048] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:45.208161 19102 raft_consensus.cc:515] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:45.229138 19351 consensus_queue.cc:1048] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:45.231989 19102 leader_election.cc:290] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 2 election: Requested vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:45.232903 19027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b506e6c7e944a398bfd174c5057182b" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "829e1719f453473c934e820685b7f6b7"
I20260709 13:06:45.233680 19027 raft_consensus.cc:3060] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.234885 19030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a583aaa89c04259a6d38100fe448cdf"
dest_uuid: "829e1719f453473c934e820685b7f6b7"
mode: GRACEFUL
new_leader_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
 from {username='slave'} at 127.0.0.1:42652
I20260709 13:06:45.235948 19030 raft_consensus.cc:606] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [term 1 LEADER]: Received request to transfer leadership to TS e39ee95ba5824b7ca83380fc4f0c596a
I20260709 13:06:45.238041 19178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b506e6c7e944a398bfd174c5057182b" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
I20260709 13:06:45.238857 19178 raft_consensus.cc:3055] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:45.239224 19178 raft_consensus.cc:740] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Running, Role: LEADER
I20260709 13:06:45.242226 19350 consensus_queue.cc:1048] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:45.240298 19178 consensus_queue.cc:260] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:45.254983 19178 raft_consensus.cc:3060] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.257664 19027 raft_consensus.cc:2468] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 2.
I20260709 13:06:45.259121 19070 leader_election.cc:304] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:45.260262 19350 raft_consensus.cc:2804] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:45.260965 19350 raft_consensus.cc:697] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a [term 2 LEADER]: Becoming Leader. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Running, Role: LEADER
I20260709 13:06:45.261332 18928 catalog_manager.cc:5697] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7 reported cstate change: term changed from 1 to 2, leader changed from e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66) to 829e1719f453473c934e820685b7f6b7 (127.8.4.65). New cstate: current_term: 2 leader_uuid: "829e1719f453473c934e820685b7f6b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:45.263618 19350 consensus_queue.cc:237] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:45.274308 19341 raft_consensus.cc:993] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a: : Instructing follower 829e1719f453473c934e820685b7f6b7 to start an election
I20260709 13:06:45.275053 19341 raft_consensus.cc:1081] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Signalling peer 829e1719f453473c934e820685b7f6b7 to start an election
I20260709 13:06:45.280331 19028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a228e7541a54198823a7f8cb28c7d36"
dest_uuid: "829e1719f453473c934e820685b7f6b7"
 from {username='slave'} at 127.0.0.1:53880
I20260709 13:06:45.281111 19028 raft_consensus.cc:493] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:45.281548 19028 raft_consensus.cc:3060] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.284574 19351 consensus_queue.cc:1048] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:45.290288 19028 raft_consensus.cc:515] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:45.292677 19301 consensus_queue.cc:1048] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:45.290012 18925 catalog_manager.cc:5697] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a reported cstate change: term changed from 1 to 2, leader changed from b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67) to e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66). New cstate: current_term: 2 leader_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:45.301307 19028 leader_election.cc:290] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 2 election: Requested vote from peers e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:45.302552 19179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a228e7541a54198823a7f8cb28c7d36" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
I20260709 13:06:45.302917 19178 raft_consensus.cc:2468] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 2.
I20260709 13:06:45.309161 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a228e7541a54198823a7f8cb28c7d36" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
I20260709 13:06:45.310119 19102 raft_consensus.cc:3055] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:45.310604 19102 raft_consensus.cc:740] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Running, Role: LEADER
I20260709 13:06:45.315383 19102 consensus_queue.cc:260] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:45.316700 19102 raft_consensus.cc:3060] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.323998 19102 raft_consensus.cc:2468] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 829e1719f453473c934e820685b7f6b7 in term 2.
I20260709 13:06:45.327261 18995 leader_election.cc:304] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, e39ee95ba5824b7ca83380fc4f0c596a; no voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4
I20260709 13:06:45.328218 19301 raft_consensus.cc:2804] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:45.328819 19301 raft_consensus.cc:697] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [term 2 LEADER]: Becoming Leader. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Running, Role: LEADER
I20260709 13:06:45.329620 19301 consensus_queue.cc:237] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:45.338742 18927 catalog_manager.cc:5697] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 reported cstate change: term changed from 1 to 2, leader changed from e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66) to 829e1719f453473c934e820685b7f6b7 (127.8.4.65). New cstate: current_term: 2 leader_uuid: "829e1719f453473c934e820685b7f6b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:45.350363 19301 consensus_queue.cc:1048] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:45.363433 19347 consensus_queue.cc:1048] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:45.459856 19354 consensus_queue.cc:1048] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:45.470741 19308 raft_consensus.cc:993] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: : Instructing follower 829e1719f453473c934e820685b7f6b7 to start an election
I20260709 13:06:45.471258 19308 raft_consensus.cc:1081] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 LEADER]: Signalling peer 829e1719f453473c934e820685b7f6b7 to start an election
I20260709 13:06:45.474627 19030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a01279662936472b899ddf84c1b6b655"
dest_uuid: "829e1719f453473c934e820685b7f6b7"
 from {username='slave'} at 127.0.0.1:53896
I20260709 13:06:45.475337 19030 raft_consensus.cc:493] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:45.475745 19030 raft_consensus.cc:3060] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.477491 19308 consensus_queue.cc:1048] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:45.484589 19030 raft_consensus.cc:515] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:45.488922 19030 leader_election.cc:290] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 2 election: Requested vote from peers e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:45.492514 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01279662936472b899ddf84c1b6b655" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
I20260709 13:06:45.493285 19102 raft_consensus.cc:3060] T a01279662936472b899ddf84c1b6b655 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.494529 19176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01279662936472b899ddf84c1b6b655" candidate_uuid: "829e1719f453473c934e820685b7f6b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
I20260709 13:06:45.495276 19176 raft_consensus.cc:3055] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:45.495617 19176 raft_consensus.cc:740] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Running, Role: LEADER
I20260709 13:06:45.496454 19176 consensus_queue.cc:260] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:45.497850 19176 raft_consensus.cc:3060] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.499853 19102 raft_consensus.cc:2468] T a01279662936472b899ddf84c1b6b655 P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 829e1719f453473c934e820685b7f6b7 in term 2.
I20260709 13:06:45.501418 18995 leader_election.cc:304] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:45.502355 19347 raft_consensus.cc:2804] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:45.502856 19347 raft_consensus.cc:697] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [term 2 LEADER]: Becoming Leader. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Running, Role: LEADER
I20260709 13:06:45.503717 19347 consensus_queue.cc:237] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:45.504522 19176 raft_consensus.cc:2468] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 829e1719f453473c934e820685b7f6b7 in term 2.
I20260709 13:06:45.513576 18925 catalog_manager.cc:5697] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 reported cstate change: term changed from 1 to 2, leader changed from b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67) to 829e1719f453473c934e820685b7f6b7 (127.8.4.65). New cstate: current_term: 2 leader_uuid: "829e1719f453473c934e820685b7f6b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:45.536522 19102 raft_consensus.cc:1275] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Refusing update from remote peer 829e1719f453473c934e820685b7f6b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:45.538203 19347 consensus_queue.cc:1048] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:45.550258 19176 raft_consensus.cc:1275] T 7ddf0309e4884e2eb558def45c86820a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Refusing update from remote peer 829e1719f453473c934e820685b7f6b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:45.552218 19301 consensus_queue.cc:1048] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:45.647658 19028 raft_consensus.cc:1275] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Refusing update from remote peer e39ee95ba5824b7ca83380fc4f0c596a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:45.648947 19351 consensus_queue.cc:1048] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:45.658149 19177 raft_consensus.cc:1275] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Refusing update from remote peer e39ee95ba5824b7ca83380fc4f0c596a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:45.662429 19341 consensus_queue.cc:1048] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:45.807868 19301 raft_consensus.cc:993] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7: : Instructing follower e39ee95ba5824b7ca83380fc4f0c596a to start an election
I20260709 13:06:45.808691 19334 raft_consensus.cc:1081] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [term 1 LEADER]: Signalling peer e39ee95ba5824b7ca83380fc4f0c596a to start an election
I20260709 13:06:45.810765 19102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a583aaa89c04259a6d38100fe448cdf"
dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
 from {username='slave'} at 127.0.0.1:57540
I20260709 13:06:45.811399 19102 raft_consensus.cc:493] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:45.811741 19102 raft_consensus.cc:3060] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.823791 19102 raft_consensus.cc:515] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:45.826817 19102 leader_election.cc:290] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 2 election: Requested vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67:35263)
I20260709 13:06:45.827919 19028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a583aaa89c04259a6d38100fe448cdf" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "829e1719f453473c934e820685b7f6b7"
I20260709 13:06:45.828074 19176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a583aaa89c04259a6d38100fe448cdf" candidate_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
I20260709 13:06:45.828719 19028 raft_consensus.cc:3055] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:45.828963 19176 raft_consensus.cc:3060] T 4a583aaa89c04259a6d38100fe448cdf P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.829146 19028 raft_consensus.cc:740] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Running, Role: LEADER
I20260709 13:06:45.832500 19028 consensus_queue.cc:260] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:45.834403 19028 raft_consensus.cc:3060] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.839533 19176 raft_consensus.cc:2468] T 4a583aaa89c04259a6d38100fe448cdf P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 2.
I20260709 13:06:45.840955 19071 leader_election.cc:304] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:45.842042 19350 raft_consensus.cc:2804] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:45.842567 19350 raft_consensus.cc:697] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [term 2 LEADER]: Becoming Leader. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Running, Role: LEADER
I20260709 13:06:45.842916 19028 raft_consensus.cc:2468] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e39ee95ba5824b7ca83380fc4f0c596a in term 2.
I20260709 13:06:45.844079 19176 raft_consensus.cc:3060] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.843986 19350 consensus_queue.cc:237] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:45.852727 19176 raft_consensus.cc:1275] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Refusing update from remote peer 829e1719f453473c934e820685b7f6b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:45.854182 18927 catalog_manager.cc:5697] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a reported cstate change: term changed from 1 to 2, leader changed from 829e1719f453473c934e820685b7f6b7 (127.8.4.65) to e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66). New cstate: current_term: 2 leader_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:45.854521 19334 consensus_queue.cc:1048] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:45.878078 19102 raft_consensus.cc:1275] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Refusing update from remote peer 829e1719f453473c934e820685b7f6b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:45.885000 19347 consensus_queue.cc:1048] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:45.970659 19176 raft_consensus.cc:1275] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Refusing update from remote peer 829e1719f453473c934e820685b7f6b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:45.972208 19301 consensus_queue.cc:1048] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:45.984040 19102 raft_consensus.cc:1275] T a01279662936472b899ddf84c1b6b655 P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Refusing update from remote peer 829e1719f453473c934e820685b7f6b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:45.986666 19301 consensus_queue.cc:1048] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:46.262493 19028 raft_consensus.cc:1275] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Refusing update from remote peer e39ee95ba5824b7ca83380fc4f0c596a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:46.264061 19341 consensus_queue.cc:1048] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:46.278928 19177 raft_consensus.cc:1275] T 4a583aaa89c04259a6d38100fe448cdf P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Refusing update from remote peer e39ee95ba5824b7ca83380fc4f0c596a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:46.280743 19341 consensus_queue.cc:1048] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:48.261854 18927 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42044:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:06:48.285295 18927 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42044:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:06:48.333173  8209 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:06:48.662689 19457 tablet.cc:1724] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:48.651568 19455 tablet.cc:1724] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:06:48.718312 19056 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:9a228e7541a54198823a7f8cb28c7d36)
W20260709 13:06:48.739251 19056 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:9a228e7541a54198823a7f8cb28c7d36)
W20260709 13:06:48.740450 19056 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:9a228e7541a54198823a7f8cb28c7d36)
I20260709 13:06:48.746737 19468 tablet.cc:1724] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:06:48.714206 18995 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.66:36305, user_credentials={real_user=slave}} blocked reactor thread for 46733.4us
I20260709 13:06:48.765070 19467 tablet.cc:1724] T d3e827f740ed46f8a41dd34ba382bf83 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:06:48.766901 19461 log.cc:927] Time spent T d3e827f740ed46f8a41dd34ba382bf83 P 829e1719f453473c934e820685b7f6b7: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:06:48.749387 19471 tablet.cc:1724] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:48.781239 19466 tablet.cc:1724] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:48.790175 19465 tablet.cc:1724] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:06:48.794055 19456 log.cc:927] Time spent T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Append to log took a long time: real 0.122s	user 0.003s	sys 0.000s
I20260709 13:06:48.733834 19463 tablet.cc:1724] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:06:48.802397 18996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:35263, user_credentials={real_user=slave}} blocked reactor thread for 45238.8us
I20260709 13:06:48.813925 19102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a73a5950c304c079b67013e79cff93a"
dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
mode: GRACEFUL
new_leader_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
 from {username='slave'} at 127.0.0.1:51420
W20260709 13:06:48.843547 19462 log.cc:927] Time spent T b33ab6d6087449ffba8dd9a00abee03f P e39ee95ba5824b7ca83380fc4f0c596a: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:06:48.845992 19466 tablet.cc:1724] T 4a583aaa89c04259a6d38100fe448cdf P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:48.850728 19102 raft_consensus.cc:606] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Received request to transfer leadership to TS b2ef83e29a8e4e8694c3c7c2dd06f9d4
I20260709 13:06:48.867708 19455 tablet.cc:1724] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:48.870836 19474 tablet.cc:1724] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:48.871551 19470 tablet.cc:1724] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:48.853927 19472 tablet.cc:1724] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:48.870893 19475 tablet.cc:1724] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:48.876734 19457 tablet.cc:1724] T b33ab6d6087449ffba8dd9a00abee03f P 829e1719f453473c934e820685b7f6b7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:48.889032 19463 tablet.cc:1724] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:48.903674 19465 tablet.cc:1724] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:48.906045 19466 tablet.cc:1724] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:48.951840 19466 tablet.cc:1724] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:48.951908 19475 tablet.cc:1724] T 7ddf0309e4884e2eb558def45c86820a P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:48.953339 19467 tablet.cc:1724] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:48.957665 19026 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a228e7541a54198823a7f8cb28c7d36"
dest_uuid: "829e1719f453473c934e820685b7f6b7"
mode: GRACEFUL
new_leader_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
 from {username='slave'} at 127.0.0.1:42654
I20260709 13:06:48.958369 19026 raft_consensus.cc:606] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [term 2 LEADER]: Received request to transfer leadership to TS b2ef83e29a8e4e8694c3c7c2dd06f9d4
I20260709 13:06:48.960490  8209 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:06:48.961165  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:48.979298 19026 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "295fe2d1af3f488a804237a87ade77d0"
dest_uuid: "829e1719f453473c934e820685b7f6b7"
mode: GRACEFUL
new_leader_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
 from {username='slave'} at 127.0.0.1:42654
I20260709 13:06:48.982805 19026 raft_consensus.cc:606] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [term 1 LEADER]: Received request to transfer leadership to TS b2ef83e29a8e4e8694c3c7c2dd06f9d4
I20260709 13:06:48.975302 19455 tablet.cc:1724] T 5a73a5950c304c079b67013e79cff93a P 829e1719f453473c934e820685b7f6b7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:48.989315 19472 tablet.cc:1724] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:49.005792 19457 tablet.cc:1724] T d3e827f740ed46f8a41dd34ba382bf83 P 829e1719f453473c934e820685b7f6b7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:49.008929 19472 tablet.cc:1724] T a01279662936472b899ddf84c1b6b655 P e39ee95ba5824b7ca83380fc4f0c596a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:49.020334 19102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9a84c1bc49d48edbd859279ba140f6e"
dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
mode: GRACEFUL
new_leader_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
 from {username='slave'} at 127.0.0.1:51420
I20260709 13:06:49.021099 19102 raft_consensus.cc:606] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [term 2 LEADER]: Received request to transfer leadership to TS b2ef83e29a8e4e8694c3c7c2dd06f9d4
I20260709 13:06:49.022890  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:49.023558  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:49.025890 19465 tablet.cc:1724] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:49.027823 19468 tablet.cc:1724] T b33ab6d6087449ffba8dd9a00abee03f P e39ee95ba5824b7ca83380fc4f0c596a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:49.064303 18925 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7: soft_deleted_table [id=c333547ee1a545159253509a98be7c12] alter complete (version 1)
I20260709 13:06:49.074035 19427 raft_consensus.cc:993] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a: : Instructing follower b2ef83e29a8e4e8694c3c7c2dd06f9d4 to start an election
I20260709 13:06:49.074756 19437 raft_consensus.cc:1081] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [term 2 LEADER]: Signalling peer b2ef83e29a8e4e8694c3c7c2dd06f9d4 to start an election
I20260709 13:06:49.077069 19174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9a84c1bc49d48edbd859279ba140f6e"
dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
 from {username='slave'} at 127.0.0.1:59958
I20260709 13:06:49.077777 19174 raft_consensus.cc:493] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:49.078190 19174 raft_consensus.cc:3060] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.086191 19174 raft_consensus.cc:515] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:49.088025 19174 leader_election.cc:290] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 3 election: Requested vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305)
I20260709 13:06:49.088842 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a84c1bc49d48edbd859279ba140f6e" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "829e1719f453473c934e820685b7f6b7"
I20260709 13:06:49.089301 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a84c1bc49d48edbd859279ba140f6e" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
I20260709 13:06:49.089664 19025 raft_consensus.cc:3060] T c9a84c1bc49d48edbd859279ba140f6e P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.089895 19102 raft_consensus.cc:3055] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:49.090233 19102 raft_consensus.cc:740] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Running, Role: LEADER
I20260709 13:06:49.091051 19102 consensus_queue.cc:260] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:49.092420 19102 raft_consensus.cc:3060] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.097877 19025 raft_consensus.cc:2468] T c9a84c1bc49d48edbd859279ba140f6e P 829e1719f453473c934e820685b7f6b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 3.
I20260709 13:06:49.099391 19144 leader_election.cc:304] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, b2ef83e29a8e4e8694c3c7c2dd06f9d4; no voters: 
I20260709 13:06:49.099737 19102 raft_consensus.cc:2468] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 3.
I20260709 13:06:49.100466 19448 raft_consensus.cc:2804] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:49.101032 19448 raft_consensus.cc:697] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 3 LEADER]: Becoming Leader. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Running, Role: LEADER
I20260709 13:06:49.101929 19448 consensus_queue.cc:237] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:49.110388 18925 catalog_manager.cc:5697] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 reported cstate change: term changed from 2 to 3, leader changed from e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66) to b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67). New cstate: current_term: 3 leader_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.210534 19427 raft_consensus.cc:993] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a: : Instructing follower b2ef83e29a8e4e8694c3c7c2dd06f9d4 to start an election
I20260709 13:06:49.211061 19437 raft_consensus.cc:1081] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Signalling peer b2ef83e29a8e4e8694c3c7c2dd06f9d4 to start an election
I20260709 13:06:49.212780 19174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a73a5950c304c079b67013e79cff93a"
dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
 from {username='slave'} at 127.0.0.1:59958
I20260709 13:06:49.213569 19174 raft_consensus.cc:493] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:49.213924 19174 raft_consensus.cc:3060] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.220956 19174 raft_consensus.cc:515] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:49.222765 19174 leader_election.cc:290] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 2 election: Requested vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305)
I20260709 13:06:49.223975 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a73a5950c304c079b67013e79cff93a" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "829e1719f453473c934e820685b7f6b7"
I20260709 13:06:49.224526 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a73a5950c304c079b67013e79cff93a" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
I20260709 13:06:49.224707 19025 raft_consensus.cc:3060] T 5a73a5950c304c079b67013e79cff93a P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.225205 19102 raft_consensus.cc:3055] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:49.225587 19102 raft_consensus.cc:740] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e39ee95ba5824b7ca83380fc4f0c596a, State: Running, Role: LEADER
I20260709 13:06:49.226454 19102 consensus_queue.cc:260] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:49.227679 19102 raft_consensus.cc:3060] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.231154 19025 raft_consensus.cc:2468] T 5a73a5950c304c079b67013e79cff93a P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 2.
I20260709 13:06:49.232606 19144 leader_election.cc:304] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829e1719f453473c934e820685b7f6b7, b2ef83e29a8e4e8694c3c7c2dd06f9d4; no voters: 
I20260709 13:06:49.233989 19397 raft_consensus.cc:2804] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:49.234369 19102 raft_consensus.cc:2468] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 2.
I20260709 13:06:49.234562 19397 raft_consensus.cc:697] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 LEADER]: Becoming Leader. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Running, Role: LEADER
I20260709 13:06:49.235741 19397 consensus_queue.cc:237] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:49.246632 18925 catalog_manager.cc:5697] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 reported cstate change: term changed from 1 to 2, leader changed from e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66) to b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67). New cstate: current_term: 2 leader_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.279924 19473 raft_consensus.cc:993] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7: : Instructing follower b2ef83e29a8e4e8694c3c7c2dd06f9d4 to start an election
I20260709 13:06:49.280413 19473 raft_consensus.cc:1081] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [term 2 LEADER]: Signalling peer b2ef83e29a8e4e8694c3c7c2dd06f9d4 to start an election
I20260709 13:06:49.282411 19174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a228e7541a54198823a7f8cb28c7d36"
dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
 from {username='slave'} at 127.0.0.1:59948
I20260709 13:06:49.283088 19174 raft_consensus.cc:493] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:49.283931 19174 raft_consensus.cc:3060] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.290463 19174 raft_consensus.cc:515] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:49.292383 19174 leader_election.cc:290] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 3 election: Requested vote from peers 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529), e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305)
I20260709 13:06:49.293362 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a228e7541a54198823a7f8cb28c7d36" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "829e1719f453473c934e820685b7f6b7"
I20260709 13:06:49.294157 19025 raft_consensus.cc:3055] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:49.293941 19104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a228e7541a54198823a7f8cb28c7d36" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
I20260709 13:06:49.294471 19025 raft_consensus.cc:740] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Running, Role: LEADER
I20260709 13:06:49.294874 19104 raft_consensus.cc:3060] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.295315 19025 consensus_queue.cc:260] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:49.296347 19025 raft_consensus.cc:3060] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.301242 19104 raft_consensus.cc:2468] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 3.
I20260709 13:06:49.302675 19025 raft_consensus.cc:2468] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 3.
I20260709 13:06:49.302806 19144 leader_election.cc:304] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:49.303823 19397 raft_consensus.cc:2804] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:49.304378 19397 raft_consensus.cc:697] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 3 LEADER]: Becoming Leader. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Running, Role: LEADER
I20260709 13:06:49.305392 19397 consensus_queue.cc:237] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } }
I20260709 13:06:49.312623 18925 catalog_manager.cc:5697] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 reported cstate change: term changed from 2 to 3, leader changed from 829e1719f453473c934e820685b7f6b7 (127.8.4.65) to b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67). New cstate: current_term: 3 leader_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.575347 19454 raft_consensus.cc:993] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7: : Instructing follower b2ef83e29a8e4e8694c3c7c2dd06f9d4 to start an election
I20260709 13:06:49.575851 19473 raft_consensus.cc:1081] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [term 1 LEADER]: Signalling peer b2ef83e29a8e4e8694c3c7c2dd06f9d4 to start an election
I20260709 13:06:49.578168 19174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "295fe2d1af3f488a804237a87ade77d0"
dest_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4"
 from {username='slave'} at 127.0.0.1:59948
I20260709 13:06:49.578868 19174 raft_consensus.cc:493] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:49.579274 19174 raft_consensus.cc:3060] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.585528 19174 raft_consensus.cc:515] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } }
I20260709 13:06:49.587634 19174 leader_election.cc:290] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 2 election: Requested vote from peers e39ee95ba5824b7ca83380fc4f0c596a (127.8.4.66:36305), 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529)
I20260709 13:06:49.588900 19104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295fe2d1af3f488a804237a87ade77d0" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e39ee95ba5824b7ca83380fc4f0c596a"
I20260709 13:06:49.588994 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295fe2d1af3f488a804237a87ade77d0" candidate_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "829e1719f453473c934e820685b7f6b7"
I20260709 13:06:49.589684 19104 raft_consensus.cc:3060] T 295fe2d1af3f488a804237a87ade77d0 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.589767 19025 raft_consensus.cc:3055] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:49.590251 19025 raft_consensus.cc:740] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 829e1719f453473c934e820685b7f6b7, State: Running, Role: LEADER
I20260709 13:06:49.590982 19025 consensus_queue.cc:260] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } }
I20260709 13:06:49.592911 19025 raft_consensus.cc:3060] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.596691 19104 raft_consensus.cc:2468] T 295fe2d1af3f488a804237a87ade77d0 P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 2.
I20260709 13:06:49.598018 19026 raft_consensus.cc:1275] T c9a84c1bc49d48edbd859279ba140f6e P 829e1719f453473c934e820685b7f6b7 [term 3 FOLLOWER]: Refusing update from remote peer b2ef83e29a8e4e8694c3c7c2dd06f9d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:49.598155 19144 leader_election.cc:304] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2ef83e29a8e4e8694c3c7c2dd06f9d4, e39ee95ba5824b7ca83380fc4f0c596a; no voters: 
I20260709 13:06:49.599655 19397 raft_consensus.cc:2804] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:49.600378 19025 raft_consensus.cc:2468] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2ef83e29a8e4e8694c3c7c2dd06f9d4 in term 2.
I20260709 13:06:49.600303 19448 consensus_queue.cc:1048] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:49.601013 19397 raft_consensus.cc:697] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 LEADER]: Becoming Leader. State: Replica: b2ef83e29a8e4e8694c3c7c2dd06f9d4, State: Running, Role: LEADER
I20260709 13:06:49.602898 19397 consensus_queue.cc:237] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } } peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } }
I20260709 13:06:49.614713 18927 catalog_manager.cc:5697] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 reported cstate change: term changed from 1 to 2, leader changed from 829e1719f453473c934e820685b7f6b7 (127.8.4.65) to b2ef83e29a8e4e8694c3c7c2dd06f9d4 (127.8.4.67). New cstate: current_term: 2 leader_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ef83e29a8e4e8694c3c7c2dd06f9d4" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 35263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.616688 19104 raft_consensus.cc:1275] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [term 3 FOLLOWER]: Refusing update from remote peer b2ef83e29a8e4e8694c3c7c2dd06f9d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:49.618357 19481 consensus_queue.cc:1048] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:49.641426 19104 raft_consensus.cc:1275] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Refusing update from remote peer b2ef83e29a8e4e8694c3c7c2dd06f9d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:49.642798 19397 consensus_queue.cc:1048] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:49.651464 19025 raft_consensus.cc:1275] T 5a73a5950c304c079b67013e79cff93a P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Refusing update from remote peer b2ef83e29a8e4e8694c3c7c2dd06f9d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:49.654250 19448 consensus_queue.cc:1048] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:49.824554 19025 raft_consensus.cc:1275] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [term 3 FOLLOWER]: Refusing update from remote peer b2ef83e29a8e4e8694c3c7c2dd06f9d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:49.826025 19488 consensus_queue.cc:1048] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:49.829602 19104 raft_consensus.cc:1275] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [term 3 FOLLOWER]: Refusing update from remote peer b2ef83e29a8e4e8694c3c7c2dd06f9d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:49.831072 19481 consensus_queue.cc:1048] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:49.995749 19025 raft_consensus.cc:1275] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Refusing update from remote peer b2ef83e29a8e4e8694c3c7c2dd06f9d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:49.997336 19448 consensus_queue.cc:1048] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "829e1719f453473c934e820685b7f6b7" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:50.010630 19104 raft_consensus.cc:1275] T 295fe2d1af3f488a804237a87ade77d0 P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Refusing update from remote peer b2ef83e29a8e4e8694c3c7c2dd06f9d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:50.012656 19481 consensus_queue.cc:1048] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e39ee95ba5824b7ca83380fc4f0c596a" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:50.097506  8209 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:06:50.102882  8209 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:06:50.103379  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:50.109205  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:06:50.109586  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:51.141970  8209 tablet_server.cc:179] TabletServer@127.8.4.65:0 shutting down...
I20260709 13:06:51.172411  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:51.173354  8209 tablet_replica.cc:333] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7: stopping tablet replica
I20260709 13:06:51.174220  8209 raft_consensus.cc:2243] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:51.175177  8209 raft_consensus.cc:2272] T ad4586d1988846818c9198992321459a P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.177904  8209 tablet_replica.cc:333] T d3e827f740ed46f8a41dd34ba382bf83 P 829e1719f453473c934e820685b7f6b7: stopping tablet replica
I20260709 13:06:51.178544  8209 raft_consensus.cc:2243] T d3e827f740ed46f8a41dd34ba382bf83 P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.179003  8209 raft_consensus.cc:2272] T d3e827f740ed46f8a41dd34ba382bf83 P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.181594  8209 tablet_replica.cc:333] T 5a73a5950c304c079b67013e79cff93a P 829e1719f453473c934e820685b7f6b7: stopping tablet replica
I20260709 13:06:51.182374  8209 raft_consensus.cc:2243] T 5a73a5950c304c079b67013e79cff93a P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.182819  8209 raft_consensus.cc:2272] T 5a73a5950c304c079b67013e79cff93a P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.184826  8209 tablet_replica.cc:333] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7: stopping tablet replica
I20260709 13:06:51.185529  8209 raft_consensus.cc:2243] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:51.186358  8209 raft_consensus.cc:2272] T a01279662936472b899ddf84c1b6b655 P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.188542  8209 tablet_replica.cc:333] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7: stopping tablet replica
I20260709 13:06:51.189231  8209 raft_consensus.cc:2243] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.189689  8209 raft_consensus.cc:2272] T 5b506e6c7e944a398bfd174c5057182b P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.191902  8209 tablet_replica.cc:333] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7: stopping tablet replica
I20260709 13:06:51.192685  8209 raft_consensus.cc:2243] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:51.193589  8209 raft_consensus.cc:2272] T 7ddf0309e4884e2eb558def45c86820a P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.196065  8209 tablet_replica.cc:333] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7: stopping tablet replica
I20260709 13:06:51.196632  8209 raft_consensus.cc:2243] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.197134  8209 raft_consensus.cc:2272] T 4a583aaa89c04259a6d38100fe448cdf P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.199198  8209 tablet_replica.cc:333] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7: stopping tablet replica
I20260709 13:06:51.199734  8209 raft_consensus.cc:2243] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.200147  8209 raft_consensus.cc:2272] T 9a228e7541a54198823a7f8cb28c7d36 P 829e1719f453473c934e820685b7f6b7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.202258  8209 tablet_replica.cc:333] T c9a84c1bc49d48edbd859279ba140f6e P 829e1719f453473c934e820685b7f6b7: stopping tablet replica
I20260709 13:06:51.202800  8209 raft_consensus.cc:2243] T c9a84c1bc49d48edbd859279ba140f6e P 829e1719f453473c934e820685b7f6b7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.203197  8209 raft_consensus.cc:2272] T c9a84c1bc49d48edbd859279ba140f6e P 829e1719f453473c934e820685b7f6b7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.205204  8209 tablet_replica.cc:333] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7: stopping tablet replica
I20260709 13:06:51.205770  8209 raft_consensus.cc:2243] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:51.206722  8209 raft_consensus.cc:2272] T fd4e237e4d8346afbeea137b22b32ee8 P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.208755  8209 tablet_replica.cc:333] T b33ab6d6087449ffba8dd9a00abee03f P 829e1719f453473c934e820685b7f6b7: stopping tablet replica
I20260709 13:06:51.209321  8209 raft_consensus.cc:2243] T b33ab6d6087449ffba8dd9a00abee03f P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.209722  8209 raft_consensus.cc:2272] T b33ab6d6087449ffba8dd9a00abee03f P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.211498  8209 tablet_replica.cc:333] T d09ea15f89c540ea8b5d66e1b68ca09f P 829e1719f453473c934e820685b7f6b7: stopping tablet replica
I20260709 13:06:51.211953  8209 raft_consensus.cc:2243] T d09ea15f89c540ea8b5d66e1b68ca09f P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.212339  8209 raft_consensus.cc:2272] T d09ea15f89c540ea8b5d66e1b68ca09f P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.214406  8209 tablet_replica.cc:333] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7: stopping tablet replica
I20260709 13:06:51.214880  8209 raft_consensus.cc:2243] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:51.215667  8209 raft_consensus.cc:2272] T 2156d44a5901495290a7a79e622d0839 P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.218621  8209 tablet_replica.cc:333] T 77620febb9004ec1a7f17f8a2806b14c P 829e1719f453473c934e820685b7f6b7: stopping tablet replica
I20260709 13:06:51.219199  8209 raft_consensus.cc:2243] T 77620febb9004ec1a7f17f8a2806b14c P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.219671  8209 raft_consensus.cc:2272] T 77620febb9004ec1a7f17f8a2806b14c P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.221861  8209 tablet_replica.cc:333] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7: stopping tablet replica
I20260709 13:06:51.222374  8209 raft_consensus.cc:2243] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:51.223170  8209 raft_consensus.cc:2272] T b85919020ef941829e15062e26562141 P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.225420  8209 tablet_replica.cc:333] T cca026d92b504d9688f93e9bf0769060 P 829e1719f453473c934e820685b7f6b7: stopping tablet replica
I20260709 13:06:51.225925  8209 raft_consensus.cc:2243] T cca026d92b504d9688f93e9bf0769060 P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.226410  8209 raft_consensus.cc:2272] T cca026d92b504d9688f93e9bf0769060 P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.229715  8209 tablet_replica.cc:333] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7: stopping tablet replica
I20260709 13:06:51.230351  8209 raft_consensus.cc:2243] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.230855  8209 raft_consensus.cc:2272] T 295fe2d1af3f488a804237a87ade77d0 P 829e1719f453473c934e820685b7f6b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.233285  8209 tablet_replica.cc:333] T 814b87b4c7be484da9237ef57482499e P 829e1719f453473c934e820685b7f6b7: stopping tablet replica
I20260709 13:06:51.233831  8209 raft_consensus.cc:2243] T 814b87b4c7be484da9237ef57482499e P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.234339  8209 raft_consensus.cc:2272] T 814b87b4c7be484da9237ef57482499e P 829e1719f453473c934e820685b7f6b7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:51.247939 19144 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 17 similar messages]
W20260709 13:06:51.251760 19144 consensus_peers.cc:597] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 -> Peer 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529): Couldn't send request to peer 829e1719f453473c934e820685b7f6b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:51.279533  8209 tablet_server.cc:196] TabletServer@127.8.4.65:0 shutdown complete.
W20260709 13:06:51.285071 19144 consensus_peers.cc:597] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 -> Peer 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529): Couldn't send request to peer 829e1719f453473c934e820685b7f6b7. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:51.306550 19070 consensus_peers.cc:597] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a -> Peer 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529): Couldn't send request to peer 829e1719f453473c934e820685b7f6b7. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:51.322794  8209 tablet_server.cc:179] TabletServer@127.8.4.66:0 shutting down...
W20260709 13:06:51.354343 19144 consensus_peers.cc:597] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 -> Peer 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529): Couldn't send request to peer 829e1719f453473c934e820685b7f6b7. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:51.356721  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:51.357723  8209 tablet_replica.cc:333] T b33ab6d6087449ffba8dd9a00abee03f P e39ee95ba5824b7ca83380fc4f0c596a: stopping tablet replica
I20260709 13:06:51.358563  8209 raft_consensus.cc:2243] T b33ab6d6087449ffba8dd9a00abee03f P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.359076  8209 raft_consensus.cc:2272] T b33ab6d6087449ffba8dd9a00abee03f P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.361306  8209 tablet_replica.cc:333] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a: stopping tablet replica
I20260709 13:06:51.361907  8209 raft_consensus.cc:2243] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.362349  8209 raft_consensus.cc:2272] T 9a228e7541a54198823a7f8cb28c7d36 P e39ee95ba5824b7ca83380fc4f0c596a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.364382  8209 tablet_replica.cc:333] T a01279662936472b899ddf84c1b6b655 P e39ee95ba5824b7ca83380fc4f0c596a: stopping tablet replica
I20260709 13:06:51.364964  8209 raft_consensus.cc:2243] T a01279662936472b899ddf84c1b6b655 P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.365487  8209 raft_consensus.cc:2272] T a01279662936472b899ddf84c1b6b655 P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.368320  8209 tablet_replica.cc:333] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a: stopping tablet replica
I20260709 13:06:51.369225  8209 raft_consensus.cc:2243] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.369889  8209 raft_consensus.cc:2272] T ad4586d1988846818c9198992321459a P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.372073  8209 tablet_replica.cc:333] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a: stopping tablet replica
I20260709 13:06:51.372712  8209 raft_consensus.cc:2243] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:51.373663  8209 raft_consensus.cc:2272] T d3e827f740ed46f8a41dd34ba382bf83 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.375949  8209 tablet_replica.cc:333] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a: stopping tablet replica
I20260709 13:06:51.376556  8209 raft_consensus.cc:2243] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:51.377535  8209 raft_consensus.cc:2272] T 4a583aaa89c04259a6d38100fe448cdf P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.379894  8209 tablet_replica.cc:333] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a: stopping tablet replica
I20260709 13:06:51.380481  8209 raft_consensus.cc:2243] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.380956  8209 raft_consensus.cc:2272] T 7ddf0309e4884e2eb558def45c86820a P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.383330  8209 tablet_replica.cc:333] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a: stopping tablet replica
I20260709 13:06:51.383908  8209 raft_consensus.cc:2243] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.384543  8209 raft_consensus.cc:2272] T 5a73a5950c304c079b67013e79cff93a P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.387926  8209 tablet_replica.cc:333] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a: stopping tablet replica
I20260709 13:06:51.388962  8209 raft_consensus.cc:2243] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.389727  8209 raft_consensus.cc:2272] T c9a84c1bc49d48edbd859279ba140f6e P e39ee95ba5824b7ca83380fc4f0c596a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.392076  8209 tablet_replica.cc:333] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a: stopping tablet replica
I20260709 13:06:51.392657  8209 raft_consensus.cc:2243] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:51.393463  8209 raft_consensus.cc:2272] T 5b506e6c7e944a398bfd174c5057182b P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.395445  8209 tablet_replica.cc:333] T fd4e237e4d8346afbeea137b22b32ee8 P e39ee95ba5824b7ca83380fc4f0c596a: stopping tablet replica
I20260709 13:06:51.396016  8209 raft_consensus.cc:2243] T fd4e237e4d8346afbeea137b22b32ee8 P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.396493  8209 raft_consensus.cc:2272] T fd4e237e4d8346afbeea137b22b32ee8 P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.398618  8209 tablet_replica.cc:333] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a: stopping tablet replica
I20260709 13:06:51.399104  8209 raft_consensus.cc:2243] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.399521  8209 raft_consensus.cc:2272] T d09ea15f89c540ea8b5d66e1b68ca09f P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.401505  8209 tablet_replica.cc:333] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a: stopping tablet replica
I20260709 13:06:51.401993  8209 raft_consensus.cc:2243] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.402513  8209 raft_consensus.cc:2272] T b85919020ef941829e15062e26562141 P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.404727  8209 tablet_replica.cc:333] T 2156d44a5901495290a7a79e622d0839 P e39ee95ba5824b7ca83380fc4f0c596a: stopping tablet replica
I20260709 13:06:51.405264  8209 raft_consensus.cc:2243] T 2156d44a5901495290a7a79e622d0839 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.405680  8209 raft_consensus.cc:2272] T 2156d44a5901495290a7a79e622d0839 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.407738  8209 tablet_replica.cc:333] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a: stopping tablet replica
I20260709 13:06:51.408203  8209 raft_consensus.cc:2243] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:51.409288  8209 raft_consensus.cc:2272] T 77620febb9004ec1a7f17f8a2806b14c P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.412340  8209 tablet_replica.cc:333] T 295fe2d1af3f488a804237a87ade77d0 P e39ee95ba5824b7ca83380fc4f0c596a: stopping tablet replica
I20260709 13:06:51.413120  8209 raft_consensus.cc:2243] T 295fe2d1af3f488a804237a87ade77d0 P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.413703  8209 raft_consensus.cc:2272] T 295fe2d1af3f488a804237a87ade77d0 P e39ee95ba5824b7ca83380fc4f0c596a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.416463  8209 tablet_replica.cc:333] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a: stopping tablet replica
I20260709 13:06:51.417371  8209 raft_consensus.cc:2243] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:51.418432  8209 raft_consensus.cc:2272] T cca026d92b504d9688f93e9bf0769060 P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.421089  8209 tablet_replica.cc:333] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a: stopping tablet replica
I20260709 13:06:51.421639  8209 raft_consensus.cc:2243] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:06:51.421875 19144 consensus_peers.cc:597] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 -> Peer 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529): Couldn't send request to peer 829e1719f453473c934e820685b7f6b7. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:51.422538  8209 raft_consensus.cc:2272] T 814b87b4c7be484da9237ef57482499e P e39ee95ba5824b7ca83380fc4f0c596a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.463851  8209 tablet_server.cc:196] TabletServer@127.8.4.66:0 shutdown complete.
I20260709 13:06:51.499929  8209 tablet_server.cc:179] TabletServer@127.8.4.67:0 shutting down...
W20260709 13:06:51.518541 19144 consensus_peers.cc:597] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 -> Peer 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529): Couldn't send request to peer 829e1719f453473c934e820685b7f6b7. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:51.536152  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:51.537056  8209 tablet_replica.cc:333] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: stopping tablet replica
I20260709 13:06:51.537742  8209 raft_consensus.cc:2243] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:51.538687  8209 raft_consensus.cc:2272] T 9a228e7541a54198823a7f8cb28c7d36 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.540745  8209 tablet_replica.cc:333] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: stopping tablet replica
I20260709 13:06:51.541383  8209 raft_consensus.cc:2243] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.541865  8209 raft_consensus.cc:2272] T a01279662936472b899ddf84c1b6b655 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.544428  8209 tablet_replica.cc:333] T 4a583aaa89c04259a6d38100fe448cdf P b2ef83e29a8e4e8694c3c7c2dd06f9d4: stopping tablet replica
I20260709 13:06:51.545245  8209 raft_consensus.cc:2243] T 4a583aaa89c04259a6d38100fe448cdf P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.545825  8209 raft_consensus.cc:2272] T 4a583aaa89c04259a6d38100fe448cdf P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:51.547010 19144 consensus_peers.cc:597] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 -> Peer 829e1719f453473c934e820685b7f6b7 (127.8.4.65:45529): Couldn't send request to peer 829e1719f453473c934e820685b7f6b7. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:45529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:51.548123  8209 tablet_replica.cc:333] T 7ddf0309e4884e2eb558def45c86820a P b2ef83e29a8e4e8694c3c7c2dd06f9d4: stopping tablet replica
I20260709 13:06:51.548691  8209 raft_consensus.cc:2243] T 7ddf0309e4884e2eb558def45c86820a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.549175  8209 raft_consensus.cc:2272] T 7ddf0309e4884e2eb558def45c86820a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.551230  8209 tablet_replica.cc:333] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4: stopping tablet replica
I20260709 13:06:51.551775  8209 raft_consensus.cc:2243] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.552171  8209 raft_consensus.cc:2272] T 5b506e6c7e944a398bfd174c5057182b P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.554086  8209 tablet_replica.cc:333] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4: stopping tablet replica
I20260709 13:06:51.554576  8209 raft_consensus.cc:2243] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:51.555259  8209 raft_consensus.cc:2272] T 5a73a5950c304c079b67013e79cff93a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.557152  8209 tablet_replica.cc:333] T d3e827f740ed46f8a41dd34ba382bf83 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: stopping tablet replica
I20260709 13:06:51.557696  8209 raft_consensus.cc:2243] T d3e827f740ed46f8a41dd34ba382bf83 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.558230  8209 raft_consensus.cc:2272] T d3e827f740ed46f8a41dd34ba382bf83 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.560814  8209 tablet_replica.cc:333] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4: stopping tablet replica
I20260709 13:06:51.561420  8209 raft_consensus.cc:2243] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.561830  8209 raft_consensus.cc:2272] T ad4586d1988846818c9198992321459a P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.564289  8209 tablet_replica.cc:333] T 814b87b4c7be484da9237ef57482499e P b2ef83e29a8e4e8694c3c7c2dd06f9d4: stopping tablet replica
I20260709 13:06:51.565130  8209 raft_consensus.cc:2243] T 814b87b4c7be484da9237ef57482499e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.565697  8209 raft_consensus.cc:2272] T 814b87b4c7be484da9237ef57482499e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.568220  8209 tablet_replica.cc:333] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: stopping tablet replica
I20260709 13:06:51.568998  8209 raft_consensus.cc:2243] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:51.570056  8209 raft_consensus.cc:2272] T 295fe2d1af3f488a804237a87ade77d0 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.572721  8209 tablet_replica.cc:333] T cca026d92b504d9688f93e9bf0769060 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: stopping tablet replica
I20260709 13:06:51.573532  8209 raft_consensus.cc:2243] T cca026d92b504d9688f93e9bf0769060 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.574067  8209 raft_consensus.cc:2272] T cca026d92b504d9688f93e9bf0769060 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.575948  8209 tablet_replica.cc:333] T 77620febb9004ec1a7f17f8a2806b14c P b2ef83e29a8e4e8694c3c7c2dd06f9d4: stopping tablet replica
I20260709 13:06:51.576427  8209 raft_consensus.cc:2243] T 77620febb9004ec1a7f17f8a2806b14c P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.576815  8209 raft_consensus.cc:2272] T 77620febb9004ec1a7f17f8a2806b14c P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.579022  8209 tablet_replica.cc:333] T 2156d44a5901495290a7a79e622d0839 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: stopping tablet replica
I20260709 13:06:51.579566  8209 raft_consensus.cc:2243] T 2156d44a5901495290a7a79e622d0839 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.580014  8209 raft_consensus.cc:2272] T 2156d44a5901495290a7a79e622d0839 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.582360  8209 tablet_replica.cc:333] T b85919020ef941829e15062e26562141 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: stopping tablet replica
I20260709 13:06:51.582888  8209 raft_consensus.cc:2243] T b85919020ef941829e15062e26562141 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.583395  8209 raft_consensus.cc:2272] T b85919020ef941829e15062e26562141 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.585492  8209 tablet_replica.cc:333] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4: stopping tablet replica
I20260709 13:06:51.586026  8209 raft_consensus.cc:2243] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:51.586885  8209 raft_consensus.cc:2272] T c9a84c1bc49d48edbd859279ba140f6e P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.589279  8209 tablet_replica.cc:333] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4: stopping tablet replica
I20260709 13:06:51.589836  8209 raft_consensus.cc:2243] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:51.590619  8209 raft_consensus.cc:2272] T b33ab6d6087449ffba8dd9a00abee03f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.592525  8209 tablet_replica.cc:333] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4: stopping tablet replica
I20260709 13:06:51.593080  8209 raft_consensus.cc:2243] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:51.593875  8209 raft_consensus.cc:2272] T d09ea15f89c540ea8b5d66e1b68ca09f P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.595896  8209 tablet_replica.cc:333] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4: stopping tablet replica
I20260709 13:06:51.596367  8209 raft_consensus.cc:2243] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.596853  8209 raft_consensus.cc:2272] T fd4e237e4d8346afbeea137b22b32ee8 P b2ef83e29a8e4e8694c3c7c2dd06f9d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.637744  8209 tablet_server.cc:196] TabletServer@127.8.4.67:0 shutdown complete.
I20260709 13:06:51.671775  8209 master.cc:562] Master@127.8.4.126:33837 shutting down...
I20260709 13:06:51.696606  8209 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:51.697247  8209 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.697611  8209 tablet_replica.cc:333] T 00000000000000000000000000000000 P 84787e84284744819b29a77db70cb0c7: stopping tablet replica
I20260709 13:06:51.719033  8209 master.cc:584] Master@127.8.4.126:33837 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (13134 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:06:51.775569  8209 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.4.126:42721
I20260709 13:06:51.776801  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:51.783012 19496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:51.783200 19497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:51.784691  8209 server_base.cc:1061] running on GCE node
W20260709 13:06:51.784741 19499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:51.786016  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:51.786247  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:51.786418  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602411786403 us; error 0 us; skew 500 ppm
I20260709 13:06:51.786955  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:51.789965  8209 webserver.cc:533] Webserver started at http://127.8.4.126:36569/ using document root <none> and password file <none>
I20260709 13:06:51.790467  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:51.790669  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:51.790946  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:51.792034  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602095438975-8209-0/minicluster-data/master-0-root/instance:
uuid: "5ab04032438d4997b8c77c428eab4980"
format_stamp: "Formatted at 2026-07-09 13:06:51 on dist-test-slave-008w"
I20260709 13:06:51.796661  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:06:51.800499 19504 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:51.801457  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:06:51.801798  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602095438975-8209-0/minicluster-data/master-0-root
uuid: "5ab04032438d4997b8c77c428eab4980"
format_stamp: "Formatted at 2026-07-09 13:06:51 on dist-test-slave-008w"
I20260709 13:06:51.802109  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602095438975-8209-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602095438975-8209-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602095438975-8209-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:51.813944  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:51.815214  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:51.856966  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.126:42721
I20260709 13:06:51.857149 19555 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.126:42721 every 8 connection(s)
I20260709 13:06:51.861203 19556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:51.872653 19556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980: Bootstrap starting.
I20260709 13:06:51.877624 19556 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.882339 19556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980: No bootstrap required, opened a new log
I20260709 13:06:51.884863 19556 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ab04032438d4997b8c77c428eab4980" member_type: VOTER }
I20260709 13:06:51.885334 19556 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.885684 19556 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ab04032438d4997b8c77c428eab4980, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.886482 19556 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ab04032438d4997b8c77c428eab4980" member_type: VOTER }
I20260709 13:06:51.886996 19556 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:06:51.887235 19556 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:06:51.887487 19556 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.892922 19556 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ab04032438d4997b8c77c428eab4980" member_type: VOTER }
I20260709 13:06:51.893572 19556 leader_election.cc:304] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ab04032438d4997b8c77c428eab4980; no voters: 
I20260709 13:06:51.894896 19556 leader_election.cc:290] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:06:51.895298 19559 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:51.896777 19559 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980 [term 1 LEADER]: Becoming Leader. State: Replica: 5ab04032438d4997b8c77c428eab4980, State: Running, Role: LEADER
I20260709 13:06:51.897550 19559 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ab04032438d4997b8c77c428eab4980" member_type: VOTER }
I20260709 13:06:51.898494 19556 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:06:51.902051 19561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ab04032438d4997b8c77c428eab4980. Latest consensus state: current_term: 1 leader_uuid: "5ab04032438d4997b8c77c428eab4980" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ab04032438d4997b8c77c428eab4980" member_type: VOTER } }
I20260709 13:06:51.902896 19561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:51.902141 19560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ab04032438d4997b8c77c428eab4980" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ab04032438d4997b8c77c428eab4980" member_type: VOTER } }
I20260709 13:06:51.903609 19560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:51.906731 19565 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:06:51.913700 19565 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:06:51.917062  8209 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:06:51.924095 19565 catalog_manager.cc:1383] Generated new cluster ID: 23b5ed69834242b48d5fb9678c43a484
I20260709 13:06:51.924414 19565 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:06:51.947851 19565 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:06:51.949688 19565 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:06:51.966580 19565 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980: Generated new TSK 0
I20260709 13:06:51.967293 19565 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:06:51.983965  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:51.990718 19577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:51.991674 19578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:51.993287 19580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:51.996284  8209 server_base.cc:1061] running on GCE node
I20260709 13:06:51.997382  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:51.997691  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:51.997905  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602411997890 us; error 0 us; skew 500 ppm
I20260709 13:06:51.998528  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:52.001454  8209 webserver.cc:533] Webserver started at http://127.8.4.65:33649/ using document root <none> and password file <none>
I20260709 13:06:52.002005  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:52.002182  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:52.002532  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:52.004027  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602095438975-8209-0/minicluster-data/ts-0-root/instance:
uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
format_stamp: "Formatted at 2026-07-09 13:06:51 on dist-test-slave-008w"
I20260709 13:06:52.009159  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.007s
I20260709 13:06:52.013202 19585 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:52.014408  8209 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 13:06:52.014861  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602095438975-8209-0/minicluster-data/ts-0-root
uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
format_stamp: "Formatted at 2026-07-09 13:06:51 on dist-test-slave-008w"
I20260709 13:06:52.015172  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602095438975-8209-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602095438975-8209-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602095438975-8209-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:52.035745  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:52.037173  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:52.038969  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:52.041683  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:52.041894  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:52.042236  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:52.042443  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:52.088867  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.65:40921
I20260709 13:06:52.089093 19647 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.65:40921 every 8 connection(s)
I20260709 13:06:52.094612  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:52.102609 19652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:52.103067 19653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:52.106287 19655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:52.107214  8209 server_base.cc:1061] running on GCE node
I20260709 13:06:52.107563 19648 heartbeater.cc:344] Connected to a master server at 127.8.4.126:42721
I20260709 13:06:52.107995 19648 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:52.108987 19648 heartbeater.cc:507] Master 127.8.4.126:42721 requested a full tablet report, sending...
I20260709 13:06:52.109186  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:52.109494  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:52.109745  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602412109723 us; error 0 us; skew 500 ppm
I20260709 13:06:52.110481  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:52.111817 19521 ts_manager.cc:194] Registered new tserver with Master: ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921)
I20260709 13:06:52.113407  8209 webserver.cc:533] Webserver started at http://127.8.4.66:46661/ using document root <none> and password file <none>
I20260709 13:06:52.113909  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:52.114078  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:52.114285  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:52.114398 19521 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58392
I20260709 13:06:52.115700  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602095438975-8209-0/minicluster-data/ts-1-root/instance:
uuid: "9a2406d1f1804f03babf933367bc038c"
format_stamp: "Formatted at 2026-07-09 13:06:52 on dist-test-slave-008w"
I20260709 13:06:52.121145  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 13:06:52.127450 19660 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:52.128506  8209 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:06:52.128871  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602095438975-8209-0/minicluster-data/ts-1-root
uuid: "9a2406d1f1804f03babf933367bc038c"
format_stamp: "Formatted at 2026-07-09 13:06:52 on dist-test-slave-008w"
I20260709 13:06:52.129307  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602095438975-8209-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602095438975-8209-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602095438975-8209-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:52.144996  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:52.146338  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:52.147857  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:52.150460  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:52.150679  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:52.151028  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:52.151192  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:52.197175  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.66:43315
I20260709 13:06:52.197405 19722 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.66:43315 every 8 connection(s)
I20260709 13:06:52.202250  8209 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:52.211090 19726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:52.212239 19727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:52.217047  8209 server_base.cc:1061] running on GCE node
W20260709 13:06:52.217324 19729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:52.217698 19723 heartbeater.cc:344] Connected to a master server at 127.8.4.126:42721
I20260709 13:06:52.218235 19723 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:52.218647  8209 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:52.218976  8209 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:52.219197  8209 hybrid_clock.cc:648] HybridClock initialized: now 1783602412219177 us; error 0 us; skew 500 ppm
I20260709 13:06:52.219224 19723 heartbeater.cc:507] Master 127.8.4.126:42721 requested a full tablet report, sending...
I20260709 13:06:52.220044  8209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:52.222071 19521 ts_manager.cc:194] Registered new tserver with Master: 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315)
I20260709 13:06:52.223204  8209 webserver.cc:533] Webserver started at http://127.8.4.67:34973/ using document root <none> and password file <none>
I20260709 13:06:52.223908  8209 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:52.224150  8209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:52.224049 19521 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58394
I20260709 13:06:52.224645  8209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:52.226235  8209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602095438975-8209-0/minicluster-data/ts-2-root/instance:
uuid: "d73cac465ea84b6b99ebc324b2b6120b"
format_stamp: "Formatted at 2026-07-09 13:06:52 on dist-test-slave-008w"
I20260709 13:06:52.231174  8209 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:06:52.234835 19734 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:52.235736  8209 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:06:52.236068  8209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602095438975-8209-0/minicluster-data/ts-2-root
uuid: "d73cac465ea84b6b99ebc324b2b6120b"
format_stamp: "Formatted at 2026-07-09 13:06:52 on dist-test-slave-008w"
I20260709 13:06:52.236340  8209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602095438975-8209-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602095438975-8209-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskO16RU5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602095438975-8209-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:52.260382  8209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:52.261631  8209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:52.263144  8209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:52.265633  8209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:52.265865  8209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:52.266111  8209 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:52.266286  8209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:52.311245  8209 rpc_server.cc:307] RPC server started. Bound to: 127.8.4.67:46405
I20260709 13:06:52.311362 19796 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.4.67:46405 every 8 connection(s)
I20260709 13:06:52.326282 19797 heartbeater.cc:344] Connected to a master server at 127.8.4.126:42721
I20260709 13:06:52.326757 19797 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:52.327524 19797 heartbeater.cc:507] Master 127.8.4.126:42721 requested a full tablet report, sending...
I20260709 13:06:52.329758 19521 ts_manager.cc:194] Registered new tserver with Master: d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:52.329921  8209 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015440855s
I20260709 13:06:52.331641 19521 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58400
I20260709 13:06:52.358709 19521 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58414:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:52.361373 19521 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:52.436640 19762 tablet_service.cc:1511] Processing CreateTablet for tablet c740fe2573ce4850b4ba3faf8c3309a9 (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:52.438267 19762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c740fe2573ce4850b4ba3faf8c3309a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.437332 19759 tablet_service.cc:1511] Processing CreateTablet for tablet 00373e3027ea4238a5f2192e08afe3a8 (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:52.439780 19759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00373e3027ea4238a5f2192e08afe3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.442335 19760 tablet_service.cc:1511] Processing CreateTablet for tablet a0f363d1ea0247e19c10c66095acb390 (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:52.443910 19760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0f363d1ea0247e19c10c66095acb390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.446152 19761 tablet_service.cc:1511] Processing CreateTablet for tablet 031e57a0eb8a464292dfe35cf712cadd (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:52.447654 19761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031e57a0eb8a464292dfe35cf712cadd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.450992 19758 tablet_service.cc:1511] Processing CreateTablet for tablet 3eafaba6fea54118a203224ebc4c6e9b (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:52.452634 19758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eafaba6fea54118a203224ebc4c6e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.455763 19755 tablet_service.cc:1511] Processing CreateTablet for tablet 6767e9811cd44c728760f5e3c414d309 (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:52.457304 19755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6767e9811cd44c728760f5e3c414d309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.458328 19757 tablet_service.cc:1511] Processing CreateTablet for tablet c6611cb14bc74c2d804eb0cb545ceb54 (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:52.459844 19757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6611cb14bc74c2d804eb0cb545ceb54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.462316 19756 tablet_service.cc:1511] Processing CreateTablet for tablet 0ba99d0bb8bc4c0d9050da080ffc465d (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:52.463886 19756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ba99d0bb8bc4c0d9050da080ffc465d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.463544 19754 tablet_service.cc:1511] Processing CreateTablet for tablet e1467e69e14349fea54e3d16796f8fd0 (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:52.465492 19613 tablet_service.cc:1511] Processing CreateTablet for tablet c740fe2573ce4850b4ba3faf8c3309a9 (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:52.466282 19608 tablet_service.cc:1511] Processing CreateTablet for tablet c6611cb14bc74c2d804eb0cb545ceb54 (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:52.467022 19613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c740fe2573ce4850b4ba3faf8c3309a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.467654 19608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6611cb14bc74c2d804eb0cb545ceb54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.470486 19612 tablet_service.cc:1511] Processing CreateTablet for tablet 031e57a0eb8a464292dfe35cf712cadd (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:52.471822 19606 tablet_service.cc:1511] Processing CreateTablet for tablet 6767e9811cd44c728760f5e3c414d309 (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:52.472409 19612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031e57a0eb8a464292dfe35cf712cadd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.474265 19611 tablet_service.cc:1511] Processing CreateTablet for tablet a0f363d1ea0247e19c10c66095acb390 (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:52.474992 19609 tablet_service.cc:1511] Processing CreateTablet for tablet 3eafaba6fea54118a203224ebc4c6e9b (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:52.475867 19611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0f363d1ea0247e19c10c66095acb390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.474321 19605 tablet_service.cc:1511] Processing CreateTablet for tablet e1467e69e14349fea54e3d16796f8fd0 (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:52.477746 19605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1467e69e14349fea54e3d16796f8fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.478071 19610 tablet_service.cc:1511] Processing CreateTablet for tablet 00373e3027ea4238a5f2192e08afe3a8 (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:52.479419 19610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00373e3027ea4238a5f2192e08afe3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.470485 19607 tablet_service.cc:1511] Processing CreateTablet for tablet 0ba99d0bb8bc4c0d9050da080ffc465d (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:52.483151 19607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ba99d0bb8bc4c0d9050da080ffc465d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.485389 19606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6767e9811cd44c728760f5e3c414d309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.489809 19609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eafaba6fea54118a203224ebc4c6e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.500502 19754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1467e69e14349fea54e3d16796f8fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.518046 19685 tablet_service.cc:1511] Processing CreateTablet for tablet 00373e3027ea4238a5f2192e08afe3a8 (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:52.519824 19685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00373e3027ea4238a5f2192e08afe3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.519925 19688 tablet_service.cc:1511] Processing CreateTablet for tablet c740fe2573ce4850b4ba3faf8c3309a9 (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:52.521395 19688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c740fe2573ce4850b4ba3faf8c3309a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.522311 19684 tablet_service.cc:1511] Processing CreateTablet for tablet 3eafaba6fea54118a203224ebc4c6e9b (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:52.523861 19684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eafaba6fea54118a203224ebc4c6e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.526298 19687 tablet_service.cc:1511] Processing CreateTablet for tablet 031e57a0eb8a464292dfe35cf712cadd (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:52.527875 19687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031e57a0eb8a464292dfe35cf712cadd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.527683 19682 tablet_service.cc:1511] Processing CreateTablet for tablet 0ba99d0bb8bc4c0d9050da080ffc465d (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:52.529280 19682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ba99d0bb8bc4c0d9050da080ffc465d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.530311 19686 tablet_service.cc:1511] Processing CreateTablet for tablet a0f363d1ea0247e19c10c66095acb390 (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:52.531754 19686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0f363d1ea0247e19c10c66095acb390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.526350 19683 tablet_service.cc:1511] Processing CreateTablet for tablet c6611cb14bc74c2d804eb0cb545ceb54 (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:52.534540 19683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6611cb14bc74c2d804eb0cb545ceb54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.534435 19680 tablet_service.cc:1511] Processing CreateTablet for tablet e1467e69e14349fea54e3d16796f8fd0 (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:52.536036 19680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1467e69e14349fea54e3d16796f8fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.532742 19681 tablet_service.cc:1511] Processing CreateTablet for tablet 6767e9811cd44c728760f5e3c414d309 (DEFAULT_TABLE table=test-workload [id=49b496d2dd3945519e5ca805fe9a5556]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:52.538983 19681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6767e9811cd44c728760f5e3c414d309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:52.644587 19813 tablet_bootstrap.cc:492] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed: Bootstrap starting.
I20260709 13:06:52.646165 19814 tablet_bootstrap.cc:492] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c: Bootstrap starting.
I20260709 13:06:52.649865 19812 tablet_bootstrap.cc:492] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b: Bootstrap starting.
I20260709 13:06:52.654000 19814 tablet_bootstrap.cc:654] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.659152 19814 tablet_bootstrap.cc:492] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c: No bootstrap required, opened a new log
I20260709 13:06:52.659746 19814 ts_tablet_manager.cc:1403] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:06:52.660084 19813 tablet_bootstrap.cc:654] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.661198 19812 tablet_bootstrap.cc:654] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.663309 19814 raft_consensus.cc:359] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.664127 19814 raft_consensus.cc:385] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.664582 19814 raft_consensus.cc:740] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.665606 19814 consensus_queue.cc:260] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.683502 19723 heartbeater.cc:499] Master 127.8.4.126:42721 was elected leader, sending a full tablet report...
I20260709 13:06:52.684036 19814 ts_tablet_manager.cc:1434] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c: Time spent starting tablet: real 0.024s	user 0.022s	sys 0.000s
I20260709 13:06:52.685375 19814 tablet_bootstrap.cc:492] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c: Bootstrap starting.
I20260709 13:06:52.685971 19813 tablet_bootstrap.cc:492] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed: No bootstrap required, opened a new log
I20260709 13:06:52.686560 19813 ts_tablet_manager.cc:1403] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.015s
I20260709 13:06:52.690299 19813 raft_consensus.cc:359] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.691079 19813 raft_consensus.cc:385] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.691381 19813 raft_consensus.cc:740] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.691998 19812 tablet_bootstrap.cc:492] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b: No bootstrap required, opened a new log
I20260709 13:06:52.692735 19812 ts_tablet_manager.cc:1403] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b: Time spent bootstrapping tablet: real 0.043s	user 0.020s	sys 0.018s
I20260709 13:06:52.692066 19813 consensus_queue.cc:260] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.693229 19814 tablet_bootstrap.cc:654] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.696467 19812 raft_consensus.cc:359] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.697698 19812 raft_consensus.cc:385] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.698086 19812 raft_consensus.cc:740] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.699180 19812 consensus_queue.cc:260] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
W20260709 13:06:52.701843 19724 tablet.cc:2406] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:06:52.705960 19814 tablet_bootstrap.cc:492] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c: No bootstrap required, opened a new log
I20260709 13:06:52.707008 19814 ts_tablet_manager.cc:1403] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.013s
I20260709 13:06:52.711251 19814 raft_consensus.cc:359] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.712440 19814 raft_consensus.cc:385] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.712908 19814 raft_consensus.cc:740] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.714221 19814 consensus_queue.cc:260] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.718019 19814 ts_tablet_manager.cc:1434] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:06:52.719579 19814 tablet_bootstrap.cc:492] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c: Bootstrap starting.
I20260709 13:06:52.728976 19814 tablet_bootstrap.cc:654] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.736186 19648 heartbeater.cc:499] Master 127.8.4.126:42721 was elected leader, sending a full tablet report...
I20260709 13:06:52.736756 19813 ts_tablet_manager.cc:1434] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent starting tablet: real 0.050s	user 0.027s	sys 0.020s
I20260709 13:06:52.737843 19813 tablet_bootstrap.cc:492] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed: Bootstrap starting.
I20260709 13:06:52.744794 19813 tablet_bootstrap.cc:654] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.747226 19797 heartbeater.cc:499] Master 127.8.4.126:42721 was elected leader, sending a full tablet report...
I20260709 13:06:52.747843 19812 ts_tablet_manager.cc:1434] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b: Time spent starting tablet: real 0.055s	user 0.024s	sys 0.028s
I20260709 13:06:52.747982 19814 tablet_bootstrap.cc:492] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c: No bootstrap required, opened a new log
I20260709 13:06:52.748617 19814 ts_tablet_manager.cc:1403] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.012s
I20260709 13:06:52.749116 19812 tablet_bootstrap.cc:492] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b: Bootstrap starting.
I20260709 13:06:52.751781 19814 raft_consensus.cc:359] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.752615 19814 raft_consensus.cc:385] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.752918 19814 raft_consensus.cc:740] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.753782 19814 consensus_queue.cc:260] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.756269 19814 ts_tablet_manager.cc:1434] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:52.756680 19812 tablet_bootstrap.cc:654] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.757460 19814 tablet_bootstrap.cc:492] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c: Bootstrap starting.
I20260709 13:06:52.765257 19813 tablet_bootstrap.cc:492] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed: No bootstrap required, opened a new log
I20260709 13:06:52.765527 19814 tablet_bootstrap.cc:654] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.765962 19813 ts_tablet_manager.cc:1403] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent bootstrapping tablet: real 0.028s	user 0.002s	sys 0.017s
I20260709 13:06:52.767416 19812 tablet_bootstrap.cc:492] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b: No bootstrap required, opened a new log
I20260709 13:06:52.768091 19812 ts_tablet_manager.cc:1403] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.005s
I20260709 13:06:52.769677 19813 raft_consensus.cc:359] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.770524 19813 raft_consensus.cc:385] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.770844 19813 raft_consensus.cc:740] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.771845 19813 consensus_queue.cc:260] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.771966 19812 raft_consensus.cc:359] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.772820 19812 raft_consensus.cc:385] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.773224 19812 raft_consensus.cc:740] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.774097 19812 consensus_queue.cc:260] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.774581 19813 ts_tablet_manager.cc:1434] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:06:52.775872 19813 tablet_bootstrap.cc:492] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed: Bootstrap starting.
I20260709 13:06:52.776978 19812 ts_tablet_manager.cc:1434] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:06:52.778128 19812 tablet_bootstrap.cc:492] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b: Bootstrap starting.
I20260709 13:06:52.782725 19813 tablet_bootstrap.cc:654] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.785027 19812 tablet_bootstrap.cc:654] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.826133 19814 tablet_bootstrap.cc:492] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c: No bootstrap required, opened a new log
I20260709 13:06:52.826691 19814 ts_tablet_manager.cc:1403] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c: Time spent bootstrapping tablet: real 0.069s	user 0.019s	sys 0.048s
I20260709 13:06:52.829541 19813 tablet_bootstrap.cc:492] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed: No bootstrap required, opened a new log
I20260709 13:06:52.829439 19814 raft_consensus.cc:359] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.829824 19812 tablet_bootstrap.cc:492] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b: No bootstrap required, opened a new log
I20260709 13:06:52.830119 19814 raft_consensus.cc:385] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.830181 19813 ts_tablet_manager.cc:1403] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent bootstrapping tablet: real 0.055s	user 0.022s	sys 0.029s
I20260709 13:06:52.830368 19812 ts_tablet_manager.cc:1403] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b: Time spent bootstrapping tablet: real 0.052s	user 0.024s	sys 0.027s
I20260709 13:06:52.830467 19814 raft_consensus.cc:740] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.831422 19814 consensus_queue.cc:260] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.833649 19814 ts_tablet_manager.cc:1434] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:06:52.833616 19813 raft_consensus.cc:359] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.833842 19812 raft_consensus.cc:359] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } }
I20260709 13:06:52.834612 19813 raft_consensus.cc:385] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.834861 19812 raft_consensus.cc:385] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.834932 19813 raft_consensus.cc:740] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.835209 19814 tablet_bootstrap.cc:492] T 00373e3027ea4238a5f2192e08afe3a8 P 9a2406d1f1804f03babf933367bc038c: Bootstrap starting.
I20260709 13:06:52.835227 19812 raft_consensus.cc:740] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.835978 19813 consensus_queue.cc:260] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.836582 19812 consensus_queue.cc:260] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } }
I20260709 13:06:52.838563 19813 ts_tablet_manager.cc:1434] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:06:52.839660 19813 tablet_bootstrap.cc:492] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed: Bootstrap starting.
I20260709 13:06:52.840060 19812 ts_tablet_manager.cc:1434] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:06:52.841238 19812 tablet_bootstrap.cc:492] T c6611cb14bc74c2d804eb0cb545ceb54 P d73cac465ea84b6b99ebc324b2b6120b: Bootstrap starting.
I20260709 13:06:52.842788 19814 tablet_bootstrap.cc:654] T 00373e3027ea4238a5f2192e08afe3a8 P 9a2406d1f1804f03babf933367bc038c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.846345 19813 tablet_bootstrap.cc:654] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.848063 19812 tablet_bootstrap.cc:654] T c6611cb14bc74c2d804eb0cb545ceb54 P d73cac465ea84b6b99ebc324b2b6120b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.854394 19821 raft_consensus.cc:493] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.855293 19821 raft_consensus.cc:515] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.859300 19821 leader_election.cc:290] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315)
I20260709 13:06:52.863849 19813 tablet_bootstrap.cc:492] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed: No bootstrap required, opened a new log
I20260709 13:06:52.864694 19813 ts_tablet_manager.cc:1403] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.008s
I20260709 13:06:52.868624 19818 raft_consensus.cc:493] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.869582 19818 raft_consensus.cc:515] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.872006 19812 tablet_bootstrap.cc:492] T c6611cb14bc74c2d804eb0cb545ceb54 P d73cac465ea84b6b99ebc324b2b6120b: No bootstrap required, opened a new log
I20260709 13:06:52.878299 19818 leader_election.cc:290] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:52.883077 19814 tablet_bootstrap.cc:492] T 00373e3027ea4238a5f2192e08afe3a8 P 9a2406d1f1804f03babf933367bc038c: No bootstrap required, opened a new log
I20260709 13:06:52.896502 19812 ts_tablet_manager.cc:1403] T c6611cb14bc74c2d804eb0cb545ceb54 P d73cac465ea84b6b99ebc324b2b6120b: Time spent bootstrapping tablet: real 0.056s	user 0.008s	sys 0.012s
I20260709 13:06:52.868752 19813 raft_consensus.cc:359] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } }
I20260709 13:06:52.887924 19623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eafaba6fea54118a203224ebc4c6e9b" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" is_pre_election: true
I20260709 13:06:52.897166 19813 raft_consensus.cc:385] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.897511 19813 raft_consensus.cc:740] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Initialized, Role: FOLLOWER
W20260709 13:06:52.898566 19735 leader_election.cc:343] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.896781 19814 ts_tablet_manager.cc:1403] T 00373e3027ea4238a5f2192e08afe3a8 P 9a2406d1f1804f03babf933367bc038c: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.026s
I20260709 13:06:52.898330 19813 consensus_queue.cc:260] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } }
I20260709 13:06:52.902311 19814 raft_consensus.cc:359] T 00373e3027ea4238a5f2192e08afe3a8 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.903146 19814 raft_consensus.cc:385] T 00373e3027ea4238a5f2192e08afe3a8 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.903455 19814 raft_consensus.cc:740] T 00373e3027ea4238a5f2192e08afe3a8 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.899947 19812 raft_consensus.cc:359] T c6611cb14bc74c2d804eb0cb545ceb54 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.904515 19814 consensus_queue.cc:260] T 00373e3027ea4238a5f2192e08afe3a8 P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.905097 19812 raft_consensus.cc:385] T c6611cb14bc74c2d804eb0cb545ceb54 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.904706 19813 ts_tablet_manager.cc:1434] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 13:06:52.905476 19812 raft_consensus.cc:740] T c6611cb14bc74c2d804eb0cb545ceb54 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.906423 19698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eafaba6fea54118a203224ebc4c6e9b" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2406d1f1804f03babf933367bc038c" is_pre_election: true
I20260709 13:06:52.906571 19812 consensus_queue.cc:260] T c6611cb14bc74c2d804eb0cb545ceb54 P d73cac465ea84b6b99ebc324b2b6120b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.907249 19698 raft_consensus.cc:2468] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d73cac465ea84b6b99ebc324b2b6120b in term 0.
I20260709 13:06:52.908573 19735 leader_election.cc:304] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, d73cac465ea84b6b99ebc324b2b6120b; no voters: ae55b6b334544ee0bb4759a3a5bf0aed
I20260709 13:06:52.910351 19821 raft_consensus.cc:2804] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:52.910737 19821 raft_consensus.cc:493] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.911168 19821 raft_consensus.cc:3060] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:52.911839 19569 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:52.906697 19813 tablet_bootstrap.cc:492] T 6767e9811cd44c728760f5e3c414d309 P ae55b6b334544ee0bb4759a3a5bf0aed: Bootstrap starting.
I20260709 13:06:52.917274 19772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f363d1ea0247e19c10c66095acb390" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b" is_pre_election: true
W20260709 13:06:52.919440 19662 leader_election.cc:343] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.919879 19821 raft_consensus.cc:515] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.920879 19814 ts_tablet_manager.cc:1434] T 00373e3027ea4238a5f2192e08afe3a8 P 9a2406d1f1804f03babf933367bc038c: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:06:52.922134 19814 tablet_bootstrap.cc:492] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c: Bootstrap starting.
I20260709 13:06:52.922853 19623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eafaba6fea54118a203224ebc4c6e9b" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
I20260709 13:06:52.923555 19812 ts_tablet_manager.cc:1434] T c6611cb14bc74c2d804eb0cb545ceb54 P d73cac465ea84b6b99ebc324b2b6120b: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.003s
W20260709 13:06:52.924759 19735 leader_election.cc:343] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.927045 19812 tablet_bootstrap.cc:492] T 0ba99d0bb8bc4c0d9050da080ffc465d P d73cac465ea84b6b99ebc324b2b6120b: Bootstrap starting.
I20260709 13:06:52.926790 19623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f363d1ea0247e19c10c66095acb390" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" is_pre_election: true
I20260709 13:06:52.927649 19623 raft_consensus.cc:2468] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 0.
I20260709 13:06:52.929308 19661 leader_election.cc:304] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, ae55b6b334544ee0bb4759a3a5bf0aed; no voters: d73cac465ea84b6b99ebc324b2b6120b
I20260709 13:06:52.929798 19814 tablet_bootstrap.cc:654] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.931265 19818 raft_consensus.cc:2804] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:52.931906 19818 raft_consensus.cc:493] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.932437 19818 raft_consensus.cc:3060] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.935352 19821 leader_election.cc:290] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315)
I20260709 13:06:52.936208 19821 raft_consensus.cc:493] T c6611cb14bc74c2d804eb0cb545ceb54 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.936720 19821 raft_consensus.cc:515] T c6611cb14bc74c2d804eb0cb545ceb54 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.938565 19698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eafaba6fea54118a203224ebc4c6e9b" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2406d1f1804f03babf933367bc038c"
I20260709 13:06:52.939364 19698 raft_consensus.cc:3060] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.948472 19623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6611cb14bc74c2d804eb0cb545ceb54" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" is_pre_election: true
I20260709 13:06:52.948698 19821 leader_election.cc:290] T c6611cb14bc74c2d804eb0cb545ceb54 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315)
W20260709 13:06:52.950670 19735 leader_election.cc:343] T c6611cb14bc74c2d804eb0cb545ceb54 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.951706 19812 tablet_bootstrap.cc:654] T 0ba99d0bb8bc4c0d9050da080ffc465d P d73cac465ea84b6b99ebc324b2b6120b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.952209 19697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6611cb14bc74c2d804eb0cb545ceb54" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2406d1f1804f03babf933367bc038c" is_pre_election: true
W20260709 13:06:52.954684 19735 leader_election.cc:343] T c6611cb14bc74c2d804eb0cb545ceb54 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.955312 19735 leader_election.cc:304] T c6611cb14bc74c2d804eb0cb545ceb54 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d73cac465ea84b6b99ebc324b2b6120b; no voters: 9a2406d1f1804f03babf933367bc038c, ae55b6b334544ee0bb4759a3a5bf0aed
I20260709 13:06:52.956426 19821 raft_consensus.cc:2749] T c6611cb14bc74c2d804eb0cb545ceb54 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:52.957218 19814 tablet_bootstrap.cc:492] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c: No bootstrap required, opened a new log
I20260709 13:06:52.957998 19819 raft_consensus.cc:493] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.958163 19814 ts_tablet_manager.cc:1403] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.018s
I20260709 13:06:52.958505 19837 raft_consensus.cc:493] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.958664 19819 raft_consensus.cc:515] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.959184 19837 raft_consensus.cc:515] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.961874 19819 leader_election.cc:290] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:52.964617 19812 tablet_bootstrap.cc:492] T 0ba99d0bb8bc4c0d9050da080ffc465d P d73cac465ea84b6b99ebc324b2b6120b: No bootstrap required, opened a new log
I20260709 13:06:52.965476 19812 ts_tablet_manager.cc:1403] T 0ba99d0bb8bc4c0d9050da080ffc465d P d73cac465ea84b6b99ebc324b2b6120b: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.003s
I20260709 13:06:52.966325 19814 raft_consensus.cc:359] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.967559 19814 raft_consensus.cc:385] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.967551 19821 raft_consensus.cc:493] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.968919 19821 raft_consensus.cc:515] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.969358 19812 raft_consensus.cc:359] T 0ba99d0bb8bc4c0d9050da080ffc465d P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.970207 19812 raft_consensus.cc:385] T 0ba99d0bb8bc4c0d9050da080ffc465d P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.970544 19812 raft_consensus.cc:740] T 0ba99d0bb8bc4c0d9050da080ffc465d P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.973829 19697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00373e3027ea4238a5f2192e08afe3a8" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2406d1f1804f03babf933367bc038c" is_pre_election: true
I20260709 13:06:52.972633 19821 leader_election.cc:290] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315)
I20260709 13:06:52.974707 19697 raft_consensus.cc:2468] T 00373e3027ea4238a5f2192e08afe3a8 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d73cac465ea84b6b99ebc324b2b6120b in term 0.
I20260709 13:06:52.974897 19814 raft_consensus.cc:740] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.975841 19837 leader_election.cc:290] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:52.976074 19772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba99d0bb8bc4c0d9050da080ffc465d" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b" is_pre_election: true
I20260709 13:06:52.976037 19814 consensus_queue.cc:260] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.977677 19735 leader_election.cc:304] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, d73cac465ea84b6b99ebc324b2b6120b; no voters: 
I20260709 13:06:52.979250 19821 raft_consensus.cc:2804] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:52.979710 19821 raft_consensus.cc:493] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.980088 19821 raft_consensus.cc:3060] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.980291 19814 ts_tablet_manager.cc:1434] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.008s
I20260709 13:06:52.980161 19812 consensus_queue.cc:260] T 0ba99d0bb8bc4c0d9050da080ffc465d P d73cac465ea84b6b99ebc324b2b6120b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:52.981475 19772 raft_consensus.cc:2468] T 0ba99d0bb8bc4c0d9050da080ffc465d P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 0.
I20260709 13:06:52.982034 19814 tablet_bootstrap.cc:492] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c: Bootstrap starting.
I20260709 13:06:52.985925 19662 leader_election.cc:304] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, d73cac465ea84b6b99ebc324b2b6120b; no voters: 
I20260709 13:06:52.986414 19623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00373e3027ea4238a5f2192e08afe3a8" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" is_pre_election: true
I20260709 13:06:52.987124 19623 raft_consensus.cc:2468] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d73cac465ea84b6b99ebc324b2b6120b in term 0.
I20260709 13:06:52.990883 19814 tablet_bootstrap.cc:654] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.992377 19698 raft_consensus.cc:2468] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73cac465ea84b6b99ebc324b2b6120b in term 1.
I20260709 13:06:52.992676 19812 ts_tablet_manager.cc:1434] T 0ba99d0bb8bc4c0d9050da080ffc465d P d73cac465ea84b6b99ebc324b2b6120b: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.003s
I20260709 13:06:52.992081 19840 raft_consensus.cc:493] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.990974 19837 raft_consensus.cc:2804] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:52.996824 19837 raft_consensus.cc:493] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.997498 19837 raft_consensus.cc:3060] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.971295 19818 raft_consensus.cc:515] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.002851 19840 raft_consensus.cc:515] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.003819 19735 leader_election.cc:304] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, d73cac465ea84b6b99ebc324b2b6120b; no voters: ae55b6b334544ee0bb4759a3a5bf0aed
I20260709 13:06:53.005371 19812 tablet_bootstrap.cc:492] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b: Bootstrap starting.
I20260709 13:06:53.007285 19837 raft_consensus.cc:515] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.008522 19840 leader_election.cc:290] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:53.009958 19772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6767e9811cd44c728760f5e3c414d309" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b" is_pre_election: true
I20260709 13:06:53.011200 19771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba99d0bb8bc4c0d9050da080ffc465d" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
I20260709 13:06:53.011874 19771 raft_consensus.cc:3060] T 0ba99d0bb8bc4c0d9050da080ffc465d P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.012157 19814 tablet_bootstrap.cc:492] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c: No bootstrap required, opened a new log
I20260709 13:06:53.012697 19814 ts_tablet_manager.cc:1403] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.005s
W20260709 13:06:53.013759 19662 leader_election.cc:343] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.014285 19813 tablet_bootstrap.cc:654] T 6767e9811cd44c728760f5e3c414d309 P ae55b6b334544ee0bb4759a3a5bf0aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.015892 19814 raft_consensus.cc:359] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.016710 19814 raft_consensus.cc:385] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.017038 19814 raft_consensus.cc:740] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.017722 19818 leader_election.cc:290] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:53.018302 19814 consensus_queue.cc:260] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.019296 19821 raft_consensus.cc:515] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.019512 19770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f363d1ea0247e19c10c66095acb390" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
I20260709 13:06:53.020782 19814 ts_tablet_manager.cc:1434] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
W20260709 13:06:53.021397 19662 leader_election.cc:343] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.021919 19814 tablet_bootstrap.cc:492] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c: Bootstrap starting.
I20260709 13:06:53.022441 19772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00373e3027ea4238a5f2192e08afe3a8" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b" is_pre_election: true
I20260709 13:06:53.025097 19623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba99d0bb8bc4c0d9050da080ffc465d" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" is_pre_election: true
I20260709 13:06:53.025561 19772 raft_consensus.cc:2393] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae55b6b334544ee0bb4759a3a5bf0aed in current term 1: Already voted for candidate d73cac465ea84b6b99ebc324b2b6120b in this term.
I20260709 13:06:53.026895 19623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f363d1ea0247e19c10c66095acb390" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
I20260709 13:06:53.027748 19623 raft_consensus.cc:3060] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.028702 19814 tablet_bootstrap.cc:654] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.031177 19837 leader_election.cc:290] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:53.013800 19843 raft_consensus.cc:2804] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:53.034108 19843 raft_consensus.cc:697] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Becoming Leader. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Running, Role: LEADER
I20260709 13:06:53.032335 19771 raft_consensus.cc:2468] T 0ba99d0bb8bc4c0d9050da080ffc465d P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 1.
I20260709 13:06:53.035679 19622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6767e9811cd44c728760f5e3c414d309" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" is_pre_election: true
I20260709 13:06:53.037671 19622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba99d0bb8bc4c0d9050da080ffc465d" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
W20260709 13:06:53.039077 19661 leader_election.cc:343] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:53.040419 19661 leader_election.cc:343] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.040897 19661 leader_election.cc:304] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c; no voters: ae55b6b334544ee0bb4759a3a5bf0aed, d73cac465ea84b6b99ebc324b2b6120b
I20260709 13:06:53.042127 19837 raft_consensus.cc:2749] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.035717 19843 consensus_queue.cc:237] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.045424 19812 tablet_bootstrap.cc:654] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.046429 19662 leader_election.cc:304] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, d73cac465ea84b6b99ebc324b2b6120b; no voters: 
I20260709 13:06:53.047794 19837 raft_consensus.cc:2804] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:06:53.048022 19661 leader_election.cc:343] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.048611 19698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00373e3027ea4238a5f2192e08afe3a8" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2406d1f1804f03babf933367bc038c" is_pre_election: true
I20260709 13:06:53.051019 19698 raft_consensus.cc:2468] T 00373e3027ea4238a5f2192e08afe3a8 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae55b6b334544ee0bb4759a3a5bf0aed in term 0.
I20260709 13:06:53.048647 19837 raft_consensus.cc:697] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Becoming Leader. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Running, Role: LEADER
I20260709 13:06:53.052256 19586 leader_election.cc:304] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, ae55b6b334544ee0bb4759a3a5bf0aed; no voters: d73cac465ea84b6b99ebc324b2b6120b
I20260709 13:06:53.053267 19819 raft_consensus.cc:2804] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:53.052909 19837 consensus_queue.cc:237] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.053727 19819 raft_consensus.cc:493] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.054174 19819 raft_consensus.cc:3060] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.054531 19814 tablet_bootstrap.cc:492] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c: No bootstrap required, opened a new log
I20260709 13:06:53.055125 19814 ts_tablet_manager.cc:1403] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.015s
I20260709 13:06:53.055712 19812 tablet_bootstrap.cc:492] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b: No bootstrap required, opened a new log
I20260709 13:06:53.056334 19812 ts_tablet_manager.cc:1403] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.000s
I20260709 13:06:53.056627 19623 raft_consensus.cc:2468] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 1.
I20260709 13:06:53.058211 19814 raft_consensus.cc:359] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } }
I20260709 13:06:53.058969 19821 leader_election.cc:290] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315)
I20260709 13:06:53.059185 19814 raft_consensus.cc:385] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.059619 19814 raft_consensus.cc:740] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.059412 19812 raft_consensus.cc:359] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.060446 19812 raft_consensus.cc:385] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.060848 19812 raft_consensus.cc:740] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.060505 19814 consensus_queue.cc:260] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } }
I20260709 13:06:53.061849 19812 consensus_queue.cc:260] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.063004 19814 ts_tablet_manager.cc:1434] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:53.064026 19814 tablet_bootstrap.cc:492] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c: Bootstrap starting.
I20260709 13:06:53.064195 19812 ts_tablet_manager.cc:1434] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:53.065138 19698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00373e3027ea4238a5f2192e08afe3a8" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2406d1f1804f03babf933367bc038c"
I20260709 13:06:53.065912 19698 raft_consensus.cc:3060] T 00373e3027ea4238a5f2192e08afe3a8 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.066785 19521 catalog_manager.cc:5697] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b reported cstate change: term changed from 0 to 1, leader changed from <none> to d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67). New cstate: current_term: 1 leader_uuid: "d73cac465ea84b6b99ebc324b2b6120b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:53.069058 19812 tablet_bootstrap.cc:492] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b: Bootstrap starting.
I20260709 13:06:53.071182 19814 tablet_bootstrap.cc:654] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.071187 19661 leader_election.cc:304] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, ae55b6b334544ee0bb4759a3a5bf0aed; no voters: d73cac465ea84b6b99ebc324b2b6120b
I20260709 13:06:53.072983 19818 raft_consensus.cc:2804] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:53.073536 19818 raft_consensus.cc:697] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Becoming Leader. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Running, Role: LEADER
I20260709 13:06:53.074473 19818 consensus_queue.cc:237] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.078922 19812 tablet_bootstrap.cc:654] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.063688 19819 raft_consensus.cc:515] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.084682 19771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00373e3027ea4238a5f2192e08afe3a8" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
I20260709 13:06:53.085915 19771 raft_consensus.cc:2393] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ae55b6b334544ee0bb4759a3a5bf0aed in current term 1: Already voted for candidate d73cac465ea84b6b99ebc324b2b6120b in this term.
I20260709 13:06:53.087929 19819 leader_election.cc:290] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 1 election: Requested vote from peers 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:53.090054 19697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00373e3027ea4238a5f2192e08afe3a8" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2406d1f1804f03babf933367bc038c"
I20260709 13:06:53.090492 19519 catalog_manager.cc:5697] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a2406d1f1804f03babf933367bc038c (127.8.4.66). New cstate: current_term: 1 leader_uuid: "9a2406d1f1804f03babf933367bc038c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:53.092828 19586 leader_election.cc:304] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae55b6b334544ee0bb4759a3a5bf0aed; no voters: 9a2406d1f1804f03babf933367bc038c, d73cac465ea84b6b99ebc324b2b6120b
I20260709 13:06:53.095045 19623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00373e3027ea4238a5f2192e08afe3a8" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
I20260709 13:06:53.096364 19623 raft_consensus.cc:2393] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d73cac465ea84b6b99ebc324b2b6120b in current term 1: Already voted for candidate ae55b6b334544ee0bb4759a3a5bf0aed in this term.
I20260709 13:06:53.113950 19819 raft_consensus.cc:2749] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.115075 19819 raft_consensus.cc:493] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.115795 19819 raft_consensus.cc:515] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.116830 19813 tablet_bootstrap.cc:492] T 6767e9811cd44c728760f5e3c414d309 P ae55b6b334544ee0bb4759a3a5bf0aed: No bootstrap required, opened a new log
I20260709 13:06:53.120421 19698 raft_consensus.cc:2468] T 00373e3027ea4238a5f2192e08afe3a8 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73cac465ea84b6b99ebc324b2b6120b in term 1.
I20260709 13:06:53.123449 19813 ts_tablet_manager.cc:1403] T 6767e9811cd44c728760f5e3c414d309 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent bootstrapping tablet: real 0.217s	user 0.024s	sys 0.005s
I20260709 13:06:53.121644 19812 tablet_bootstrap.cc:492] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b: No bootstrap required, opened a new log
I20260709 13:06:53.130853 19812 ts_tablet_manager.cc:1403] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b: Time spent bootstrapping tablet: real 0.062s	user 0.031s	sys 0.010s
I20260709 13:06:53.124601 19735 leader_election.cc:304] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, d73cac465ea84b6b99ebc324b2b6120b; no voters: ae55b6b334544ee0bb4759a3a5bf0aed
I20260709 13:06:53.132385 19843 raft_consensus.cc:2804] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:53.132906 19843 raft_consensus.cc:697] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Becoming Leader. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Running, Role: LEADER
I20260709 13:06:53.133284 19813 raft_consensus.cc:359] T 6767e9811cd44c728760f5e3c414d309 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.134159 19813 raft_consensus.cc:385] T 6767e9811cd44c728760f5e3c414d309 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.133780 19843 consensus_queue.cc:237] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.134509 19813 raft_consensus.cc:740] T 6767e9811cd44c728760f5e3c414d309 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.135432 19813 consensus_queue.cc:260] T 6767e9811cd44c728760f5e3c414d309 P ae55b6b334544ee0bb4759a3a5bf0aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.136154 19812 raft_consensus.cc:359] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.137369 19812 raft_consensus.cc:385] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.138149 19813 ts_tablet_manager.cc:1434] T 6767e9811cd44c728760f5e3c414d309 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:06:53.139343 19813 tablet_bootstrap.cc:492] T c6611cb14bc74c2d804eb0cb545ceb54 P ae55b6b334544ee0bb4759a3a5bf0aed: Bootstrap starting.
I20260709 13:06:53.137833 19812 raft_consensus.cc:740] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.143324 19812 consensus_queue.cc:260] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.146266 19813 tablet_bootstrap.cc:654] T c6611cb14bc74c2d804eb0cb545ceb54 P ae55b6b334544ee0bb4759a3a5bf0aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.146906 19812 ts_tablet_manager.cc:1434] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:06:53.148577 19812 tablet_bootstrap.cc:492] T a0f363d1ea0247e19c10c66095acb390 P d73cac465ea84b6b99ebc324b2b6120b: Bootstrap starting.
I20260709 13:06:53.155779 19818 raft_consensus.cc:493] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.156673 19818 raft_consensus.cc:515] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.161744 19623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031e57a0eb8a464292dfe35cf712cadd" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" is_pre_election: true
I20260709 13:06:53.162900 19623 raft_consensus.cc:2468] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 0.
I20260709 13:06:53.164628 19661 leader_election.cc:304] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, ae55b6b334544ee0bb4759a3a5bf0aed; no voters: 
I20260709 13:06:53.165848 19837 raft_consensus.cc:2804] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:53.166344 19837 raft_consensus.cc:493] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.166780 19837 raft_consensus.cc:3060] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.175424 19812 tablet_bootstrap.cc:654] T a0f363d1ea0247e19c10c66095acb390 P d73cac465ea84b6b99ebc324b2b6120b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.179916 19698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031e57a0eb8a464292dfe35cf712cadd" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2406d1f1804f03babf933367bc038c" is_pre_election: true
I20260709 13:06:53.180910 19819 leader_election.cc:290] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:53.183233 19771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031e57a0eb8a464292dfe35cf712cadd" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b" is_pre_election: true
W20260709 13:06:53.199172 19587 leader_election.cc:343] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.187440 19837 raft_consensus.cc:515] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.191324 19772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031e57a0eb8a464292dfe35cf712cadd" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b" is_pre_election: true
I20260709 13:06:53.202489 19698 raft_consensus.cc:2393] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae55b6b334544ee0bb4759a3a5bf0aed in current term 1: Already voted for candidate 9a2406d1f1804f03babf933367bc038c in this term.
W20260709 13:06:53.203339 19662 leader_election.cc:343] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.192022 19812 tablet_bootstrap.cc:492] T a0f363d1ea0247e19c10c66095acb390 P d73cac465ea84b6b99ebc324b2b6120b: No bootstrap required, opened a new log
I20260709 13:06:53.204497 19812 ts_tablet_manager.cc:1403] T a0f363d1ea0247e19c10c66095acb390 P d73cac465ea84b6b99ebc324b2b6120b: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.005s
I20260709 13:06:53.205227 19586 leader_election.cc:304] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae55b6b334544ee0bb4759a3a5bf0aed; no voters: 9a2406d1f1804f03babf933367bc038c, d73cac465ea84b6b99ebc324b2b6120b
I20260709 13:06:53.199746 19814 tablet_bootstrap.cc:492] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c: No bootstrap required, opened a new log
I20260709 13:06:53.206851 19814 ts_tablet_manager.cc:1403] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c: Time spent bootstrapping tablet: real 0.143s	user 0.058s	sys 0.070s
I20260709 13:06:53.207823 19623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031e57a0eb8a464292dfe35cf712cadd" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
I20260709 13:06:53.208626 19623 raft_consensus.cc:3060] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.195535 19818 leader_election.cc:290] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:53.210994 19837 leader_election.cc:290] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:53.212323 19772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031e57a0eb8a464292dfe35cf712cadd" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
I20260709 13:06:53.209801 19814 raft_consensus.cc:359] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.214578 19814 raft_consensus.cc:385] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.214869 19814 raft_consensus.cc:740] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.216465 19814 consensus_queue.cc:260] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.217370 19623 raft_consensus.cc:2468] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 1.
I20260709 13:06:53.218694 19814 ts_tablet_manager.cc:1434] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
W20260709 13:06:53.214121 19662 leader_election.cc:343] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.219462 19661 leader_election.cc:304] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, ae55b6b334544ee0bb4759a3a5bf0aed; no voters: d73cac465ea84b6b99ebc324b2b6120b
I20260709 13:06:53.220278 19813 tablet_bootstrap.cc:492] T c6611cb14bc74c2d804eb0cb545ceb54 P ae55b6b334544ee0bb4759a3a5bf0aed: No bootstrap required, opened a new log
I20260709 13:06:53.220698 19813 ts_tablet_manager.cc:1403] T c6611cb14bc74c2d804eb0cb545ceb54 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent bootstrapping tablet: real 0.082s	user 0.041s	sys 0.028s
I20260709 13:06:53.221081 19818 raft_consensus.cc:2804] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:53.221727 19818 raft_consensus.cc:697] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Becoming Leader. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Running, Role: LEADER
I20260709 13:06:53.222352 19812 raft_consensus.cc:359] T a0f363d1ea0247e19c10c66095acb390 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.223155 19812 raft_consensus.cc:385] T a0f363d1ea0247e19c10c66095acb390 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.223457 19812 raft_consensus.cc:740] T a0f363d1ea0247e19c10c66095acb390 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.222632 19818 consensus_queue.cc:237] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.224014 19813 raft_consensus.cc:359] T c6611cb14bc74c2d804eb0cb545ceb54 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.224220 19812 consensus_queue.cc:260] T a0f363d1ea0247e19c10c66095acb390 P d73cac465ea84b6b99ebc324b2b6120b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.224933 19813 raft_consensus.cc:385] T c6611cb14bc74c2d804eb0cb545ceb54 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.225618 19813 raft_consensus.cc:740] T c6611cb14bc74c2d804eb0cb545ceb54 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.226739 19819 raft_consensus.cc:2749] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.226502 19813 consensus_queue.cc:260] T c6611cb14bc74c2d804eb0cb545ceb54 P ae55b6b334544ee0bb4759a3a5bf0aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.228909 19813 ts_tablet_manager.cc:1434] T c6611cb14bc74c2d804eb0cb545ceb54 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:06:53.226502 19812 ts_tablet_manager.cc:1434] T a0f363d1ea0247e19c10c66095acb390 P d73cac465ea84b6b99ebc324b2b6120b: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:06:53.229980 19813 tablet_bootstrap.cc:492] T 3eafaba6fea54118a203224ebc4c6e9b P ae55b6b334544ee0bb4759a3a5bf0aed: Bootstrap starting.
I20260709 13:06:53.231112 19812 tablet_bootstrap.cc:492] T 031e57a0eb8a464292dfe35cf712cadd P d73cac465ea84b6b99ebc324b2b6120b: Bootstrap starting.
I20260709 13:06:53.230520 19519 catalog_manager.cc:5697] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b reported cstate change: term changed from 0 to 1, leader changed from <none> to d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67). New cstate: current_term: 1 leader_uuid: "d73cac465ea84b6b99ebc324b2b6120b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:53.238461 19812 tablet_bootstrap.cc:654] T 031e57a0eb8a464292dfe35cf712cadd P d73cac465ea84b6b99ebc324b2b6120b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.242668 19813 tablet_bootstrap.cc:654] T 3eafaba6fea54118a203224ebc4c6e9b P ae55b6b334544ee0bb4759a3a5bf0aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.247385 19818 raft_consensus.cc:493] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.229986 19521 catalog_manager.cc:5697] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a2406d1f1804f03babf933367bc038c (127.8.4.66). New cstate: current_term: 1 leader_uuid: "9a2406d1f1804f03babf933367bc038c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:53.248915 19818 raft_consensus.cc:515] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.249604 19812 tablet_bootstrap.cc:492] T 031e57a0eb8a464292dfe35cf712cadd P d73cac465ea84b6b99ebc324b2b6120b: No bootstrap required, opened a new log
I20260709 13:06:53.250087 19812 ts_tablet_manager.cc:1403] T 031e57a0eb8a464292dfe35cf712cadd P d73cac465ea84b6b99ebc324b2b6120b: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.009s
I20260709 13:06:53.250736 19813 tablet_bootstrap.cc:492] T 3eafaba6fea54118a203224ebc4c6e9b P ae55b6b334544ee0bb4759a3a5bf0aed: No bootstrap required, opened a new log
I20260709 13:06:53.251116 19818 leader_election.cc:290] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:53.251286 19813 ts_tablet_manager.cc:1403] T 3eafaba6fea54118a203224ebc4c6e9b P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.003s
I20260709 13:06:53.253302 19623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1467e69e14349fea54e3d16796f8fd0" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" is_pre_election: true
I20260709 13:06:53.252694 19812 raft_consensus.cc:359] T 031e57a0eb8a464292dfe35cf712cadd P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.253928 19812 raft_consensus.cc:385] T 031e57a0eb8a464292dfe35cf712cadd P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.254200 19812 raft_consensus.cc:740] T 031e57a0eb8a464292dfe35cf712cadd P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.254441 19813 raft_consensus.cc:359] T 3eafaba6fea54118a203224ebc4c6e9b P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
W20260709 13:06:53.254909 19661 leader_election.cc:343] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.254999 19812 consensus_queue.cc:260] T 031e57a0eb8a464292dfe35cf712cadd P d73cac465ea84b6b99ebc324b2b6120b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.255326 19813 raft_consensus.cc:385] T 3eafaba6fea54118a203224ebc4c6e9b P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.255168 19772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1467e69e14349fea54e3d16796f8fd0" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b" is_pre_election: true
I20260709 13:06:53.255967 19813 raft_consensus.cc:740] T 3eafaba6fea54118a203224ebc4c6e9b P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.256553 19772 raft_consensus.cc:2468] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 0.
I20260709 13:06:53.257341 19812 ts_tablet_manager.cc:1434] T 031e57a0eb8a464292dfe35cf712cadd P d73cac465ea84b6b99ebc324b2b6120b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:06:53.257195 19813 consensus_queue.cc:260] T 3eafaba6fea54118a203224ebc4c6e9b P ae55b6b334544ee0bb4759a3a5bf0aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.258021 19662 leader_election.cc:304] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, d73cac465ea84b6b99ebc324b2b6120b; no voters: ae55b6b334544ee0bb4759a3a5bf0aed
I20260709 13:06:53.259755 19813 ts_tablet_manager.cc:1434] T 3eafaba6fea54118a203224ebc4c6e9b P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:06:53.260881 19813 tablet_bootstrap.cc:492] T e1467e69e14349fea54e3d16796f8fd0 P ae55b6b334544ee0bb4759a3a5bf0aed: Bootstrap starting.
I20260709 13:06:53.262328 19818 raft_consensus.cc:2804] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:53.262807 19818 raft_consensus.cc:493] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.263199 19818 raft_consensus.cc:3060] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.268002 19813 tablet_bootstrap.cc:654] T e1467e69e14349fea54e3d16796f8fd0 P ae55b6b334544ee0bb4759a3a5bf0aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.268086 19519 catalog_manager.cc:5697] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a2406d1f1804f03babf933367bc038c (127.8.4.66). New cstate: current_term: 1 leader_uuid: "9a2406d1f1804f03babf933367bc038c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:53.272342 19818 raft_consensus.cc:515] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.274114 19813 tablet_bootstrap.cc:492] T e1467e69e14349fea54e3d16796f8fd0 P ae55b6b334544ee0bb4759a3a5bf0aed: No bootstrap required, opened a new log
I20260709 13:06:53.274766 19813 ts_tablet_manager.cc:1403] T e1467e69e14349fea54e3d16796f8fd0 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:06:53.275568 19623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1467e69e14349fea54e3d16796f8fd0" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
I20260709 13:06:53.276741 19818 leader_election.cc:290] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:53.276980 19837 raft_consensus.cc:493] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:53.277480 19661 leader_election.cc:343] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.277591 19837 raft_consensus.cc:515] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.278996 19813 raft_consensus.cc:359] T e1467e69e14349fea54e3d16796f8fd0 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.279717 19813 raft_consensus.cc:385] T e1467e69e14349fea54e3d16796f8fd0 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.279978 19813 raft_consensus.cc:740] T e1467e69e14349fea54e3d16796f8fd0 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.280049 19837 leader_election.cc:290] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:53.280722 19813 consensus_queue.cc:260] T e1467e69e14349fea54e3d16796f8fd0 P ae55b6b334544ee0bb4759a3a5bf0aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.281147 19772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1467e69e14349fea54e3d16796f8fd0" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
I20260709 13:06:53.281760 19772 raft_consensus.cc:3060] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.282246 19771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6611cb14bc74c2d804eb0cb545ceb54" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b" is_pre_election: true
I20260709 13:06:53.282496 19623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6611cb14bc74c2d804eb0cb545ceb54" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" is_pre_election: true
I20260709 13:06:53.282953 19771 raft_consensus.cc:2468] T c6611cb14bc74c2d804eb0cb545ceb54 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 0.
I20260709 13:06:53.283177 19623 raft_consensus.cc:2468] T c6611cb14bc74c2d804eb0cb545ceb54 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 0.
I20260709 13:06:53.284740 19661 leader_election.cc:304] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, ae55b6b334544ee0bb4759a3a5bf0aed; no voters: 
I20260709 13:06:53.283221 19813 ts_tablet_manager.cc:1434] T e1467e69e14349fea54e3d16796f8fd0 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:06:53.286391 19837 raft_consensus.cc:2804] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:53.286718 19813 tablet_bootstrap.cc:492] T 0ba99d0bb8bc4c0d9050da080ffc465d P ae55b6b334544ee0bb4759a3a5bf0aed: Bootstrap starting.
I20260709 13:06:53.287096 19837 raft_consensus.cc:493] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.287519 19837 raft_consensus.cc:3060] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.292276 19772 raft_consensus.cc:2468] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 1.
I20260709 13:06:53.293252 19813 tablet_bootstrap.cc:654] T 0ba99d0bb8bc4c0d9050da080ffc465d P ae55b6b334544ee0bb4759a3a5bf0aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.293774 19662 leader_election.cc:304] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, d73cac465ea84b6b99ebc324b2b6120b; no voters: ae55b6b334544ee0bb4759a3a5bf0aed
I20260709 13:06:53.294721 19818 raft_consensus.cc:2804] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:53.295257 19818 raft_consensus.cc:697] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Becoming Leader. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Running, Role: LEADER
I20260709 13:06:53.296140 19837 raft_consensus.cc:515] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.296141 19818 consensus_queue.cc:237] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.301769 19840 raft_consensus.cc:493] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.302100 19623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6611cb14bc74c2d804eb0cb545ceb54" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
I20260709 13:06:53.302861 19623 raft_consensus.cc:3060] T c6611cb14bc74c2d804eb0cb545ceb54 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.302505 19840 raft_consensus.cc:515] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } }
I20260709 13:06:53.305164 19840 leader_election.cc:290] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:53.307202 19622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c740fe2573ce4850b4ba3faf8c3309a9" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" is_pre_election: true
I20260709 13:06:53.307979 19622 raft_consensus.cc:2468] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 0.
I20260709 13:06:53.309536 19661 leader_election.cc:304] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, ae55b6b334544ee0bb4759a3a5bf0aed; no voters: 
I20260709 13:06:53.311748 19840 raft_consensus.cc:2804] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:53.311935 19771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c740fe2573ce4850b4ba3faf8c3309a9" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b" is_pre_election: true
I20260709 13:06:53.312271 19840 raft_consensus.cc:493] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.312672 19840 raft_consensus.cc:3060] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.312721 19771 raft_consensus.cc:2468] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 0.
I20260709 13:06:53.315686 19623 raft_consensus.cc:2468] T c6611cb14bc74c2d804eb0cb545ceb54 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 1.
I20260709 13:06:53.316540 19772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6611cb14bc74c2d804eb0cb545ceb54" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
I20260709 13:06:53.317142 19661 leader_election.cc:304] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, ae55b6b334544ee0bb4759a3a5bf0aed; no voters: 
I20260709 13:06:53.318100 19772 raft_consensus.cc:3060] T c6611cb14bc74c2d804eb0cb545ceb54 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.319193 19818 raft_consensus.cc:2804] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:53.321448 19521 catalog_manager.cc:5697] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a2406d1f1804f03babf933367bc038c (127.8.4.66). New cstate: current_term: 1 leader_uuid: "9a2406d1f1804f03babf933367bc038c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:53.328531 19837 leader_election.cc:290] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:53.329521 19818 raft_consensus.cc:697] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Becoming Leader. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Running, Role: LEADER
I20260709 13:06:53.331118 19818 consensus_queue.cc:237] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.333215 19772 raft_consensus.cc:2468] T c6611cb14bc74c2d804eb0cb545ceb54 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 1.
I20260709 13:06:53.331387 19840 raft_consensus.cc:515] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } }
I20260709 13:06:53.340137 19772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c740fe2573ce4850b4ba3faf8c3309a9" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
I20260709 13:06:53.340370 19623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c740fe2573ce4850b4ba3faf8c3309a9" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
I20260709 13:06:53.340801 19813 tablet_bootstrap.cc:492] T 0ba99d0bb8bc4c0d9050da080ffc465d P ae55b6b334544ee0bb4759a3a5bf0aed: No bootstrap required, opened a new log
I20260709 13:06:53.341602 19813 ts_tablet_manager.cc:1403] T 0ba99d0bb8bc4c0d9050da080ffc465d P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.024s
I20260709 13:06:53.340982 19772 raft_consensus.cc:3060] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.342324 19623 raft_consensus.cc:3060] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.344659 19813 raft_consensus.cc:359] T 0ba99d0bb8bc4c0d9050da080ffc465d P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.345625 19813 raft_consensus.cc:385] T 0ba99d0bb8bc4c0d9050da080ffc465d P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.338981 19840 leader_election.cc:290] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:53.346025 19813 raft_consensus.cc:740] T 0ba99d0bb8bc4c0d9050da080ffc465d P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.347949 19813 consensus_queue.cc:260] T 0ba99d0bb8bc4c0d9050da080ffc465d P ae55b6b334544ee0bb4759a3a5bf0aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.350322 19813 ts_tablet_manager.cc:1434] T 0ba99d0bb8bc4c0d9050da080ffc465d P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:06:53.354493 19772 raft_consensus.cc:2468] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 1.
I20260709 13:06:53.355999 19662 leader_election.cc:304] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, d73cac465ea84b6b99ebc324b2b6120b; no voters: 
I20260709 13:06:53.356365 19623 raft_consensus.cc:2468] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 1.
I20260709 13:06:53.355671 19521 catalog_manager.cc:5697] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a2406d1f1804f03babf933367bc038c (127.8.4.66). New cstate: current_term: 1 leader_uuid: "9a2406d1f1804f03babf933367bc038c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:53.357656 19818 raft_consensus.cc:2804] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:53.358261 19818 raft_consensus.cc:697] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Becoming Leader. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Running, Role: LEADER
I20260709 13:06:53.359104 19818 consensus_queue.cc:237] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } }
I20260709 13:06:53.371016 19521 catalog_manager.cc:5697] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a2406d1f1804f03babf933367bc038c (127.8.4.66). New cstate: current_term: 1 leader_uuid: "9a2406d1f1804f03babf933367bc038c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:53.410168 19843 raft_consensus.cc:493] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.410938 19843 raft_consensus.cc:515] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.412876 19843 leader_election.cc:290] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315)
I20260709 13:06:53.413877 19623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6767e9811cd44c728760f5e3c414d309" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" is_pre_election: true
I20260709 13:06:53.414031 19698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6767e9811cd44c728760f5e3c414d309" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2406d1f1804f03babf933367bc038c" is_pre_election: true
I20260709 13:06:53.414604 19623 raft_consensus.cc:2468] T 6767e9811cd44c728760f5e3c414d309 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d73cac465ea84b6b99ebc324b2b6120b in term 0.
I20260709 13:06:53.414702 19698 raft_consensus.cc:2468] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d73cac465ea84b6b99ebc324b2b6120b in term 0.
I20260709 13:06:53.415764 19735 leader_election.cc:304] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae55b6b334544ee0bb4759a3a5bf0aed, d73cac465ea84b6b99ebc324b2b6120b; no voters: 
I20260709 13:06:53.416492 19843 raft_consensus.cc:2804] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:53.416977 19843 raft_consensus.cc:493] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.417344 19843 raft_consensus.cc:3060] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.422653 19843 raft_consensus.cc:515] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.424438 19843 leader_election.cc:290] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315)
I20260709 13:06:53.425504 19623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6767e9811cd44c728760f5e3c414d309" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
I20260709 13:06:53.425779 19698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6767e9811cd44c728760f5e3c414d309" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2406d1f1804f03babf933367bc038c"
I20260709 13:06:53.426229 19623 raft_consensus.cc:3060] T 6767e9811cd44c728760f5e3c414d309 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.426350 19698 raft_consensus.cc:3060] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.433509 19623 raft_consensus.cc:2468] T 6767e9811cd44c728760f5e3c414d309 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73cac465ea84b6b99ebc324b2b6120b in term 1.
I20260709 13:06:53.433511 19698 raft_consensus.cc:2468] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73cac465ea84b6b99ebc324b2b6120b in term 1.
I20260709 13:06:53.434870 19735 leader_election.cc:304] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, d73cac465ea84b6b99ebc324b2b6120b; no voters: 
I20260709 13:06:53.435652 19843 raft_consensus.cc:2804] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:53.436188 19843 raft_consensus.cc:697] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Becoming Leader. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Running, Role: LEADER
I20260709 13:06:53.436995 19843 consensus_queue.cc:237] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.445629 19521 catalog_manager.cc:5697] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b reported cstate change: term changed from 0 to 1, leader changed from <none> to d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67). New cstate: current_term: 1 leader_uuid: "d73cac465ea84b6b99ebc324b2b6120b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:53.470332 19818 consensus_queue.cc:1048] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:53.474807 19843 raft_consensus.cc:493] T 031e57a0eb8a464292dfe35cf712cadd P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.475332 19843 raft_consensus.cc:515] T 031e57a0eb8a464292dfe35cf712cadd P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.477336 19843 leader_election.cc:290] T 031e57a0eb8a464292dfe35cf712cadd P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315)
I20260709 13:06:53.478579 19623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031e57a0eb8a464292dfe35cf712cadd" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" is_pre_election: true
I20260709 13:06:53.478644 19698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031e57a0eb8a464292dfe35cf712cadd" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2406d1f1804f03babf933367bc038c" is_pre_election: true
I20260709 13:06:53.479697 19623 raft_consensus.cc:2393] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d73cac465ea84b6b99ebc324b2b6120b in current term 1: Already voted for candidate 9a2406d1f1804f03babf933367bc038c in this term.
I20260709 13:06:53.483268 19735 leader_election.cc:304] T 031e57a0eb8a464292dfe35cf712cadd P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d73cac465ea84b6b99ebc324b2b6120b; no voters: 9a2406d1f1804f03babf933367bc038c, ae55b6b334544ee0bb4759a3a5bf0aed
I20260709 13:06:53.484575 19843 raft_consensus.cc:3060] T 031e57a0eb8a464292dfe35cf712cadd P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.488929 19623 raft_consensus.cc:3060] T 0ba99d0bb8bc4c0d9050da080ffc465d P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.492983 19772 raft_consensus.cc:3060] T a0f363d1ea0247e19c10c66095acb390 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.496649 19843 raft_consensus.cc:2749] T 031e57a0eb8a464292dfe35cf712cadd P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.498837 19840 consensus_queue.cc:1048] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:53.501134 19840 consensus_queue.cc:1048] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:53.520810 19865 consensus_queue.cc:1048] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:53.534370 19623 raft_consensus.cc:3060] T 3eafaba6fea54118a203224ebc4c6e9b P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.542732 19843 consensus_queue.cc:1048] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:53.559325 19877 consensus_queue.cc:1048] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:53.633150 19698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c740fe2573ce4850b4ba3faf8c3309a9"
dest_uuid: "9a2406d1f1804f03babf933367bc038c"
mode: GRACEFUL
new_leader_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
 from {username='slave'} at 127.0.0.1:53236
I20260709 13:06:53.633844 19698 raft_consensus.cc:606] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Received request to transfer leadership to TS ae55b6b334544ee0bb4759a3a5bf0aed
I20260709 13:06:53.640015 19698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "031e57a0eb8a464292dfe35cf712cadd"
dest_uuid: "9a2406d1f1804f03babf933367bc038c"
mode: GRACEFUL
new_leader_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
 from {username='slave'} at 127.0.0.1:53236
I20260709 13:06:53.640658 19698 raft_consensus.cc:606] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Received request to transfer leadership to TS ae55b6b334544ee0bb4759a3a5bf0aed
I20260709 13:06:53.646550 19877 consensus_queue.cc:1048] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:53.646950 19698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0f363d1ea0247e19c10c66095acb390"
dest_uuid: "9a2406d1f1804f03babf933367bc038c"
mode: GRACEFUL
new_leader_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
 from {username='slave'} at 127.0.0.1:53236
I20260709 13:06:53.647555 19698 raft_consensus.cc:606] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Received request to transfer leadership to TS ae55b6b334544ee0bb4759a3a5bf0aed
I20260709 13:06:53.666800 19877 consensus_queue.cc:1048] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:53.675483 19772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00373e3027ea4238a5f2192e08afe3a8"
dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
mode: GRACEFUL
new_leader_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
 from {username='slave'} at 127.0.0.1:44070
I20260709 13:06:53.675971 19772 raft_consensus.cc:606] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Received request to transfer leadership to TS ae55b6b334544ee0bb4759a3a5bf0aed
I20260709 13:06:53.682142 19772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3eafaba6fea54118a203224ebc4c6e9b"
dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
mode: GRACEFUL
new_leader_uuid: "9a2406d1f1804f03babf933367bc038c"
 from {username='slave'} at 127.0.0.1:44070
I20260709 13:06:53.682686 19772 raft_consensus.cc:606] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Received request to transfer leadership to TS 9a2406d1f1804f03babf933367bc038c
I20260709 13:06:53.693516 19772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6767e9811cd44c728760f5e3c414d309"
dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
mode: GRACEFUL
new_leader_uuid: "9a2406d1f1804f03babf933367bc038c"
 from {username='slave'} at 127.0.0.1:44070
I20260709 13:06:53.694069 19772 raft_consensus.cc:606] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Received request to transfer leadership to TS 9a2406d1f1804f03babf933367bc038c
I20260709 13:06:53.699817 19698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1467e69e14349fea54e3d16796f8fd0"
dest_uuid: "9a2406d1f1804f03babf933367bc038c"
mode: GRACEFUL
new_leader_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
 from {username='slave'} at 127.0.0.1:53236
I20260709 13:06:53.700479 19698 raft_consensus.cc:606] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Received request to transfer leadership to TS d73cac465ea84b6b99ebc324b2b6120b
I20260709 13:06:53.714128 19623 raft_consensus.cc:3060] T e1467e69e14349fea54e3d16796f8fd0 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.720912 19865 consensus_queue.cc:1048] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:53.733170 19818 consensus_queue.cc:1048] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:53.741617 19840 raft_consensus.cc:993] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c: : Instructing follower d73cac465ea84b6b99ebc324b2b6120b to start an election
I20260709 13:06:53.742111 19818 raft_consensus.cc:1081] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Signalling peer d73cac465ea84b6b99ebc324b2b6120b to start an election
I20260709 13:06:53.743659 19772 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1467e69e14349fea54e3d16796f8fd0"
dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
 from {username='slave'} at 127.0.0.1:47444
I20260709 13:06:53.744254 19772 raft_consensus.cc:493] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:53.744632 19772 raft_consensus.cc:3060] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.746974 19818 consensus_queue.cc:1048] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:53.752455 19772 raft_consensus.cc:515] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.754101 19818 consensus_queue.cc:1048] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:53.756369 19772 leader_election.cc:290] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 2 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315)
I20260709 13:06:53.757680 19623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1467e69e14349fea54e3d16796f8fd0" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
I20260709 13:06:53.758365 19623 raft_consensus.cc:3060] T e1467e69e14349fea54e3d16796f8fd0 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.760783 19698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1467e69e14349fea54e3d16796f8fd0" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a2406d1f1804f03babf933367bc038c"
I20260709 13:06:53.761490 19698 raft_consensus.cc:3055] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:53.761792 19698 raft_consensus.cc:740] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Running, Role: LEADER
I20260709 13:06:53.762598 19698 consensus_queue.cc:260] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.763727 19698 raft_consensus.cc:3060] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.769760 19623 raft_consensus.cc:2468] T e1467e69e14349fea54e3d16796f8fd0 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73cac465ea84b6b99ebc324b2b6120b in term 2.
I20260709 13:06:53.771414 19735 leader_election.cc:304] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae55b6b334544ee0bb4759a3a5bf0aed, d73cac465ea84b6b99ebc324b2b6120b; no voters: 
I20260709 13:06:53.772768 19877 raft_consensus.cc:2804] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:53.772372 19840 consensus_queue.cc:1048] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:53.773351 19877 raft_consensus.cc:697] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b [term 2 LEADER]: Becoming Leader. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Running, Role: LEADER
I20260709 13:06:53.774211 19877 consensus_queue.cc:237] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.774564 19840 consensus_queue.cc:1048] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:53.774624 19698 raft_consensus.cc:2468] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73cac465ea84b6b99ebc324b2b6120b in term 2.
I20260709 13:06:53.792758 19818 consensus_queue.cc:1048] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:53.798439 19520 catalog_manager.cc:5697] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b reported cstate change: term changed from 1 to 2, leader changed from 9a2406d1f1804f03babf933367bc038c (127.8.4.66) to d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67). New cstate: current_term: 2 leader_uuid: "d73cac465ea84b6b99ebc324b2b6120b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:53.813807 19865 raft_consensus.cc:993] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c: : Instructing follower ae55b6b334544ee0bb4759a3a5bf0aed to start an election
I20260709 13:06:53.814383 19865 raft_consensus.cc:1081] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Signalling peer ae55b6b334544ee0bb4759a3a5bf0aed to start an election
I20260709 13:06:53.815255 19865 consensus_queue.cc:1048] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:53.816169 19622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "031e57a0eb8a464292dfe35cf712cadd"
dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
 from {username='slave'} at 127.0.0.1:37756
I20260709 13:06:53.816838 19622 raft_consensus.cc:493] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:53.817239 19622 raft_consensus.cc:3060] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.834713 19622 raft_consensus.cc:515] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.837644 19698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031e57a0eb8a464292dfe35cf712cadd" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a2406d1f1804f03babf933367bc038c"
I20260709 13:06:53.838063 19770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031e57a0eb8a464292dfe35cf712cadd" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
I20260709 13:06:53.838306 19698 raft_consensus.cc:3055] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:53.838739 19770 raft_consensus.cc:3060] T 031e57a0eb8a464292dfe35cf712cadd P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.838686 19698 raft_consensus.cc:740] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Running, Role: LEADER
I20260709 13:06:53.838615 19840 raft_consensus.cc:993] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c: : Instructing follower ae55b6b334544ee0bb4759a3a5bf0aed to start an election
I20260709 13:06:53.840226 19837 raft_consensus.cc:1081] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Signalling peer ae55b6b334544ee0bb4759a3a5bf0aed to start an election
I20260709 13:06:53.840441 19698 consensus_queue.cc:260] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.841871 19698 raft_consensus.cc:3060] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.842394 19621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c740fe2573ce4850b4ba3faf8c3309a9"
dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
 from {username='slave'} at 127.0.0.1:37756
I20260709 13:06:53.843158 19621 raft_consensus.cc:493] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:53.843601 19621 raft_consensus.cc:3060] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.838120 19622 leader_election.cc:290] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 2 election: Requested vote from peers 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:53.865267 19770 raft_consensus.cc:2468] T 031e57a0eb8a464292dfe35cf712cadd P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae55b6b334544ee0bb4759a3a5bf0aed in term 2.
I20260709 13:06:53.865267 19698 raft_consensus.cc:2468] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae55b6b334544ee0bb4759a3a5bf0aed in term 2.
I20260709 13:06:53.867089 19587 leader_election.cc:304] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae55b6b334544ee0bb4759a3a5bf0aed, d73cac465ea84b6b99ebc324b2b6120b; no voters: 
I20260709 13:06:53.868016 19819 raft_consensus.cc:2804] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:53.868770 19621 raft_consensus.cc:515] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } }
I20260709 13:06:53.869280 19819 raft_consensus.cc:697] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 LEADER]: Becoming Leader. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Running, Role: LEADER
I20260709 13:06:53.870270 19819 consensus_queue.cc:237] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.871963 19770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c740fe2573ce4850b4ba3faf8c3309a9" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
I20260709 13:06:53.872020 19621 leader_election.cc:290] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 2 election: Requested vote from peers d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405), 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315)
I20260709 13:06:53.872373 19698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c740fe2573ce4850b4ba3faf8c3309a9" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a2406d1f1804f03babf933367bc038c"
I20260709 13:06:53.872720 19770 raft_consensus.cc:3060] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.873420 19698 raft_consensus.cc:3055] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:53.873930 19698 raft_consensus.cc:740] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Running, Role: LEADER
I20260709 13:06:53.875011 19698 consensus_queue.cc:260] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } }
I20260709 13:06:53.876209 19698 raft_consensus.cc:3060] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.880137 19770 raft_consensus.cc:2468] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae55b6b334544ee0bb4759a3a5bf0aed in term 2.
I20260709 13:06:53.881443 19587 leader_election.cc:304] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae55b6b334544ee0bb4759a3a5bf0aed, d73cac465ea84b6b99ebc324b2b6120b; no voters: 
I20260709 13:06:53.882344 19819 raft_consensus.cc:2804] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:53.882885 19819 raft_consensus.cc:697] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 LEADER]: Becoming Leader. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Running, Role: LEADER
I20260709 13:06:53.883085 19698 raft_consensus.cc:2468] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae55b6b334544ee0bb4759a3a5bf0aed in term 2.
I20260709 13:06:53.882630 19519 catalog_manager.cc:5697] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed reported cstate change: term changed from 1 to 2, leader changed from 9a2406d1f1804f03babf933367bc038c (127.8.4.66) to ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65). New cstate: current_term: 2 leader_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:53.883905 19819 consensus_queue.cc:237] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } }
I20260709 13:06:53.896880 19519 catalog_manager.cc:5697] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed reported cstate change: term changed from 1 to 2, leader changed from 9a2406d1f1804f03babf933367bc038c (127.8.4.66) to ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65). New cstate: current_term: 2 leader_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:53.937120 19877 consensus_queue.cc:1048] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:53.944216 19883 raft_consensus.cc:993] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b: : Instructing follower 9a2406d1f1804f03babf933367bc038c to start an election
I20260709 13:06:53.944814 19843 raft_consensus.cc:1081] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Signalling peer 9a2406d1f1804f03babf933367bc038c to start an election
I20260709 13:06:53.946461 19697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6767e9811cd44c728760f5e3c414d309"
dest_uuid: "9a2406d1f1804f03babf933367bc038c"
 from {username='slave'} at 127.0.0.1:57258
I20260709 13:06:53.947126 19697 raft_consensus.cc:493] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:53.947501 19697 raft_consensus.cc:3060] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.952872 19843 consensus_queue.cc:1048] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:53.955360 19697 raft_consensus.cc:515] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.958477 19622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6767e9811cd44c728760f5e3c414d309" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
I20260709 13:06:53.961967 19697 leader_election.cc:290] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 2 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:53.962209 19770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6767e9811cd44c728760f5e3c414d309" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
I20260709 13:06:53.962976 19770 raft_consensus.cc:3055] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:53.963372 19770 raft_consensus.cc:740] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Running, Role: LEADER
I20260709 13:06:53.964216 19770 consensus_queue.cc:260] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.965653 19770 raft_consensus.cc:3060] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.972088 19770 raft_consensus.cc:2468] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 2.
I20260709 13:06:53.973160 19662 leader_election.cc:304] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, d73cac465ea84b6b99ebc324b2b6120b; no voters: ae55b6b334544ee0bb4759a3a5bf0aed
I20260709 13:06:53.973850 19837 raft_consensus.cc:2804] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:53.974323 19837 raft_consensus.cc:697] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [term 2 LEADER]: Becoming Leader. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Running, Role: LEADER
I20260709 13:06:53.975056 19837 consensus_queue.cc:237] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:53.981750 19520 catalog_manager.cc:5697] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c reported cstate change: term changed from 1 to 2, leader changed from d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67) to 9a2406d1f1804f03babf933367bc038c (127.8.4.66). New cstate: current_term: 2 leader_uuid: "9a2406d1f1804f03babf933367bc038c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:54.077764 19877 raft_consensus.cc:993] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b: : Instructing follower 9a2406d1f1804f03babf933367bc038c to start an election
I20260709 13:06:54.078203 19843 raft_consensus.cc:1081] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Signalling peer 9a2406d1f1804f03babf933367bc038c to start an election
I20260709 13:06:54.079800 19697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3eafaba6fea54118a203224ebc4c6e9b"
dest_uuid: "9a2406d1f1804f03babf933367bc038c"
 from {username='slave'} at 127.0.0.1:57258
I20260709 13:06:54.080315 19697 raft_consensus.cc:493] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:54.080658 19697 raft_consensus.cc:3060] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:54.086417 19697 raft_consensus.cc:515] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:54.088250 19697 leader_election.cc:290] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 2 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:54.089046 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eafaba6fea54118a203224ebc4c6e9b" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
I20260709 13:06:54.089423 19770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eafaba6fea54118a203224ebc4c6e9b" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
I20260709 13:06:54.089748 19621 raft_consensus.cc:3060] T 3eafaba6fea54118a203224ebc4c6e9b P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:54.090051 19770 raft_consensus.cc:3055] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:54.090396 19770 raft_consensus.cc:740] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Running, Role: LEADER
I20260709 13:06:54.091120 19770 consensus_queue.cc:260] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:54.092128 19770 raft_consensus.cc:3060] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:54.095566 19621 raft_consensus.cc:2468] T 3eafaba6fea54118a203224ebc4c6e9b P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 2.
I20260709 13:06:54.096931 19661 leader_election.cc:304] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, ae55b6b334544ee0bb4759a3a5bf0aed; no voters: 
I20260709 13:06:54.097728 19770 raft_consensus.cc:2468] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 2.
I20260709 13:06:54.097760 19837 raft_consensus.cc:2804] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:54.098481 19837 raft_consensus.cc:697] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [term 2 LEADER]: Becoming Leader. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Running, Role: LEADER
I20260709 13:06:54.099246 19837 consensus_queue.cc:237] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:54.105777 19520 catalog_manager.cc:5697] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c reported cstate change: term changed from 1 to 2, leader changed from d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67) to 9a2406d1f1804f03babf933367bc038c (127.8.4.66). New cstate: current_term: 2 leader_uuid: "9a2406d1f1804f03babf933367bc038c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:54.117616 19818 raft_consensus.cc:993] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c: : Instructing follower ae55b6b334544ee0bb4759a3a5bf0aed to start an election
I20260709 13:06:54.118225 19837 raft_consensus.cc:1081] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Signalling peer ae55b6b334544ee0bb4759a3a5bf0aed to start an election
I20260709 13:06:54.120407 19621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0f363d1ea0247e19c10c66095acb390"
dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
 from {username='slave'} at 127.0.0.1:37756
I20260709 13:06:54.121203 19621 raft_consensus.cc:493] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:54.121655 19621 raft_consensus.cc:3060] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:54.129724 19621 raft_consensus.cc:515] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:54.132208 19621 leader_election.cc:290] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 2 election: Requested vote from peers 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:54.133406 19770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f363d1ea0247e19c10c66095acb390" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
I20260709 13:06:54.134244 19770 raft_consensus.cc:3060] T a0f363d1ea0247e19c10c66095acb390 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:54.135469 19697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f363d1ea0247e19c10c66095acb390" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a2406d1f1804f03babf933367bc038c"
I20260709 13:06:54.136188 19697 raft_consensus.cc:3055] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:54.136564 19697 raft_consensus.cc:740] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Running, Role: LEADER
I20260709 13:06:54.137841 19697 consensus_queue.cc:260] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:54.139307 19697 raft_consensus.cc:3060] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:54.142901 19770 raft_consensus.cc:2468] T a0f363d1ea0247e19c10c66095acb390 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae55b6b334544ee0bb4759a3a5bf0aed in term 2.
I20260709 13:06:54.144279 19587 leader_election.cc:304] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae55b6b334544ee0bb4759a3a5bf0aed, d73cac465ea84b6b99ebc324b2b6120b; no voters: 
I20260709 13:06:54.145028 19819 raft_consensus.cc:2804] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:54.145545 19819 raft_consensus.cc:697] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 LEADER]: Becoming Leader. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Running, Role: LEADER
I20260709 13:06:54.146395 19819 consensus_queue.cc:237] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:54.147210 19697 raft_consensus.cc:2468] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae55b6b334544ee0bb4759a3a5bf0aed in term 2.
I20260709 13:06:54.153224 19520 catalog_manager.cc:5697] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed reported cstate change: term changed from 1 to 2, leader changed from 9a2406d1f1804f03babf933367bc038c (127.8.4.66) to ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65). New cstate: current_term: 2 leader_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:54.160992 19621 raft_consensus.cc:1275] T e1467e69e14349fea54e3d16796f8fd0 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Refusing update from remote peer d73cac465ea84b6b99ebc324b2b6120b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:54.162405 19843 consensus_queue.cc:1048] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:54.172197 19697 raft_consensus.cc:1275] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Refusing update from remote peer d73cac465ea84b6b99ebc324b2b6120b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:54.173800 19883 consensus_queue.cc:1048] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:54.252339 19843 raft_consensus.cc:993] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b: : Instructing follower ae55b6b334544ee0bb4759a3a5bf0aed to start an election
I20260709 13:06:54.252821 19883 raft_consensus.cc:1081] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Signalling peer ae55b6b334544ee0bb4759a3a5bf0aed to start an election
I20260709 13:06:54.254688 19621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00373e3027ea4238a5f2192e08afe3a8"
dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
 from {username='slave'} at 127.0.0.1:37740
I20260709 13:06:54.255187 19621 raft_consensus.cc:493] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:54.255457 19621 raft_consensus.cc:3060] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:54.260732 19621 raft_consensus.cc:515] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:54.262773 19621 leader_election.cc:290] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 2 election: Requested vote from peers 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:54.263671 19697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00373e3027ea4238a5f2192e08afe3a8" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a2406d1f1804f03babf933367bc038c"
I20260709 13:06:54.263892 19770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00373e3027ea4238a5f2192e08afe3a8" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
I20260709 13:06:54.264271 19697 raft_consensus.cc:3060] T 00373e3027ea4238a5f2192e08afe3a8 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:54.264524 19770 raft_consensus.cc:3055] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:54.264871 19770 raft_consensus.cc:740] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Running, Role: LEADER
I20260709 13:06:54.265691 19770 consensus_queue.cc:260] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:54.266651 19770 raft_consensus.cc:3060] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:54.269948 19697 raft_consensus.cc:2468] T 00373e3027ea4238a5f2192e08afe3a8 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae55b6b334544ee0bb4759a3a5bf0aed in term 2.
I20260709 13:06:54.271263 19586 leader_election.cc:304] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, ae55b6b334544ee0bb4759a3a5bf0aed; no voters: 
I20260709 13:06:54.272053 19819 raft_consensus.cc:2804] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:54.272166 19770 raft_consensus.cc:2468] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae55b6b334544ee0bb4759a3a5bf0aed in term 2.
I20260709 13:06:54.272495 19819 raft_consensus.cc:697] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 LEADER]: Becoming Leader. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Running, Role: LEADER
I20260709 13:06:54.273435 19819 consensus_queue.cc:237] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:54.280270 19519 catalog_manager.cc:5697] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed reported cstate change: term changed from 1 to 2, leader changed from d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67) to ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65). New cstate: current_term: 2 leader_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:54.317595 19770 raft_consensus.cc:1275] T 031e57a0eb8a464292dfe35cf712cadd P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Refusing update from remote peer ae55b6b334544ee0bb4759a3a5bf0aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:54.319193 19819 consensus_queue.cc:1048] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:54.329988 19697 raft_consensus.cc:1275] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Refusing update from remote peer ae55b6b334544ee0bb4759a3a5bf0aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:54.331972 19819 consensus_queue.cc:1048] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:54.370422 19697 raft_consensus.cc:1275] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Refusing update from remote peer ae55b6b334544ee0bb4759a3a5bf0aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:54.372546 19819 consensus_queue.cc:1048] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:54.383311 19770 raft_consensus.cc:1275] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Refusing update from remote peer ae55b6b334544ee0bb4759a3a5bf0aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:54.386637 19895 consensus_queue.cc:1048] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:54.404505 19770 raft_consensus.cc:1275] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Refusing update from remote peer 9a2406d1f1804f03babf933367bc038c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:54.406001 19837 consensus_queue.cc:1048] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:54.414724 19621 raft_consensus.cc:3060] T 6767e9811cd44c728760f5e3c414d309 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:54.424535 19621 raft_consensus.cc:1275] T 6767e9811cd44c728760f5e3c414d309 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Refusing update from remote peer 9a2406d1f1804f03babf933367bc038c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:54.426235 19837 consensus_queue.cc:1048] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:54.623319 19770 raft_consensus.cc:1275] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Refusing update from remote peer 9a2406d1f1804f03babf933367bc038c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:54.624759 19837 consensus_queue.cc:1048] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:54.633757 19621 raft_consensus.cc:1275] T 3eafaba6fea54118a203224ebc4c6e9b P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Refusing update from remote peer 9a2406d1f1804f03babf933367bc038c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:54.635640 19840 consensus_queue.cc:1048] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:54.684998 19770 raft_consensus.cc:1275] T a0f363d1ea0247e19c10c66095acb390 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Refusing update from remote peer ae55b6b334544ee0bb4759a3a5bf0aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:54.686640 19895 consensus_queue.cc:1048] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:54.696353 19697 raft_consensus.cc:1275] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Refusing update from remote peer ae55b6b334544ee0bb4759a3a5bf0aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:54.700088 19895 consensus_queue.cc:1048] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:54.724960 19697 raft_consensus.cc:1275] T 00373e3027ea4238a5f2192e08afe3a8 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Refusing update from remote peer ae55b6b334544ee0bb4759a3a5bf0aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:54.726333 19895 consensus_queue.cc:1048] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:54.736038 19770 raft_consensus.cc:1275] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Refusing update from remote peer ae55b6b334544ee0bb4759a3a5bf0aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:54.737818 19895 consensus_queue.cc:1048] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:56.740492 19520 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34986:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:56.743407 19520 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:56.803146 19607 tablet_service.cc:1511] Processing CreateTablet for tablet ae74fed69af749a281c0f6563fda8aa5 (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:56.805294 19607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae74fed69af749a281c0f6563fda8aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.806609 19683 tablet_service.cc:1511] Processing CreateTablet for tablet ae74fed69af749a281c0f6563fda8aa5 (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:56.807132 19761 tablet_service.cc:1511] Processing CreateTablet for tablet ae74fed69af749a281c0f6563fda8aa5 (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:56.810595 19688 tablet_service.cc:1511] Processing CreateTablet for tablet f99dde56af05406184d1e723e9f39d8e (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:56.811443 19605 tablet_service.cc:1511] Processing CreateTablet for tablet f99dde56af05406184d1e723e9f39d8e (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:56.812191 19761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae74fed69af749a281c0f6563fda8aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.814105 19760 tablet_service.cc:1511] Processing CreateTablet for tablet f99dde56af05406184d1e723e9f39d8e (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:56.815825 19760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f99dde56af05406184d1e723e9f39d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.816103 19687 tablet_service.cc:1511] Processing CreateTablet for tablet c617b2667bb849c9afcfc0f0a5eab94a (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:56.818326 19755 tablet_service.cc:1511] Processing CreateTablet for tablet c617b2667bb849c9afcfc0f0a5eab94a (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:56.818939 19610 tablet_service.cc:1511] Processing CreateTablet for tablet c617b2667bb849c9afcfc0f0a5eab94a (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:56.820364 19610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c617b2667bb849c9afcfc0f0a5eab94a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.820966 19683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae74fed69af749a281c0f6563fda8aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.828702 19688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f99dde56af05406184d1e723e9f39d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.821635 19605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f99dde56af05406184d1e723e9f39d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.828918 19681 tablet_service.cc:1511] Processing CreateTablet for tablet d169db5c8b464da19c4c7ed067273ed6 (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:56.821756 19609 tablet_service.cc:1511] Processing CreateTablet for tablet 300f8f40462f46798ecb456c04714af1 (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:56.830477 19681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d169db5c8b464da19c4c7ed067273ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.830631 19609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 300f8f40462f46798ecb456c04714af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.832429 19687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c617b2667bb849c9afcfc0f0a5eab94a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.823184 19686 tablet_service.cc:1511] Processing CreateTablet for tablet 300f8f40462f46798ecb456c04714af1 (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:56.833951 19686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 300f8f40462f46798ecb456c04714af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.836894 19762 tablet_service.cc:1511] Processing CreateTablet for tablet 8d83829a87964484824cb187f347fcfa (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:56.837162 19680 tablet_service.cc:1511] Processing CreateTablet for tablet 8d83829a87964484824cb187f347fcfa (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:56.824365 19757 tablet_service.cc:1511] Processing CreateTablet for tablet 300f8f40462f46798ecb456c04714af1 (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:56.838686 19680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d83829a87964484824cb187f347fcfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.839355 19606 tablet_service.cc:1511] Processing CreateTablet for tablet 8d83829a87964484824cb187f347fcfa (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:56.842494 19611 tablet_service.cc:1511] Processing CreateTablet for tablet e8f6a097b0dc474f8da99b0aa4c2f8c9 (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:56.842957 19685 tablet_service.cc:1511] Processing CreateTablet for tablet e8f6a097b0dc474f8da99b0aa4c2f8c9 (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:56.844416 19685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f6a097b0dc474f8da99b0aa4c2f8c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.845989 19612 tablet_service.cc:1511] Processing CreateTablet for tablet 81ef4646489f4aa4a20f216386236f07 (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:56.846336 19756 tablet_service.cc:1511] Processing CreateTablet for tablet e8f6a097b0dc474f8da99b0aa4c2f8c9 (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:56.840901 19606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d83829a87964484824cb187f347fcfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.849319 19758 tablet_service.cc:1511] Processing CreateTablet for tablet 81ef4646489f4aa4a20f216386236f07 (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:56.850060 19612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81ef4646489f4aa4a20f216386236f07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.827757 19755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c617b2667bb849c9afcfc0f0a5eab94a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.852248 19611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f6a097b0dc474f8da99b0aa4c2f8c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.826699 19608 tablet_service.cc:1511] Processing CreateTablet for tablet d169db5c8b464da19c4c7ed067273ed6 (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:56.853487 19684 tablet_service.cc:1511] Processing CreateTablet for tablet 81ef4646489f4aa4a20f216386236f07 (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:56.853977 19608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d169db5c8b464da19c4c7ed067273ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.854437 19762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d83829a87964484824cb187f347fcfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.855194 19684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81ef4646489f4aa4a20f216386236f07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.852049 19613 tablet_service.cc:1511] Processing CreateTablet for tablet c12e7a3498fd4c9088935d70944cc275 (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:56.856711 19613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c12e7a3498fd4c9088935d70944cc275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.857586 19758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81ef4646489f4aa4a20f216386236f07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.859254 19757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 300f8f40462f46798ecb456c04714af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.832608 19754 tablet_service.cc:1511] Processing CreateTablet for tablet d169db5c8b464da19c4c7ed067273ed6 (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:56.862459 19754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d169db5c8b464da19c4c7ed067273ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.864949 19756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f6a097b0dc474f8da99b0aa4c2f8c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.870834 19682 tablet_service.cc:1511] Processing CreateTablet for tablet c12e7a3498fd4c9088935d70944cc275 (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:56.872478 19682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c12e7a3498fd4c9088935d70944cc275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:56.872452 19759 tablet_service.cc:1511] Processing CreateTablet for tablet c12e7a3498fd4c9088935d70944cc275 (DEFAULT_TABLE table=soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:56.874142 19759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c12e7a3498fd4c9088935d70944cc275. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:56.957962 19569 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:57.006469 19919 tablet_bootstrap.cc:492] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b: Bootstrap starting.
I20260709 13:06:57.018994 19919 tablet_bootstrap.cc:654] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.033792 19919 tablet_bootstrap.cc:492] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b: No bootstrap required, opened a new log
I20260709 13:06:57.034368 19919 ts_tablet_manager.cc:1403] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.009s
I20260709 13:06:57.038496 19919 raft_consensus.cc:359] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.039872 19919 raft_consensus.cc:385] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.040307 19919 raft_consensus.cc:740] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.041630 19919 consensus_queue.cc:260] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.062947 19919 ts_tablet_manager.cc:1434] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b: Time spent starting tablet: real 0.028s	user 0.011s	sys 0.010s
I20260709 13:06:57.066497 19919 tablet_bootstrap.cc:492] T ae74fed69af749a281c0f6563fda8aa5 P d73cac465ea84b6b99ebc324b2b6120b: Bootstrap starting.
I20260709 13:06:57.078649 19919 tablet_bootstrap.cc:654] T ae74fed69af749a281c0f6563fda8aa5 P d73cac465ea84b6b99ebc324b2b6120b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.104264 19918 tablet_bootstrap.cc:492] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c: Bootstrap starting.
I20260709 13:06:57.104264 19921 tablet_bootstrap.cc:492] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed: Bootstrap starting.
I20260709 13:06:57.116947 19918 tablet_bootstrap.cc:654] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.134635 19921 tablet_bootstrap.cc:654] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.146790 19918 tablet_bootstrap.cc:492] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c: No bootstrap required, opened a new log
I20260709 13:06:57.147329 19918 ts_tablet_manager.cc:1403] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.008s
I20260709 13:06:57.147771 19919 tablet_bootstrap.cc:492] T ae74fed69af749a281c0f6563fda8aa5 P d73cac465ea84b6b99ebc324b2b6120b: No bootstrap required, opened a new log
I20260709 13:06:57.148365 19919 ts_tablet_manager.cc:1403] T ae74fed69af749a281c0f6563fda8aa5 P d73cac465ea84b6b99ebc324b2b6120b: Time spent bootstrapping tablet: real 0.084s	user 0.019s	sys 0.006s
I20260709 13:06:57.150380 19918 raft_consensus.cc:359] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.151204 19918 raft_consensus.cc:385] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.151558 19918 raft_consensus.cc:740] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.151345 19919 raft_consensus.cc:359] T ae74fed69af749a281c0f6563fda8aa5 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.152151 19919 raft_consensus.cc:385] T ae74fed69af749a281c0f6563fda8aa5 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.152447 19919 raft_consensus.cc:740] T ae74fed69af749a281c0f6563fda8aa5 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.153278 19919 consensus_queue.cc:260] T ae74fed69af749a281c0f6563fda8aa5 P d73cac465ea84b6b99ebc324b2b6120b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.153213 19918 consensus_queue.cc:260] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.160209 19921 tablet_bootstrap.cc:492] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed: No bootstrap required, opened a new log
I20260709 13:06:57.160413 19918 ts_tablet_manager.cc:1434] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:06:57.160979 19921 ts_tablet_manager.cc:1403] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.012s
I20260709 13:06:57.161273 19919 ts_tablet_manager.cc:1434] T ae74fed69af749a281c0f6563fda8aa5 P d73cac465ea84b6b99ebc324b2b6120b: Time spent starting tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:06:57.161772 19918 tablet_bootstrap.cc:492] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c: Bootstrap starting.
I20260709 13:06:57.162851 19919 tablet_bootstrap.cc:492] T 81ef4646489f4aa4a20f216386236f07 P d73cac465ea84b6b99ebc324b2b6120b: Bootstrap starting.
I20260709 13:06:57.166329 19921 raft_consensus.cc:359] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.167161 19921 raft_consensus.cc:385] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.167510 19921 raft_consensus.cc:740] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.168532 19921 consensus_queue.cc:260] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.170799 19918 tablet_bootstrap.cc:654] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.171648 19921 ts_tablet_manager.cc:1434] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.006s
I20260709 13:06:57.172154 19919 tablet_bootstrap.cc:654] T 81ef4646489f4aa4a20f216386236f07 P d73cac465ea84b6b99ebc324b2b6120b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.172890 19921 tablet_bootstrap.cc:492] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P ae55b6b334544ee0bb4759a3a5bf0aed: Bootstrap starting.
I20260709 13:06:57.181061 19921 tablet_bootstrap.cc:654] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P ae55b6b334544ee0bb4759a3a5bf0aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.183947 19918 tablet_bootstrap.cc:492] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c: No bootstrap required, opened a new log
I20260709 13:06:57.184691 19918 ts_tablet_manager.cc:1403] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.004s
I20260709 13:06:57.190469 19918 raft_consensus.cc:359] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.191284 19918 raft_consensus.cc:385] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.191601 19918 raft_consensus.cc:740] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.192104 19919 tablet_bootstrap.cc:492] T 81ef4646489f4aa4a20f216386236f07 P d73cac465ea84b6b99ebc324b2b6120b: No bootstrap required, opened a new log
I20260709 13:06:57.192703 19919 ts_tablet_manager.cc:1403] T 81ef4646489f4aa4a20f216386236f07 P d73cac465ea84b6b99ebc324b2b6120b: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.008s
I20260709 13:06:57.192361 19918 consensus_queue.cc:260] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.194850 19918 ts_tablet_manager.cc:1434] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:06:57.196311 19919 raft_consensus.cc:359] T 81ef4646489f4aa4a20f216386236f07 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.197520 19919 raft_consensus.cc:385] T 81ef4646489f4aa4a20f216386236f07 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.197829 19919 raft_consensus.cc:740] T 81ef4646489f4aa4a20f216386236f07 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.198587 19919 consensus_queue.cc:260] T 81ef4646489f4aa4a20f216386236f07 P d73cac465ea84b6b99ebc324b2b6120b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.200990 19919 ts_tablet_manager.cc:1434] T 81ef4646489f4aa4a20f216386236f07 P d73cac465ea84b6b99ebc324b2b6120b: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.003s
I20260709 13:06:57.202131 19919 tablet_bootstrap.cc:492] T 8d83829a87964484824cb187f347fcfa P d73cac465ea84b6b99ebc324b2b6120b: Bootstrap starting.
I20260709 13:06:57.204418 19918 tablet_bootstrap.cc:492] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c: Bootstrap starting.
I20260709 13:06:57.209141 19919 tablet_bootstrap.cc:654] T 8d83829a87964484824cb187f347fcfa P d73cac465ea84b6b99ebc324b2b6120b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.209549 19819 raft_consensus.cc:493] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.210378 19819 raft_consensus.cc:515] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.216078 19918 tablet_bootstrap.cc:654] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.215708 19697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae74fed69af749a281c0f6563fda8aa5" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2406d1f1804f03babf933367bc038c" is_pre_election: true
I20260709 13:06:57.220830 19819 leader_election.cc:290] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:57.224745 19770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae74fed69af749a281c0f6563fda8aa5" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b" is_pre_election: true
I20260709 13:06:57.225651 19770 raft_consensus.cc:2468] T ae74fed69af749a281c0f6563fda8aa5 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae55b6b334544ee0bb4759a3a5bf0aed in term 0.
I20260709 13:06:57.233589 19587 leader_election.cc:304] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae55b6b334544ee0bb4759a3a5bf0aed, d73cac465ea84b6b99ebc324b2b6120b; no voters: 
W20260709 13:06:57.234629 19586 leader_election.cc:343] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.234791 19930 raft_consensus.cc:2804] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:57.236701 19930 raft_consensus.cc:493] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.238808 19930 raft_consensus.cc:3060] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.243633 19921 tablet_bootstrap.cc:492] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P ae55b6b334544ee0bb4759a3a5bf0aed: No bootstrap required, opened a new log
I20260709 13:06:57.244517 19921 ts_tablet_manager.cc:1403] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.029s
I20260709 13:06:57.249233 19919 tablet_bootstrap.cc:492] T 8d83829a87964484824cb187f347fcfa P d73cac465ea84b6b99ebc324b2b6120b: No bootstrap required, opened a new log
I20260709 13:06:57.249161 19921 raft_consensus.cc:359] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.249889 19919 ts_tablet_manager.cc:1403] T 8d83829a87964484824cb187f347fcfa P d73cac465ea84b6b99ebc324b2b6120b: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.018s
I20260709 13:06:57.249575 19930 raft_consensus.cc:515] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.249993 19921 raft_consensus.cc:385] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.250715 19921 raft_consensus.cc:740] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.251637 19921 consensus_queue.cc:260] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P ae55b6b334544ee0bb4759a3a5bf0aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.253193 19919 raft_consensus.cc:359] T 8d83829a87964484824cb187f347fcfa P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.253468 19770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae74fed69af749a281c0f6563fda8aa5" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
I20260709 13:06:57.254266 19919 raft_consensus.cc:385] T 8d83829a87964484824cb187f347fcfa P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.254460 19770 raft_consensus.cc:3060] T ae74fed69af749a281c0f6563fda8aa5 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.254638 19919 raft_consensus.cc:740] T 8d83829a87964484824cb187f347fcfa P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.255647 19919 consensus_queue.cc:260] T 8d83829a87964484824cb187f347fcfa P d73cac465ea84b6b99ebc324b2b6120b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.258208 19919 ts_tablet_manager.cc:1434] T 8d83829a87964484824cb187f347fcfa P d73cac465ea84b6b99ebc324b2b6120b: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:06:57.259229 19919 tablet_bootstrap.cc:492] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b: Bootstrap starting.
I20260709 13:06:57.266647 19919 tablet_bootstrap.cc:654] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.266827 19697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae74fed69af749a281c0f6563fda8aa5" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2406d1f1804f03babf933367bc038c"
W20260709 13:06:57.271487 19586 leader_election.cc:343] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.272281 19930 leader_election.cc:290] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 1 election: Requested vote from peers 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:57.276014 19770 raft_consensus.cc:2468] T ae74fed69af749a281c0f6563fda8aa5 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae55b6b334544ee0bb4759a3a5bf0aed in term 1.
I20260709 13:06:57.278795 19587 leader_election.cc:304] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae55b6b334544ee0bb4759a3a5bf0aed, d73cac465ea84b6b99ebc324b2b6120b; no voters: 9a2406d1f1804f03babf933367bc038c
I20260709 13:06:57.281023 19819 raft_consensus.cc:2804] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:57.281329 19919 tablet_bootstrap.cc:492] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b: No bootstrap required, opened a new log
I20260709 13:06:57.281577 19819 raft_consensus.cc:697] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 LEADER]: Becoming Leader. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Running, Role: LEADER
I20260709 13:06:57.282232 19919 ts_tablet_manager.cc:1403] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.008s
I20260709 13:06:57.282766 19819 consensus_queue.cc:237] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.285698 19919 raft_consensus.cc:359] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.286612 19919 raft_consensus.cc:385] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.286986 19919 raft_consensus.cc:740] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.287881 19919 consensus_queue.cc:260] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.290307 19919 ts_tablet_manager.cc:1434] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:57.291093 19918 tablet_bootstrap.cc:492] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c: No bootstrap required, opened a new log
I20260709 13:06:57.291406 19919 tablet_bootstrap.cc:492] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b: Bootstrap starting.
I20260709 13:06:57.291826 19918 ts_tablet_manager.cc:1403] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c: Time spent bootstrapping tablet: real 0.088s	user 0.012s	sys 0.020s
I20260709 13:06:57.306906 19919 tablet_bootstrap.cc:654] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.311440 19918 raft_consensus.cc:359] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.312294 19918 raft_consensus.cc:385] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.312723 19918 raft_consensus.cc:740] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.312289 19519 catalog_manager.cc:5697] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed reported cstate change: term changed from 0 to 1, leader changed from <none> to ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65). New cstate: current_term: 1 leader_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.314417 19921 ts_tablet_manager.cc:1434] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.004s
I20260709 13:06:57.315577 19921 tablet_bootstrap.cc:492] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed: Bootstrap starting.
I20260709 13:06:57.316509 19918 consensus_queue.cc:260] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.317612 19840 raft_consensus.cc:493] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.318081 19840 raft_consensus.cc:515] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.323055 19840 leader_election.cc:290] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:57.324020 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d83829a87964484824cb187f347fcfa" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" is_pre_election: true
I20260709 13:06:57.326047 19918 ts_tablet_manager.cc:1434] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c: Time spent starting tablet: real 0.034s	user 0.015s	sys 0.000s
W20260709 13:06:57.326359 19661 leader_election.cc:343] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.327524 19918 tablet_bootstrap.cc:492] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c: Bootstrap starting.
I20260709 13:06:57.328388 19921 tablet_bootstrap.cc:654] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.326220 19770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d83829a87964484824cb187f347fcfa" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b" is_pre_election: true
I20260709 13:06:57.331432 19770 raft_consensus.cc:2468] T 8d83829a87964484824cb187f347fcfa P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 0.
I20260709 13:06:57.333621 19662 leader_election.cc:304] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, d73cac465ea84b6b99ebc324b2b6120b; no voters: ae55b6b334544ee0bb4759a3a5bf0aed
I20260709 13:06:57.334704 19918 tablet_bootstrap.cc:654] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.335475 19840 raft_consensus.cc:2804] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:57.336127 19840 raft_consensus.cc:493] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.336510 19840 raft_consensus.cc:3060] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.338912 19919 tablet_bootstrap.cc:492] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b: No bootstrap required, opened a new log
I20260709 13:06:57.339529 19919 ts_tablet_manager.cc:1403] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.001s
I20260709 13:06:57.341328 19883 raft_consensus.cc:493] T 81ef4646489f4aa4a20f216386236f07 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.342021 19883 raft_consensus.cc:515] T 81ef4646489f4aa4a20f216386236f07 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.342814 19919 raft_consensus.cc:359] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.343618 19919 raft_consensus.cc:385] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.343919 19919 raft_consensus.cc:740] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.344779 19919 consensus_queue.cc:260] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.345773 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ef4646489f4aa4a20f216386236f07" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" is_pre_election: true
W20260709 13:06:57.348822 19735 leader_election.cc:343] T 81ef4646489f4aa4a20f216386236f07 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.352857 19883 leader_election.cc:290] T 81ef4646489f4aa4a20f216386236f07 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315)
I20260709 13:06:57.355055 19697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ef4646489f4aa4a20f216386236f07" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2406d1f1804f03babf933367bc038c" is_pre_election: true
I20260709 13:06:57.355795 19840 raft_consensus.cc:515] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
W20260709 13:06:57.357816 19735 leader_election.cc:343] T 81ef4646489f4aa4a20f216386236f07 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.358407 19735 leader_election.cc:304] T 81ef4646489f4aa4a20f216386236f07 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d73cac465ea84b6b99ebc324b2b6120b; no voters: 9a2406d1f1804f03babf933367bc038c, ae55b6b334544ee0bb4759a3a5bf0aed
I20260709 13:06:57.365237 19883 raft_consensus.cc:2749] T 81ef4646489f4aa4a20f216386236f07 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:57.366647 19883 raft_consensus.cc:493] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.367529 19883 raft_consensus.cc:515] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.371198 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f6a097b0dc474f8da99b0aa4c2f8c9" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" is_pre_election: true
I20260709 13:06:57.372228 19621 raft_consensus.cc:2468] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d73cac465ea84b6b99ebc324b2b6120b in term 0.
I20260709 13:06:57.374366 19735 leader_election.cc:304] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae55b6b334544ee0bb4759a3a5bf0aed, d73cac465ea84b6b99ebc324b2b6120b; no voters: 
I20260709 13:06:57.379043 19883 leader_election.cc:290] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315)
I20260709 13:06:57.380997 19697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f6a097b0dc474f8da99b0aa4c2f8c9" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2406d1f1804f03babf933367bc038c" is_pre_election: true
W20260709 13:06:57.383364 19735 leader_election.cc:343] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.384474 19883 raft_consensus.cc:493] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.385200 19883 raft_consensus.cc:515] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.388222 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99dde56af05406184d1e723e9f39d8e" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" is_pre_election: true
W20260709 13:06:57.390007 19735 leader_election.cc:343] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.391119 19921 tablet_bootstrap.cc:492] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed: No bootstrap required, opened a new log
I20260709 13:06:57.391741 19921 ts_tablet_manager.cc:1403] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent bootstrapping tablet: real 0.076s	user 0.006s	sys 0.007s
I20260709 13:06:57.393023 19840 leader_election.cc:290] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:57.394482 19770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d83829a87964484824cb187f347fcfa" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
I20260709 13:06:57.394356 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d83829a87964484824cb187f347fcfa" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
I20260709 13:06:57.403313 19770 raft_consensus.cc:3060] T 8d83829a87964484824cb187f347fcfa P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.405213 19883 leader_election.cc:290] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315)
I20260709 13:06:57.405912 19883 raft_consensus.cc:2804] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:57.406263 19883 raft_consensus.cc:493] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.406576 19883 raft_consensus.cc:3060] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:57.410333 19661 leader_election.cc:343] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.411230 19919 ts_tablet_manager.cc:1434] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b: Time spent starting tablet: real 0.071s	user 0.004s	sys 0.028s
I20260709 13:06:57.410400 19697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99dde56af05406184d1e723e9f39d8e" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2406d1f1804f03babf933367bc038c" is_pre_election: true
I20260709 13:06:57.412629 19919 tablet_bootstrap.cc:492] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b: Bootstrap starting.
W20260709 13:06:57.416543 19735 leader_election.cc:343] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.417125 19735 leader_election.cc:304] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d73cac465ea84b6b99ebc324b2b6120b; no voters: 9a2406d1f1804f03babf933367bc038c, ae55b6b334544ee0bb4759a3a5bf0aed
I20260709 13:06:57.417778 19770 raft_consensus.cc:2468] T 8d83829a87964484824cb187f347fcfa P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 1.
I20260709 13:06:57.419175 19662 leader_election.cc:304] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, d73cac465ea84b6b99ebc324b2b6120b; no voters: ae55b6b334544ee0bb4759a3a5bf0aed
I20260709 13:06:57.420208 19941 raft_consensus.cc:2749] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:57.420490 19919 tablet_bootstrap.cc:654] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.420495 19840 raft_consensus.cc:2804] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:57.421342 19840 raft_consensus.cc:697] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Becoming Leader. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Running, Role: LEADER
I20260709 13:06:57.421939 19921 raft_consensus.cc:359] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.422737 19921 raft_consensus.cc:385] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.423059 19921 raft_consensus.cc:740] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.422247 19840 consensus_queue.cc:237] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.424892 19883 raft_consensus.cc:515] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.426208 19921 consensus_queue.cc:260] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.427840 19918 tablet_bootstrap.cc:492] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c: No bootstrap required, opened a new log
I20260709 13:06:57.428793 19918 ts_tablet_manager.cc:1403] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c: Time spent bootstrapping tablet: real 0.102s	user 0.019s	sys 0.014s
I20260709 13:06:57.429895 19919 tablet_bootstrap.cc:492] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b: No bootstrap required, opened a new log
I20260709 13:06:57.430559 19921 ts_tablet_manager.cc:1434] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.005s
I20260709 13:06:57.430639 19919 ts_tablet_manager.cc:1403] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 13:06:57.437520 19921 tablet_bootstrap.cc:492] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed: Bootstrap starting.
I20260709 13:06:57.439778 19919 raft_consensus.cc:359] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.440986 19919 raft_consensus.cc:385] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.441354 19919 raft_consensus.cc:740] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.442183 19919 consensus_queue.cc:260] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.445602 19919 ts_tablet_manager.cc:1434] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:06:57.446754 19919 tablet_bootstrap.cc:492] T 300f8f40462f46798ecb456c04714af1 P d73cac465ea84b6b99ebc324b2b6120b: Bootstrap starting.
I20260709 13:06:57.449707 19921 tablet_bootstrap.cc:654] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.451725 19521 catalog_manager.cc:5697] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a2406d1f1804f03babf933367bc038c (127.8.4.66). New cstate: current_term: 1 leader_uuid: "9a2406d1f1804f03babf933367bc038c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.432281 19918 raft_consensus.cc:359] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.434571 19928 raft_consensus.cc:493] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.435027 19697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f6a097b0dc474f8da99b0aa4c2f8c9" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2406d1f1804f03babf933367bc038c"
I20260709 13:06:57.453435 19918 raft_consensus.cc:385] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.435411 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f6a097b0dc474f8da99b0aa4c2f8c9" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
I20260709 13:06:57.453884 19918 raft_consensus.cc:740] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.435745 19883 leader_election.cc:290] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315)
I20260709 13:06:57.455025 19621 raft_consensus.cc:3060] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.454838 19918 consensus_queue.cc:260] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.456473 19919 tablet_bootstrap.cc:654] T 300f8f40462f46798ecb456c04714af1 P d73cac465ea84b6b99ebc324b2b6120b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.457701 19918 ts_tablet_manager.cc:1434] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:06:57.458847 19918 tablet_bootstrap.cc:492] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c: Bootstrap starting.
I20260709 13:06:57.453594 19928 raft_consensus.cc:515] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
W20260709 13:06:57.461091 19735 leader_election.cc:343] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.463424 19928 leader_election.cc:290] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:57.465956 19622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617b2667bb849c9afcfc0f0a5eab94a" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" is_pre_election: true
I20260709 13:06:57.466745 19622 raft_consensus.cc:2468] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 0.
I20260709 13:06:57.468293 19770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617b2667bb849c9afcfc0f0a5eab94a" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b" is_pre_election: true
W20260709 13:06:57.469998 19662 leader_election.cc:343] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.471202 19621 raft_consensus.cc:2468] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73cac465ea84b6b99ebc324b2b6120b in term 1.
I20260709 13:06:57.472607 19661 leader_election.cc:304] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, ae55b6b334544ee0bb4759a3a5bf0aed; no voters: d73cac465ea84b6b99ebc324b2b6120b
I20260709 13:06:57.472826 19735 leader_election.cc:304] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae55b6b334544ee0bb4759a3a5bf0aed, d73cac465ea84b6b99ebc324b2b6120b; no voters: 9a2406d1f1804f03babf933367bc038c
I20260709 13:06:57.474110 19883 raft_consensus.cc:2804] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:57.474401 19918 tablet_bootstrap.cc:654] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.474601 19883 raft_consensus.cc:697] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Becoming Leader. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Running, Role: LEADER
I20260709 13:06:57.475593 19883 consensus_queue.cc:237] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.480736 19928 raft_consensus.cc:2804] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:57.482651 19928 raft_consensus.cc:493] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.482987 19928 raft_consensus.cc:3060] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.491742 19928 raft_consensus.cc:515] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.492614 19919 tablet_bootstrap.cc:492] T 300f8f40462f46798ecb456c04714af1 P d73cac465ea84b6b99ebc324b2b6120b: No bootstrap required, opened a new log
I20260709 13:06:57.493232 19919 ts_tablet_manager.cc:1403] T 300f8f40462f46798ecb456c04714af1 P d73cac465ea84b6b99ebc324b2b6120b: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.006s
I20260709 13:06:57.494359 19918 tablet_bootstrap.cc:492] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c: No bootstrap required, opened a new log
I20260709 13:06:57.494789 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617b2667bb849c9afcfc0f0a5eab94a" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
I20260709 13:06:57.494943 19918 ts_tablet_manager.cc:1403] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.003s
I20260709 13:06:57.495432 19621 raft_consensus.cc:3060] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.496168 19919 raft_consensus.cc:359] T 300f8f40462f46798ecb456c04714af1 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.496994 19919 raft_consensus.cc:385] T 300f8f40462f46798ecb456c04714af1 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.497300 19919 raft_consensus.cc:740] T 300f8f40462f46798ecb456c04714af1 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.498005 19919 consensus_queue.cc:260] T 300f8f40462f46798ecb456c04714af1 P d73cac465ea84b6b99ebc324b2b6120b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.498271 19918 raft_consensus.cc:359] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.498994 19918 raft_consensus.cc:385] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.499321 19918 raft_consensus.cc:740] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.500140 19918 consensus_queue.cc:260] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.501204 19770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617b2667bb849c9afcfc0f0a5eab94a" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
W20260709 13:06:57.502815 19662 leader_election.cc:343] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.502851 19918 ts_tablet_manager.cc:1434] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:06:57.503021 19919 ts_tablet_manager.cc:1434] T 300f8f40462f46798ecb456c04714af1 P d73cac465ea84b6b99ebc324b2b6120b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:06:57.503639 19928 leader_election.cc:290] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:57.504153 19918 tablet_bootstrap.cc:492] T ae74fed69af749a281c0f6563fda8aa5 P 9a2406d1f1804f03babf933367bc038c: Bootstrap starting.
I20260709 13:06:57.504206 19919 tablet_bootstrap.cc:492] T c617b2667bb849c9afcfc0f0a5eab94a P d73cac465ea84b6b99ebc324b2b6120b: Bootstrap starting.
I20260709 13:06:57.510358 19621 raft_consensus.cc:2468] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 1.
I20260709 13:06:57.511161 19918 tablet_bootstrap.cc:654] T ae74fed69af749a281c0f6563fda8aa5 P 9a2406d1f1804f03babf933367bc038c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.512204 19661 leader_election.cc:304] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, ae55b6b334544ee0bb4759a3a5bf0aed; no voters: d73cac465ea84b6b99ebc324b2b6120b
I20260709 13:06:57.512782 19521 catalog_manager.cc:5697] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b reported cstate change: term changed from 0 to 1, leader changed from <none> to d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67). New cstate: current_term: 1 leader_uuid: "d73cac465ea84b6b99ebc324b2b6120b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:57.513734 19947 raft_consensus.cc:2804] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:57.514344 19947 raft_consensus.cc:697] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Becoming Leader. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Running, Role: LEADER
I20260709 13:06:57.514519 19921 tablet_bootstrap.cc:492] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed: No bootstrap required, opened a new log
I20260709 13:06:57.515448 19921 ts_tablet_manager.cc:1403] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.004s
I20260709 13:06:57.515242 19947 consensus_queue.cc:237] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.514873 19883 raft_consensus.cc:493] T 300f8f40462f46798ecb456c04714af1 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.517633 19883 raft_consensus.cc:515] T 300f8f40462f46798ecb456c04714af1 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.519892 19883 leader_election.cc:290] T 300f8f40462f46798ecb456c04714af1 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315)
I20260709 13:06:57.520591 19622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300f8f40462f46798ecb456c04714af1" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" is_pre_election: true
I20260709 13:06:57.522081 19921 raft_consensus.cc:359] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.522818 19921 raft_consensus.cc:385] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.523135 19921 raft_consensus.cc:740] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Initialized, Role: FOLLOWER
W20260709 13:06:57.523140 19735 leader_election.cc:343] T 300f8f40462f46798ecb456c04714af1 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.523984 19921 consensus_queue.cc:260] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.524694 19697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300f8f40462f46798ecb456c04714af1" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2406d1f1804f03babf933367bc038c" is_pre_election: true
W20260709 13:06:57.526361 19735 leader_election.cc:343] T 300f8f40462f46798ecb456c04714af1 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.526852 19735 leader_election.cc:304] T 300f8f40462f46798ecb456c04714af1 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d73cac465ea84b6b99ebc324b2b6120b; no voters: 9a2406d1f1804f03babf933367bc038c, ae55b6b334544ee0bb4759a3a5bf0aed
I20260709 13:06:57.527137 19921 ts_tablet_manager.cc:1434] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:06:57.528118 19883 raft_consensus.cc:2749] T 300f8f40462f46798ecb456c04714af1 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:57.528306 19921 tablet_bootstrap.cc:492] T d169db5c8b464da19c4c7ed067273ed6 P ae55b6b334544ee0bb4759a3a5bf0aed: Bootstrap starting.
I20260709 13:06:57.536881 19921 tablet_bootstrap.cc:654] T d169db5c8b464da19c4c7ed067273ed6 P ae55b6b334544ee0bb4759a3a5bf0aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.538980 19919 tablet_bootstrap.cc:654] T c617b2667bb849c9afcfc0f0a5eab94a P d73cac465ea84b6b99ebc324b2b6120b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.551702 19921 tablet_bootstrap.cc:492] T d169db5c8b464da19c4c7ed067273ed6 P ae55b6b334544ee0bb4759a3a5bf0aed: No bootstrap required, opened a new log
I20260709 13:06:57.551784 19918 tablet_bootstrap.cc:492] T ae74fed69af749a281c0f6563fda8aa5 P 9a2406d1f1804f03babf933367bc038c: No bootstrap required, opened a new log
I20260709 13:06:57.552268 19921 ts_tablet_manager.cc:1403] T d169db5c8b464da19c4c7ed067273ed6 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.000s
I20260709 13:06:57.552661 19918 ts_tablet_manager.cc:1403] T ae74fed69af749a281c0f6563fda8aa5 P 9a2406d1f1804f03babf933367bc038c: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.007s
I20260709 13:06:57.553362 19947 raft_consensus.cc:493] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.553922 19947 raft_consensus.cc:515] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.555608 19921 raft_consensus.cc:359] T d169db5c8b464da19c4c7ed067273ed6 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.556418 19921 raft_consensus.cc:385] T d169db5c8b464da19c4c7ed067273ed6 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.556358 19947 leader_election.cc:290] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:57.556839 19921 raft_consensus.cc:740] T d169db5c8b464da19c4c7ed067273ed6 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.557699 19918 raft_consensus.cc:359] T ae74fed69af749a281c0f6563fda8aa5 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.557667 19921 consensus_queue.cc:260] T d169db5c8b464da19c4c7ed067273ed6 P ae55b6b334544ee0bb4759a3a5bf0aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.558718 19918 raft_consensus.cc:385] T ae74fed69af749a281c0f6563fda8aa5 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.559126 19918 raft_consensus.cc:740] T ae74fed69af749a281c0f6563fda8aa5 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.559247 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12e7a3498fd4c9088935d70944cc275" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" is_pre_election: true
I20260709 13:06:57.559958 19919 tablet_bootstrap.cc:492] T c617b2667bb849c9afcfc0f0a5eab94a P d73cac465ea84b6b99ebc324b2b6120b: No bootstrap required, opened a new log
I20260709 13:06:57.560423 19921 ts_tablet_manager.cc:1434] T d169db5c8b464da19c4c7ed067273ed6 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.003s
I20260709 13:06:57.560514 19770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12e7a3498fd4c9088935d70944cc275" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b" is_pre_election: true
I20260709 13:06:57.560160 19918 consensus_queue.cc:260] T ae74fed69af749a281c0f6563fda8aa5 P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
W20260709 13:06:57.561317 19661 leader_election.cc:343] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.561655 19921 tablet_bootstrap.cc:492] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed: Bootstrap starting.
I20260709 13:06:57.562101 19770 raft_consensus.cc:2468] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 0.
I20260709 13:06:57.563097 19918 ts_tablet_manager.cc:1434] T ae74fed69af749a281c0f6563fda8aa5 P 9a2406d1f1804f03babf933367bc038c: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:06:57.563385 19662 leader_election.cc:304] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, d73cac465ea84b6b99ebc324b2b6120b; no voters: ae55b6b334544ee0bb4759a3a5bf0aed
I20260709 13:06:57.563045 19519 catalog_manager.cc:5697] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a2406d1f1804f03babf933367bc038c (127.8.4.66). New cstate: current_term: 1 leader_uuid: "9a2406d1f1804f03babf933367bc038c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.564800 19928 raft_consensus.cc:2804] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:57.565218 19928 raft_consensus.cc:493] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.565536 19928 raft_consensus.cc:3060] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.566337 19918 tablet_bootstrap.cc:492] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c: Bootstrap starting.
I20260709 13:06:57.560475 19919 ts_tablet_manager.cc:1403] T c617b2667bb849c9afcfc0f0a5eab94a P d73cac465ea84b6b99ebc324b2b6120b: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.011s
I20260709 13:06:57.569809 19919 raft_consensus.cc:359] T c617b2667bb849c9afcfc0f0a5eab94a P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.570621 19919 raft_consensus.cc:385] T c617b2667bb849c9afcfc0f0a5eab94a P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.570919 19919 raft_consensus.cc:740] T c617b2667bb849c9afcfc0f0a5eab94a P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.571633 19919 consensus_queue.cc:260] T c617b2667bb849c9afcfc0f0a5eab94a P d73cac465ea84b6b99ebc324b2b6120b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.573781 19919 ts_tablet_manager.cc:1434] T c617b2667bb849c9afcfc0f0a5eab94a P d73cac465ea84b6b99ebc324b2b6120b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:57.576062 19918 tablet_bootstrap.cc:654] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.580020 19921 tablet_bootstrap.cc:654] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.588701 19928 raft_consensus.cc:515] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.593120 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12e7a3498fd4c9088935d70944cc275" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
I20260709 13:06:57.594424 19947 raft_consensus.cc:493] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.595052 19947 raft_consensus.cc:515] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.596451 19921 tablet_bootstrap.cc:492] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed: No bootstrap required, opened a new log
I20260709 13:06:57.597056 19921 ts_tablet_manager.cc:1403] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.011s
I20260709 13:06:57.598476 19770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f6a097b0dc474f8da99b0aa4c2f8c9" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b" is_pre_election: true
W20260709 13:06:57.599459 19661 leader_election.cc:343] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.600162 19947 leader_election.cc:290] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:57.600564 19918 tablet_bootstrap.cc:492] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c: No bootstrap required, opened a new log
I20260709 13:06:57.600451 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f6a097b0dc474f8da99b0aa4c2f8c9" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" is_pre_election: true
I20260709 13:06:57.600443 19921 raft_consensus.cc:359] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.601245 19928 leader_election.cc:290] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:57.601436 19918 ts_tablet_manager.cc:1403] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.016s
I20260709 13:06:57.601508 19921 raft_consensus.cc:385] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.601614 19621 raft_consensus.cc:2393] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a2406d1f1804f03babf933367bc038c in current term 1: Already voted for candidate d73cac465ea84b6b99ebc324b2b6120b in this term.
I20260709 13:06:57.602021 19921 raft_consensus.cc:740] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.603062 19770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12e7a3498fd4c9088935d70944cc275" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
I20260709 13:06:57.602990 19921 consensus_queue.cc:260] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.603667 19770 raft_consensus.cc:3060] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.604729 19918 raft_consensus.cc:359] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.605434 19918 raft_consensus.cc:385] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.605741 19918 raft_consensus.cc:740] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.606829 19921 ts_tablet_manager.cc:1434] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:06:57.606598 19918 consensus_queue.cc:260] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.609040 19921 tablet_bootstrap.cc:492] T 8d83829a87964484824cb187f347fcfa P ae55b6b334544ee0bb4759a3a5bf0aed: Bootstrap starting.
I20260709 13:06:57.609516 19918 ts_tablet_manager.cc:1434] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:06:57.603406 19661 leader_election.cc:304] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c; no voters: ae55b6b334544ee0bb4759a3a5bf0aed, d73cac465ea84b6b99ebc324b2b6120b
I20260709 13:06:57.610620 19918 tablet_bootstrap.cc:492] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c: Bootstrap starting.
I20260709 13:06:57.611523 19928 raft_consensus.cc:3060] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.616804 19921 tablet_bootstrap.cc:654] T 8d83829a87964484824cb187f347fcfa P ae55b6b334544ee0bb4759a3a5bf0aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.611960 19770 raft_consensus.cc:2468] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 1.
I20260709 13:06:57.620771 19918 tablet_bootstrap.cc:654] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.617880 19883 raft_consensus.cc:493] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.625790 19883 raft_consensus.cc:515] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.628242 19662 leader_election.cc:304] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, d73cac465ea84b6b99ebc324b2b6120b; no voters: ae55b6b334544ee0bb4759a3a5bf0aed
I20260709 13:06:57.629050 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d169db5c8b464da19c4c7ed067273ed6" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" is_pre_election: true
I20260709 13:06:57.630007 19621 raft_consensus.cc:2468] T d169db5c8b464da19c4c7ed067273ed6 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d73cac465ea84b6b99ebc324b2b6120b in term 0.
I20260709 13:06:57.630455 19840 raft_consensus.cc:2804] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:57.631621 19735 leader_election.cc:304] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae55b6b334544ee0bb4759a3a5bf0aed, d73cac465ea84b6b99ebc324b2b6120b; no voters: 
I20260709 13:06:57.632591 19941 raft_consensus.cc:2804] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:57.632980 19941 raft_consensus.cc:493] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.633368 19941 raft_consensus.cc:3060] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.635136 19697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d169db5c8b464da19c4c7ed067273ed6" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2406d1f1804f03babf933367bc038c" is_pre_election: true
W20260709 13:06:57.638208 19735 leader_election.cc:343] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.639091 19883 leader_election.cc:290] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315)
I20260709 13:06:57.643944 19928 raft_consensus.cc:2749] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:57.647727 19921 tablet_bootstrap.cc:492] T 8d83829a87964484824cb187f347fcfa P ae55b6b334544ee0bb4759a3a5bf0aed: No bootstrap required, opened a new log
I20260709 13:06:57.648313 19921 ts_tablet_manager.cc:1403] T 8d83829a87964484824cb187f347fcfa P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.012s
I20260709 13:06:57.645345 19840 raft_consensus.cc:697] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Becoming Leader. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Running, Role: LEADER
I20260709 13:06:57.652731 19941 raft_consensus.cc:515] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.654914 19840 consensus_queue.cc:237] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.658591 19921 raft_consensus.cc:359] T 8d83829a87964484824cb187f347fcfa P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.659446 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d169db5c8b464da19c4c7ed067273ed6" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
I20260709 13:06:57.659466 19918 tablet_bootstrap.cc:492] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c: No bootstrap required, opened a new log
I20260709 13:06:57.659768 19921 raft_consensus.cc:385] T 8d83829a87964484824cb187f347fcfa P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.660277 19621 raft_consensus.cc:3060] T d169db5c8b464da19c4c7ed067273ed6 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.660359 19921 raft_consensus.cc:740] T 8d83829a87964484824cb187f347fcfa P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.660425 19918 ts_tablet_manager.cc:1403] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c: Time spent bootstrapping tablet: real 0.050s	user 0.019s	sys 0.024s
I20260709 13:06:57.661731 19921 consensus_queue.cc:260] T 8d83829a87964484824cb187f347fcfa P ae55b6b334544ee0bb4759a3a5bf0aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.664343 19921 ts_tablet_manager.cc:1434] T 8d83829a87964484824cb187f347fcfa P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:06:57.664810 19918 raft_consensus.cc:359] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.665565 19918 raft_consensus.cc:385] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.665802 19921 tablet_bootstrap.cc:492] T 81ef4646489f4aa4a20f216386236f07 P ae55b6b334544ee0bb4759a3a5bf0aed: Bootstrap starting.
I20260709 13:06:57.665831 19918 raft_consensus.cc:740] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.667244 19918 consensus_queue.cc:260] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.669327 19918 ts_tablet_manager.cc:1434] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:57.670272 19918 tablet_bootstrap.cc:492] T 300f8f40462f46798ecb456c04714af1 P 9a2406d1f1804f03babf933367bc038c: Bootstrap starting.
I20260709 13:06:57.676024 19918 tablet_bootstrap.cc:654] T 300f8f40462f46798ecb456c04714af1 P 9a2406d1f1804f03babf933367bc038c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.677052 19921 tablet_bootstrap.cc:654] T 81ef4646489f4aa4a20f216386236f07 P ae55b6b334544ee0bb4759a3a5bf0aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.696002 19928 raft_consensus.cc:493] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.697064 19918 tablet_bootstrap.cc:492] T 300f8f40462f46798ecb456c04714af1 P 9a2406d1f1804f03babf933367bc038c: No bootstrap required, opened a new log
I20260709 13:06:57.697619 19918 ts_tablet_manager.cc:1403] T 300f8f40462f46798ecb456c04714af1 P 9a2406d1f1804f03babf933367bc038c: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.002s
I20260709 13:06:57.696852 19928 raft_consensus.cc:515] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.700881 19622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ef4646489f4aa4a20f216386236f07" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" is_pre_election: true
I20260709 13:06:57.701056 19621 raft_consensus.cc:2468] T d169db5c8b464da19c4c7ed067273ed6 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73cac465ea84b6b99ebc324b2b6120b in term 1.
I20260709 13:06:57.702323 19735 leader_election.cc:304] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae55b6b334544ee0bb4759a3a5bf0aed, d73cac465ea84b6b99ebc324b2b6120b; no voters: 
I20260709 13:06:57.702217 19772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ef4646489f4aa4a20f216386236f07" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b" is_pre_election: true
W20260709 13:06:57.702327 19661 leader_election.cc:343] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.703428 19918 raft_consensus.cc:359] T 300f8f40462f46798ecb456c04714af1 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.703989 19883 raft_consensus.cc:2804] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:57.704161 19918 raft_consensus.cc:385] T 300f8f40462f46798ecb456c04714af1 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.704567 19918 raft_consensus.cc:740] T 300f8f40462f46798ecb456c04714af1 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.704591 19883 raft_consensus.cc:697] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Becoming Leader. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Running, Role: LEADER
I20260709 13:06:57.705590 19918 consensus_queue.cc:260] T 300f8f40462f46798ecb456c04714af1 P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.705806 19883 consensus_queue.cc:237] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.707960 19918 ts_tablet_manager.cc:1434] T 300f8f40462f46798ecb456c04714af1 P 9a2406d1f1804f03babf933367bc038c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:06:57.703691 19928 leader_election.cc:290] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:57.703470 19772 raft_consensus.cc:2468] T 81ef4646489f4aa4a20f216386236f07 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 0.
I20260709 13:06:57.709653 19662 leader_election.cc:304] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, d73cac465ea84b6b99ebc324b2b6120b; no voters: ae55b6b334544ee0bb4759a3a5bf0aed
I20260709 13:06:57.710480 19928 raft_consensus.cc:2804] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:57.711002 19928 raft_consensus.cc:493] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.711316 19928 raft_consensus.cc:3060] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.714113 19941 leader_election.cc:290] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 1 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315)
I20260709 13:06:57.715672 19697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d169db5c8b464da19c4c7ed067273ed6" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2406d1f1804f03babf933367bc038c"
I20260709 13:06:57.716423 19697 raft_consensus.cc:3060] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.722669 19697 raft_consensus.cc:2468] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73cac465ea84b6b99ebc324b2b6120b in term 1.
I20260709 13:06:57.724748 19921 tablet_bootstrap.cc:492] T 81ef4646489f4aa4a20f216386236f07 P ae55b6b334544ee0bb4759a3a5bf0aed: No bootstrap required, opened a new log
I20260709 13:06:57.725437 19921 ts_tablet_manager.cc:1403] T 81ef4646489f4aa4a20f216386236f07 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent bootstrapping tablet: real 0.060s	user 0.025s	sys 0.031s
I20260709 13:06:57.727600 19928 raft_consensus.cc:515] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.728613 19921 raft_consensus.cc:359] T 81ef4646489f4aa4a20f216386236f07 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.729454 19921 raft_consensus.cc:385] T 81ef4646489f4aa4a20f216386236f07 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.729779 19921 raft_consensus.cc:740] T 81ef4646489f4aa4a20f216386236f07 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.728968 19520 catalog_manager.cc:5697] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b reported cstate change: term changed from 0 to 1, leader changed from <none> to d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67). New cstate: current_term: 1 leader_uuid: "d73cac465ea84b6b99ebc324b2b6120b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:57.730671 19928 leader_election.cc:290] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:57.730688 19921 consensus_queue.cc:260] T 81ef4646489f4aa4a20f216386236f07 P ae55b6b334544ee0bb4759a3a5bf0aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.731300 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ef4646489f4aa4a20f216386236f07" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
I20260709 13:06:57.732074 19621 raft_consensus.cc:3060] T 81ef4646489f4aa4a20f216386236f07 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.732008 19772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ef4646489f4aa4a20f216386236f07" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
I20260709 13:06:57.732736 19772 raft_consensus.cc:3060] T 81ef4646489f4aa4a20f216386236f07 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.729990 19521 catalog_manager.cc:5697] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a2406d1f1804f03babf933367bc038c (127.8.4.66). New cstate: current_term: 1 leader_uuid: "9a2406d1f1804f03babf933367bc038c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.736311 19921 ts_tablet_manager.cc:1434] T 81ef4646489f4aa4a20f216386236f07 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:06:57.737594 19921 tablet_bootstrap.cc:492] T c12e7a3498fd4c9088935d70944cc275 P ae55b6b334544ee0bb4759a3a5bf0aed: Bootstrap starting.
I20260709 13:06:57.740988 19772 raft_consensus.cc:2468] T 81ef4646489f4aa4a20f216386236f07 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 1.
I20260709 13:06:57.742537 19662 leader_election.cc:304] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, d73cac465ea84b6b99ebc324b2b6120b; no voters: 
I20260709 13:06:57.743425 19840 raft_consensus.cc:493] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.743899 19840 raft_consensus.cc:515] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.744342 19921 tablet_bootstrap.cc:654] T c12e7a3498fd4c9088935d70944cc275 P ae55b6b334544ee0bb4759a3a5bf0aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.745978 19958 raft_consensus.cc:2804] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:57.746356 19840 leader_election.cc:290] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:57.746567 19958 raft_consensus.cc:697] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Becoming Leader. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Running, Role: LEADER
I20260709 13:06:57.747609 19958 consensus_queue.cc:237] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.753413 19621 raft_consensus.cc:2468] T 81ef4646489f4aa4a20f216386236f07 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 1.
I20260709 13:06:57.753468 19622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99dde56af05406184d1e723e9f39d8e" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" is_pre_election: true
I20260709 13:06:57.754892 19622 raft_consensus.cc:2468] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 0.
I20260709 13:06:57.757891 19772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99dde56af05406184d1e723e9f39d8e" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b" is_pre_election: true
I20260709 13:06:57.758657 19772 raft_consensus.cc:2468] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 0.
I20260709 13:06:57.760344 19662 leader_election.cc:304] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, d73cac465ea84b6b99ebc324b2b6120b; no voters: 
I20260709 13:06:57.761826 19840 raft_consensus.cc:2804] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:57.762434 19840 raft_consensus.cc:493] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.762996 19840 raft_consensus.cc:3060] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.770512 19930 consensus_queue.cc:1048] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:57.772046 19921 tablet_bootstrap.cc:492] T c12e7a3498fd4c9088935d70944cc275 P ae55b6b334544ee0bb4759a3a5bf0aed: No bootstrap required, opened a new log
I20260709 13:06:57.772732 19921 ts_tablet_manager.cc:1403] T c12e7a3498fd4c9088935d70944cc275 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.014s
I20260709 13:06:57.775951 19921 raft_consensus.cc:359] T c12e7a3498fd4c9088935d70944cc275 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.776713 19921 raft_consensus.cc:385] T c12e7a3498fd4c9088935d70944cc275 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.777098 19921 raft_consensus.cc:740] T c12e7a3498fd4c9088935d70944cc275 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.777966 19921 consensus_queue.cc:260] T c12e7a3498fd4c9088935d70944cc275 P ae55b6b334544ee0bb4759a3a5bf0aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.777889 19840 raft_consensus.cc:515] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.780793 19921 ts_tablet_manager.cc:1434] T c12e7a3498fd4c9088935d70944cc275 P ae55b6b334544ee0bb4759a3a5bf0aed: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:06:57.782390 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99dde56af05406184d1e723e9f39d8e" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
I20260709 13:06:57.783129 19621 raft_consensus.cc:3060] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.784017 19770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99dde56af05406184d1e723e9f39d8e" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
I20260709 13:06:57.784747 19770 raft_consensus.cc:3060] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.791309 19621 raft_consensus.cc:2468] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 1.
I20260709 13:06:57.792045 19770 raft_consensus.cc:2468] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 1.
I20260709 13:06:57.792511 19661 leader_election.cc:304] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, ae55b6b334544ee0bb4759a3a5bf0aed; no voters: 
I20260709 13:06:57.793470 19958 raft_consensus.cc:2804] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:57.793507 19840 leader_election.cc:290] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 1 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:57.794052 19958 raft_consensus.cc:697] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Becoming Leader. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Running, Role: LEADER
I20260709 13:06:57.794982 19958 consensus_queue.cc:237] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.798792 19520 catalog_manager.cc:5697] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a2406d1f1804f03babf933367bc038c (127.8.4.66). New cstate: current_term: 1 leader_uuid: "9a2406d1f1804f03babf933367bc038c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.808223 19697 raft_consensus.cc:3060] T ae74fed69af749a281c0f6563fda8aa5 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.816707 19930 raft_consensus.cc:493] T 8d83829a87964484824cb187f347fcfa P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.817411 19930 raft_consensus.cc:515] T 8d83829a87964484824cb187f347fcfa P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.819516 19930 leader_election.cc:290] T 8d83829a87964484824cb187f347fcfa P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:57.821297 19698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d83829a87964484824cb187f347fcfa" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2406d1f1804f03babf933367bc038c" is_pre_election: true
I20260709 13:06:57.823071 19772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d83829a87964484824cb187f347fcfa" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b" is_pre_election: true
I20260709 13:06:57.822515 19521 catalog_manager.cc:5697] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a2406d1f1804f03babf933367bc038c (127.8.4.66). New cstate: current_term: 1 leader_uuid: "9a2406d1f1804f03babf933367bc038c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.823210 19930 consensus_queue.cc:1048] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:57.823935 19772 raft_consensus.cc:2393] T 8d83829a87964484824cb187f347fcfa P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae55b6b334544ee0bb4759a3a5bf0aed in current term 1: Already voted for candidate 9a2406d1f1804f03babf933367bc038c in this term.
I20260709 13:06:57.825253 19587 leader_election.cc:304] T 8d83829a87964484824cb187f347fcfa P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae55b6b334544ee0bb4759a3a5bf0aed; no voters: 9a2406d1f1804f03babf933367bc038c, d73cac465ea84b6b99ebc324b2b6120b
I20260709 13:06:57.826495 19930 raft_consensus.cc:3060] T 8d83829a87964484824cb187f347fcfa P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.835825 19930 raft_consensus.cc:2749] T 8d83829a87964484824cb187f347fcfa P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:57.878654 19930 raft_consensus.cc:493] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.879225 19930 raft_consensus.cc:515] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.881112 19930 leader_election.cc:290] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:57.882146 19698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300f8f40462f46798ecb456c04714af1" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2406d1f1804f03babf933367bc038c" is_pre_election: true
I20260709 13:06:57.882200 19772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300f8f40462f46798ecb456c04714af1" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b" is_pre_election: true
I20260709 13:06:57.882877 19698 raft_consensus.cc:2468] T 300f8f40462f46798ecb456c04714af1 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae55b6b334544ee0bb4759a3a5bf0aed in term 0.
I20260709 13:06:57.882977 19772 raft_consensus.cc:2468] T 300f8f40462f46798ecb456c04714af1 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae55b6b334544ee0bb4759a3a5bf0aed in term 0.
I20260709 13:06:57.884095 19586 leader_election.cc:304] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, ae55b6b334544ee0bb4759a3a5bf0aed; no voters: 
I20260709 13:06:57.884918 19930 raft_consensus.cc:2804] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:57.885331 19930 raft_consensus.cc:493] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.885735 19930 raft_consensus.cc:3060] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.890954 19930 raft_consensus.cc:515] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.892702 19930 leader_election.cc:290] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 1 election: Requested vote from peers 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:57.893790 19772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300f8f40462f46798ecb456c04714af1" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
I20260709 13:06:57.893811 19698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300f8f40462f46798ecb456c04714af1" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2406d1f1804f03babf933367bc038c"
I20260709 13:06:57.894378 19772 raft_consensus.cc:3060] T 300f8f40462f46798ecb456c04714af1 P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.894654 19698 raft_consensus.cc:3060] T 300f8f40462f46798ecb456c04714af1 P 9a2406d1f1804f03babf933367bc038c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.900555 19772 raft_consensus.cc:2468] T 300f8f40462f46798ecb456c04714af1 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae55b6b334544ee0bb4759a3a5bf0aed in term 1.
I20260709 13:06:57.900900 19698 raft_consensus.cc:2468] T 300f8f40462f46798ecb456c04714af1 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae55b6b334544ee0bb4759a3a5bf0aed in term 1.
I20260709 13:06:57.901948 19587 leader_election.cc:304] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae55b6b334544ee0bb4759a3a5bf0aed, d73cac465ea84b6b99ebc324b2b6120b; no voters: 
I20260709 13:06:57.902731 19930 raft_consensus.cc:2804] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:57.903172 19930 raft_consensus.cc:697] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 LEADER]: Becoming Leader. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Running, Role: LEADER
I20260709 13:06:57.903975 19930 consensus_queue.cc:237] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:57.909705 19772 raft_consensus.cc:3060] T c617b2667bb849c9afcfc0f0a5eab94a P d73cac465ea84b6b99ebc324b2b6120b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.913664 19941 consensus_queue.cc:1048] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:57.914647 19521 catalog_manager.cc:5697] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed reported cstate change: term changed from 0 to 1, leader changed from <none> to ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65). New cstate: current_term: 1 leader_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.918294 19958 consensus_queue.cc:1048] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:57.929631 19883 consensus_queue.cc:1048] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:57.938153 19928 consensus_queue.cc:1048] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:57.943619 19928 consensus_queue.cc:1048] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:57.977377 19840 consensus_queue.cc:1048] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:58.060129 19698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f99dde56af05406184d1e723e9f39d8e"
dest_uuid: "9a2406d1f1804f03babf933367bc038c"
mode: GRACEFUL
new_leader_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
 from {username='slave'} at 127.0.0.1:53236
I20260709 13:06:58.060928 19698 raft_consensus.cc:606] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Received request to transfer leadership to TS ae55b6b334544ee0bb4759a3a5bf0aed
I20260709 13:06:58.067013 19698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c617b2667bb849c9afcfc0f0a5eab94a"
dest_uuid: "9a2406d1f1804f03babf933367bc038c"
mode: GRACEFUL
new_leader_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
 from {username='slave'} at 127.0.0.1:53236
I20260709 13:06:58.067494 19698 raft_consensus.cc:606] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Received request to transfer leadership to TS ae55b6b334544ee0bb4759a3a5bf0aed
I20260709 13:06:58.076026 19770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d169db5c8b464da19c4c7ed067273ed6"
dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
mode: GRACEFUL
new_leader_uuid: "9a2406d1f1804f03babf933367bc038c"
 from {username='slave'} at 127.0.0.1:44070
I20260709 13:06:58.076581 19770 raft_consensus.cc:606] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Received request to transfer leadership to TS 9a2406d1f1804f03babf933367bc038c
I20260709 13:06:58.083125 19622 raft_consensus.cc:3060] T c12e7a3498fd4c9088935d70944cc275 P ae55b6b334544ee0bb4759a3a5bf0aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:58.087662 19770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8f6a097b0dc474f8da99b0aa4c2f8c9"
dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
mode: GRACEFUL
new_leader_uuid: "9a2406d1f1804f03babf933367bc038c"
 from {username='slave'} at 127.0.0.1:44070
I20260709 13:06:58.088280 19770 raft_consensus.cc:606] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Received request to transfer leadership to TS 9a2406d1f1804f03babf933367bc038c
I20260709 13:06:58.091493 19840 consensus_queue.cc:1048] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:58.098851 19698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c12e7a3498fd4c9088935d70944cc275"
dest_uuid: "9a2406d1f1804f03babf933367bc038c"
mode: GRACEFUL
new_leader_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
 from {username='slave'} at 127.0.0.1:53236
I20260709 13:06:58.099545 19698 raft_consensus.cc:606] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Received request to transfer leadership to TS d73cac465ea84b6b99ebc324b2b6120b
I20260709 13:06:58.107405 19840 consensus_queue.cc:1048] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:58.115056 19928 raft_consensus.cc:993] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c: : Instructing follower d73cac465ea84b6b99ebc324b2b6120b to start an election
I20260709 13:06:58.115691 19840 raft_consensus.cc:1081] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Signalling peer d73cac465ea84b6b99ebc324b2b6120b to start an election
I20260709 13:06:58.117337 19770 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c12e7a3498fd4c9088935d70944cc275"
dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
 from {username='slave'} at 127.0.0.1:47444
I20260709 13:06:58.117940 19770 raft_consensus.cc:493] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:58.118268 19770 raft_consensus.cc:3060] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.125090 19770 raft_consensus.cc:515] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:58.127135 19770 leader_election.cc:290] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 2 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315)
I20260709 13:06:58.128674 19622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12e7a3498fd4c9088935d70944cc275" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
I20260709 13:06:58.129482 19622 raft_consensus.cc:3060] T c12e7a3498fd4c9088935d70944cc275 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.130399 19698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12e7a3498fd4c9088935d70944cc275" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a2406d1f1804f03babf933367bc038c"
I20260709 13:06:58.131230 19698 raft_consensus.cc:3055] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:58.131577 19698 raft_consensus.cc:740] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Running, Role: LEADER
I20260709 13:06:58.132452 19698 consensus_queue.cc:260] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:58.133839 19698 raft_consensus.cc:3060] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.137491 19622 raft_consensus.cc:2468] T c12e7a3498fd4c9088935d70944cc275 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73cac465ea84b6b99ebc324b2b6120b in term 2.
I20260709 13:06:58.138737 19735 leader_election.cc:304] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae55b6b334544ee0bb4759a3a5bf0aed, d73cac465ea84b6b99ebc324b2b6120b; no voters: 
I20260709 13:06:58.139492 19883 raft_consensus.cc:2804] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:58.139971 19883 raft_consensus.cc:697] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b [term 2 LEADER]: Becoming Leader. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Running, Role: LEADER
I20260709 13:06:58.140268 19698 raft_consensus.cc:2468] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73cac465ea84b6b99ebc324b2b6120b in term 2.
I20260709 13:06:58.140832 19883 consensus_queue.cc:237] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:58.146050 19840 consensus_queue.cc:1048] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:58.149211 19520 catalog_manager.cc:5697] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b reported cstate change: term changed from 1 to 2, leader changed from 9a2406d1f1804f03babf933367bc038c (127.8.4.66) to d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67). New cstate: current_term: 2 leader_uuid: "d73cac465ea84b6b99ebc324b2b6120b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:58.164194 19928 consensus_queue.cc:1048] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:58.178471 19883 consensus_queue.cc:1048] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:58.186259 19939 raft_consensus.cc:993] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b: : Instructing follower 9a2406d1f1804f03babf933367bc038c to start an election
I20260709 13:06:58.186811 19939 raft_consensus.cc:1081] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Signalling peer 9a2406d1f1804f03babf933367bc038c to start an election
I20260709 13:06:58.189204 19697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d169db5c8b464da19c4c7ed067273ed6"
dest_uuid: "9a2406d1f1804f03babf933367bc038c"
 from {username='slave'} at 127.0.0.1:57258
I20260709 13:06:58.189805 19697 raft_consensus.cc:493] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:58.190196 19697 raft_consensus.cc:3060] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.192448 19941 consensus_queue.cc:1048] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:58.197544 19697 raft_consensus.cc:515] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:58.200961 19770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d169db5c8b464da19c4c7ed067273ed6" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
I20260709 13:06:58.201557 19770 raft_consensus.cc:3055] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:58.201992 19770 raft_consensus.cc:740] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Running, Role: LEADER
I20260709 13:06:58.202803 19770 consensus_queue.cc:260] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:58.203819 19770 raft_consensus.cc:3060] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.205915 19697 leader_election.cc:290] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 2 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:58.210222 19622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d169db5c8b464da19c4c7ed067273ed6" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
I20260709 13:06:58.210904 19622 raft_consensus.cc:3060] T d169db5c8b464da19c4c7ed067273ed6 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.214260 19770 raft_consensus.cc:2468] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 2.
I20260709 13:06:58.215659 19662 leader_election.cc:304] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, d73cac465ea84b6b99ebc324b2b6120b; no voters: 
I20260709 13:06:58.216536 19928 raft_consensus.cc:2804] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:58.217067 19928 raft_consensus.cc:697] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c [term 2 LEADER]: Becoming Leader. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Running, Role: LEADER
I20260709 13:06:58.217980 19928 consensus_queue.cc:237] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:58.219553 19622 raft_consensus.cc:2468] T d169db5c8b464da19c4c7ed067273ed6 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 2.
I20260709 13:06:58.227016 19521 catalog_manager.cc:5697] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c reported cstate change: term changed from 1 to 2, leader changed from d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67) to 9a2406d1f1804f03babf933367bc038c (127.8.4.66). New cstate: current_term: 2 leader_uuid: "9a2406d1f1804f03babf933367bc038c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:58.284611 19928 consensus_queue.cc:1048] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:58.285455 19840 consensus_queue.cc:1048] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:58.301944 19947 raft_consensus.cc:993] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c: : Instructing follower ae55b6b334544ee0bb4759a3a5bf0aed to start an election
I20260709 13:06:58.302616 19947 raft_consensus.cc:1081] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Signalling peer ae55b6b334544ee0bb4759a3a5bf0aed to start an election
I20260709 13:06:58.305758 19621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f99dde56af05406184d1e723e9f39d8e"
dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
 from {username='slave'} at 127.0.0.1:37756
I20260709 13:06:58.306325 19621 raft_consensus.cc:493] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:58.306664 19621 raft_consensus.cc:3060] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.310881 19930 consensus_queue.cc:1048] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:58.321632 19621 raft_consensus.cc:515] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:58.325060 19770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99dde56af05406184d1e723e9f39d8e" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
I20260709 13:06:58.325276 19697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99dde56af05406184d1e723e9f39d8e" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a2406d1f1804f03babf933367bc038c"
I20260709 13:06:58.325711 19770 raft_consensus.cc:3060] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.326026 19697 raft_consensus.cc:3055] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:58.326414 19697 raft_consensus.cc:740] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Running, Role: LEADER
I20260709 13:06:58.327270 19697 consensus_queue.cc:260] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:58.328441 19697 raft_consensus.cc:3060] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.333834 19622 raft_consensus.cc:1240] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Rejecting Update request from peer 9a2406d1f1804f03babf933367bc038c for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:58.334395 19621 leader_election.cc:290] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 2 election: Requested vote from peers 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:58.338249 19770 raft_consensus.cc:2468] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae55b6b334544ee0bb4759a3a5bf0aed in term 2.
I20260709 13:06:58.339195 19933 consensus_queue.cc:1048] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:58.339720 19587 leader_election.cc:304] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae55b6b334544ee0bb4759a3a5bf0aed, d73cac465ea84b6b99ebc324b2b6120b; no voters: 
I20260709 13:06:58.340705 19933 raft_consensus.cc:2804] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:58.345197 19697 raft_consensus.cc:2468] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae55b6b334544ee0bb4759a3a5bf0aed in term 2.
I20260709 13:06:58.341207 19933 raft_consensus.cc:697] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 LEADER]: Becoming Leader. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Running, Role: LEADER
I20260709 13:06:58.346691 19933 consensus_queue.cc:237] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:58.350683 19958 raft_consensus.cc:993] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c: : Instructing follower ae55b6b334544ee0bb4759a3a5bf0aed to start an election
I20260709 13:06:58.351282 19958 raft_consensus.cc:1081] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Signalling peer ae55b6b334544ee0bb4759a3a5bf0aed to start an election
I20260709 13:06:58.354763 19621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c617b2667bb849c9afcfc0f0a5eab94a"
dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
 from {username='slave'} at 127.0.0.1:37756
I20260709 13:06:58.355407 19621 raft_consensus.cc:493] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:58.355798 19621 raft_consensus.cc:3060] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.359298 19521 catalog_manager.cc:5697] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed reported cstate change: term changed from 1 to 2, leader changed from 9a2406d1f1804f03babf933367bc038c (127.8.4.66) to ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65). New cstate: current_term: 2 leader_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:58.363067 19621 raft_consensus.cc:515] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:58.364828 19621 leader_election.cc:290] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 2 election: Requested vote from peers 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:58.366027 19697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617b2667bb849c9afcfc0f0a5eab94a" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a2406d1f1804f03babf933367bc038c"
I20260709 13:06:58.366546 19771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617b2667bb849c9afcfc0f0a5eab94a" candidate_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
I20260709 13:06:58.366761 19697 raft_consensus.cc:3055] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:58.367189 19697 raft_consensus.cc:740] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Running, Role: LEADER
I20260709 13:06:58.367246 19771 raft_consensus.cc:3060] T c617b2667bb849c9afcfc0f0a5eab94a P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.368064 19697 consensus_queue.cc:260] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:58.369414 19697 raft_consensus.cc:3060] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.375465 19771 raft_consensus.cc:2468] T c617b2667bb849c9afcfc0f0a5eab94a P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae55b6b334544ee0bb4759a3a5bf0aed in term 2.
I20260709 13:06:58.376780 19587 leader_election.cc:304] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae55b6b334544ee0bb4759a3a5bf0aed, d73cac465ea84b6b99ebc324b2b6120b; no voters: 
I20260709 13:06:58.377801 19933 raft_consensus.cc:2804] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:58.378605 19933 raft_consensus.cc:697] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 LEADER]: Becoming Leader. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Running, Role: LEADER
I20260709 13:06:58.379528 19933 consensus_queue.cc:237] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:58.380604 19697 raft_consensus.cc:2468] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae55b6b334544ee0bb4759a3a5bf0aed in term 2.
I20260709 13:06:58.387524 19521 catalog_manager.cc:5697] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed reported cstate change: term changed from 1 to 2, leader changed from 9a2406d1f1804f03babf933367bc038c (127.8.4.66) to ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65). New cstate: current_term: 2 leader_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:58.533869 19883 raft_consensus.cc:993] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b: : Instructing follower 9a2406d1f1804f03babf933367bc038c to start an election
I20260709 13:06:58.534452 19941 raft_consensus.cc:1081] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Signalling peer 9a2406d1f1804f03babf933367bc038c to start an election
I20260709 13:06:58.536119 19697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8f6a097b0dc474f8da99b0aa4c2f8c9"
dest_uuid: "9a2406d1f1804f03babf933367bc038c"
 from {username='slave'} at 127.0.0.1:57258
I20260709 13:06:58.536679 19697 raft_consensus.cc:493] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:58.537065 19697 raft_consensus.cc:3060] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.541754 19697 raft_consensus.cc:515] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:58.543203 19697 leader_election.cc:290] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 2 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67:46405)
I20260709 13:06:58.544049 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f6a097b0dc474f8da99b0aa4c2f8c9" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
I20260709 13:06:58.544363 19771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f6a097b0dc474f8da99b0aa4c2f8c9" candidate_uuid: "9a2406d1f1804f03babf933367bc038c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
I20260709 13:06:58.544764 19621 raft_consensus.cc:3060] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.544981 19771 raft_consensus.cc:3055] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:58.545382 19771 raft_consensus.cc:740] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Running, Role: LEADER
I20260709 13:06:58.546146 19771 consensus_queue.cc:260] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
W20260709 13:06:58.547036 19736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.547102 19771 raft_consensus.cc:3060] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.549971 19621 raft_consensus.cc:2468] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 2.
I20260709 13:06:58.551362 19661 leader_election.cc:304] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, ae55b6b334544ee0bb4759a3a5bf0aed; no voters: 
I20260709 13:06:58.552280 19958 raft_consensus.cc:2804] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:58.552924 19958 raft_consensus.cc:697] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c [term 2 LEADER]: Becoming Leader. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Running, Role: LEADER
I20260709 13:06:58.553824 19958 consensus_queue.cc:237] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:06:58.554352 19771 raft_consensus.cc:2468] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a2406d1f1804f03babf933367bc038c in term 2.
I20260709 13:06:58.561159 19521 catalog_manager.cc:5697] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c reported cstate change: term changed from 1 to 2, leader changed from d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67) to 9a2406d1f1804f03babf933367bc038c (127.8.4.66). New cstate: current_term: 2 leader_uuid: "9a2406d1f1804f03babf933367bc038c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:58.567111 19697 raft_consensus.cc:1275] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Refusing update from remote peer d73cac465ea84b6b99ebc324b2b6120b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:58.568454 19941 consensus_queue.cc:1048] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:58.577862 19621 raft_consensus.cc:1275] T c12e7a3498fd4c9088935d70944cc275 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Refusing update from remote peer d73cac465ea84b6b99ebc324b2b6120b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:58.580036 19939 consensus_queue.cc:1048] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:58.785701 19697 raft_consensus.cc:1275] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Refusing update from remote peer ae55b6b334544ee0bb4759a3a5bf0aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:58.787068 19933 consensus_queue.cc:1048] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:58.796701 19771 raft_consensus.cc:1275] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Refusing update from remote peer ae55b6b334544ee0bb4759a3a5bf0aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:58.798497 19933 consensus_queue.cc:1048] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:58.816784 19622 raft_consensus.cc:1275] T d169db5c8b464da19c4c7ed067273ed6 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Refusing update from remote peer 9a2406d1f1804f03babf933367bc038c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:58.818491 19947 consensus_queue.cc:1048] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:58.821122 19771 raft_consensus.cc:1275] T c617b2667bb849c9afcfc0f0a5eab94a P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Refusing update from remote peer ae55b6b334544ee0bb4759a3a5bf0aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:58.822389 19819 consensus_queue.cc:1048] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:58.822599 19772 raft_consensus.cc:1275] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Refusing update from remote peer 9a2406d1f1804f03babf933367bc038c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:58.824235 19947 consensus_queue.cc:1048] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:58.840590 19697 raft_consensus.cc:1275] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Refusing update from remote peer ae55b6b334544ee0bb4759a3a5bf0aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:58.843307 19819 consensus_queue.cc:1048] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:59.024873 19771 raft_consensus.cc:1275] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Refusing update from remote peer 9a2406d1f1804f03babf933367bc038c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:59.026135 19928 consensus_queue.cc:1048] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:59.035494 19622 raft_consensus.cc:1275] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Refusing update from remote peer 9a2406d1f1804f03babf933367bc038c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:59.037087 19928 consensus_queue.cc:1048] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:01.103509 19519 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34986:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:07:01.125385 19519 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34986:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:07:01.170027  8209 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:01.278050 20027 tablet.cc:1724] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.407462 20036 tablet.cc:1724] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:07:01.344961 19662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.4.67:46405, user_credentials={real_user=slave}} blocked reactor thread for 58487.8us
I20260709 13:07:01.424314 20040 tablet.cc:1724] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.454083 20049 tablet.cc:1724] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:07:01.457746 20043 log.cc:927] Time spent T 8d83829a87964484824cb187f347fcfa P d73cac465ea84b6b99ebc324b2b6120b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:07:01.460026 19698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3eafaba6fea54118a203224ebc4c6e9b"
dest_uuid: "9a2406d1f1804f03babf933367bc038c"
mode: GRACEFUL
new_leader_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
 from {username='slave'} at 127.0.0.1:53246
I20260709 13:07:01.451354 20045 tablet.cc:1724] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.460929 19698 raft_consensus.cc:606] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [term 2 LEADER]: Received request to transfer leadership to TS d73cac465ea84b6b99ebc324b2b6120b
W20260709 13:07:01.471835 20041 log.cc:927] Time spent T 300f8f40462f46798ecb456c04714af1 P 9a2406d1f1804f03babf933367bc038c: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:07:01.461115 20039 tablet.cc:1724] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.521129 20054 tablet.cc:1724] T c617b2667bb849c9afcfc0f0a5eab94a P d73cac465ea84b6b99ebc324b2b6120b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.543872 20058 tablet.cc:1724] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.543691 20061 tablet.cc:1724] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.553726 20050 tablet.cc:1724] T ae74fed69af749a281c0f6563fda8aa5 P 9a2406d1f1804f03babf933367bc038c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.546013 20036 tablet.cc:1724] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.478938 20051 tablet.cc:1724] T ae74fed69af749a281c0f6563fda8aa5 P d73cac465ea84b6b99ebc324b2b6120b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.556299 20040 tablet.cc:1724] T d169db5c8b464da19c4c7ed067273ed6 P ae55b6b334544ee0bb4759a3a5bf0aed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:07:01.593794 20048 log.cc:927] Time spent T 8d83829a87964484824cb187f347fcfa P ae55b6b334544ee0bb4759a3a5bf0aed: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:07:01.611065 20057 raft_consensus.cc:993] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c: : Instructing follower d73cac465ea84b6b99ebc324b2b6120b to start an election
I20260709 13:07:01.611769 20057 raft_consensus.cc:1081] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [term 2 LEADER]: Signalling peer d73cac465ea84b6b99ebc324b2b6120b to start an election
I20260709 13:07:01.620045 19770 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3eafaba6fea54118a203224ebc4c6e9b"
dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
 from {username='slave'} at 127.0.0.1:47444
I20260709 13:07:01.620690 19770 raft_consensus.cc:493] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:01.621121 19770 raft_consensus.cc:3060] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.635090 19770 raft_consensus.cc:515] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:07:01.650292 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eafaba6fea54118a203224ebc4c6e9b" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
I20260709 13:07:01.651050 19621 raft_consensus.cc:3060] T 3eafaba6fea54118a203224ebc4c6e9b P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.641340 20049 tablet.cc:1724] T 81ef4646489f4aa4a20f216386236f07 P ae55b6b334544ee0bb4759a3a5bf0aed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.659286 19621 raft_consensus.cc:2468] T 3eafaba6fea54118a203224ebc4c6e9b P ae55b6b334544ee0bb4759a3a5bf0aed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73cac465ea84b6b99ebc324b2b6120b in term 3.
I20260709 13:07:01.659590 19770 leader_election.cc:290] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 3 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315)
I20260709 13:07:01.661636 19735 leader_election.cc:304] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae55b6b334544ee0bb4759a3a5bf0aed, d73cac465ea84b6b99ebc324b2b6120b; no voters: 
I20260709 13:07:01.662823 20033 raft_consensus.cc:2804] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:01.663316 20033 raft_consensus.cc:697] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 3 LEADER]: Becoming Leader. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Running, Role: LEADER
I20260709 13:07:01.663796 19695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eafaba6fea54118a203224ebc4c6e9b" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9a2406d1f1804f03babf933367bc038c"
I20260709 13:07:01.664505 19695 raft_consensus.cc:3055] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:01.665104 19695 raft_consensus.cc:740] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a2406d1f1804f03babf933367bc038c, State: Running, Role: LEADER
I20260709 13:07:01.666152 19695 consensus_queue.cc:260] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:07:01.667289 19695 raft_consensus.cc:3060] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.664179 20033 consensus_queue.cc:237] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } }
I20260709 13:07:01.663584 20055 tablet.cc:1724] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.679035 20061 tablet.cc:1724] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P ae55b6b334544ee0bb4759a3a5bf0aed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.702886 19519 catalog_manager.cc:5697] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b reported cstate change: term changed from 2 to 3, leader changed from 9a2406d1f1804f03babf933367bc038c (127.8.4.66) to d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67). New cstate: current_term: 3 leader_uuid: "d73cac465ea84b6b99ebc324b2b6120b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:01.707003 20036 tablet.cc:1724] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.709467 20027 tablet.cc:1724] T 8d83829a87964484824cb187f347fcfa P ae55b6b334544ee0bb4759a3a5bf0aed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.680526 20039 tablet.cc:1724] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.717510 20058 tablet.cc:1724] T 8d83829a87964484824cb187f347fcfa P d73cac465ea84b6b99ebc324b2b6120b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.730585 20045 tablet.cc:1724] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.733683 19695 raft_consensus.cc:2468] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73cac465ea84b6b99ebc324b2b6120b in term 3.
I20260709 13:07:01.720774 20054 tablet.cc:1724] T 300f8f40462f46798ecb456c04714af1 P d73cac465ea84b6b99ebc324b2b6120b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.736589 20051 tablet.cc:1724] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.726217 20050 tablet.cc:1724] T 300f8f40462f46798ecb456c04714af1 P 9a2406d1f1804f03babf933367bc038c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.772468 20049 tablet.cc:1724] T c12e7a3498fd4c9088935d70944cc275 P ae55b6b334544ee0bb4759a3a5bf0aed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.778478 20058 tablet.cc:1724] T 81ef4646489f4aa4a20f216386236f07 P d73cac465ea84b6b99ebc324b2b6120b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.779891 19623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c740fe2573ce4850b4ba3faf8c3309a9"
dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
mode: GRACEFUL
new_leader_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
 from {username='slave'} at 127.0.0.1:43382
I20260709 13:07:01.780676 19623 raft_consensus.cc:606] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 LEADER]: Received request to transfer leadership to TS d73cac465ea84b6b99ebc324b2b6120b
I20260709 13:07:01.783344  8209 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:01.784077  8209 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:01.787905 20055 tablet.cc:1724] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:01.837114 19519 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980: soft_deleted_table [id=e3533a8a86454c4a97bd4af55b2fe12a] alter complete (version 1)
I20260709 13:07:02.103180 19623 raft_consensus.cc:1275] T 3eafaba6fea54118a203224ebc4c6e9b P ae55b6b334544ee0bb4759a3a5bf0aed [term 3 FOLLOWER]: Refusing update from remote peer d73cac465ea84b6b99ebc324b2b6120b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:02.104709 19991 consensus_queue.cc:1048] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:02.115881 19695 raft_consensus.cc:1275] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [term 3 FOLLOWER]: Refusing update from remote peer d73cac465ea84b6b99ebc324b2b6120b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:02.123368 20071 consensus_queue.cc:1048] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:02.177299 19930 raft_consensus.cc:993] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed: : Instructing follower d73cac465ea84b6b99ebc324b2b6120b to start an election
I20260709 13:07:02.177764 20030 raft_consensus.cc:1081] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 LEADER]: Signalling peer d73cac465ea84b6b99ebc324b2b6120b to start an election
I20260709 13:07:02.179373 19770 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c740fe2573ce4850b4ba3faf8c3309a9"
dest_uuid: "d73cac465ea84b6b99ebc324b2b6120b"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:07:02.179920 19770 raft_consensus.cc:493] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:02.180215 19770 raft_consensus.cc:3060] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:02.185520 19770 raft_consensus.cc:515] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } }
I20260709 13:07:02.187276 19770 leader_election.cc:290] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 3 election: Requested vote from peers ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921), 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315)
I20260709 13:07:02.188131 19623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c740fe2573ce4850b4ba3faf8c3309a9" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed"
I20260709 13:07:02.188311 19695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c740fe2573ce4850b4ba3faf8c3309a9" candidate_uuid: "d73cac465ea84b6b99ebc324b2b6120b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9a2406d1f1804f03babf933367bc038c"
I20260709 13:07:02.188862 19623 raft_consensus.cc:3055] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:02.188885 19695 raft_consensus.cc:3060] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:02.189384 19623 raft_consensus.cc:740] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ae55b6b334544ee0bb4759a3a5bf0aed, State: Running, Role: LEADER
I20260709 13:07:02.190395 19623 consensus_queue.cc:260] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } }
I20260709 13:07:02.192091 19623 raft_consensus.cc:3060] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:02.196143 19695 raft_consensus.cc:2468] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73cac465ea84b6b99ebc324b2b6120b in term 3.
I20260709 13:07:02.197674 19735 leader_election.cc:304] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a2406d1f1804f03babf933367bc038c, d73cac465ea84b6b99ebc324b2b6120b; no voters: 
I20260709 13:07:02.198593 19623 raft_consensus.cc:2468] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d73cac465ea84b6b99ebc324b2b6120b in term 3.
I20260709 13:07:02.198665 20071 raft_consensus.cc:2804] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:02.200210 20071 raft_consensus.cc:697] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b [term 3 LEADER]: Becoming Leader. State: Replica: d73cac465ea84b6b99ebc324b2b6120b, State: Running, Role: LEADER
I20260709 13:07:02.201162 20071 consensus_queue.cc:237] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } }
I20260709 13:07:02.209353 19521 catalog_manager.cc:5697] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b reported cstate change: term changed from 2 to 3, leader changed from ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65) to d73cac465ea84b6b99ebc324b2b6120b (127.8.4.67). New cstate: current_term: 3 leader_uuid: "d73cac465ea84b6b99ebc324b2b6120b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d73cac465ea84b6b99ebc324b2b6120b" member_type: VOTER last_known_addr { host: "127.8.4.67" port: 46405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:02.595392 19623 raft_consensus.cc:1275] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 3 FOLLOWER]: Refusing update from remote peer d73cac465ea84b6b99ebc324b2b6120b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:02.596693 20071 consensus_queue.cc:1048] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae55b6b334544ee0bb4759a3a5bf0aed" member_type: VOTER last_known_addr { host: "127.8.4.65" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:02.607848 19695 raft_consensus.cc:1275] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [term 3 FOLLOWER]: Refusing update from remote peer d73cac465ea84b6b99ebc324b2b6120b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:02.609787 19991 consensus_queue.cc:1048] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2406d1f1804f03babf933367bc038c" member_type: VOTER last_known_addr { host: "127.8.4.66" port: 43315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:02.850383  8209 tablet_server.cc:179] TabletServer@127.8.4.65:0 shutting down...
I20260709 13:07:02.880829  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:02.881752  8209 tablet_replica.cc:333] T 81ef4646489f4aa4a20f216386236f07 P ae55b6b334544ee0bb4759a3a5bf0aed: stopping tablet replica
I20260709 13:07:02.882911  8209 raft_consensus.cc:2243] T 81ef4646489f4aa4a20f216386236f07 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.883749  8209 raft_consensus.cc:2272] T 81ef4646489f4aa4a20f216386236f07 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.886132  8209 tablet_replica.cc:333] T 8d83829a87964484824cb187f347fcfa P ae55b6b334544ee0bb4759a3a5bf0aed: stopping tablet replica
I20260709 13:07:02.886759  8209 raft_consensus.cc:2243] T 8d83829a87964484824cb187f347fcfa P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.887270  8209 raft_consensus.cc:2272] T 8d83829a87964484824cb187f347fcfa P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.889283  8209 tablet_replica.cc:333] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed: stopping tablet replica
I20260709 13:07:02.889875  8209 raft_consensus.cc:2243] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.891208  8209 raft_consensus.cc:2272] T f99dde56af05406184d1e723e9f39d8e P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.893986  8209 tablet_replica.cc:333] T d169db5c8b464da19c4c7ed067273ed6 P ae55b6b334544ee0bb4759a3a5bf0aed: stopping tablet replica
I20260709 13:07:02.894608  8209 raft_consensus.cc:2243] T d169db5c8b464da19c4c7ed067273ed6 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.895103  8209 raft_consensus.cc:2272] T d169db5c8b464da19c4c7ed067273ed6 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.896967  8209 tablet_replica.cc:333] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed: stopping tablet replica
I20260709 13:07:02.897617  8209 raft_consensus.cc:2243] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.898434  8209 raft_consensus.cc:2272] T 300f8f40462f46798ecb456c04714af1 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.900408  8209 tablet_replica.cc:333] T 0ba99d0bb8bc4c0d9050da080ffc465d P ae55b6b334544ee0bb4759a3a5bf0aed: stopping tablet replica
I20260709 13:07:02.901186  8209 raft_consensus.cc:2243] T 0ba99d0bb8bc4c0d9050da080ffc465d P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.901638  8209 raft_consensus.cc:2272] T 0ba99d0bb8bc4c0d9050da080ffc465d P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.903853  8209 tablet_replica.cc:333] T e1467e69e14349fea54e3d16796f8fd0 P ae55b6b334544ee0bb4759a3a5bf0aed: stopping tablet replica
I20260709 13:07:02.904572  8209 raft_consensus.cc:2243] T e1467e69e14349fea54e3d16796f8fd0 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.905169  8209 raft_consensus.cc:2272] T e1467e69e14349fea54e3d16796f8fd0 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.907611  8209 tablet_replica.cc:333] T c12e7a3498fd4c9088935d70944cc275 P ae55b6b334544ee0bb4759a3a5bf0aed: stopping tablet replica
I20260709 13:07:02.908245  8209 raft_consensus.cc:2243] T c12e7a3498fd4c9088935d70944cc275 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.908720  8209 raft_consensus.cc:2272] T c12e7a3498fd4c9088935d70944cc275 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.912017  8209 tablet_replica.cc:333] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed: stopping tablet replica
I20260709 13:07:02.912859  8209 raft_consensus.cc:2243] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.913895  8209 raft_consensus.cc:2272] T ae74fed69af749a281c0f6563fda8aa5 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.916574  8209 tablet_replica.cc:333] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed: stopping tablet replica
I20260709 13:07:02.917397  8209 raft_consensus.cc:2243] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.918270  8209 raft_consensus.cc:2272] T c617b2667bb849c9afcfc0f0a5eab94a P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.920574  8209 tablet_replica.cc:333] T 3eafaba6fea54118a203224ebc4c6e9b P ae55b6b334544ee0bb4759a3a5bf0aed: stopping tablet replica
I20260709 13:07:02.921232  8209 raft_consensus.cc:2243] T 3eafaba6fea54118a203224ebc4c6e9b P ae55b6b334544ee0bb4759a3a5bf0aed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.921731  8209 raft_consensus.cc:2272] T 3eafaba6fea54118a203224ebc4c6e9b P ae55b6b334544ee0bb4759a3a5bf0aed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.924844  8209 tablet_replica.cc:333] T c6611cb14bc74c2d804eb0cb545ceb54 P ae55b6b334544ee0bb4759a3a5bf0aed: stopping tablet replica
I20260709 13:07:02.925729  8209 raft_consensus.cc:2243] T c6611cb14bc74c2d804eb0cb545ceb54 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.926317  8209 raft_consensus.cc:2272] T c6611cb14bc74c2d804eb0cb545ceb54 P ae55b6b334544ee0bb4759a3a5bf0aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.928509  8209 tablet_replica.cc:333] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P ae55b6b334544ee0bb4759a3a5bf0aed: stopping tablet replica
I20260709 13:07:02.929141  8209 raft_consensus.cc:2243] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.929597  8209 raft_consensus.cc:2272] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.931561  8209 tablet_replica.cc:333] T 6767e9811cd44c728760f5e3c414d309 P ae55b6b334544ee0bb4759a3a5bf0aed: stopping tablet replica
I20260709 13:07:02.932305  8209 raft_consensus.cc:2243] T 6767e9811cd44c728760f5e3c414d309 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.932812  8209 raft_consensus.cc:2272] T 6767e9811cd44c728760f5e3c414d309 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:02.933915 19661 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
I20260709 13:07:02.935474  8209 tablet_replica.cc:333] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed: stopping tablet replica
I20260709 13:07:02.936172  8209 raft_consensus.cc:2243] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.936703  8209 raft_consensus.cc:2272] T c740fe2573ce4850b4ba3faf8c3309a9 P ae55b6b334544ee0bb4759a3a5bf0aed [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:02.937281 19661 consensus_peers.cc:597] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c -> Peer ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921): Couldn't send request to peer ae55b6b334544ee0bb4759a3a5bf0aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:02.940160  8209 tablet_replica.cc:333] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed: stopping tablet replica
I20260709 13:07:02.940902  8209 raft_consensus.cc:2243] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.941843  8209 raft_consensus.cc:2272] T a0f363d1ea0247e19c10c66095acb390 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.944507  8209 tablet_replica.cc:333] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed: stopping tablet replica
I20260709 13:07:02.945123  8209 raft_consensus.cc:2243] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.945914  8209 raft_consensus.cc:2272] T 031e57a0eb8a464292dfe35cf712cadd P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.948021  8209 tablet_replica.cc:333] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed: stopping tablet replica
I20260709 13:07:02.948529  8209 raft_consensus.cc:2243] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.949422  8209 raft_consensus.cc:2272] T 00373e3027ea4238a5f2192e08afe3a8 P ae55b6b334544ee0bb4759a3a5bf0aed [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:02.969031 19661 consensus_peers.cc:597] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c -> Peer ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921): Couldn't send request to peer ae55b6b334544ee0bb4759a3a5bf0aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:02.991009  8209 tablet_server.cc:196] TabletServer@127.8.4.65:0 shutdown complete.
W20260709 13:07:02.992981 19735 consensus_peers.cc:597] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b -> Peer ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921): Couldn't send request to peer ae55b6b334544ee0bb4759a3a5bf0aed. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:40921: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:02.998960 19661 consensus_peers.cc:597] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c -> Peer ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921): Couldn't send request to peer ae55b6b334544ee0bb4759a3a5bf0aed. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:40921: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:03.028684  8209 tablet_server.cc:179] TabletServer@127.8.4.66:0 shutting down...
W20260709 13:07:03.046061 19661 consensus_peers.cc:597] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c -> Peer ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921): Couldn't send request to peer ae55b6b334544ee0bb4759a3a5bf0aed. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:40921: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:03.062613 19735 consensus_peers.cc:597] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b -> Peer 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315): Couldn't send request to peer 9a2406d1f1804f03babf933367bc038c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:03.066820  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:03.067759  8209 tablet_replica.cc:333] T 300f8f40462f46798ecb456c04714af1 P 9a2406d1f1804f03babf933367bc038c: stopping tablet replica
I20260709 13:07:03.068514  8209 raft_consensus.cc:2243] T 300f8f40462f46798ecb456c04714af1 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.069167  8209 raft_consensus.cc:2272] T 300f8f40462f46798ecb456c04714af1 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.071349  8209 tablet_replica.cc:333] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c: stopping tablet replica
I20260709 13:07:03.072041  8209 raft_consensus.cc:2243] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:03.073199  8209 raft_consensus.cc:2272] T d169db5c8b464da19c4c7ed067273ed6 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.076046  8209 tablet_replica.cc:333] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c: stopping tablet replica
I20260709 13:07:03.076938  8209 raft_consensus.cc:2243] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:03.078028  8209 raft_consensus.cc:2272] T 81ef4646489f4aa4a20f216386236f07 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.080619  8209 tablet_replica.cc:333] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c: stopping tablet replica
I20260709 13:07:03.081477  8209 raft_consensus.cc:2243] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.082072  8209 raft_consensus.cc:2272] T f99dde56af05406184d1e723e9f39d8e P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.084728  8209 tablet_replica.cc:333] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c: stopping tablet replica
I20260709 13:07:03.085569  8209 raft_consensus.cc:2243] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:03.086654  8209 raft_consensus.cc:2272] T 8d83829a87964484824cb187f347fcfa P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.089486  8209 tablet_replica.cc:333] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c: stopping tablet replica
I20260709 13:07:03.090365  8209 raft_consensus.cc:2243] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:03.091418  8209 raft_consensus.cc:2272] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.094218  8209 tablet_replica.cc:333] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c: stopping tablet replica
I20260709 13:07:03.095252  8209 raft_consensus.cc:2243] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.095860  8209 raft_consensus.cc:2272] T c617b2667bb849c9afcfc0f0a5eab94a P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.098564  8209 tablet_replica.cc:333] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c: stopping tablet replica
I20260709 13:07:03.099380  8209 raft_consensus.cc:2243] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.099887  8209 raft_consensus.cc:2272] T 3eafaba6fea54118a203224ebc4c6e9b P 9a2406d1f1804f03babf933367bc038c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.103392  8209 tablet_replica.cc:333] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c: stopping tablet replica
I20260709 13:07:03.104372  8209 raft_consensus.cc:2243] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:03.105640  8209 raft_consensus.cc:2272] T c6611cb14bc74c2d804eb0cb545ceb54 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.108829  8209 tablet_replica.cc:333] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c: stopping tablet replica
I20260709 13:07:03.109710  8209 raft_consensus.cc:2243] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.110268  8209 raft_consensus.cc:2272] T 031e57a0eb8a464292dfe35cf712cadd P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.112658  8209 tablet_replica.cc:333] T ae74fed69af749a281c0f6563fda8aa5 P 9a2406d1f1804f03babf933367bc038c: stopping tablet replica
I20260709 13:07:03.113341  8209 raft_consensus.cc:2243] T ae74fed69af749a281c0f6563fda8aa5 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.113816  8209 raft_consensus.cc:2272] T ae74fed69af749a281c0f6563fda8aa5 P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.116015  8209 tablet_replica.cc:333] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c: stopping tablet replica
I20260709 13:07:03.116495  8209 raft_consensus.cc:2243] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.116881  8209 raft_consensus.cc:2272] T c12e7a3498fd4c9088935d70944cc275 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.118785  8209 tablet_replica.cc:333] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c: stopping tablet replica
I20260709 13:07:03.119292  8209 raft_consensus.cc:2243] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:03.120234  8209 raft_consensus.cc:2272] T 6767e9811cd44c728760f5e3c414d309 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.122359  8209 tablet_replica.cc:333] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c: stopping tablet replica
I20260709 13:07:03.122918  8209 raft_consensus.cc:2243] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.123338  8209 raft_consensus.cc:2272] T c740fe2573ce4850b4ba3faf8c3309a9 P 9a2406d1f1804f03babf933367bc038c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.126086  8209 tablet_replica.cc:333] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c: stopping tablet replica
I20260709 13:07:03.126639  8209 raft_consensus.cc:2243] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.127152  8209 raft_consensus.cc:2272] T a0f363d1ea0247e19c10c66095acb390 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.129241  8209 tablet_replica.cc:333] T 00373e3027ea4238a5f2192e08afe3a8 P 9a2406d1f1804f03babf933367bc038c: stopping tablet replica
I20260709 13:07:03.129712  8209 raft_consensus.cc:2243] T 00373e3027ea4238a5f2192e08afe3a8 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.130084  8209 raft_consensus.cc:2272] T 00373e3027ea4238a5f2192e08afe3a8 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.132041  8209 tablet_replica.cc:333] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c: stopping tablet replica
I20260709 13:07:03.132545  8209 raft_consensus.cc:2243] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.133065  8209 raft_consensus.cc:2272] T e1467e69e14349fea54e3d16796f8fd0 P 9a2406d1f1804f03babf933367bc038c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.135080  8209 tablet_replica.cc:333] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c: stopping tablet replica
I20260709 13:07:03.135550  8209 raft_consensus.cc:2243] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:03.136428  8209 raft_consensus.cc:2272] T 0ba99d0bb8bc4c0d9050da080ffc465d P 9a2406d1f1804f03babf933367bc038c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:03.148305 19735 consensus_peers.cc:597] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b -> Peer ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921): Couldn't send request to peer ae55b6b334544ee0bb4759a3a5bf0aed. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:40921: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:03.178881  8209 tablet_server.cc:196] TabletServer@127.8.4.66:0 shutdown complete.
W20260709 13:07:03.208425 19735 consensus_peers.cc:597] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b -> Peer ae55b6b334544ee0bb4759a3a5bf0aed (127.8.4.65:40921): Couldn't send request to peer ae55b6b334544ee0bb4759a3a5bf0aed. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.65:40921: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:03.213192  8209 tablet_server.cc:179] TabletServer@127.8.4.67:0 shutting down...
W20260709 13:07:03.222635 19735 consensus_peers.cc:597] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b -> Peer 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315): Couldn't send request to peer 9a2406d1f1804f03babf933367bc038c. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:43315: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:03.248077  8209 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:03.249068  8209 tablet_replica.cc:333] T 300f8f40462f46798ecb456c04714af1 P d73cac465ea84b6b99ebc324b2b6120b: stopping tablet replica
I20260709 13:07:03.249761  8209 raft_consensus.cc:2243] T 300f8f40462f46798ecb456c04714af1 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.250319  8209 raft_consensus.cc:2272] T 300f8f40462f46798ecb456c04714af1 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.252429  8209 tablet_replica.cc:333] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b: stopping tablet replica
I20260709 13:07:03.253172  8209 raft_consensus.cc:2243] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.253662  8209 raft_consensus.cc:2272] T f99dde56af05406184d1e723e9f39d8e P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.255664  8209 tablet_replica.cc:333] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b: stopping tablet replica
I20260709 13:07:03.256278  8209 raft_consensus.cc:2243] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.256772  8209 raft_consensus.cc:2272] T d169db5c8b464da19c4c7ed067273ed6 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.258836  8209 tablet_replica.cc:333] T 8d83829a87964484824cb187f347fcfa P d73cac465ea84b6b99ebc324b2b6120b: stopping tablet replica
I20260709 13:07:03.259456  8209 raft_consensus.cc:2243] T 8d83829a87964484824cb187f347fcfa P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.259955  8209 raft_consensus.cc:2272] T 8d83829a87964484824cb187f347fcfa P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.262135  8209 tablet_replica.cc:333] T 81ef4646489f4aa4a20f216386236f07 P d73cac465ea84b6b99ebc324b2b6120b: stopping tablet replica
I20260709 13:07:03.262775  8209 raft_consensus.cc:2243] T 81ef4646489f4aa4a20f216386236f07 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.263335  8209 raft_consensus.cc:2272] T 81ef4646489f4aa4a20f216386236f07 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.265341  8209 tablet_replica.cc:333] T 031e57a0eb8a464292dfe35cf712cadd P d73cac465ea84b6b99ebc324b2b6120b: stopping tablet replica
I20260709 13:07:03.265946  8209 raft_consensus.cc:2243] T 031e57a0eb8a464292dfe35cf712cadd P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.266455  8209 raft_consensus.cc:2272] T 031e57a0eb8a464292dfe35cf712cadd P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.268666  8209 tablet_replica.cc:333] T c617b2667bb849c9afcfc0f0a5eab94a P d73cac465ea84b6b99ebc324b2b6120b: stopping tablet replica
I20260709 13:07:03.269448  8209 raft_consensus.cc:2243] T c617b2667bb849c9afcfc0f0a5eab94a P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.269950  8209 raft_consensus.cc:2272] T c617b2667bb849c9afcfc0f0a5eab94a P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.271878  8209 tablet_replica.cc:333] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b: stopping tablet replica
I20260709 13:07:03.272501  8209 raft_consensus.cc:2243] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:03.273484  8209 raft_consensus.cc:2272] T 3eafaba6fea54118a203224ebc4c6e9b P d73cac465ea84b6b99ebc324b2b6120b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.276657  8209 tablet_replica.cc:333] T c6611cb14bc74c2d804eb0cb545ceb54 P d73cac465ea84b6b99ebc324b2b6120b: stopping tablet replica
I20260709 13:07:03.277433  8209 raft_consensus.cc:2243] T c6611cb14bc74c2d804eb0cb545ceb54 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.277963  8209 raft_consensus.cc:2272] T c6611cb14bc74c2d804eb0cb545ceb54 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:03.280169 19735 consensus_peers.cc:597] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b -> Peer 9a2406d1f1804f03babf933367bc038c (127.8.4.66:43315): Couldn't send request to peer 9a2406d1f1804f03babf933367bc038c. Status: Network error: Client connection negotiation failed: client connection to 127.8.4.66:43315: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:03.280941  8209 tablet_replica.cc:333] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b: stopping tablet replica
I20260709 13:07:03.281870  8209 raft_consensus.cc:2243] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.282374  8209 raft_consensus.cc:2272] T e8f6a097b0dc474f8da99b0aa4c2f8c9 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.284346  8209 tablet_replica.cc:333] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b: stopping tablet replica
I20260709 13:07:03.284965  8209 raft_consensus.cc:2243] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.285537  8209 raft_consensus.cc:2272] T 6767e9811cd44c728760f5e3c414d309 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.287863  8209 tablet_replica.cc:333] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b: stopping tablet replica
I20260709 13:07:03.288470  8209 raft_consensus.cc:2243] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:03.289367  8209 raft_consensus.cc:2272] T c12e7a3498fd4c9088935d70944cc275 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.291532  8209 tablet_replica.cc:333] T ae74fed69af749a281c0f6563fda8aa5 P d73cac465ea84b6b99ebc324b2b6120b: stopping tablet replica
I20260709 13:07:03.292124  8209 raft_consensus.cc:2243] T ae74fed69af749a281c0f6563fda8aa5 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.292598  8209 raft_consensus.cc:2272] T ae74fed69af749a281c0f6563fda8aa5 P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.294755  8209 tablet_replica.cc:333] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b: stopping tablet replica
I20260709 13:07:03.295317  8209 raft_consensus.cc:2243] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:03.296169  8209 raft_consensus.cc:2272] T e1467e69e14349fea54e3d16796f8fd0 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.298341  8209 tablet_replica.cc:333] T 0ba99d0bb8bc4c0d9050da080ffc465d P d73cac465ea84b6b99ebc324b2b6120b: stopping tablet replica
I20260709 13:07:03.298900  8209 raft_consensus.cc:2243] T 0ba99d0bb8bc4c0d9050da080ffc465d P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.299348  8209 raft_consensus.cc:2272] T 0ba99d0bb8bc4c0d9050da080ffc465d P d73cac465ea84b6b99ebc324b2b6120b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.301606  8209 tablet_replica.cc:333] T a0f363d1ea0247e19c10c66095acb390 P d73cac465ea84b6b99ebc324b2b6120b: stopping tablet replica
I20260709 13:07:03.302170  8209 raft_consensus.cc:2243] T a0f363d1ea0247e19c10c66095acb390 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.302656  8209 raft_consensus.cc:2272] T a0f363d1ea0247e19c10c66095acb390 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.304944  8209 tablet_replica.cc:333] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b: stopping tablet replica
I20260709 13:07:03.305503  8209 raft_consensus.cc:2243] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:03.306388  8209 raft_consensus.cc:2272] T c740fe2573ce4850b4ba3faf8c3309a9 P d73cac465ea84b6b99ebc324b2b6120b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.308930  8209 tablet_replica.cc:333] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b: stopping tablet replica
I20260709 13:07:03.309538  8209 raft_consensus.cc:2243] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:03.310107  8209 raft_consensus.cc:2272] T 00373e3027ea4238a5f2192e08afe3a8 P d73cac465ea84b6b99ebc324b2b6120b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.354250  8209 tablet_server.cc:196] TabletServer@127.8.4.67:0 shutdown complete.
I20260709 13:07:03.388015  8209 master.cc:562] Master@127.8.4.126:42721 shutting down...
I20260709 13:07:03.421823  8209 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:03.422415  8209 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:03.422770  8209 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5ab04032438d4997b8c77c428eab4980: stopping tablet replica
I20260709 13:07:03.444296  8209 master.cc:584] Master@127.8.4.126:42721 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11725 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24860 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (327884 ms total)
[  PASSED  ] 8 tests.
I20260709 13:07:03.503928  8209 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 412 messages since previous log ~14 seconds ago
I20260709 13:07:03.504179  8209 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 412 messages since previous log ~14 seconds ago
I20260709 13:07:03.504410  8209 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 410 messages since previous log ~14 seconds ago
I20260709 13:07:03.504596  8209 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~36 seconds ago
I20260709 13:07:03.504819  8209 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~36 seconds ago
I20260709 13:07:03.505048  8209 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 5 messages since previous log ~218 seconds ago
I20260709 13:07:03.505512  8209 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 9 messages since previous log ~0 seconds ago
I20260709 13:07:03.505841  8209 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 52 messages since previous log ~10 seconds ago
